Andrew Charlwood
adc1dbfc58
Tested full refresh pipeline end-to-end with real Snowflake data: - Fixed trust filter to read Name column from defaultTrusts.csv - Fixed Decimal type handling in calculate_cost_per_patient_per_annum - Fixed array handling in convert_to_records for average_administered - Added required reference CSV files to data/ directory - Configured Snowflake connection (account, warehouse, user) Results: - Snowflake fetch: 656,695 records in ~7s - Transformations: 519,848 records after UPID/drug/directory - Pathway nodes: 293 for all_6mo (8 trusts, 14 directories) - Total processing time: ~6.2 minutes
1.0 KiB
1.0 KiB
| 1 | directory |
|---|---|
| 2 | ACCIDENT & EMERGENCY |
| 3 | ANAESTHETICS |
| 4 | ANTICOAGULANT SERVICE |
| 5 | AUDIOLOGY |
| 6 | BLOOD AND MARROW TRANSPLANTATION |
| 7 | BREAST SURGERY |
| 8 | CARDIOLOGY |
| 9 | CARDIOTHORACIC TRANSPLANTATION |
| 10 | CHEMICAL PATHOLOGY |
| 11 | CLINICAL HAEMATOLOGY |
| 12 | CLINICAL IMMUNOLOGY |
| 13 | CLINICAL NEUROPHYSIOLOGY |
| 14 | CLINICAL ONCOLOGY (PREVIOUSLY RADIOTHERAPY) |
| 15 | COLORECTAL SURGERY |
| 16 | CRITICAL CARE MEDICINE |
| 17 | DERMATOLOGY |
| 18 | DIABETIC MEDICINE |
| 19 | DIETETICS |
| 20 | ENDOCRINOLOGY |
| 21 | ENT |
| 22 | GASTROENTEROLOGY |
| 23 | GENERAL MEDICINE |
| 24 | GENERAL SURGERY |
| 25 | GERIATRIC MEDICINE |
| 26 | GYNAECOLOGICAL ONCOLOGY |
| 27 | GYNAECOLOGY |
| 28 | INFECTIOUS DISEASES |
| 29 | MEDICAL ONCOLOGY |
| 30 | MEDICAL OPHTHALMOLOGY |
| 31 | MIDWIFE EPISODE |
| 32 | NEONATOLOGY |
| 33 | NEPHROLOGY |
| 34 | NEUROLOGY |
| 35 | NEUROSURGERY |
| 36 | OBSTETRICS |
| 37 | OPHTHALMOLOGY |
| 38 | ORAL SURGERY |
| 39 | ORTHOPTICS |
| 40 | ORTHOTICS |
| 41 | PAEDIATRIC CARDIOLOGY |
| 42 | PAEDIATRIC DIABETIC MEDICINE |
| 43 | PAEDIATRIC GASTROENTEROLOGY |
| 44 | PAEDIATRIC UROLOGY |
| 45 | PAEDIATRICS |
| 46 | PAIN MANAGEMENT |
| 47 | PLASTIC SURGERY |
| 48 | REHABILITATION |
| 49 | RHEUMATOLOGY |
| 50 | STROKE MEDICINE |
| 51 | THORACIC MEDICINE |
| 52 | THORACIC SURGERY |
| 53 | TRANSIENT ISCHAEMIC ATTACK |
| 54 | TRANSPLANTATION SURGERY |
| 55 | TRAUMA & ORTHOPAEDICS |
| 56 | UPPER GASTROINTESTINAL SURGERY |
| 57 | UROLOGY |
| 58 | VASCULAR SURGERY |