Andrew Charlwood c6e426e36c fix: increase network timeout and batch size for GP lookup queries (Task 3.2) ...

Dry run test revealed GP lookup queries timing out at 30s (connection_timeout
in snowflake.toml). Increased to 600s. Also increased batch_size from 500 to
5000 — query time is ~40s regardless of batch size (CTE compilation overhead),
so larger batches reduce total time from ~50min to ~6min for 36K patients.

Dry run results: 91.8% GP match rate, 49.3% drug-indication match rate,
42,072 modified UPIDs, 1,846 pathway nodes across 6 date filters.

2026-02-05 23:55:12 +00:00

..

__init__.py

Initial commit before Ralph loop

2026-02-04 13:04:29 +00:00

cache.py

Initial commit before Ralph loop

2026-02-04 13:04:29 +00:00

data_source.py

Initial commit before Ralph loop

2026-02-04 13:04:29 +00:00

database.py

Initial commit before Ralph loop

2026-02-04 13:04:29 +00:00

diagnosis_lookup.py

fix: increase network timeout and batch size for GP lookup queries (Task 3.2)

2026-02-05 23:55:12 +00:00

load_snomed_mapping.py

fix: correct patient identifier for GP diagnosis lookup (Task 3.3)

2026-02-05 15:49:24 +00:00

loader.py

Initial commit before Ralph loop

2026-02-04 13:04:29 +00:00

migrate.py

feat: add chart_type column to pathway_nodes schema (Task 2.2)

2026-02-05 14:24:57 +00:00

pathway_pipeline.py

feat: add indication pathway processing functions (Task 2.3)

2026-02-05 14:32:28 +00:00

patient_data.py

Initial commit before Ralph loop

2026-02-04 13:04:29 +00:00

reference_data.py

Initial commit before Ralph loop

2026-02-04 13:04:29 +00:00

schema.py

feat: add chart_type column to pathway_nodes schema (Task 2.2)

2026-02-05 14:24:57 +00:00

snowflake_connector.py

Initial commit before Ralph loop

2026-02-04 13:04:29 +00:00