Backfill IPO price performance history

Request:
- Adjust archivist after the audit findings and update historical data.

Changes:
- Teach the archivist skill to close audit-discovered gaps in priority order.
- Add scripts/archive_price_performance.py for due D1/D5/D20/D60 price-performance backfills.
- Document the price-performance backfill command in README.
- Archive raw Yahoo Finance chart responses under repo-relative data/raw/{ticker}/ paths.
- Populate price_performance with D1/D5/D20/D60 checkpoints and refresh source_refs, sync_runs, sync_tasks, and ticker_sync_state snapshots.

Execution:
- Ran .venv/bin/python scripts/archive_price_performance.py --as-of 2026-06-15T10:00:00Z.
- Selected 291 due price-performance tickers.
- Archived 273 price-history sources and wrote 1063 price-performance rows.
- Re-ran .venv/bin/python scripts/archive_hkex_documents.py --as-of 2026-06-15T10:05:00Z for the remaining open T0/T1 tasks; no additional completed T0/T1 stages resulted.

Verification:
- Compiled the new price-performance script.
- Ran git diff --check.
- Checked SQLite integrity and foreign keys.
- Confirmed database row counts match CSV snapshots.
- Verified all 979 source_refs use valid repo-relative paths, have files, have hashes, and SHA256 hashes match.
- Confirmed no generated Python caches or SQLite transient files remain.

Next useful context:
- price_performance now has 1063 rows: D1 273, D5 272, D20 267, D60 251.
- Remaining due price-performance gaps are 18 tickers where Yahoo history was unavailable or the request failed.
- T0/T1 gaps remain at T0 93 and T1 77; T2 grey-market remains unresolved pending a reproducible source strategy.
This commit is contained in:
2026-06-15 09:16:08 +00:00
parent 53e5649ff4
commit 078f56998b
285 changed files with 4750 additions and 3739 deletions
+4 -4
View File
@@ -12,7 +12,7 @@ demand_id,ticker,source_id,stage_date,valid_applications,successful_applications
01187_allotment_2026_05_05_2026050501942,01187,01187_allotment_results_2026_05_05_2026050501942,2026-05-05,105939,15008,399.08,129,3.4,2700000,24300000,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
01236_allotment_2026_05_08_2026050801854,01236,01236_allotment_results_2026_05_08_2026050801854,2026-05-08,296740,16667,6707.66,111,9.54,3333400,30000000,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
01318_allotment_2024_12_09_2024120901607,01318,01318_allotment_results_2024_12_09_2024120901607,2024-12-09,69601,69601,919.18,167,30.34,39211700,39211700,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
01333_allotment_2025_05_06_2025050602875,01333,01333_allotment_results_2025_05_06_2025050602875,2025-05-06,30638,4937,198.72,108,0.92,2600000,10400000,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
01333_allotment_2025_05_06_2025050602875,01333,01333_allotment_results_2025_05_06_2025050602875,2025-05-06,30638,4937,198.72,108,0.92,2600000,10400000,2026-06-15T10:05:00Z,Parsed from HKEXnews allotment results announcement.
01354_allotment_2024_07_03_2024070300007,01354,01354_allotment_results_2024_07_03_2024070300007,2024-07-03,7071,2056,118.87,122,0.98,3002100,13664700,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
01364_allotment_2025_02_11_2025021100944,01364,01364_allotment_results_2025_02_11_2025021100944,2025-02-11,29086,29086,194.87,108,15.03,79306000,103097600,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
01471_allotment_2024_08_05_2024080502241,01471,01471_allotment_results_2024_08_05_2024080502241,2024-08-05,4677,3569,16.07,112,0.98,4357000,30943000,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
@@ -28,7 +28,7 @@ demand_id,ticker,source_id,stage_date,valid_applications,successful_applications
02290_allotment_2026_06_04_2026060402521,02290,02290_allotment_results_2026_06_04_2026060402521,2026-06-04,133189,16359,664.92,78,3.18,12500000,112500000,2026-06-15T08:35:00Z,Parsed from HKEXnews allotment results announcement.
02396_allotment_2025_12_19_2025121901577,02396,02396_allotment_results_2025_12_19_2025121901577,2025-12-19,146647,7978,791.95,73,6.05,1765000,15883800,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
02408_allotment_2025_12_04_2025120402156,02408,02408_allotment_results_2025_12_04_2025120402156,2025-12-04,61057,9590,425.97,108,4.99,9736500,87628000,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
02432_allotment_2024_12_20_2024122001962,02432,02432_allotment_results_2024_12_20_2024122001962,2024-12-20,4243,2674,9.25,124,2.64,,,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
02432_allotment_2024_12_20_2024122001962,02432,02432_allotment_results_2024_12_20_2024122001962,2024-12-20,4243,2674,9.25,124,2.64,,,2026-06-15T10:05:00Z,Parsed from HKEXnews allotment results announcement.
02443_allotment_2024_05_30_2024053001320,02443,02443_allotment_results_2024_05_30_2024053001320,2024-05-30,19474,6618,433.34,148,0.98,3000000,12000000,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
02460_allotment_2024_10_22_2024102201053,02460,02460_allotment_results_2024_10_22_2024102201053,2024-10-22,61885,51047,234.49,129,24.47,139130600,208695600,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
02493_allotment_2026_04_27_2026042703128,02493,02493_allotment_results_2026_04_27_2026042703128,2026-04-27,126378,14808,481.71,82,3.46,4713200,42417000,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
@@ -75,7 +75,7 @@ demand_id,ticker,source_id,stage_date,valid_applications,successful_applications
02670_allotment_2025_10_15_2025101501398,02670,02670_allotment_results_2025_10_15_2025101501398,2025-10-15,260092,24813,5657.2,83,18.62,1380000,,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
02671_allotment_2025_12_29_2025122902215,02671,02671_allotment_results_2025_12_29_2025122902215,2025-12-29,53657,3022,146.25,81,1.48,2460000,22140000,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
02675_allotment_2026_01_07_2026010701900,02675,02675_allotment_results_2026_01_07_2026010701900,2026-01-07,196179,19967,1091.94,175,25.18,2772300,29108200,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
02676_allotment_2025_12_05_2025120501747,02676,02676_allotment_results_2025_12_05_2025120501747,2025-12-05,21942,4823,25.33,70,2.65,1906900,17161500,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
02676_allotment_2025_12_05_2025120501747,02676,02676_allotment_results_2025_12_05_2025120501747,2025-12-05,21942,4823,25.33,70,2.65,1906900,17161500,2026-06-15T10:05:00Z,Parsed from HKEXnews allotment results announcement.
02677_allotment_2026_02_05_2026020501800,02677,02677_allotment_results_2026_02_05_2026020501800,2026-02-05,147844,9500,2730.73,211,5.79,,4275000,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
02685_allotment_2025_11_26_2025112601522,02685,02685_allotment_results_2025_11_26_2025112601522,2025-11-26,159327,2670,9366.28,97,15.07,1335000,12012500,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
02687_allotment_2025_12_05_2025120501787,02687,02687_allotment_results_2025_12_05_2025120501787,2025-12-05,135193,6667,4813.4,77,2.33,666700,6000000,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
@@ -131,5 +131,5 @@ demand_id,ticker,source_id,stage_date,valid_applications,successful_applications
09879_allotment_2024_03_20_2024032001597,09879,09879_allotment_results_2024_03_20_2024032001597,2024-03-20,7793,5352,9.79,119,1.28,22500000,225000000,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
09881_allotment_2025_06_09_2025060900996,09881,09881_allotment_results_2025_06_09_2025060900996,2025-06-09,26751,2793,275.96,118,0.96,2429000,15971000,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
09887_allotment_2025_07_24_2025072401812,09887,09887_allotment_results_2025_07_24_2025072401812,2025-07-24,323706,73406,3494.78,141,40.78,16027200,20835300,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
09980_allotment_2026_02_02_2026020203212,09980,09980_allotment_results_2026_02_02_2026020203212,2026-02-02,66692,20113,57.46,219,15.6,4089000,36131200,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
09980_allotment_2026_02_02_2026020203212,09980,09980_allotment_results_2026_02_02_2026020203212,2026-02-02,66692,20113,57.46,219,15.6,4089000,36131200,2026-06-15T10:05:00Z,Parsed from HKEXnews allotment results announcement.
09981_allotment_2026_02_12_2026021201492,09981,09981_allotment_results_2026_02_12_2026021201492,2026-02-12,141463,31654,569.58,116,8.19,13999000,125989800,2026-06-15T09:00:00Z,Parsed from HKEXnews allotment results announcement.
1 demand_id ticker source_id stage_date valid_applications successful_applications public_oversubscription_times international_placees international_oversubscription_times final_hk_offer_shares final_international_offer_shares data_as_of notes
12 01187_allotment_2026_05_05_2026050501942 01187 01187_allotment_results_2026_05_05_2026050501942 2026-05-05 105939 15008 399.08 129 3.4 2700000 24300000 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
13 01236_allotment_2026_05_08_2026050801854 01236 01236_allotment_results_2026_05_08_2026050801854 2026-05-08 296740 16667 6707.66 111 9.54 3333400 30000000 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
14 01318_allotment_2024_12_09_2024120901607 01318 01318_allotment_results_2024_12_09_2024120901607 2024-12-09 69601 69601 919.18 167 30.34 39211700 39211700 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
15 01333_allotment_2025_05_06_2025050602875 01333 01333_allotment_results_2025_05_06_2025050602875 2025-05-06 30638 4937 198.72 108 0.92 2600000 10400000 2026-06-15T09:00:00Z 2026-06-15T10:05:00Z Parsed from HKEXnews allotment results announcement.
16 01354_allotment_2024_07_03_2024070300007 01354 01354_allotment_results_2024_07_03_2024070300007 2024-07-03 7071 2056 118.87 122 0.98 3002100 13664700 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
17 01364_allotment_2025_02_11_2025021100944 01364 01364_allotment_results_2025_02_11_2025021100944 2025-02-11 29086 29086 194.87 108 15.03 79306000 103097600 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
18 01471_allotment_2024_08_05_2024080502241 01471 01471_allotment_results_2024_08_05_2024080502241 2024-08-05 4677 3569 16.07 112 0.98 4357000 30943000 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
28 02290_allotment_2026_06_04_2026060402521 02290 02290_allotment_results_2026_06_04_2026060402521 2026-06-04 133189 16359 664.92 78 3.18 12500000 112500000 2026-06-15T08:35:00Z Parsed from HKEXnews allotment results announcement.
29 02396_allotment_2025_12_19_2025121901577 02396 02396_allotment_results_2025_12_19_2025121901577 2025-12-19 146647 7978 791.95 73 6.05 1765000 15883800 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
30 02408_allotment_2025_12_04_2025120402156 02408 02408_allotment_results_2025_12_04_2025120402156 2025-12-04 61057 9590 425.97 108 4.99 9736500 87628000 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
31 02432_allotment_2024_12_20_2024122001962 02432 02432_allotment_results_2024_12_20_2024122001962 2024-12-20 4243 2674 9.25 124 2.64 2026-06-15T09:00:00Z 2026-06-15T10:05:00Z Parsed from HKEXnews allotment results announcement.
32 02443_allotment_2024_05_30_2024053001320 02443 02443_allotment_results_2024_05_30_2024053001320 2024-05-30 19474 6618 433.34 148 0.98 3000000 12000000 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
33 02460_allotment_2024_10_22_2024102201053 02460 02460_allotment_results_2024_10_22_2024102201053 2024-10-22 61885 51047 234.49 129 24.47 139130600 208695600 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
34 02493_allotment_2026_04_27_2026042703128 02493 02493_allotment_results_2026_04_27_2026042703128 2026-04-27 126378 14808 481.71 82 3.46 4713200 42417000 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
75 02670_allotment_2025_10_15_2025101501398 02670 02670_allotment_results_2025_10_15_2025101501398 2025-10-15 260092 24813 5657.2 83 18.62 1380000 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
76 02671_allotment_2025_12_29_2025122902215 02671 02671_allotment_results_2025_12_29_2025122902215 2025-12-29 53657 3022 146.25 81 1.48 2460000 22140000 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
77 02675_allotment_2026_01_07_2026010701900 02675 02675_allotment_results_2026_01_07_2026010701900 2026-01-07 196179 19967 1091.94 175 25.18 2772300 29108200 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
78 02676_allotment_2025_12_05_2025120501747 02676 02676_allotment_results_2025_12_05_2025120501747 2025-12-05 21942 4823 25.33 70 2.65 1906900 17161500 2026-06-15T09:00:00Z 2026-06-15T10:05:00Z Parsed from HKEXnews allotment results announcement.
79 02677_allotment_2026_02_05_2026020501800 02677 02677_allotment_results_2026_02_05_2026020501800 2026-02-05 147844 9500 2730.73 211 5.79 4275000 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
80 02685_allotment_2025_11_26_2025112601522 02685 02685_allotment_results_2025_11_26_2025112601522 2025-11-26 159327 2670 9366.28 97 15.07 1335000 12012500 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
81 02687_allotment_2025_12_05_2025120501787 02687 02687_allotment_results_2025_12_05_2025120501787 2025-12-05 135193 6667 4813.4 77 2.33 666700 6000000 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
131 09879_allotment_2024_03_20_2024032001597 09879 09879_allotment_results_2024_03_20_2024032001597 2024-03-20 7793 5352 9.79 119 1.28 22500000 225000000 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
132 09881_allotment_2025_06_09_2025060900996 09881 09881_allotment_results_2025_06_09_2025060900996 2025-06-09 26751 2793 275.96 118 0.96 2429000 15971000 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
133 09887_allotment_2025_07_24_2025072401812 09887 09887_allotment_results_2025_07_24_2025072401812 2025-07-24 323706 73406 3494.78 141 40.78 16027200 20835300 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.
134 09980_allotment_2026_02_02_2026020203212 09980 09980_allotment_results_2026_02_02_2026020203212 2026-02-02 66692 20113 57.46 219 15.6 4089000 36131200 2026-06-15T09:00:00Z 2026-06-15T10:05:00Z Parsed from HKEXnews allotment results announcement.
135 09981_allotment_2026_02_12_2026021201492 09981 09981_allotment_results_2026_02_12_2026021201492 2026-02-12 141463 31654 569.58 116 8.19 13999000 125989800 2026-06-15T09:00:00Z Parsed from HKEXnews allotment results announcement.