geometrybase/hk-ipo
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Backfill IPO price performance history

Browse Source 
Request:
- Adjust archivist after the audit findings and update historical data.

Changes:
- Teach the archivist skill to close audit-discovered gaps in priority order.
- Add scripts/archive_price_performance.py for due D1/D5/D20/D60 price-performance backfills.
- Document the price-performance backfill command in README.
- Archive raw Yahoo Finance chart responses under repo-relative data/raw/{ticker}/ paths.
- Populate price_performance with D1/D5/D20/D60 checkpoints and refresh source_refs, sync_runs, sync_tasks, and ticker_sync_state snapshots.

Execution:
- Ran .venv/bin/python scripts/archive_price_performance.py --as-of 2026-06-15T10:00:00Z.
- Selected 291 due price-performance tickers.
- Archived 273 price-history sources and wrote 1063 price-performance rows.
- Re-ran .venv/bin/python scripts/archive_hkex_documents.py --as-of 2026-06-15T10:05:00Z for the remaining open T0/T1 tasks; no additional completed T0/T1 stages resulted.

Verification:
- Compiled the new price-performance script.
- Ran git diff --check.
- Checked SQLite integrity and foreign keys.
- Confirmed database row counts match CSV snapshots.
- Verified all 979 source_refs use valid repo-relative paths, have files, have hashes, and SHA256 hashes match.
- Confirmed no generated Python caches or SQLite transient files remain.

Next useful context:
- price_performance now has 1063 rows: D1 273, D5 272, D20 267, D60 251.
- Remaining due price-performance gaps are 18 tickers where Yahoo history was unavailable or the request failed.
- T0/T1 gaps remain at T0 93 and T1 77; T2 grey-market remains unresolved pending a reproducible source strategy.
This commit is contained in:
geometrybase
2026-06-15 09:16:08 +00:00
parent 53e5649ff4
commit 078f56998b
285 changed files with 4750 additions and 3739 deletions
Download Patch File Download Diff File Expand all files Collapse all files
data/snapshots/sync_runs.csv
+3
View File
@@ -1,4 +1,5 @@
sync_run_id,mode,as_of,started_at,finished_at,status,notes
price_performance_archive_20260615T100000Z,price_performance_archive,2026-06-15T10:00:00Z,2026-06-15T10:00:00Z,2026-06-15T10:00:00Z,complete,Archived 273 price-history sources and 1063 price-performance rows; 17 tickers failed.
sync_state_20260615T073000Z,recent_ipo_list_refresh,2026-06-15T07:30:00Z,2026-06-15T07:30:00Z,2026-06-15T07:30:00Z,complete,Derived ticker sync state refreshed.
sync_state_20260615T081500Z,hkex_document_archive,2026-06-15T08:15:00Z,2026-06-15T08:15:00Z,2026-06-15T08:15:00Z,complete,Derived ticker sync state refreshed.
sync_state_20260615T082000Z,hkex_document_archive,2026-06-15T08:20:00Z,2026-06-15T08:20:00Z,2026-06-15T08:20:00Z,complete,Derived ticker sync state refreshed.
@@ -8,4 +9,6 @@ sync_state_20260615T083500Z,hkex_document_archive,2026-06-15T08:35:00Z,2026-06-1
sync_state_20260615T084500Z,hkex_document_archive,2026-06-15T08:45:00Z,2026-06-15T08:45:00Z,2026-06-15T08:45:00Z,complete,Derived ticker sync state refreshed.
sync_state_20260615T085000Z,hkex_document_archive,2026-06-15T08:50:00Z,2026-06-15T08:50:00Z,2026-06-15T08:50:00Z,complete,Derived ticker sync state refreshed.
sync_state_20260615T090000Z,hkex_document_archive,2026-06-15T09:00:00Z,2026-06-15T09:00:00Z,2026-06-15T09:00:00Z,complete,Derived ticker sync state refreshed.
sync_state_20260615T100000Z,price_performance_archive,2026-06-15T10:00:00Z,2026-06-15T10:00:00Z,2026-06-15T10:00:00Z,complete,Derived ticker sync state refreshed.
sync_state_20260615T100500Z,hkex_document_archive,2026-06-15T10:05:00Z,2026-06-15T10:05:00Z,2026-06-15T10:05:00Z,complete,Derived ticker sync state refreshed.
sync_state_seed_2026_06_15,bootstrap_state_refresh,2026-06-15T06:30:00Z,2026-06-15T06:30:00Z,2026-06-15T06:30:00Z,complete,Derived ticker sync state refreshed.
1 sync_run_id mode as_of started_at finished_at status notes
2 price_performance_archive_20260615T100000Z price_performance_archive 2026-06-15T10:00:00Z 2026-06-15T10:00:00Z 2026-06-15T10:00:00Z complete Archived 273 price-history sources and 1063 price-performance rows; 17 tickers failed.
3 sync_state_20260615T073000Z recent_ipo_list_refresh 2026-06-15T07:30:00Z 2026-06-15T07:30:00Z 2026-06-15T07:30:00Z complete Derived ticker sync state refreshed.
4 sync_state_20260615T081500Z hkex_document_archive 2026-06-15T08:15:00Z 2026-06-15T08:15:00Z 2026-06-15T08:15:00Z complete Derived ticker sync state refreshed.
5 sync_state_20260615T082000Z hkex_document_archive 2026-06-15T08:20:00Z 2026-06-15T08:20:00Z 2026-06-15T08:20:00Z complete Derived ticker sync state refreshed.
9 sync_state_20260615T084500Z hkex_document_archive 2026-06-15T08:45:00Z 2026-06-15T08:45:00Z 2026-06-15T08:45:00Z complete Derived ticker sync state refreshed.
10 sync_state_20260615T085000Z hkex_document_archive 2026-06-15T08:50:00Z 2026-06-15T08:50:00Z 2026-06-15T08:50:00Z complete Derived ticker sync state refreshed.
11 sync_state_20260615T090000Z hkex_document_archive 2026-06-15T09:00:00Z 2026-06-15T09:00:00Z 2026-06-15T09:00:00Z complete Derived ticker sync state refreshed.
12 sync_state_20260615T100000Z price_performance_archive 2026-06-15T10:00:00Z 2026-06-15T10:00:00Z 2026-06-15T10:00:00Z complete Derived ticker sync state refreshed.
13 sync_state_20260615T100500Z hkex_document_archive 2026-06-15T10:05:00Z 2026-06-15T10:05:00Z 2026-06-15T10:05:00Z complete Derived ticker sync state refreshed.
14 sync_state_seed_2026_06_15 bootstrap_state_refresh 2026-06-15T06:30:00Z 2026-06-15T06:30:00Z 2026-06-15T06:30:00Z complete Derived ticker sync state refreshed.