geometrybase
078f56998b
Request:
- Adjust archivist after the audit findings and update historical data.
Changes:
- Teach the archivist skill to close audit-discovered gaps in priority order.
- Add scripts/archive_price_performance.py for due D1/D5/D20/D60 price-performance backfills.
- Document the price-performance backfill command in README.
- Archive raw Yahoo Finance chart responses under repo-relative data/raw/{ticker}/ paths.
- Populate price_performance with D1/D5/D20/D60 checkpoints and refresh source_refs, sync_runs, sync_tasks, and ticker_sync_state snapshots.
Execution:
- Ran .venv/bin/python scripts/archive_price_performance.py --as-of 2026-06-15T10:00:00Z.
- Selected 291 due price-performance tickers.
- Archived 273 price-history sources and wrote 1063 price-performance rows.
- Re-ran .venv/bin/python scripts/archive_hkex_documents.py --as-of 2026-06-15T10:05:00Z for the remaining open T0/T1 tasks; no additional completed T0/T1 stages resulted.
Verification:
- Compiled the new price-performance script.
- Ran git diff --check.
- Checked SQLite integrity and foreign keys.
- Confirmed database row counts match CSV snapshots.
- Verified all 979 source_refs use valid repo-relative paths, have files, have hashes, and SHA256 hashes match.
- Confirmed no generated Python caches or SQLite transient files remain.
Next useful context:
- price_performance now has 1063 rows: D1 273, D5 272, D20 267, D60 251.
- Remaining due price-performance gaps are 18 tickers where Yahoo history was unavailable or the request failed.
- T0/T1 gaps remain at T0 93 and T1 77; T2 grey-market remains unresolved pending a reproducible source strategy.
2.2 KiB
2.2 KiB
| 1 | sync_run_id | mode | as_of | started_at | finished_at | status | notes |
|---|---|---|---|---|---|---|---|
| 2 | price_performance_archive_20260615T100000Z | price_performance_archive | 2026-06-15T10:00:00Z | 2026-06-15T10:00:00Z | 2026-06-15T10:00:00Z | complete | Archived 273 price-history sources and 1063 price-performance rows; 17 tickers failed. |
| 3 | sync_state_20260615T073000Z | recent_ipo_list_refresh | 2026-06-15T07:30:00Z | 2026-06-15T07:30:00Z | 2026-06-15T07:30:00Z | complete | Derived ticker sync state refreshed. |
| 4 | sync_state_20260615T081500Z | hkex_document_archive | 2026-06-15T08:15:00Z | 2026-06-15T08:15:00Z | 2026-06-15T08:15:00Z | complete | Derived ticker sync state refreshed. |
| 5 | sync_state_20260615T082000Z | hkex_document_archive | 2026-06-15T08:20:00Z | 2026-06-15T08:20:00Z | 2026-06-15T08:20:00Z | complete | Derived ticker sync state refreshed. |
| 6 | sync_state_20260615T082500Z | hkex_document_archive | 2026-06-15T08:25:00Z | 2026-06-15T08:25:00Z | 2026-06-15T08:25:00Z | complete | Derived ticker sync state refreshed. |
| 7 | sync_state_20260615T083000Z | hkex_document_archive | 2026-06-15T08:30:00Z | 2026-06-15T08:30:00Z | 2026-06-15T08:30:00Z | complete | Derived ticker sync state refreshed. |
| 8 | sync_state_20260615T083500Z | hkex_document_archive | 2026-06-15T08:35:00Z | 2026-06-15T08:35:00Z | 2026-06-15T08:35:00Z | complete | Derived ticker sync state refreshed. |
| 9 | sync_state_20260615T084500Z | hkex_document_archive | 2026-06-15T08:45:00Z | 2026-06-15T08:45:00Z | 2026-06-15T08:45:00Z | complete | Derived ticker sync state refreshed. |
| 10 | sync_state_20260615T085000Z | hkex_document_archive | 2026-06-15T08:50:00Z | 2026-06-15T08:50:00Z | 2026-06-15T08:50:00Z | complete | Derived ticker sync state refreshed. |
| 11 | sync_state_20260615T090000Z | hkex_document_archive | 2026-06-15T09:00:00Z | 2026-06-15T09:00:00Z | 2026-06-15T09:00:00Z | complete | Derived ticker sync state refreshed. |
| 12 | sync_state_20260615T100000Z | price_performance_archive | 2026-06-15T10:00:00Z | 2026-06-15T10:00:00Z | 2026-06-15T10:00:00Z | complete | Derived ticker sync state refreshed. |
| 13 | sync_state_20260615T100500Z | hkex_document_archive | 2026-06-15T10:05:00Z | 2026-06-15T10:05:00Z | 2026-06-15T10:05:00Z | complete | Derived ticker sync state refreshed. |
| 14 | sync_state_seed_2026_06_15 | bootstrap_state_refresh | 2026-06-15T06:30:00Z | 2026-06-15T06:30:00Z | 2026-06-15T06:30:00Z | complete | Derived ticker sync state refreshed. |