Files
hk-ipo/data/snapshots/sync_tasks.csv
T
geometrybase 08db218b6d Add archivist incremental sync state
Request:
Add archivist support for remembering which IPO archive stages have already been synced and which stages should be updated next.

Changes:
- Add sync_runs, ticker_sync_state, sync_tasks, and price_performance tables to the archive schema.
- Add scripts/update_sync_state.py to derive per-ticker stage status and rebuild the next-sync task queue.
- Export the new sync-state tables as Git-friendly CSV snapshots.
- Document the incremental archive flow in the archivist skill and README.

Verification:
- Ran scripts/bootstrap_historical_data.py.
- Ran scripts/update_sync_state.py with a deterministic as-of timestamp.
- Checked SQLite integrity and DB-to-snapshot row counts with Python sqlite3.
- Parsed Python scripts with ast.parse.
- Ran git diff --check and checked for temporary SQLite/cache files.

Next useful context:
- Current derived queue has 2 open tasks for 06658 and 15 waiting_until_due tasks for future stages.
2026-06-15 06:29:54 +00:00

3.7 KiB

1task_idtickerstagetask_typetask_statusdue_datedata_gap_idlast_sync_run_idupdated_atnotes
206658_D106658D1archive_price_performanceopen2026-06-15sync_state_seed_2026_06_152026-06-15T06:30:00ZPrice/performance source is not archived yet.
306658_T2_grey_market06658T2_grey_marketarchive_grey_market_resultopen2026-06-15sync_state_seed_2026_06_152026-06-15T06:30:00ZPrice/performance source is not archived yet.
406675_T1_allotment06675T1_allotmentarchive_allotment_resultswaiting_until_due2026-06-1606675_allotment_results_pending_2026_06_15sync_state_seed_2026_06_152026-06-15T06:30:00ZAllotment result facts are not archived yet.
506675_D106675D1archive_price_performancewaiting_until_due2026-06-17sync_state_seed_2026_06_152026-06-15T06:30:00ZPrice/performance source is not archived yet.
606675_T2_grey_market06675T2_grey_marketarchive_grey_market_resultwaiting_until_due2026-06-17sync_state_seed_2026_06_152026-06-15T06:30:00ZPrice/performance source is not archived yet.
706658_D506658D5archive_price_performancewaiting_until_due2026-06-19sync_state_seed_2026_06_152026-06-15T06:30:00ZPrice/performance source is not archived yet. Due date uses calendar days until trading-calendar support is added.
806675_D506675D5archive_price_performancewaiting_until_due2026-06-21sync_state_seed_2026_06_152026-06-15T06:30:00ZPrice/performance source is not archived yet. Due date uses calendar days until trading-calendar support is added.
906106_T1_allotment06106T1_allotmentarchive_allotment_resultswaiting_until_due2026-06-2306106_allotment_results_pending_2026_06_15sync_state_seed_2026_06_152026-06-15T06:30:00ZAllotment result facts are not archived yet.
1006106_D106106D1archive_price_performancewaiting_until_due2026-06-24sync_state_seed_2026_06_152026-06-15T06:30:00ZPrice/performance source is not archived yet.
1106106_T2_grey_market06106T2_grey_marketarchive_grey_market_resultwaiting_until_due2026-06-24sync_state_seed_2026_06_152026-06-15T06:30:00ZPrice/performance source is not archived yet.
1206106_D506106D5archive_price_performancewaiting_until_due2026-06-28sync_state_seed_2026_06_152026-06-15T06:30:00ZPrice/performance source is not archived yet. Due date uses calendar days until trading-calendar support is added.
1306658_D2006658D20archive_price_performancewaiting_until_due2026-07-04sync_state_seed_2026_06_152026-06-15T06:30:00ZPrice/performance source is not archived yet. Due date uses calendar days until trading-calendar support is added.
1406675_D2006675D20archive_price_performancewaiting_until_due2026-07-06sync_state_seed_2026_06_152026-06-15T06:30:00ZPrice/performance source is not archived yet. Due date uses calendar days until trading-calendar support is added.
1506106_D2006106D20archive_price_performancewaiting_until_due2026-07-13sync_state_seed_2026_06_152026-06-15T06:30:00ZPrice/performance source is not archived yet. Due date uses calendar days until trading-calendar support is added.
1606658_D6006658D60archive_price_performancewaiting_until_due2026-08-13sync_state_seed_2026_06_152026-06-15T06:30:00ZPrice/performance source is not archived yet. Due date uses calendar days until trading-calendar support is added.
1706675_D6006675D60archive_price_performancewaiting_until_due2026-08-15sync_state_seed_2026_06_152026-06-15T06:30:00ZPrice/performance source is not archived yet. Due date uses calendar days until trading-calendar support is added.
1806106_D6006106D60archive_price_performancewaiting_until_due2026-08-22sync_state_seed_2026_06_152026-06-15T06:30:00ZPrice/performance source is not archived yet. Due date uses calendar days until trading-calendar support is added.