gold-data

Prices data: weekly capture, native-frequency series

Timing and safe operation

Published contract

snapshots/latest.json points to snapshots/YYYY-MM-DD.json after the first successful scheduled Monday. It contains path, previous_snapshot, snapshot_date, captured_at, kind, complete, data_sha256 and snapshot_sha256.

The immutable snapshot contains:

series.change_status is baseline, new_observation, revised or unchanged. New monthly/quarterly releases are not weekly market moves. Baseline means no prior frozen snapshot, not zero change. source_status distinguishes retrieved data, manual input and overdue input. Per-source weekly fetch failures are unavailable, not carried forward as fresh data.

Tests use snapshots/test-latest.json and snapshots/tests/<timestamp>.json, with kind=test. Never use those as a Monday issue cut.

Newsletter reader

  1. Read latest.json and require complete=true, kind=monday and this Monday’s date. If missing/old, flag it and explicitly label any prior successful cut.
  2. Read the exact path and previous_snapshot. Verify digests using Python json.dumps(value, separators=(',', ':'), sort_keys=True, allow_nan=False) encoded as UTF-8, then SHA256. data_sha256 covers data; snapshot_sha256 covers the whole snapshot. Retain the manifest and selected paths/checksums in the Monday draft.
  3. Head the section Data checked Monday [date]. Include actual source periods. Wednesday text and chart must use the same frozen Monday data, not floating data.json.
  4. Separate new releases, revisions and actual weekly observations. If nothing new arrived, say so. Failed/overdue/pending sources stay visibly excluded from claims.
  5. Rate deltas use percentage points/basis points, price deltas use percent. Percentiles need mode/history window and original proxy-history caveats. The long source/history and rights notes stay with any chart.

Sources and conventions

Run local checks with python scripts/weekly_snapshot.py --self-test. A normal invocation fetches/validates all legacy data, captures weekly sources and saves an isolated test. Only --publish writes the production Monday cut.

Lumber addition (29 October 2026)

Copper

World Bank Pink Sheet Copper monthly averages, USD per metric tonne. LME grade A minimum 99.9935% purity cathodes/wire bar settlement benchmark, not live/retail/scrap quotes. Workbook history begins January 1960; only months matching actual monthly model gold and silver are included, without forward-filling or early synthetic ratios. Current incomplete month excluded. The base and weekly runners refresh this monthly row; existing immutable Monday snapshots are not rewritten. Source: https://www.worldbank.org/en/research/commodity-markets .