Hour audit: 2026-09-21T20
back to the files for this hour · how the archive is audited
Every number on this page is a stored measurement read from this hour's own records: its
manifest.json, its witness
statistics sidecar, and the corpus attestation. Nothing here is computed from the served
bytes at the time you load the page, so no line below claims the bytes are correct. The
digest and the one command that checks them are printed instead.
1 finding
- a machine expected this hour contributed nothing. Of the 5 machines expected to be capturing this hour, 1 contributed no rows: g. The hour is still whole on minutes; it simply rests on 4 machines rather than 5.
The report
POLYMARKET ORDERBOOK ARCHIVE — HOUR AUDIT
hour 2026-09-21T20 · corpus v3 · verdict AUDIT PASS* (1 finding)
COVERAGE minutes present 60/60 · first event 2026-09-21T20:00:00.000013910+00:00 · last event 2026-09-21T20:59:59.999998341+00:00
VOLUME 108,999,182 rows · 1,214,022,588 bytes (1.13 GiB) · 7 products, all holding rows
WITNESSES cefh — 4 machines contributed rows
captured h: 106,323,607 · f: 104,632,835 · e: 103,705,956 · c: 79,747,970 (each machine's own feed; these overlap and do not sum to the file)
supplied h: 33,677,252 (30.90%) · f: 1,689,255 (1.55%) · e: 2,961,820 (2.72%) · c: 70,670,855 (64.84%) (rows of the merged file that came from it; these partition it)
5 expected (cefgh), 1 contributed nothing: g
INTEGRITY sha256 604eab2e6ae2025c47c42f24feba9936131c6000ebf6ebafed0e733342c87522
the corpus checksum ledger names this file with the same digest
joined 109,019,345 to merged 108,999,182, minus 20,163 (minus 0.0185%)
boundary drops 20,163 · guard cache
SIDECARS none: this hour's manifest has no v31 key. The v3.1 sidecars are optional, and hours before them have none
MARKETS not measured (the per-hour market census runs on the capture host and its output is not published per hour)
HISTORY merged 2026-09-21T21:54:10Z as cefh
layout union-event-sorted-v1
re-merges not measured (the merge ledger records the merge that produced this file, not the history of attempts)
supersessions not measured (supersession is recorded per corpus in the storage registry, not in the hour manifest)
CHECKS 7/8 pass, 1 finding
PASS all products present
PASS row counts reconcile
PASS byte ranges tile the file
PASS the merge delta is explained
FINDING a machine expected this hour contributed nothing
PASS the checksum ledger names this file
PASS the hour is whole
PASS a boundary guard ran
UPSTREAM our incident register was checked against the venue's own status feed at 2026-09-23T20:35Z and names no event in this hour. That is a statement about what they published, not a check that every message they sent reached us.The words in this report
Each line in the CHECKS block states what was found, not what was
hoped for: a check that passes is named for the thing that is true, and a check that does
not is renamed to the thing that is wrong. So FINDING never sits beside a
sentence asserting the opposite of the one below it.
The report above is fixed-width text, so nothing in it can be clicked. The same terms are linked here instead. Its verdict is a statement about minutes and nothing else. The row it reports comes from this hour's own manifest and its witness-statistics sidecar, and the completeness line comes from the corpus attestation. The gap between the joined and merged counts is deduplication, not loss, and the boundary drops are the duplicates discarded at the seam with the hour before. Where the history line names a supersession, this hour was rebuilt to a better state after it was first published. The precision is the timestamp resolution these files carry.
Detail
The same records, per product. A product holding no rows renders its zero rather than
being dropped: dropped and empty are indistinguishable to a reader, and only one of them is
a defect. A cell reading not meas. is one nothing published, which is a third
thing again and never a zero.
The class column is the merger's own verdict for that product, and it is
keyed to CONTRIBUTION rather than presence. FULL means every machine expected to
be capturing this hour delivered rows for that product; PARTIAL means some did
and some did not; SINGLE-BY-DESIGN means only one machine was ever expected, and
SINGLE-BY-DEFECT means several were and one delivered. So PARTIAL
here is a statement about the fleet, not about the product being damaged or truncated: the
rows that are present are whole.
PRODUCT rows bytes row groups sha256 best_bid_ask 10,138,221 124,769,625 0-38 d4381b97c47f61d3bf3da7900b113449248b9f99255040fab8d78a492afefdca book 2,582,349 94,840,881 39-48 c09e1cf9cf7f3da54f03a1154ce8049203cd5093cd9a797b682942d417836d43 last_trade_price 66,711 3,744,358 49-49 4defd1bd55a9a1018d1779cededf783c0d701b96c4391dd9c531097394b88c38 market_resolved 1,766 157,954 50-50 761909c71e32d0ab2ed9af2fe1effda905c3dd8067e99fb9b9f570105e726658 new_market 26,547 2,246,881 51-51 25e1a698e98deaa9ccfc5fe1793e542f5d7e41f75550efda6dccc24c7e045d5b price_change 96,181,256 986,937,219 52-418 62eba1e33d403e0c10eb963d0443dbe965cce98ce5a1b8fd7e7d3425b13a4f7c tick_size_change 2,332 87,570 419-419 024f0611fc68b024a26c210885463b2abefbc4679661a18f9093251ce00fff6f EVENT MIX count share price_change 96,181,256 88.24% best_bid_ask 10,138,221 9.30% book 2,582,349 2.37% last_trade_price 66,711 0.06% new_market 26,547 0.02% tick_size_change 2,332 <0.01% market_resolved 1,766 <0.01% PER PRODUCT joined merged boundary exception mkts class best_bid_ask 10,138,564 10,138,221 343 81,914 PARTIAL book 2,598,101 2,582,349 15,752 176,852 PARTIAL last_trade_price 66,714 66,711 3 3,486 PARTIAL market_resolved 1,767 1,766 1 935 PARTIAL new_market 26,731 26,547 184 13,969 PARTIAL price_change 96,185,136 96,181,256 3,880 134,047 PARTIAL tick_size_change 2,332 2,332 0 583 PARTIAL ARRIVAL SKEW m rows won p50 p90 p99 max unmeasurable interpretation best_bid_ask c 7,361,238 6,504,530 6ms 55ms 302ms 17.2s 0 transport_latency_assumed best_bid_ask e 10,063,854 291,867 43ms 180ms 1.3s 30.8s 0 transport_latency_assumed best_bid_ask f 10,098,027 152,639 49ms 192ms 721ms 28.0s 0 transport_latency_assumed best_bid_ask h 10,125,372 3,189,185 19ms 89ms 881ms 51.6s 0 transport_latency_assumed book c 2,484,937 2,426,489 6.7min 3.2d 44.3d 114.9d 0 book_staleness book e 167,038 31,116 311ms 1.7min 13.1d 114.9d 0 book_staleness book f 164,738 21,955 300ms 58.1s 11.4d 114.9d 0 book_staleness book h 281,760 102,789 914ms 41.2min 30.3d 114.9d 0 book_staleness last_trade_price c 50,002 44,927 7ms 78ms 330ms 2.2s 0 transport_latency_assumed last_trade_price e 56,164 1,589 108ms 6.5s 18.2s 30.6s 0 transport_latency_assumed last_trade_price f 57,740 1,036 126ms 6.8s 15.6s 27.7s 0 transport_latency_assumed last_trade_price h 65,857 19,159 22ms 210ms 1.0s 21.1s 0 transport_latency_assumed market_resolved c 1,393 1,271 3.4min 11.6min 14.8min 18.5min 0 transport_latency_assumed market_resolved e 906 150 51ms 27.1s 1.0min 2.3min 0 transport_latency_assumed market_resolved f 906 13 57ms 24.3s 59.0s 59.1s 0 transport_latency_assumed market_resolved h 906 332 20ms 23.4s 57.5s 57.6s 0 transport_latency_assumed new_market c 21,456 15,153 397ms 8.2min 17.0min 19.2min 0 transport_latency_assumed new_market e 13,333 2,947 182ms 1.6min 4.6min 7.1min 0 transport_latency_assumed new_market f 13,330 2,782 190ms 1.4min 4.4min 6.4min 0 transport_latency_assumed new_market h 13,332 5,665 123ms 1.5min 4.5min 6.5min 0 transport_latency_assumed price_change c 69,827,228 61,676,886 6ms 60ms 309ms 31.9s 0 transport_latency_assumed price_change e 93,402,361 2,634,103 44ms 281ms 9.8s 30.9s 0 transport_latency_assumed price_change f 94,295,762 1,510,821 50ms 290ms 8.3s 28.0s 0 transport_latency_assumed price_change h 95,834,048 30,359,446 19ms 113ms 1.0s 51.6s 0 transport_latency_assumed tick_size_change c 1,716 1,599 6ms 23ms 257ms 629ms 0 transport_latency_assumed tick_size_change e 2,300 48 43ms 122ms 9.5s 25.2s 0 transport_latency_assumed tick_size_change f 2,332 9 48ms 119ms 453ms 602ms 0 transport_latency_assumed tick_size_change h 2,332 676 19ms 49ms 642ms 4.3s 0 transport_latency_assumed
Captured and supplied are different numbers
Captured is how many rows each machine's own feed carried. Redundant capture means these OVERLAP, heavily and on purpose, so they do not partition the file and their sum is larger than it. Two machines each capturing nearly every event is the archive working, not double counting.
Supplied is how many rows of the merged file actually came from that machine. This one does partition: it sums to the file's row count exactly. But it is decided by the merge's tie-break, so a machine can capture almost everything and supply almost nothing. Read alone, either number tells a false story about the fleet, which is why both are printed and neither is called "the witness share".
What the skew columns mean
Arrival skew is the receipt timestamp minus the venue timestamp, in milliseconds. For six of the seven products the sidecar interprets it as transport latency, and marks that interpretation assumed: it rests on the venue timestamp being emit time, which we cannot verify from outside.
book is not latency and must not be read as latency. Its
venue timestamp is the last time the book changed, so the sidecar interprets it as book
staleness and warns in its own note that large values mean a quiet book rather than slow
transport. Its maximum runs to weeks for that reason. This is why the table above gives a
row per product per machine and never one figure for the hour: percentiles do not average,
and these seven do not measure the same quantity.
Check it yourself
The digest above is a claim. This is how you refuse to take our word for it:
curl -O https://archive.pendulumflow.com/v3/2026-09-21/20/2026-09-21T20.parquet sha256sum 2026-09-21T20.parquet # compare with the sha256 line in the report above
A range digest certifies bytes. That those bytes are the product the manifest names comes from the manifest, which is why both are published and both are checkable.