Hour audit: 2026-09-20T20
back to the files for this hour · how the archive is audited
Every number on this page is a stored measurement read from this hour's own records: its
manifest.json, its witness
statistics sidecar, and the corpus attestation. Nothing here is computed from the served
bytes at the time you load the page, so no line below claims the bytes are correct. The
digest and the one command that checks them are printed instead.
1 finding
- a machine expected this hour contributed nothing. Of the 5 machines expected to be capturing this hour, 1 contributed no rows: g. The hour is still whole on minutes; it simply rests on 4 machines rather than 5.
The report
POLYMARKET ORDERBOOK ARCHIVE — HOUR AUDIT
hour 2026-09-20T20 · corpus v3 · verdict AUDIT PASS* (1 finding)
COVERAGE minutes present 60/60 · first event 2026-09-20T20:00:00.000045002+00:00 · last event 2026-09-20T20:59:59.999995662+00:00
VOLUME 127,267,181 rows · 1,458,572,806 bytes (1.36 GiB) · 7 products, all holding rows
WITNESSES cefh — 4 machines contributed rows
captured e: 124,277,281 · h: 121,899,343 · f: 114,972,967 · c: 92,831,134 (each machine's own feed; these overlap and do not sum to the file)
supplied e: 3,962,660 (3.11%) · h: 35,112,557 (27.59%) · f: 2,058,797 (1.62%) · c: 86,133,167 (67.68%) (rows of the merged file that came from it; these partition it)
5 expected (cefgh), 1 contributed nothing: g
INTEGRITY sha256 2b28f805a52ed049b79d3200cbc92157017eafaee1a39dd648cae3feb2c9ada3
the corpus checksum ledger names this file with the same digest
joined 127,279,471 to merged 127,267,181, minus 12,290 (minus 0.0097%)
boundary drops 12,290 · guard cache
SIDECARS none: this hour's manifest has no v31 key. The v3.1 sidecars are optional, and hours before them have none
MARKETS not measured (the per-hour market census runs on the capture host and its output is not published per hour)
HISTORY merged 2026-09-21T03:32:51Z as cefh
layout union-event-sorted-v1
re-merges not measured (the merge ledger records the merge that produced this file, not the history of attempts)
supersessions not measured (supersession is recorded per corpus in the storage registry, not in the hour manifest)
CHECKS 7/8 pass, 1 finding
PASS all products present
PASS row counts reconcile
PASS byte ranges tile the file
PASS the merge delta is explained
FINDING a machine expected this hour contributed nothing
PASS the checksum ledger names this file
PASS the hour is whole
PASS a boundary guard ran
UPSTREAM our incident register was checked against the venue's own status feed at 2026-09-23T20:35Z and names no event in this hour. That is a statement about what they published, not a check that every message they sent reached us.The words in this report
Each line in the CHECKS block states what was found, not what was
hoped for: a check that passes is named for the thing that is true, and a check that does
not is renamed to the thing that is wrong. So FINDING never sits beside a
sentence asserting the opposite of the one below it.
The report above is fixed-width text, so nothing in it can be clicked. The same terms are linked here instead. Its verdict is a statement about minutes and nothing else. The row it reports comes from this hour's own manifest and its witness-statistics sidecar, and the completeness line comes from the corpus attestation. The gap between the joined and merged counts is deduplication, not loss, and the boundary drops are the duplicates discarded at the seam with the hour before. Where the history line names a supersession, this hour was rebuilt to a better state after it was first published. The precision is the timestamp resolution these files carry.
Detail
The same records, per product. A product holding no rows renders its zero rather than
being dropped: dropped and empty are indistinguishable to a reader, and only one of them is
a defect. A cell reading not meas. is one nothing published, which is a third
thing again and never a zero.
The class column is the merger's own verdict for that product, and it is
keyed to CONTRIBUTION rather than presence. FULL means every machine expected to
be capturing this hour delivered rows for that product; PARTIAL means some did
and some did not; SINGLE-BY-DESIGN means only one machine was ever expected, and
SINGLE-BY-DEFECT means several were and one delivered. So PARTIAL
here is a statement about the fleet, not about the product being damaged or truncated: the
rows that are present are whole.
PRODUCT rows bytes row groups sha256 best_bid_ask 13,315,022 158,263,830 0-50 51e860b4a64693d7b88dedf27533046cebfefae54aeca0f459a98a3aad4a3424 book 2,711,695 97,674,481 51-61 4e230ecc3c631dfd0e7bd228bc3671dfb04e5f285d4961d1705e744b283536b4 last_trade_price 68,699 3,944,847 62-62 bc8ef11ca3e6eb715bed129f8a6bcab9554753b775aaf932f98f63fb256e9a81 market_resolved 6,786 809,460 63-63 3318b62364d7cf50cde8e7de05e2742c211e6b32a6ea643ccb3483402e859ac8 new_market 10,139 921,219 64-64 c0ffec01c1ce1779502f50776a44710500e5787f10f0f05196116f1bb3b7931a price_change 111,145,020 1,195,158,084 65-488 204d20178354d2357818dd20c5767968ec6e5b4c638601159bec73b24d263fd0 tick_size_change 9,820 356,731 489-489 a28f36727379e01c1b9a12124e540b203d7003c39b8389261eb827d55c7e9f6d EVENT MIX count share price_change 111,145,020 87.33% best_bid_ask 13,315,022 10.46% book 2,711,695 2.13% last_trade_price 68,699 0.05% new_market 10,139 <0.01% tick_size_change 9,820 <0.01% market_resolved 6,786 <0.01% PER PRODUCT joined merged boundary exception mkts class best_bid_ask 13,315,632 13,315,022 610 82,276 PARTIAL book 2,716,843 2,711,695 5,148 171,302 PARTIAL last_trade_price 68,699 68,699 0 3,871 PARTIAL market_resolved 6,787 6,786 1 4,893 PARTIAL new_market 10,294 10,139 155 5,825 PARTIAL price_change 111,151,396 111,145,020 6,376 132,623 PARTIAL tick_size_change 9,820 9,820 0 2,455 PARTIAL ARRIVAL SKEW m rows won p50 p90 p99 max unmeasurable interpretation best_bid_ask c 9,761,850 9,055,278 6ms 26ms 264ms 4.5s 0 transport_latency_assumed best_bid_ask e 13,303,799 405,887 43ms 113ms 537ms 27.8s 0 transport_latency_assumed best_bid_ask f 12,355,642 193,420 45ms 114ms 536ms 37.0s 0 transport_latency_assumed best_bid_ask h 13,053,826 3,660,437 19ms 58ms 689ms 46.8s 0 transport_latency_assumed book c 2,458,066 2,394,649 6.3min 2.2d 43.3d 113.9d 0 book_staleness book e 206,191 36,790 188ms 16.2min 25.1d 113.9d 0 book_staleness book f 847,015 216,476 4.3min 2.2d 40.1d 113.9d 0 book_staleness book h 192,303 63,780 45ms 12.0min 15.3d 113.9d 0 book_staleness last_trade_price c 50,033 46,196 7ms 51ms 346ms 2.3s 0 transport_latency_assumed last_trade_price e 66,144 2,038 58ms 1.2s 14.5s 27.8s 0 transport_latency_assumed last_trade_price f 60,582 1,226 59ms 826ms 13.3s 36.8s 0 transport_latency_assumed last_trade_price h 66,143 19,239 21ms 156ms 1.1s 15.7s 0 transport_latency_assumed market_resolved c 5,292 5,050 7ms 7.6min 12.7min 13.4min 0 transport_latency_assumed market_resolved e 4,889 97 61ms 223ms 634ms 1.1min 0 transport_latency_assumed market_resolved f 4,854 315 84ms 418ms 4.9min 6.1min 0 transport_latency_assumed market_resolved h 4,822 1,324 33ms 98ms 2.5s 2.5min 0 transport_latency_assumed new_market c 7,732 5,658 183ms 6.2min 8.6min 17.9h 0 transport_latency_assumed new_market e 5,546 1,066 230ms 1.2min 6.6min 4.6h 0 transport_latency_assumed new_market f 5,677 1,073 244ms 3.6min 6.7min 10.2h 0 transport_latency_assumed new_market h 5,563 2,342 161ms 1.2min 6.6min 22.6min 0 transport_latency_assumed price_change c 80,541,057 74,619,821 6ms 29ms 267ms 4.6s 0 transport_latency_assumed price_change e 110,680,892 3,516,342 43ms 155ms 2.5s 27.9s 0 transport_latency_assumed price_change f 101,689,953 1,646,144 46ms 153ms 2.2s 37.0s 0 transport_latency_assumed price_change h 108,567,030 31,362,713 19ms 67ms 743ms 46.8s 0 transport_latency_assumed tick_size_change c 7,104 6,515 6ms 41ms 251ms 607ms 0 transport_latency_assumed tick_size_change e 9,820 440 42ms 110ms 449ms 747ms 0 transport_latency_assumed tick_size_change f 9,244 143 45ms 154ms 475ms 848ms 0 transport_latency_assumed tick_size_change h 9,656 2,722 19ms 70ms 523ms 9.9s 0 transport_latency_assumed
Captured and supplied are different numbers
Captured is how many rows each machine's own feed carried. Redundant capture means these OVERLAP, heavily and on purpose, so they do not partition the file and their sum is larger than it. Two machines each capturing nearly every event is the archive working, not double counting.
Supplied is how many rows of the merged file actually came from that machine. This one does partition: it sums to the file's row count exactly. But it is decided by the merge's tie-break, so a machine can capture almost everything and supply almost nothing. Read alone, either number tells a false story about the fleet, which is why both are printed and neither is called "the witness share".
What the skew columns mean
Arrival skew is the receipt timestamp minus the venue timestamp, in milliseconds. For six of the seven products the sidecar interprets it as transport latency, and marks that interpretation assumed: it rests on the venue timestamp being emit time, which we cannot verify from outside.
book is not latency and must not be read as latency. Its
venue timestamp is the last time the book changed, so the sidecar interprets it as book
staleness and warns in its own note that large values mean a quiet book rather than slow
transport. Its maximum runs to weeks for that reason. This is why the table above gives a
row per product per machine and never one figure for the hour: percentiles do not average,
and these seven do not measure the same quantity.
Check it yourself
The digest above is a claim. This is how you refuse to take our word for it:
curl -O https://archive.pendulumflow.com/v3/2026-09-20/20/2026-09-20T20.parquet sha256sum 2026-09-20T20.parquet # compare with the sha256 line in the report above
A range digest certifies bytes. That those bytes are the product the manifest names comes from the manifest, which is why both are published and both are checkable.