Index of /contrib/devpyle/
Contributed by devpyle. 68 hours of crypto Up-or-Down markets, in his own format.
Format, provenance and known issues for this data: Contributed. What we measured about it, and where it falls short: the audit.
Contributed; not witnessed by this archive. Recorded and contributed by devpyle (github.com/devpyle) and published here under CC BY 4.0 at his request. Four files per hour in his own schema, crypto Up-or-Down markets only. Nothing in this tier is merged with, or attested like, the witness products. What is in these files.
What is wrong with this data
A handful of crypto markets, in the contributor's own format, recorded by one machine and attested by nobody here.
- It covers crypto Up-or-Down markets only. BTC, ETH, SOL, XRP, BNB, DOGE and HYPE; 5-minute, 15-minute and 1-hour markets. Every other market in these 68 hours is absent from this tier, so it does not close the gap for the venue as a whole. the contribution audit, 2026-09-16
- Its book is five levels deep, at the recorder's receipt time. clob_l2 is a 5-level snapshot, not the venue's full book, and carries no venue timestamps. poly_trades are last-trade events. the contribution audit, 2026-09-16
- Timestamps are his receipt time, in milliseconds. int64 ms from one NTP host, measured about 80 ms behind the venue, p95 230 to 800 ms. Prices are float32: compare them with a 1e-3 tolerance. the contribution audit, 2026-09-16
- Rows are not de-duplicated across his recorder restarts. De-duplicate yourself before counting events around a restart. the contribution audit, 2026-09-16
Checksums for this prefix:
SHA256SUMS.txt, verify a download with
sha256sum -c.
Download this prefix in bulk
You do not need to open the hour pages, and you should not scrape this one.
SHA256SUMS.txt lists every file under this prefix, so it is both the
download list and the verification file.
# every file URL under /contrib/devpyle/
curl -s https://archive.pendulumflow.com/contrib/devpyle/SHA256SUMS.txt | awk '{print $2}' \
| sed 's|^|https://archive.pendulumflow.com/contrib/devpyle/|'
# fetch them, four at a time, keeping the directory layout
curl -s https://archive.pendulumflow.com/contrib/devpyle/SHA256SUMS.txt | awk '{print $2}' \
| xargs -P4 -I{} curl -sf --create-dirs -o {} https://archive.pendulumflow.com/contrib/devpyle/{}
# then verify the lot, in the directory you downloaded into
curl -sO https://archive.pendulumflow.com/contrib/devpyle/SHA256SUMS.txt && sha256sum -c SHA256SUMS.txt
# fetched only PART of it? filter the ledger to MATCH WHAT YOU TOOK
grep <the prefix you fetched> SHA256SUMS.txt | sha256sum -c -Fetched only part of it? Filter the checksum list to what you took first, for example
grep 2026-08-18 SHA256SUMS.txt | sha256sum -c - for one day, or every file you
skipped prints as FAILED.
Add | grep 'parquet$' to skip the manifests. Ranges within a file work
too, see the format notes.
275 objects.
Looking for data we don't publish yet? Tell us.
Pendulum Flow Discord
Something wrong with an hour, or a file you need that is not here? Say so in the Discord, where the people who run the site and prediction market data geeks compare notes.
Join the Discord