Index of /v3/2026-08-20/18/

You do not need to open the hour pages, and you should not scrape this one. SHA256SUMS.txt lists every file under this prefix, so it is both the download list and the verification file.

# every file URL under /v3/2026-08-20/18/
curl -s https://archive.pendulumflow.com/v3/2026-08-20/18/SHA256SUMS.txt | awk '{print $2}' \
  | sed 's|^|https://dl.pendulumflow.com/v3/2026-08-20/18/|'

# fetch them, four at a time, keeping the directory layout
curl -s https://archive.pendulumflow.com/v3/2026-08-20/18/SHA256SUMS.txt | awk '{print $2}' \
  | xargs -P4 -I{} curl -sf --create-dirs -o {} https://dl.pendulumflow.com/v3/2026-08-20/18/{}

# then verify the lot, in the directory you downloaded into
curl -sO https://archive.pendulumflow.com/v3/2026-08-20/18/SHA256SUMS.txt && sha256sum -c SHA256SUMS.txt

# fetched only PART of it? filter the ledger to MATCH WHAT YOU TOOK
grep <the prefix you fetched> SHA256SUMS.txt | sha256sum -c -

Fetched only part of it? Filter the checksum list to what you took first, for example grep 2026-08-20 SHA256SUMS.txt | sha256sum -c - for one day, or every file you skipped prints as FAILED.

Add | grep 'parquet$' to skip the manifests. Ranges within a file work too, see the format notes.