Datasetpublic

rhinot/prediction-market-analysis

Prediction Market Analysis Dataset (Public Mirror) This repository is a durable public mirror of the prediction market dataset collected and originally published by Jonathan Becker (jon-becker/prediction-market-analysis). Overview The dataset provides the largest publicly available collection of Polymarket and Kalshi market, order book, and trade history data, covering both API-collected data and blockchain-indexed trade data. Original Creator / Author: Jonathan… See the full description on the dataset page: https://huggingface.co/datasets/rhinot/prediction-market-analysis.

sourceHugging Facemitupdated 13d agoView on Hugging Face

0likes118downloads

Dataset Card

Prediction Market Analysis Dataset (Public Mirror)

This repository is a durable public mirror of the prediction market dataset collected and originally published by Jonathan Becker (jon-becker/prediction-market-analysis).

Overview

The dataset provides the largest publicly available collection of Polymarket and Kalshi market, order book, and trade history data, covering both API-collected data and blockchain-indexed trade data.

—Original Creator / Author: Jonathan Becker (@BeckerrJon / jonathan@jbecker.dev)
—Original Repository: github.com/jon-becker/prediction-market-analysis
—License: MIT License (carried forward from the original project)

Purpose of this Mirror

This repository serves as an immutable public backup of the complete, unpruned dataset archive (data.tar.zst, ~36.02 GiB compressed / ~50 GiB uncompressed across 49,486 Parquet & JSON files), ensuring long-term data durability independent of upstream Cloudflare R2 hosting.

Contents & Layout

When extracted, the archive contains:

—data/kalshi/markets/: Market metadata parquet files
—data/kalshi/trades/: Kalshi trade execution parquet files
—data/polymarket/blocks/: Polygon blockchain block data
—data/polymarket/markets/: Polymarket market metadata
—data/polymarket/trades/: Trade events indexed from Polygon blockchain
—data/polymarket/legacy_trades/: Historical Polymarket trade data
—data/polymarket/fpmm_collateral_lookup.json: FPMM collateral token lookup map

How to Restore & Use

To restore this dataset into a clone of jon-becker/prediction-market-analysis:

bash

# 1. Download the archive
curl -L -o data.tar.zst "https://huggingface.co/datasets/rhinot/prediction-market-analysis/resolve/main/data.tar.zst"

# 2. Extract into data/
zstd -d data.tar.zst --stdout | tar -xf -

# 3. Clean up
rm data.tar.zst

Or update scripts/download.sh in the repository to point URL to: https://huggingface.co/datasets/rhinot/prediction-market-analysis/resolve/main/data.tar.zst and run:

bash

make setup

Citation

bibtex

@misc{becker2026predictionmarkets,
  author = {Becker, Jonathan},
  title = {Prediction Market Analysis: Polymarket and Kalshi Dataset},
  year = {2026},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\\url{https://github.com/jon-becker/prediction-market-analysis}}
}