Apppublic

commanderzee/crypto-1s-daily-updater

sourceHugging Faceupdated 5mo agoView on Hugging Face

0likes

App README

1s Crypto Data — Daily Updater

This Space runs every day at 06:00 UTC and keeps the commanderzee/1s-crypto-data dataset up to date.

Two daily phases

1.Raw OHLCV update — pulls new days from Binance and appends to data/{SYMBOL}_1s.parquet for each tracked symbol.
2.Enhanced update — joins each new day of crypto OHLCV with Polymarket book_snapshot_25 order book data for 5-minute "Up or Down" prediction markets, producing 207-column rows with 100 PM levels (50 Up + 50 Down) in data/enhanced/{SYMBOL}_enhanced.parquet.

Symbols Updated

Symbol	Raw File	Enhanced File
BTCUSDT	`data/BTCUSDT_1s.parquet`	`data/enhanced/BTCUSDT_enhanced.parquet`
ETHUSDT	`data/ETHUSDT_1s.parquet`	`data/enhanced/ETHUSDT_enhanced.parquet`
SOLUSDT	`data/SOLUSDT_1s.parquet`	`data/enhanced/SOLUSDT_enhanced.parquet`
DOGEUSDT	`data/DOGEUSDT_1s.parquet`	`data/enhanced/DOGEUSDT_enhanced.parquet`
XRPUSDT	`data/XRPUSDT_1s.parquet`	`data/enhanced/XRPUSDT_enhanced.parquet`
BNBUSDT	`data/BNBUSDT_1s.parquet`	`data/enhanced/BNBUSDT_enhanced.parquet`

Tabs

—Daily Update (raw) — fetch missing days from Binance
—Daily Update (enhanced) — append PM-joined days to enhanced files
—One-Time Merge — combine yearly parquets into one file per asset

Required Secrets

Set both in this Space's Settings → Repository secrets:

—HF_TOKEN — token with write access to commanderzee/1s-crypto-data
—TELONEX_API_KEY — for fetching Polymarket booksnapshot25 data

Data Sources

—Binance: https://data.binance.vision/data/spot/daily/klines/{SYMBOL}/1s/
—Polymarket: Telonex book_snapshot_25 channel