data-forge
forge-3b-pretrain-data
FORGE-3B Pretraining Data
Tokenized and packed pretraining data for the FORGE-3B language model.
Stats
Total tokens: 51.4070B
Domains: 10/10
Sequence length: 2048 tokens
Format: .npy shards of shape (N, 2048) with dtype uint32
Tokenizer: CRAYON (xerv-crayon, standard profile)
Domain Breakdown
Domain
Weight
Tokens (B)
Status
fineweb_edu
30%
15.0008
✓
thestack
16%
8.0011
✓
wikipedia
8%
4.2791
✓
openwebmath
8%
3.9654
✓
books
7%… See the full description on the dataset page: https://huggingface.co/datasets/Phase-Technologies/forge-3b-pretrain-data.solana-dex-execution
Solana DEX quotes and routing
Jupiter swap quotes at fixed SOL input sizes, with the route legs returned for each quote. The panel supports comparisons of quoted output, reported price impact and routing across sizes and observation times.
Contents
Table
Record
solana_swap_quotes
A pair and input amount, with quoted output, price impact, value and route-leg count
solana_swap_routes
A leg of the chosen route, including venue, amounts and allocation… See the full description on the dataset page: https://huggingface.co/datasets/dataforge-labs/solana-dex-execution.l2-preconfirmation-reliability
L2 sequencer preconfirmation observations
Periodic observations of unsafe and safe heads on selected OP Stack networks, with subsequent checks of sampled unsafe block hashes against the chain reported by the endpoint. The panel records coverage and detected changes to previously observed blocks.
Contents
Table
Record
l2_preconfirmation_checks
A heartbeat with head and check statistics, or a detected violation
Using the data
row_type… See the full description on the dataset page: https://huggingface.co/datasets/dataforge-labs/l2-preconfirmation-reliability.bitcoin-mempool-lifecycle
Bitcoin and Litecoin mempool lifecycle
Transaction observations covering first sight, time spent pending, confirmation and disappearance from monitored mempools. The repository also contains comparisons between Bitcoin provider views and a measure of how much of each block was visible before it arrived.
Contents
Table
Record
bitcoin_transaction_lifecycle
A Bitcoin transaction's observed lifecycle, fee information and outcome
bitcoin_mempool_comparison… See the full description on the dataset page: https://huggingface.co/datasets/dataforge-labs/bitcoin-mempool-lifecycle.crypto-execution-costs
Crypto execution quotes and order-book depth
Ethereum swap quotes, route details and selected perpetual-futures order-book snapshots. The tables support comparisons of quoted output, provider fees, routing choices and available depth at the time of collection.
Contents
Table
Record
ethereum_swap_quotes
A swap quote at a specified size, with available provider-fee details
ethereum_swap_routes
A route leg, with venue, pool and amount where supplied… See the full description on the dataset page: https://huggingface.co/datasets/dataforge-labs/crypto-execution-costs.ethereum-gas-estimator-accuracy
Ethereum gas estimator comparisons
Ethereum mainnet gas suggestions from public RPC providers, recorded alongside provider-reported head blocks and subsequent block-fee statistics. The panel supports analysis of differences in gas recommendations and their relationship to observed block conditions.
Contents
Table
Record
ethereum_gas_recommendations
A provider's gas-price and priority-fee suggestions, with its reported head block
ethereum_block_fees
A… See the full description on the dataset page: https://huggingface.co/datasets/dataforge-labs/ethereum-gas-estimator-accuracy.