PhysiQuanty/CATIE-AQ_DFP_BASE_65536_VOCAB_65538
Tokenizer FREE Radix = 65 536 (256**2) Vocab size = 65 538 Source DATASET = CATIE-AQ/DFP
Create README.md
Upload metadata.json with huggingface_hub
Upload data/validation/validation__shard_000000__base65536__bos_eos.bin with huggingface_hub
Upload data/train/train__shard_000007__base65536__bos_eos.bin with huggingface_hub
Upload data/train/train__shard_000006__base65536__bos_eos.bin with huggingface_hub
Upload data/train/train__shard_000005__base65536__bos_eos.bin with huggingface_hub
Upload data/train/train__shard_000004__base65536__bos_eos.bin with huggingface_hub
Upload data/train/train__shard_000003__base65536__bos_eos.bin with huggingface_hub
Upload data/train/train__shard_000002__base65536__bos_eos.bin with huggingface_hub
Upload data/train/train__shard_000001__base65536__bos_eos.bin with huggingface_hub
Upload data/train/train__shard_000000__base65536__bos_eos.bin with huggingface_hub
initial commit
