PhysiQuanty/CATIE-AQ_DFP_BASE_65536_VOCAB_65538
Tokenizer FREE Radix = 65 536 (256**2) Vocab size = 65 538 Source DATASET = CATIE-AQ/DFP
212
Tokenizer FREE
Radix = 65 536 (256**2) Vocab size = 65 538
Source DATASET = CATIE-AQ/DFP
Tokenizer FREE Radix = 65 536 (256**2) Vocab size = 65 538 Source DATASET = CATIE-AQ/DFP
Tokenizer FREE
Radix = 65 536 (256**2) Vocab size = 65 538
Source DATASET = CATIE-AQ/DFP