yvonne90190/allenai_olmo2_superbpe_10G_1M_tokenizer_tulu-3-sft-olmo-2-mixture-0225-bpe-to-superbpe
samples processed: 866138 Total user BPE tokens: 252198220 Total assistant BPE tokens: 402038966 Total assistant SuperBPE tokens: 198274197 Assistant reduction vs BPE = 50.68284077717979%
017
This repository belongs to yvonne90190 on Hugging Face.
CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.
allenai_olmo2_superbpe_10G_1M_tokenizer_tulu-3-sft-olmo-2-mixture-0225-bpe-to-superbpe
public
not set
no
yvonne90190