cpral/step35-en2pl-conv-pass4-jsonl
conversations: 1,251,034 chat-template tokens (role+content, incl. special tokens): 2,664,206,408 reasoning_content tokens (not covered by chat template, counted separately): 6,662,763,429 avg tokens/conversation: 2129.6 used tokenizer: APT4
0685
conversations: 1,251,034 chat-template tokens (role+content, incl. special tokens): 2,664,206,408 reasoning_content tokens (not covered by chat template, counted separately): 6,662,763,429 avg tokens/conversation: 2129.6
used tokenizer: APT4
