CoolFace
Datasetpublic

eduagarcia/tokenizer_benchmark_results

sourceHugging Faceupdated 2d agoView on Hugging Face
0likes987downloads
50 commits on main
142cec42d ago

Upload evaluations/results_etri-lirs_vaetki-tokenizer-v2_main.jsonl with huggingface_hub

eduagarcia
1b8cdab12d ago

Upload evaluations/results_distilbert-base-uncased-finetuned-sst-2-english_main.jsonl with huggingface_hub

eduagarcia
467e28314d ago

Upload evaluations/results_sshalimov04_ru-reranker-edge-150m_main.jsonl with huggingface_hub

eduagarcia
f05471f4mo ago

Upload evaluations/results_boffire_kabyle-gpt2-tokenizer_main.jsonl with huggingface_hub

eduagarcia
b8c08964mo ago

Upload evaluations/results_boffire_bpe-tokenizer-for-kabyle_main.jsonl with huggingface_hub

eduagarcia
94718be5mo ago

Upload evaluations/results_mookiezii_Discord-Hermes-3-8B_main.jsonl with huggingface_hub

eduagarcia
38414735mo ago

Upload evaluations/results_perplexity-ai_pplx-embed-v1-4b_main.jsonl with huggingface_hub

eduagarcia
1c077c35mo ago

Upload evaluations/results_nvidia_Gemma-4-31B-IT-NVFP4_main.jsonl with huggingface_hub

eduagarcia
e7778425mo ago

Upload evaluations/results_unsloth_grok-2_main.jsonl with huggingface_hub

eduagarcia
d2822285mo ago

Upload evaluations/results_openai_privacy-filter_main.jsonl with huggingface_hub

eduagarcia
c29cef35mo ago

Upload evaluations/results_baidu_Qianfan-OCR_main.jsonl with huggingface_hub

eduagarcia
95ca6cc5mo ago

Upload evaluations/results_DJLougen_Harmonic-Hermes-9B_main.jsonl with huggingface_hub

eduagarcia
71f24be5mo ago

chore: Recalculate derived metrics

eduagarcia
fef27ab5mo ago

chore: Backfill byte-fidelity and EBPB metrics

eduagarcia
34a677b5mo ago

chore: Backfill byte-fidelity and EBPB metrics

eduagarcia
8079d9d6mo ago

chore: Update model metadata (likes, sha, created_at, downloads_all_time, author fields)

eduagarcia
9ccd8cb6mo ago

Upload evaluations/results_CohereLabs_multilingual-22-12_main.jsonl with huggingface_hub

eduagarcia
3ad66016mo ago

Upload evaluations/results_Qwen_Qwen3.5-397B-A17B_main.jsonl with huggingface_hub

eduagarcia
9cd1e396mo ago

chore: Update model metadata (likes, sha, created_at, downloads_all_time)

eduagarcia
c2829446mo ago

chore: compact 500 JSONL files into 1 batch zip(s)

eduagarcia
f0d5b1a6mo ago

New eval batch 04/2026

eduagarcia
c52a7f26mo ago

chore: compact 8000 JSONL files into 16 batch zip(s)

eduagarcia
059028e1y ago

fix likes

eduagarcia
67d22671y ago

chore: Update model metadata (likes, sha, created_at, downloads_all_time)

eduagarcia
388dfdc1y ago

init_lb 6

eduagarcia
dc7d0401y ago

fix missing init_lb

eduagarcia
688c6c01y ago

init_lb v5

eduagarcia
c8573391y ago

Upload evaluations/results_mmcarpi_carolina-superbpe_main.jsonl with huggingface_hub

eduagarcia
88149061y ago

init lb v4_2

eduagarcia
f53402a1y ago

init lb v4

eduagarcia
ef225971y ago

init_lb v3

eduagarcia
fb3c3ee1y ago

init_lb v2

eduagarcia
e8622dd1y ago

init_db v1

eduagarcia
40142501y ago

init_db 0.2

eduagarcia
8c174601y ago

update likes, sha, etc..

eduagarcia
1b748cb1y ago

init lb v0_1

eduagarcia
f0b7bf51y ago

Upload evaluations/results_Helsinki-NLP_opus-mt-tc-big-en-pt_main__target_mode.jsonl with huggingface_hub

eduagarcia
667a7381y ago

Upload evaluations/results_Helsinki-NLP_opus-mt-tc-big-en-pt_main.jsonl with huggingface_hub

eduagarcia
13cce7a1y ago

retry helsinki

eduagarcia
384807a1y ago

Upload evaluations/results_Helsinki-NLP_opus-mt-tc-big-en-pt_main__target_mode.jsonl with huggingface_hub

eduagarcia
d8086291y ago

Upload evaluations/results_Helsinki-NLP_opus-mt-tc-big-en-pt_main.jsonl with huggingface_hub

eduagarcia
417f7191y ago

Upload evaluations/results_black-forest-labs_FLUX.1-Kontext-dev_main_tokenizer_2.jsonl with huggingface_hub

eduagarcia
177fd841y ago

Upload evaluations/results_black-forest-labs_FLUX.1-Kontext-dev_main_tokenizer.jsonl with huggingface_hub

eduagarcia
9f229dd1y ago

cleanup

eduagarcia
546f52c1y ago

Upload evaluations/results_HuggingFaceTB_SmolLM3-3B_main.jsonl with huggingface_hub

eduagarcia
430d7911y ago

Upload evaluations/results_THUDM_GLM-4.1V-9B-Thinking_main.jsonl with huggingface_hub

eduagarcia
3eeaa0c1y ago

cleanup for v3

eduagarcia
49766e91y ago

chore: Update model metadata (likes, sha, created_at, downloads_all_time)

eduagarcia
558050b1y ago

chore: Fix tokenizer algorithm, implementation and hashes

eduagarcia
ccf43741y ago

init_lb v2

eduagarcia