CoolFace
Datasetpublic

Exqrch/Rebuttal-balinese-pixelgpt

Balinese PixelGPT Tokenizer Ablation Dataset Optimized with Font Size 6 and Dynamic Trimming. Tokenizer Schema tok_grapheme: Language-specific Grapheme BPE (izzako/javanese-llama-tokenizer) tok_llama2: Standard Llama-2 BPE (ernie-research/DualGPT) tok_komodo: SEA-Optimized BPE (yellow-ai-central/komodo-7b-v1) tok_mt5: Google Multilingual Unigram (google/mt5-small)

sourceHugging Faceupdated 6mo agoView on Hugging Face
0likes5downloads
3 commits on main
4a319926mo ago

Upload README.md with huggingface_hub

Exqrch
8e08b186mo ago

tokenizer ablation study setup

Exqrch
e649cfc6mo ago

initial commit

Exqrch