CoolFace
Modelpublic

OpenFormosa/PangolinTokenizer

sourceHugging Faceotherupdated 4mo agoView on Hugging Face
3likes12downloads
root
file.gitattributes1 KBdownload
fileadded_tokens.json5 KBdownload
fileconfig.json123 Bdownload
fileevaluation_report.json857 Bdownload
filemerges.txt1.5 MBdownload
fileREADME.md1 KBdownload
filespecial_tokens_map.json4 KBdownload
filetokenizer_config.json2 KBdownload
filetokenizer.json8.9 MBdownload
filevocab.json2.8 MBdownload

OpenFormosa/PangolinTokenizer · main · files are served by the source, never re-hosted here