Modelpublic

JuloEco/opsiom-fr-tokenizer

sourceHugging Faceunknownupdated 18h agoView on Hugging Face

1likes

file_shard_tinystories_fr.bin13.3 MBdownload

file_shard_wikipedia_fr.bin3.26 GBdownload

file.gitattributes1 KBdownload

filedialogues_fr.jsonl611 KBdownload

fileeval_prompts.py10 KBdownload

filekaggle_train_chat.py66 KBdownload

filemain_GPU-optimum.py143 KBdownload

filemain_GPU.py83 KBdownload

filemain-GPU-TPU-CPU.py164 KBdownload

filemain.py82 KBdownload

filepretrain_corpus_meta.json306 Bdownload

filepretrain_corpus.bin7.33 GBdownload

fileREADME.md17 KBdownload

filetest_ia.py30 KBdownload

filetokenizer_32k.json2.2 MBdownload

filetokenizer.json1.1 MBdownload

filetrain_chat.py66 KBdownload

JuloEco/opsiom-fr-tokenizer · main · files are served by the source, never re-hosted here