Apppublic

huggingface/text-data-filtering

sourceHugging Faceupdated 3y agoView on Hugging Face

37likes

file.gitattributes1 KBdownload

file.gitignore25 Bdownload

fileapp.py41 KBdownload

fileca_examples_with_stats.json98.8 MBdownload

fileca.arpa.bin2.62 GBdownload

fileca.sp.model925 KBdownload

fileen_examples_with_stats.json230.2 MBdownload

fileen.arpa.bin4.14 GBdownload

fileen.sp.model910 KBdownload

filees_examples_with_stats.json141.5 MBdownload

filees.arpa.bin3.57 GBdownload

filees.sp.model939 KBdownload

fileeu_examples_with_stats.json63.3 MBdownload

fileeu.arpa.bin738.2 MBdownload

fileeu.sp.model933 KBdownload

fileexplanation_filtering_pipeline.pdf216 KBdownload

filefiltering.py33 KBdownload

fileflagged_words.py27 KBdownload

filefr_examples_with_stats.json134.3 MBdownload

filefr.arpa.bin2.63 GBdownload

filefr.sp.model921 KBdownload

fileid_examples_with_stats.json85.3 MBdownload

fileid.arpa.bin1.72 GBdownload

fileid.sp.model905 KBdownload

filelanguages_id.py5 KBdownload

fileLICENSE11 KBdownload

filelid.176.bin125.2 MBdownload

filenormalization.py941 Bdownload

fileparameters_filtering.py34 KBdownload

filept_examples_with_stats.json129.2 MBdownload

filept.arpa.bin3.00 GBdownload

filept.sp.model936 KBdownload

fileREADME.md909 Bdownload

filerequirements.txt120 Bdownload

filestopwords.py133 KBdownload

filezh_examples_with_stats.json60.6 MBdownload

filezh.arpa.bin3.39 GBdownload

filezh.sp.model856 KBdownload

huggingface/text-data-filtering · main · files are served by the source, never re-hosted here