Datasetpublic

miesepeter/CEFR_vocab_tokens

Dataset with English words classified along CEFR categories, tokenized forms based on sentencepiece tokenizer. License based on foundational dataset, accessible at: http://www.englishprofile.org/wordlists/terms-of-use

sourceHugging Faceotherupdated 3y agoView on Hugging Face

0likes102downloads

12 commits on main

5bd2c6c3y ago

Update README.md

miesepeter

33fbf893y ago

Upload vocab_dict_full.json

miesepeter

94043563y ago

Create README.md

miesepeter

7e960d73y ago

Upload 3 files

miesepeter

0c093253y ago

Upload vocab_token.json

miesepeter

4bdfdd43y ago

Rename vocab_token.json to vocab_dict.json

miesepeter

f3874773y ago

Rename vocab_dict.json to vocab_token.json

miesepeter

23291f53y ago

Upload vocab_dict.json

miesepeter

49db5a93y ago

Delete vocab_token.json

miesepeter

3c308c23y ago

Upload functionality_token.json

miesepeter

a65fee83y ago

Upload vocab_token.json

miesepeter

9a57ef83y ago

initial commit

miesepeter