aborasheed/Multilingual-Core-Vocabulary

Multilingual Core Vocabulary 🌍 This dataset contains millions of frequency-sorted, highly accurate words across 19 languages. It is designed to be the ultimate resource for building cross-lingual applications, AI similarity agents, and translation models. Dataset Structure This repository contains two variations of the dataset: Massive_Dataset: Contains over 6 million words. The words were extracted and frequency-sorted from FastText, cleaned from internet noise… See the full description on the dataset page: https://huggingface.co/datasets/aborasheed/Multilingual-Core-Vocabulary.