TempestTeam/dataset-tokenizer
Dataset-Tokenizer This dataset is designed for training models to classify both textual and code data. It provides a diverse collection of natural language and code samples, aimed at tasks such as natural language processing (NLP) and code understanding. The dataset supports three natural languages (English, French, Spanish) and five programming languages (Python, Java, JavaScript, C++, C). Languages and Sources Natural Languages (80%): English (34%) French… See the full description on the dataset page: https://huggingface.co/datasets/TempestTeam/dataset-tokenizer.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face