ananddey/asm-corpus
AsmCorpus — Assamese Pretraining Dataset The largest open monolingual Assamese corpus for LLM pretraining. Documents: 2.37M Characters: 11B GPT-2 tokens: ~3.7B | Gemma 4 E2B tokens: ~5.8B Format: Parquet (text column only) License: ODC-By 1.0 Usage from datasets import load_dataset ds = load_dataset("ananddey/asm-corpus", split="train", streaming=True) for doc in ds: print(doc["text"]) How It Was Built All documents passed through language… See the full description on the dataset page: https://huggingface.co/datasets/ananddey/asm-corpus.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face