duarteocarmo/fineweb2-bagaco
Bagaço 🍷🇵🇹 Bagaço is a pretraining dataset for European Portuguese. It filters the Fineweb2 dataset to URLs from Portuguese domains (e.g., .pt/). Each document is classified into one of 9 categories and scored for educational quality. Filtering Source: HuggingFaceFW/fineweb-2, subset por_Latn, split train Filter: URLs containing .pt/ (Portuguese top-level domain) Document classification Each document is classified into one of 9 categories:… See the full description on the dataset page: https://huggingface.co/datasets/duarteocarmo/fineweb2-bagaco.
update
update
update
notebook
update
update
update
Add files using upload-large-folder tool
Add files using upload-large-folder tool
Add files using upload-large-folder tool
update
readme
update scripts for procdessing
edu datasets
Upload fineweb2_edu_classification_sample.parquet
remove edu classification sample from git tracking
Upload reference/fineweb2_edu_classification_sample.parquet with huggingface_hub
remove edu classification sample from repo
re-add edu classification sample via xet
remove edu classification sample for xet re-upload
update
Update README.md
rename full dataset config to 'all' to avoid conflict with HF default config name
update
update
update
update
update
update
add scripts
add scripts
Add files using upload-large-folder tool
Add files using upload-large-folder tool
Add files using upload-large-folder tool
Upload fineweb2_classification_sample.parquet
Add files using upload-large-folder tool
Add files using upload-large-folder tool
Add files using upload-large-folder tool
Add files using upload-large-folder tool
Add files using upload-large-folder tool
Add files using upload-large-folder tool
Add files using upload-large-folder tool
initial commit