Datasetpublic

joelniklaus/mc4_legal

Dataset Card for MC4_Legal: A Corpus Covering the Legal Part of MC4 for European Languages Dataset Summary This dataset contains large text resources (~133GB in total) from mc4 filtered for legal data that can be used for pretraining language models. Use the dataset like this: from datasets import load_dataset dataset = load_dataset("joelito/mc4_legal", "de", split='train', streaming=True) Supported Tasks and Leaderboards The dataset supports the… See the full description on the dataset page: https://huggingface.co/datasets/joelniklaus/mc4_legal.

sourceHugging Facecc-by-4.0updated 4y agoView on Hugging Face

7likes413downloads

13 commits on main

e214dad4y ago

Edited statistics. (#3)

Joelito, kapllan

20166824y ago

improved dataset card

joelniklaus

13d54f14y ago

fixed bug in data loader for de, en, and es

joelniklaus

fd5d2044y ago

tried removing more code from hu.jsonl.xz to pass malware scanner on huggingface hub

joelniklaus

27f92dc4y ago

tried removing bad stuff from hu.jsonl.xz to pass malware scanner on huggingface hub

joelniklaus

109575c4y ago

added more information to dataset card

joelniklaus

03be7fd4y ago

added more information to dataset card

joelniklaus

2ae28464y ago

fixed bug

joelniklaus

34699da4y ago

fixed bug

joelniklaus

c7a96824y ago

fixed bug

joelniklaus

72ffc944y ago

fixed bug

joelniklaus

4deba174y ago

first version of mc4_legal dataset

joelniklaus

da7bf554y ago

initial commit

joelniklaus