datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
cricket-commentary-ball-datacricket-wiki
cricket-wiki
# data preparation steps
pip install wikiextractor
wget -c https://dumps.wikimedia.org/enwiki/latest/enwiki-latest-pages-articles-multistream.xml.bz2
# extract files using wikiextractor (take a few hours)
python3 -m wikiextractor.WikiExtractor enwiki-latest-pages-articles-multistream.xml.bz2 --json
# get cricket records in a separate file
# take a few minutes
grep -i cricket text/*/* > cricket.jsonl
cricketcricket-commons-state