Datasetpublicgated

hiimivantang-org/chunked-enwiki-ns0-20250301-enterprise-html

20250301.jsonl contains preprocessed text chunks from the wikipedia 20250301 html dump. dead_letter_queue.jsonl contains articles that couldn't be processed due to formatitng or missing tags. en_redirection_map.pkl can be deserialize to avoid building redirection_map everytime preprocessing_wikipedia_html_dump runs.

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes1downloads

root

file.gitattributes2 KBdownload

file20250301.jsonl38.25 GBdownload

filedead_letter_queue.jsonl63 KBdownload

fileen_redirection_map.pkl478.8 MBdownload

fileREADME.md329 Bdownload

hiimivantang-org/chunked-enwiki-ns0-20250301-enterprise-html · main · files are served by the source, never re-hosted here

This repository is gated. The listing is public, but downloading a file means accepting the publisher’s terms at Hugging Face first — the links above take you there rather than around it.