recursal/SuperWiki-Tiny

Dataset Card for SuperWiki-Tiny

Waifu to catch your attention.

Dataset Details

Dataset Description

SuperWiki-Tiny is a english only subset of the SuperWikipedia-NEXT (SuperWikiNEXT-32B)

• —Curated by: KaraKaraWitch
• —Funded by: Recursal.ai (I work there lol)
• —Shared by: KaraKaraWitch
• —Language(s) (NLP): English Only.
• —License: cc-by-sa-4.0,

Dataset Sources

<!-- Provide the basic links for the dataset. -->

• —Source Data: https://dumps.wikimedia.org/other/enterprise_html/

Dataset Summary

Refer to the original dataset for more details. All of it applies except the formatting and the language selection. Additionally, only articles which character length exceeds > 2048 characters are included.

Data keys

Users can run less to see the contents. A sample and a list of dictionary keys have been provided below:

{
    "text": "\n**Tharman Shanmugaratnam** PBM (born 25 February 1957) is a Singaporean politician and economist. He is the President of Singapore since 2023. \n\nHe was Senior Minister of Singapore between 2019 and 2023.<...TRUNCATED IN SAMPLE>",
}

text: str (Markdown text)

Changelog

• —13 Jan 13:00 GMT
• —Inital Release
• —15 Jan 10:11 GMT
• —Replaced revision due to long context spam. Someone uploaded an article that is super long but is repeated words... Something to do with... Um... Jews and Niggers. Since those are clearly spam and not really nice, it's removed.

Dataset Curators

KaraKaraWitch. (I now mainly hangout in ~~PygmalionAI~~ EleutherAI discord. If something is wrong, @karakarawitch on discord.)

I'd be happy if you could spread the word and recommend this dataset over wikitext for your use cases :)

Licensing Information

Most of Wikipedia's text and many of its images are co-licensed under the Creative Commons Attribution-ShareAlike 3.0 Unported License (CC BY-SA) and the GNU Free Documentation License (GFDL) (un-versioned, with no invariant sections, front-cover texts, or back-cover texts).

Some text has been imported only under CC BY-SA and CC BY-SA-compatible license and cannot be reused under GFDL; such text will be identified on the page footer, in the page history, or on the discussion page of the article that utilizes the text.

Recursal Waifus (The banner image) are licensed under CC-BY-SA. They do not represent the related websites in any official capacity unless otherwise or announced by the website. You may use them as a banner image. However, you must always link back to the dataset.