recursal/SuperWikiNEXT-32B

Dataset Card for SuperWikiNEXT-32B Waifu to catch your attention. Dataset Details Dataset Description SuperWikipedia-NEXT is an enhanced version of the SuperWIKI dataset. Which SuperWIKI was born out of the thought of a better filtered Wikipedia while retaining markdowns. SuperWikipedia-NEXT contains ~32.44B Tokens (llama-2-7b-chat-tokenizer) / ~27.92B Tokens (RWKV Tokenizer) from approximately 60 "High quality" / "Selected" languages. Curated… See the full description on the dataset page: https://huggingface.co/datasets/recursal/SuperWikiNEXT-32B.