datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
policy-alignment-verification-dataset
Policy Alignment Verification Dataset
🌐 NAVI's Ecosystem 🌐
🌍 NAVI Platform – Dive into NAVI's full capabilities and explore how it ensures policy alignment and compliance.
🤗 NAVI-small-preview – Access the open-weights version of NAVI designed for policy verification.
📜 API Docs – Your starting point for integrating NAVI into your applications.
📝 Blogpost: Policy-Driven Safeguards Comparison – A deep dive into the challenges and solutions NAVI addresses.
✨… See the full description on the dataset page: https://huggingface.co/datasets/nace-ai/policy-alignment-verification-dataset.Open-Web-Math
Keiran Paster*, Marco Dos Santos*, Zhangir Azerbayev, Jimmy Ba
GitHub | ArXiv
| PDF
OpenWebMath is a dataset containing the majority of the high-quality, mathematical text from the internet. It is filtered and extracted from over 200B HTML files on Common Crawl down to a set of 6.3 million documents containing a total of 14.7B tokens. OpenWebMath is intended for use in pretraining and finetuning large language models.
You can download the dataset using Hugging Face:
from datasets import… See the full description on the dataset page: https://huggingface.co/datasets/Alignment-Lab-AI/Open-Web-Math.oig-fixedformatted-ttest-datasetLmSys-pref-ft-splitlibrispeech-codec-22khzStack-Exchange-Aprilriddler-sharegptStackStoreMaverick-sharegpt-3mEverythingIsAllYouNeed0.25Flan-Trainorcamath-sharegptmnist-shaped-datasetfr-benchCodeInterpreterData-sharegptwikisplit-2048chatml-rpSharegpt-sodasequentializes-evol-instructarc-agi-2-clean-augmenteddoghotdog-gptRPGuild-sharegpt-filteredwildchat-sharegptevoltext8192Fashion-decayhermes-pretrain-llama-3bytepair-lookup-slidingspcorrect