datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
financial-news-multisource
Multi-Source Financial & General News
🚀 57.1 MILLION ROWS OF NEWS CONTENT — one unified corpus for market-aware AI/ML
I combined 24 public news datasets (many small on their own) into one consistent, ready-to-use layer so you don’t have to wrangle them yourself. Everything is normalized to a minimal schema (date, text, extra_fields) and shipped as Parquet shards per subset—streamable, DuckDB-friendly, and built with a trading date policy (this can be edited if folks see other… See the full description on the dataset page: https://huggingface.co/datasets/idleengine/financial-news-multisource.financial-news-multisource
Multi-Source Financial & General News
🚀 57.1 MILLION ROWS OF NEWS CONTENT — one unified corpus for market-aware AI/ML
I combined 24 public news datasets (many small on their own) into one consistent, ready-to-use layer so you don’t have to wrangle them yourself. Everything is normalized to a minimal schema (date, text, extra_fields) and shipped as Parquet shards per subset—streamable, DuckDB-friendly, and built with a trading date policy (this can be edited if folks see other use… See the full description on the dataset page: https://huggingface.co/datasets/Brianferrell787/financial-news-multisource.multisource_textiran_cpi_and_inflation_multisource
شاخص بهای مصرفکننده و تورم ایران (چندمرجعی)
سریهای رسمیِ شاخص قیمت مصرفکننده (CPI) و نرخ تورم ایران از دو مرجعِ رسمی: مرکز آمار
ایران (ماهانه) و بانک مرکزی (سالانه، سریِ تاریخیِ بلند). هر مرجع سریِ مستقلِ خود را دارد و در
کنارشان یک نمای یکپارچه ارائه میشود.
پوشش: بانک مرکزی سالانه ۱۳۱۵–۱۴۰۱ · مرکز آمار ماهانه ۱۳۹۰–۱۴۰۵
سطح: ملی · واحد: شاخص و درصد
شاخصها
شاخص
مرجع
تناوب
شاخص قیمت مصرفکننده
مرکز آمار (پایهٔ ۱۴۰۰) · بانک مرکزی (پایهٔ ۱۳۹۵)… See the full description on the dataset page: https://huggingface.co/datasets/Farmaanaa/iran_cpi_and_inflation_multisource.pii-detection-multisource-en-saudi-arabic
PII Detection Multisource EN + Saudi/Arabic
284,619 English examples. 2,088,335 labelled spans. 31 entity types. One label space.
Four public PII datasets, merged into a single schema, plus Saudi and Arabic
coverage that none of them had, plus material for two failure modes that matter
when you run redaction in production.
Built for OnKith, a privacy first voice assistant that
transcribes speech and strips personal information on the device itself, before
anything is allowed to… See the full description on the dataset page: https://huggingface.co/datasets/KhalidAlharbi377/pii-detection-multisource-en-saudi-arabic.code-multi-line-infilling-benchmark
Dataset Summary
This dataset is used to evaluate Multi-Line fill in the middle code completion capabilities of a system.
The dataset is derived from SWE-Bench dataset.
Evaluation is performed by stiching the generated middle portion, with the other patch and passing into the SWE Evaluation harness, which runs unit test verification and calculate Pass@1.
Data Instances
In addition to the fields already calculated by SWE-Bench dataset, this dataset contains five… See the full description on the dataset page: https://huggingface.co/datasets/sourcegraph/code-multi-line-infilling-benchmark.ko-multisource-retrieval-dataset
구성
여러 공개 출처를 하나의 스키마로 통합한 한국어 query–passage 페어 데이터셋입니다.
stage1, stage2 두 subset. 각각 train 100,000 / valid 10,000행 (총 220,000행, parquet, 151MB)
필드
설명
dataset
원 출처 식별자 (18종)
query
질의문 (2~2,020자)
passage
대응 문서 (10~2,050자)
출처
AI 허브 — 기계독해 지식검색 일반상식 도서자료 행정문서 뉴스기사 금융법률 숫자연산 표정보 추상요약 이벤트 (AI허브_ 접두사)
KLUE — klue-mrc klue-nli klue-sts
기타 — kakao-nli 공공데이터포털-deepqa LGNLP
참고
출처별로 페어 성격이 다르므로 용도에 맞게 필터링을 권장합니다.
klue-nli klue-sts… See the full description on the dataset page: https://huggingface.co/datasets/FronyAI/ko-multisource-retrieval-dataset.crux-mds-multi_news-sourcemultisource_tok_nobookbuzz_sources_033_processed_unified_multi_newshigh_quality_data_10k_multisourcesummarization_wikilingua_multisource_chatgpt_segmentationflan_source_task611_mutual_multi_turn_dialogue_291flan_source_race_middle_Write_a_multi_choice_question_for_the_following_article_115llm_rag_picto_multisource_180kllm_rag_picto_multisource_350kflan_source_race_high_Write_a_multi_choice_question_options_given__67flan_source_race_high_Write_a_multi_choice_question_for_the_following_article_72flan_source_race_middle_Write_a_multi_choice_question_options_given__116