datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Wikipedia_contradict_benchmark
Wikipedia contradict benchmark
Wikipedia contradict benchmark is a dataset consisting of 253 high-quality, human-annotated instances designed to assess LLM performance when augmented with retrieved passages containing real-world knowledge conflicts. The dataset was created intentionally with that task in mind, focusing on a benchmark consisting of high-quality, human-annotated instances.
Dataset Details
Dataset Description… See the full description on the dataset page: https://huggingface.co/datasets/ibm-research/Wikipedia_contradict_benchmark.Wikipedia-Articles
Dataset Card for "BrightData/Wikipedia-Articles"
Dataset Summary
Explore a collection of millions of Wikipedia articles with the Wikipedia dataset, comprising over 1.23M structured records and 10 data fields updated and refreshed regularly.
Each entry includes all major data points such as timestamp, URLs, article titles, raw and cataloged text, images, "see also" references, external links, and a structured table of contents.
For a complete list of data points, please… See the full description on the dataset page: https://huggingface.co/datasets/BrightData/Wikipedia-Articles.en_wikipedia_001
Dataset Card for en_wikipedia_001
The en_wikipedia_001 dataset is a collection of crawled paragraph text from Wikipedia on the 28th of April, 2024. It contains high-quality text, stored in multiple documents, available to be used to finetune or train AI models based that the license is followed.
Dataset Details
The dataset was crawled using our web crawler on the 28th of April at an average of 1 page per second as to respect robots.txt rules. Strict licensing must be… See the full description on the dataset page: https://huggingface.co/datasets/orionai/en_wikipedia_001.wikipedia-id-qna
Wikipedia ID Synthetic QnA
This dataset contains synthetic question-answer pairs (QnA) generated using DeepSeek from Indonesian Wikipedia articles. The data has been sourced from this Wikipedia dataset, which contains a subset of Indonesian Wikipedia articles. Each entry includes a context, a related question and answer pair, and an unrelated question.
Dataset Structure
The dataset contains the following columns:
id: A unique identifier for each row.
context: A… See the full description on the dataset page: https://huggingface.co/datasets/vitoghif/wikipedia-id-qna.20k_wikipedia_title_prompts
Wikipedia Prompts
Created by combining a gpt-4o-mini request from a Wikipedia's API function, this generated a short 75 word prompt. Along with the title from the randomly generated article.
This current version has not been cleaned or pruned, so minor error in formating might exist, as well as duplications. Further versions will be numbered to show their improved
formating.
import requests
import random
import csv
import time
from openai import OpenAI
from datetime import… See the full description on the dataset page: https://huggingface.co/datasets/080-ai/20k_wikipedia_title_prompts.