Datasetpublic

AIMClab-RUC/PhD-webdataset

PhD Webdataset This repository contains the packaged version of PhD. For a detailed introduction to PhD, please visit the official website. Overview The PhD Webdataset is designed to facilitate easy access and usage of the PhD dataset. It includes various fields in 'json' key. The data in this repo is totally the same as in PhD. Installation Ensure you have Hugging Face's datasets library installed. You can install it via pip: pip install datasets… See the full description on the dataset page: https://huggingface.co/datasets/AIMClab-RUC/PhD-webdataset.

sourceHugging Faceupdated 1y agoView on Hugging Face

0likes40downloads

Dataset Card

PhD Webdataset

This repository contains the packaged version of **PhD**. For a detailed introduction to PhD, please visit the official website.

Overview

The PhD Webdataset is designed to facilitate easy access and usage of the PhD dataset. It includes various fields in 'json' key. The data in this repo is totally the same as in **PhD**.

Installation

Ensure you have Hugging Face's datasets library installed. You can install it via pip:

bash

pip install datasets

Usage

To load and use the PhD dataset, simply run the following code:

python

from datasets import load_dataset

phd = load_dataset("AIMClab-RUC/PhD-package")['phd_base']  # options include (phd_base, phd_sec, phd_icc, phd_ccs)

# see phd[0]['json']['question']

The loaded dataset includes the following fields:

—question_id
—question
—answer
—image
—task
—mode