datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
ChatML-WebGLM-QATHUDM/webglm-qa in ChatML format.
Python code used for conversion:
from datasets import load_dataset
import pandas
import re
import random
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained(
pretrained_model_name_or_path="Felladrin/Llama-160M-Chat-v1"
)
dataset = load_dataset("THUDM/webglm-qa", split="train")
def format(columns):
references = "\n".join(
[
f"- {columns['references'][i].strip()}"
for i in… See the full description on the dataset page: https://huggingface.co/datasets/Felladrin/ChatML-WebGLM-QA.THUDM__webglm-qa-test-raftwebglm-qa
Dataset Card for "webglm-qa"
More Information needed
webglm_vi
Dataset Card for "webglm_vi"
More Information needed
THUDM__webglm-qa-train-raft-3THUDM__webglm-qa-train-raftTHUDM__webglm-qa-train-raft-2