datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
trivia-qa-kg-processedTriviaQA-rc.nocontext__meta-llama_Llama-3.1-8B-Instruct
TriviaQA-rc.nocontext__meta-llama_Llama-3.1-8B-Instruct
Cached QA + hidden states dataset.
Per sample:
question
gold_answers
model_answer
label (0=FAITHFUL, 1=HALLUCINATED) from Qwen/Qwen2.5-14B-Instruct
tensor_file -> path to torch.HalfTensor [num_layers, hidden_size]
= mean over generated answer tokens per layer
layers, hidden_size
Subdirs:
train/samples_manifest.jsonl
train/tensors/*.pt
validation/samples_manifest.jsonl
validation/tensors/*.pt
NOTE: tensors/*.pt can be huge.… See the full description on the dataset page: https://huggingface.co/datasets/Cygnuss/TriviaQA-rc.nocontext__meta-llama_Llama-3.1-8B-Instruct.TIP-TriviaQA