datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
gemma_psychometrics_personas_responses
Model Usage
This dataset includes model-generated responses conditioned on psychometric personas.
Responses are generated using personas from the thoughtworks/psychometric_personas dataset (restricted split) and evaluated on prompts from the walledai/advbench dataset.
Model Details
Base Model: google/gemma-3-4b-it
Inference Setup: Standard causal language model generation using vLLM
Conditioning Mechanism: Persona-conditioned prompting
Prompting Strategy… See the full description on the dataset page: https://huggingface.co/datasets/thoughtworks/gemma_psychometrics_personas_responses.psychometric_sjts_analysis
📘 Dataset Card: Synthetic SJTs for Psychometric & Contextual Variations
Dataset Summary
This dataset is a large-scale synthetic collection of Situational Judgment Tests (SJTs) designed to evaluate behavioral tendencies and psychometric traits under controlled variations.
The dataset contains 4,000 SJTs generated from 20 base scenarios, with systematic perturbations introduced across multiple contextual and demographic attributes. Each SJT is constructed using the HEXACO… See the full description on the dataset page: https://huggingface.co/datasets/thoughtworks/psychometric_sjts_analysis.ablation_psychometrics_personaspsychometric_SJTs
📘 Dataset Card: Synthetic SJTs for Psychometric & Contextual Variations
Dataset Summary
This dataset is a large-scale synthetic collection of Situational Judgment Tests (SJTs) designed to evaluate behavioral tendencies and psychometric traits under controlled variations.
The dataset contains 4,000 SJTs generated from 20 base scenarios, with systematic perturbations introduced across multiple contextual and demographic attributes. Each SJT is constructed using the HEXACO… See the full description on the dataset page: https://huggingface.co/datasets/thoughtworks/psychometric_SJTs.gsm8k_reliability_subset_1gsm8k_reliability_subset_9gsm8k_full_subsetgsm8k_reliability_subset_5gsm8k_core_subsetgsm8k_extended_subsetgsm8k_reliability_subset_4gsm8k_pilot_subsetgsm8k_reliability_subset_2gsm8k_reliability_subset_10gsm8k_reliability_subset_3gsm8k_reliability_subset_6gsm8k_reliability_subset_7gsm8k_reliability_subset_8