datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
FoR-T2I
Can Text-to-Image Models Draw from the Right Frame of Reference?
Left is not always image-left. If a person is facing the viewer, their left hand appears on the right side of the image. A text-to-image model can therefore render a plausible scene with the requested objects while still drawing the spatial relation from the wrong perspective.
FoR-T2I is the official benchmark release for Can Text-to-Image Models Draw from the Right Frame of Reference?. It… See the full description on the dataset page: https://huggingface.co/datasets/ernie-research/FoR-T2I.MEnvData-SWE-Trajectory
MEnvData-SWE-Trajectory: Agent Execution Trajectories for Software Engineering
📋 Dataset Description
MEnvData-SWE-Trajectory extends MEnvData-SWE with 3,872 complete agent execution trajectories across 3,005 task instances from 942 repositories in 10 programming languages. These trajectories capture the full problem-solving process of an AI agent tackling real-world software engineering issues.
Key Features
🤖 3,872 Agent Trajectories:… See the full description on the dataset page: https://huggingface.co/datasets/ernie-research/MEnvData-SWE-Trajectory.ConvAI2-ERNIE-original-Qwen3.5-35B-A3B
Visual Memory Results: convai2-ernie-original
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "Qwen/Qwen3.5-35B-A3B",
"hf_results_repo": "visual-memory/ConvAI2-ERNIE-original-Qwen3.5-35B-A3B",
"results_jsonl": "results/ConvAI2-ERNIE-original-Qwen3.5-35B-A3B.jsonl",
"hf_dataset": "visual-memory/ConvAI2-With-Ids_1k-no-redundancy",
"hf_mapping_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/ConvAI2-ERNIE-original-Qwen3.5-35B-A3B.ConvAI2-ERNIE-original-gemma-4-26B-A4B-it
Visual Memory Results: convai2-ernie-original
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-26B-A4B-it",
"hf_results_repo": "visual-memory/ConvAI2-ERNIE-original-gemma-4-26B-A4B-it",
"results_jsonl": "results/ConvAI2-ERNIE-original-gemma-4-26B-A4B-it.jsonl",
"hf_dataset": "visual-memory/ConvAI2-With-Ids_1k-no-redundancy"… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/ConvAI2-ERNIE-original-gemma-4-26B-A4B-it.ConvAI2-ERNIE-enhanced-Qwen3.5-35B-A3B
Visual Memory Results: convai2-ernie-enhanced
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "Qwen/Qwen3.5-35B-A3B",
"hf_results_repo": "visual-memory/ConvAI2-ERNIE-enhanced-Qwen3.5-35B-A3B",
"results_jsonl": "results/ConvAI2-ERNIE-enhanced-Qwen3.5-35B-A3B.jsonl",
"hf_dataset": "visual-memory/ConvAI2-With-Ids_1k-no-redundancy",
"hf_mapping_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/ConvAI2-ERNIE-enhanced-Qwen3.5-35B-A3B.ConvAI2-ERNIE-enhanced-gemma-4-26B-A4B-it
Visual Memory Results: convai2-ernie-enhanced
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-26B-A4B-it",
"hf_results_repo": "visual-memory/ConvAI2-ERNIE-enhanced-gemma-4-26B-A4B-it",
"results_jsonl": "results/ConvAI2-ERNIE-enhanced-gemma-4-26B-A4B-it.jsonl",
"hf_dataset": "visual-memory/ConvAI2-With-Ids_1k-no-redundancy"… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/ConvAI2-ERNIE-enhanced-gemma-4-26B-A4B-it.Synthetic-Persona-Chat-ERNIE-enhanced-gemma-4-31B-it
Visual Memory Results: synthetic-persona-chat-ernie-enhanced
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-31B-it",
"hf_results_repo": "visual-memory/Synthetic-Persona-Chat-ERNIE-enhanced-gemma-4-31B-it",
"results_jsonl": "results/Synthetic-Persona-Chat-ERNIE-enhanced-gemma-4-31B-it.jsonl",
"hf_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/Synthetic-Persona-Chat-ERNIE-enhanced-gemma-4-31B-it.Synthetic-Persona-Chat-ERNIE-original-gemma-4-31B-it
Visual Memory Results: synthetic-persona-chat-ernie-original
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-31B-it",
"hf_results_repo": "visual-memory/Synthetic-Persona-Chat-ERNIE-original-gemma-4-31B-it",
"results_jsonl": "results/Synthetic-Persona-Chat-ERNIE-original-gemma-4-31B-it.jsonl",
"hf_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/Synthetic-Persona-Chat-ERNIE-original-gemma-4-31B-it.PersonaChat-ERNIE-enhanced-Qwen3.5-35B-A3B
Visual Memory Results: personachat-ernie-enhanced
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "Qwen/Qwen3.5-35B-A3B",
"hf_results_repo": "visual-memory/PersonaChat-ERNIE-enhanced-Qwen3.5-35B-A3B",
"results_jsonl": "results/PersonaChat-ERNIE-enhanced-Qwen3.5-35B-A3B.jsonl",
"hf_dataset": "visual-memory/PersonaChat-With-Ids_1k-no-redundancy"… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/PersonaChat-ERNIE-enhanced-Qwen3.5-35B-A3B.ConvAI2-ERNIE-enhanced-gemma-4-E4B-it
Visual Memory Results: convai2-ernie-enhanced
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-E4B-it",
"hf_results_repo": "visual-memory/ConvAI2-ERNIE-enhanced-gemma-4-E4B-it",
"results_jsonl": "results/ConvAI2-ERNIE-enhanced-gemma-4-E4B-it.jsonl",
"hf_dataset": "visual-memory/ConvAI2-With-Ids_1k-no-redundancy",
"hf_mapping_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/ConvAI2-ERNIE-enhanced-gemma-4-E4B-it.Synthetic-Persona-Chat-ERNIE-original-gemma-4-12B-it
Visual Memory Results: synthetic-persona-chat-ernie-original
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-12B-it",
"hf_results_repo": "visual-memory/Synthetic-Persona-Chat-ERNIE-original-gemma-4-12B-it",
"results_jsonl": "results/Synthetic-Persona-Chat-ERNIE-original-gemma-4-12B-it.jsonl",
"hf_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/Synthetic-Persona-Chat-ERNIE-original-gemma-4-12B-it.PersonaChat-ERNIE-original-gemma-4-12B-it
Visual Memory Results: personachat-ernie-original
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-12B-it",
"hf_results_repo": "visual-memory/PersonaChat-ERNIE-original-gemma-4-12B-it",
"results_jsonl": "results/PersonaChat-ERNIE-original-gemma-4-12B-it.jsonl",
"hf_dataset": "visual-memory/PersonaChat-With-Ids_1k-no-redundancy"… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/PersonaChat-ERNIE-original-gemma-4-12B-it.ConvAI2-ERNIE-original-gemma-4-E4B-it
Visual Memory Results: convai2-ernie-original
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-E4B-it",
"hf_results_repo": "visual-memory/ConvAI2-ERNIE-original-gemma-4-E4B-it",
"results_jsonl": "results/ConvAI2-ERNIE-original-gemma-4-E4B-it.jsonl",
"hf_dataset": "visual-memory/ConvAI2-With-Ids_1k-no-redundancy",
"hf_mapping_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/ConvAI2-ERNIE-original-gemma-4-E4B-it.ConvAI2-ERNIE-original-Qwen3.5-27B
Visual Memory Results: convai2-ernie-original
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "Qwen/Qwen3.5-27B",
"hf_results_repo": "visual-memory/ConvAI2-ERNIE-original-Qwen3.5-27B",
"results_jsonl": "results/ConvAI2-ERNIE-original-Qwen3.5-27B.jsonl",
"hf_dataset": "visual-memory/ConvAI2-With-Ids_1k-no-redundancy",
"hf_mapping_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/ConvAI2-ERNIE-original-Qwen3.5-27B.Synthetic-Persona-Chat-ERNIE-enhanced-gemma-4-12B-it
Visual Memory Results: synthetic-persona-chat-ernie-enhanced
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-12B-it",
"hf_results_repo": "visual-memory/Synthetic-Persona-Chat-ERNIE-enhanced-gemma-4-12B-it",
"results_jsonl": "results/Synthetic-Persona-Chat-ERNIE-enhanced-gemma-4-12B-it.jsonl",
"hf_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/Synthetic-Persona-Chat-ERNIE-enhanced-gemma-4-12B-it.MEnvBench
MEnvBench: Multi-Language Environment Construction Benchmark
📋 Dataset Description
MEnvBench is a comprehensive benchmark for evaluating multi-language environment building and test execution capabilities, comprising 1,000 task instances (10 languages × 20 repositories × 5 instances) selected from 200 high-quality open-source repositories.
Key Features
🌐 Multi-Language Coverage: 10 programming languages (Python, Java, TypeScript… See the full description on the dataset page: https://huggingface.co/datasets/ernie-research/MEnvBench.Synthetic-Persona-Chat-ERNIE-enhanced-Qwen3.5-2B
Visual Memory Results: synthetic-persona-chat-ernie-enhanced
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "Qwen/Qwen3.5-2B",
"hf_results_repo": "visual-memory/Synthetic-Persona-Chat-ERNIE-enhanced-Qwen3.5-2B",
"results_jsonl": "results/Synthetic-Persona-Chat-ERNIE-enhanced-Qwen3.5-2B.jsonl",
"hf_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/Synthetic-Persona-Chat-ERNIE-enhanced-Qwen3.5-2B.Synthetic-Persona-Chat-ERNIE-original-Qwen3.5-4B
Visual Memory Results: synthetic-persona-chat-ernie-original
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "Qwen/Qwen3.5-4B",
"hf_results_repo": "visual-memory/Synthetic-Persona-Chat-ERNIE-original-Qwen3.5-4B",
"results_jsonl": "results/Synthetic-Persona-Chat-ERNIE-original-Qwen3.5-4B.jsonl",
"hf_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/Synthetic-Persona-Chat-ERNIE-original-Qwen3.5-4B.Synthetic-Persona-Chat-ERNIE-enhanced-Qwen3.5-4B
Visual Memory Results: synthetic-persona-chat-ernie-enhanced
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "Qwen/Qwen3.5-4B",
"hf_results_repo": "visual-memory/Synthetic-Persona-Chat-ERNIE-enhanced-Qwen3.5-4B",
"results_jsonl": "results/Synthetic-Persona-Chat-ERNIE-enhanced-Qwen3.5-4B.jsonl",
"hf_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/Synthetic-Persona-Chat-ERNIE-enhanced-Qwen3.5-4B.ConvAI2-ERNIE-enhanced-Qwen3.8-27B
Visual Memory Results: convai2-ernie-enhanced
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "Qwen/Qwen3.8-27B",
"hf_results_repo": "visual-memory/ConvAI2-ERNIE-enhanced-Qwen3.8-27B",
"results_jsonl": "results/ConvAI2-ERNIE-enhanced-Qwen3.8-27B.jsonl",
"hf_dataset": "visual-memory/ConvAI2-With-Ids_1k-no-redundancy",
"hf_mapping_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/ConvAI2-ERNIE-enhanced-Qwen3.8-27B.PersonaChat-ERNIE-original-Qwen3.5-35B-A3B
Visual Memory Results: personachat-ernie-original
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "Qwen/Qwen3.5-35B-A3B",
"hf_results_repo": "visual-memory/PersonaChat-ERNIE-original-Qwen3.5-35B-A3B",
"results_jsonl": "results/PersonaChat-ERNIE-original-Qwen3.5-35B-A3B.jsonl",
"hf_dataset": "visual-memory/PersonaChat-With-Ids_1k-no-redundancy"… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/PersonaChat-ERNIE-original-Qwen3.5-35B-A3B.PersonaChat-ERNIE-original-gemma-4-E4B-it
Visual Memory Results: personachat-ernie-original
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-E4B-it",
"hf_results_repo": "visual-memory/PersonaChat-ERNIE-original-gemma-4-E4B-it",
"results_jsonl": "results/PersonaChat-ERNIE-original-gemma-4-E4B-it.jsonl",
"hf_dataset": "visual-memory/PersonaChat-With-Ids_1k-no-redundancy"… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/PersonaChat-ERNIE-original-gemma-4-E4B-it.PersonaChat-ERNIE-enhanced-gemma-4-12B-it
Visual Memory Results: personachat-ernie-enhanced
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-12B-it",
"hf_results_repo": "visual-memory/PersonaChat-ERNIE-enhanced-gemma-4-12B-it",
"results_jsonl": "results/PersonaChat-ERNIE-enhanced-gemma-4-12B-it.jsonl",
"hf_dataset": "visual-memory/PersonaChat-With-Ids_1k-no-redundancy"… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/PersonaChat-ERNIE-enhanced-gemma-4-12B-it.ConvAI2-ERNIE-original-gemma-4-12B-it
Visual Memory Results: convai2-ernie-original
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-12B-it",
"hf_results_repo": "visual-memory/ConvAI2-ERNIE-original-gemma-4-12B-it",
"results_jsonl": "results/ConvAI2-ERNIE-original-gemma-4-12B-it.jsonl",
"hf_dataset": "visual-memory/ConvAI2-With-Ids_1k-no-redundancy",
"hf_mapping_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/ConvAI2-ERNIE-original-gemma-4-12B-it.Synthetic-Persona-Chat-ERNIE-original-gemma-4-E4B-it
Visual Memory Results: synthetic-persona-chat-ernie-original
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-E4B-it",
"hf_results_repo": "visual-memory/Synthetic-Persona-Chat-ERNIE-original-gemma-4-E4B-it",
"results_jsonl": "results/Synthetic-Persona-Chat-ERNIE-original-gemma-4-E4B-it.jsonl",
"hf_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/Synthetic-Persona-Chat-ERNIE-original-gemma-4-E4B-it.Synthetic-Persona-Chat-ERNIE-enhanced-gemma-4-E4B-it
Visual Memory Results: synthetic-persona-chat-ernie-enhanced
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-E4B-it",
"hf_results_repo": "visual-memory/Synthetic-Persona-Chat-ERNIE-enhanced-gemma-4-E4B-it",
"results_jsonl": "results/Synthetic-Persona-Chat-ERNIE-enhanced-gemma-4-E4B-it.jsonl",
"hf_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/Synthetic-Persona-Chat-ERNIE-enhanced-gemma-4-E4B-it.Synthetic-Persona-Chat-ERNIE-original-Qwen3.5-9B
Visual Memory Results: synthetic-persona-chat-ernie-original
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "Qwen/Qwen3.5-9B",
"hf_results_repo": "visual-memory/Synthetic-Persona-Chat-ERNIE-original-Qwen3.5-9B",
"results_jsonl": "results/Synthetic-Persona-Chat-ERNIE-original-Qwen3.5-9B.jsonl",
"hf_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/Synthetic-Persona-Chat-ERNIE-original-Qwen3.5-9B.ConvAI2-ERNIE-enhanced-Qwen3.5-27B
Visual Memory Results: convai2-ernie-enhanced
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "Qwen/Qwen3.5-27B",
"hf_results_repo": "visual-memory/ConvAI2-ERNIE-enhanced-Qwen3.5-27B",
"results_jsonl": "results/ConvAI2-ERNIE-enhanced-Qwen3.5-27B.jsonl",
"hf_dataset": "visual-memory/ConvAI2-With-Ids_1k-no-redundancy",
"hf_mapping_dataset":… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/ConvAI2-ERNIE-enhanced-Qwen3.5-27B.PersonaChat-ERNIE-original-gemma-4-26B-A4B-it
Visual Memory Results: personachat-ernie-original
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-26B-A4B-it",
"hf_results_repo": "visual-memory/PersonaChat-ERNIE-original-gemma-4-26B-A4B-it",
"results_jsonl": "results/PersonaChat-ERNIE-original-gemma-4-26B-A4B-it.jsonl",
"hf_dataset": "visual-memory/PersonaChat-With-Ids_1k-no-redundancy"… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/PersonaChat-ERNIE-original-gemma-4-26B-A4B-it.PersonaChat-ERNIE-enhanced-gemma-4-26B-A4B-it
Visual Memory Results: personachat-ernie-enhanced
This dataset contains the scored output of a visual-memory perplexity experiment.
Experiment metadata
{
"experiment": {
"model_name": "google/gemma-4-26B-A4B-it",
"hf_results_repo": "visual-memory/PersonaChat-ERNIE-enhanced-gemma-4-26B-A4B-it",
"results_jsonl": "results/PersonaChat-ERNIE-enhanced-gemma-4-26B-A4B-it.jsonl",
"hf_dataset": "visual-memory/PersonaChat-With-Ids_1k-no-redundancy"… See the full description on the dataset page: https://huggingface.co/datasets/visual-memory/PersonaChat-ERNIE-enhanced-gemma-4-26B-A4B-it.