yourbench-testing/test-complex-custom-schema
Test Complex Custom Schema This dataset was generated using YourBench (v0.6.0), an open-source framework for generating domain-specific benchmarks from document collections. Pipeline Steps ingestion: Read raw source documents, convert them to normalized markdown and save for downstream steps chunking: Split texts into token-based single-hop and multi-hop chunks single_shot_question_generation: Generate standalone question-answer pairs per chunk using LLM… See the full description on the dataset page: https://huggingface.co/datasets/yourbench-testing/test-complex-custom-schema.
Test Complex Custom Schema
This dataset was generated using YourBench (v0.6.0), an open-source framework for generating domain-specific benchmarks from document collections.
Pipeline Steps
- ingestion: Read raw source documents, convert them to normalized markdown and save for downstream steps
- chunking: Split texts into token-based single-hop and multi-hop chunks
- single_shot_question_generation: Generate standalone question-answer pairs per chunk using LLM
Reproducibility
To reproduce this dataset, use YourBench v0.6.0 with the following configuration:
hf_configuration:
hf_dataset_name: test-complex-custom-schema
hf_organization: $HF_ORGANISATION
push_to_hub: true
model_list:
- model_name: Qwen/Qwen3-4B-Instruct-2507
pipeline:
ingestion:
source_documents_dir: example/default_example/data
output_dir: data/complex_custom_processed
supported_file_extensions:
- .md
- .txt
- .pdf
chunking: {}
single_shot_question_generation:
chunk_sampling:
enable: false
num_samples: 100
strategy: random
random_seed: 42
use_structured_outputs: false
structured_fallback: true
custom_schema_path: test_complex_custom_schema.py
custom_schema_class: TestQuestion
custom_schema_auto_batch: true
(This dataset card was automatically generated by YourBench)