stress-testing
stress_testing_model_spec
Stress Testing Model Spec Compliance
A dataset of AI model responses to queries designed to create value tensions, along with compliance evaluations from multiple judge models.
Configurations
1. Subset Default (6 splits)
dataset = load_dataset('jifanz/stress_testing_model_spec')
Six curated subsets of query-response pairs.
Columns:
rank: Integer ranking
query_generator: Which model generated the query (e.g., "o3", "claude_opus_4")
value1, value2: Two values… See the full description on the dataset page: https://huggingface.co/datasets/jifanz/stress_testing_model_spec.frontier-llm-logical-stress-testing-2026
📄 THE ONE-PAGE FILE SUMMARY
WHO I AM
An independent AI enthusiast and tech explorer who designed advanced logical stress-tests out of curiosity to see how frontier AI architectures handle absolute constraints.
WHAT I DID
I developed a behavioral stress-testing framework executing three multi-layered logical challenges in French to neutralize pre-compiled conversational safety scripts. I subjected six frontier models—Claude 4.6 Sonnet, Grok 4.5… See the full description on the dataset page: https://huggingface.co/datasets/ghosplayerg1vt/frontier-llm-logical-stress-testing-2026.stress_testing_model_spec_cycles
Stress Testing Model Spec - Preference Cycles
This dataset identifies intransitive preference cycles in LLM value rankings, derived from the jifanz/stress_testing_model_spec dataset by Zhang et al. (2025).
A preference cycle occurs when a model's pairwise value comparisons are intransitive — e.g., the model prefers value A over B, B over C, but C over A. This violates the transitivity assumption underlying Bradley-Terry ranking models and may indicate genuine value tensions or… See the full description on the dataset page: https://huggingface.co/datasets/timhua/stress_testing_model_spec_cycles.