datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
elfsupervised-selfrepair-under-constraint-v0.1Self-Repair Under Constraint v0.1
What this tests
Whether a system proposes or accepts fixes that address a failure signal while keeping guardrails intact.
Failure modes
guardrail_violatedResponse approves a fix that violates stated guardrails
symptom_fixResponse approves a cosmetic fix that does not address root cause
repair_okResponse rejects bad fixes and approves feasible fixes
How it works
failure_signal describes what went wrong
proposed_correction is the suggested fix
guardrails are… See the full description on the dataset page: https://huggingface.co/datasets/ClarusC64/elfsupervised-selfrepair-under-constraint-v0.1.fatima_task
Model id and loading:
model_id = "Qwen/Qwen3.5-2B-Base"
# Load tokenizer
tokenizer = AutoTokenizer.from_pretrained(model_id)
# Load model
model = AutoModelForCausalLM.from_pretrained(
model_id,
device_map="auto",
torch_dtype=torch.bfloat16
)
For point 1.1. 1.2: the model can not give me the accurate value of gold and silver data even in the past before 2024
I believe this problem is easy to find solution for as answer is deterministic value, the model should be… See the full description on the dataset page: https://huggingface.co/datasets/rawann-elframawy/fatima_task.