LocalDoc/YOXLA-Benchmark
YOXLA Benchmark 1443 frozen examples for evaluating large language models in Azerbaijani, across four blocks and eleven tasks. Run with the YOXLA framework: pip install "yoxla[api]" yoxla run --provider openrouter --model <model> --block all Or load a config directly: from datasets import load_dataset data = load_dataset("LocalDoc/YOXLA-Benchmark", "rag_selection_v1")["test"] What makes it different Every answer space is closed. A label, a number, or a span… See the full description on the dataset page: https://huggingface.co/datasets/LocalDoc/YOXLA-Benchmark.
Update README.md
Update README.md
Add YOXLA rag_selection_v1 test set
Update README.md
Add YOXLA knowledge_choice_v1 test set
Delete knowledge_v1
Add YOXLA knowledge_v1 test set
Update README.md
Add YOXLA az_tr_interference_v1 test set
Add YOXLA rag_verification_v1 test set
Delete rag_verification_v1
Delete knowledge_v1
Update README.md
Add YOXLA rag_verification_v1 test set
Add YOXLA knowledge_v1 test set
Delete orthography_v1
Delete knowledge_v1
Add YOXLA knowledge_v1 test set
Delete knowledge_v1
Add YOXLA orthography_v1 test set
Delete orthography_v1
Add YOXLA orthography_v1 test set
Add YOXLA knowledge_v1 test set
Update README.md
Add YOXLA knowledge_v1 test set
Update README.md
Add YOXLA minimal_pairs_v1 test set
Update README.md
Add YOXLA orthography_v1 test set
Update README.md
Add YOXLA intent_v1 test set
Update README.md
Add YOXLA sentiment_v1 test set
Update README.md
Add YOXLA sts_v1 test set
Update README.md
Add YOXLA nli_v1 test set
Update README.md
Add YOXLA qa_abstention_v1 test set
Create README.md
Add YOXLA extractive_qa_v1 test set
initial commit