Datasetpublicgated

Laborator/austrian-german-benchmark

AT-Bench: Austrian German Benchmark 300 multiple-choice questions testing whether an LLM actually understands Austrian German — not just German. The problem Every German benchmark treats German as one language. But ask GPT what "Obers" means and half the time it guesses wrong. Ask it about the Bezirksgericht and it describes the German court system. Austrian German is an official language variety spoken by 9 million people, and models consistently get it wrong.… See the full description on the dataset page: https://huggingface.co/datasets/Laborator/austrian-german-benchmark.

sourceHugging Faceapache-2.0updated 7mo agoView on Hugging Face

0likes5downloads

root

dirdata/

file.gitattributes2 KBdownload

fileREADME.md2 KBdownload

Laborator/austrian-german-benchmark · main · files are served by the source, never re-hosted here

This repository is gated. The listing is public, but downloading a file means accepting the publisher’s terms at Hugging Face first — the links above take you there rather than around it.