iapp/openai_humaneval-th

HumanEval-th A Thai translation of all 164 problems of OpenAI's HumanEval. Every row corresponds 1:1, in order, to a row of the English original, so the Thai and English scores of a model are directly comparable. Only the prompt column is Thai. canonical_solution, test and entry_point are Python rather than prose and were never translated; they are byte-identical to openai/openai_humaneval in all 164 rows, and validate.py checks that on every run. Every revision of this dataset… See the full description on the dataset page: https://huggingface.co/datasets/iapp/openai_humaneval-th.