theblackcat102/anime-understanding-dataset
Anime Understanding Benchmark (WIP) Evaluate anime knowledge found in existing LLMs. We hope to provide an easy to run evaluation on knowledge understanding in anime/manga. Better understanding in anime/manga knowledge should resulted in task such as waifu role play. Any suggestion is open in discussion tab. Currently in the works [] Eval on popular models such as gpt, hermes, dolphin, llama base model [] Add more metadata regarding of anime/manga year span []… See the full description on the dataset page: https://huggingface.co/datasets/theblackcat102/anime-understanding-dataset.
Anime Understanding Benchmark (WIP)
Evaluate anime knowledge found in existing LLMs. We hope to provide an easy to run evaluation on knowledge understanding in anime/manga. Better understanding in anime/manga knowledge should resulted in task such as waifu role play.
Any suggestion is open in discussion tab.
Currently in the works
[] Eval on popular models such as gpt, hermes, dolphin, llama base model
[] Add more metadata regarding of anime/manga year span
[] Suggestions for more anime choices ideally diverse in terms of year of air and topic diversity.
[] Human inspection for any potential errors