froggeric/creativity
"The only difference between Science and screwing around is writing it down." (Adam Savage) The LLM Creativity benchmark Last benchmark update: 28 May 2024 The goal of this benchmark is to evaluate the ability of Large Language Models to be used as an uncensored creative writing assistant. Human evaluation of the results is done manually, by me, to assess the quality of writing. There are 24 questions, some standalone, other follow-ups to previous questions for a multi-turn… See the full description on the dataset page: https://huggingface.co/datasets/froggeric/creativity.
2024-05-28 update
Upload benchmark-results.csv
formatting
Add refusal bypass method, and link to coding leaderboard
Upload benchmark-results.csv
updated screenshot
presentation
typo
updated results with new models, and added recommendations
Upload benchmark-results.csv
corrected info for command-r-plus and added link to prompting guide
New results and observations from 2024-04-16
Upload benchmark-results.csv
removed duplicate
Added link to Creative Writing Leaderboard
added link to UGI leaderboard
Update README.md
Added https://eqbench.com/creative_writing.html
Updated results from 2024-03-12
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Delete sample_reply_westlake-v2-7b.md
Delete sample_reply_miqu-1-70b.md
Delete sample_reply_daybreak-kunoichi-dpo-7b.md
Delete sample_prompt.txt
Create sample_reply_daybreak-kunoichi-dpo-7b.md
Update sample_reply_miqu-1-70b.md
Update sample_reply_westlake-v2-7b.md
Create sample_reply_westlake-v2-7b.md
Rename sample_prompt.md to sample_prompt.txt
Rename sample_prompt.txt to sample_prompt.md
Update sample_reply_miqu-1-70b.md
Rename sample_reply_miqu-1-70b.txt to sample_reply_miqu-1-70b.md
Create sample_reply_miqu-1-70b.txt
Create sample_prompt.txt
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Upload benchmark-results.csv
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
