Rapidata/bananamark-dataset
🍌 Bananamark - Who has the best Bananas? Google released a model called Nano Banana. We had to know: is it actually good at generating bananas? Turns out, not as good as FLUX 2 or Seedream 4! What we did We tested 11 image generation models on various banana-themed prompts and collected over 20'000 human preferences using the Rapidata Python API. Annotators were asked a simple question: Which image has the better bananas? Want to evaluate your own models?… See the full description on the dataset page: https://huggingface.co/datasets/Rapidata/bananamark-dataset.
🍌 Bananamark - Who has the best Bananas?
<a href="https://www.rapidata.ai"> <img src="https://cdn-uploads.huggingface.co/production/uploads/66f5624c42b853e73e0738eb/jfxR79bOztqaC6_yNNnGU.jpeg" width="400" alt="Dataset visualization"> </a>
Google released a model called Nano Banana. We had to know: is it actually good at generating bananas?
Turns out, not as good as FLUX 2 or Seedream 4!
What we did
We tested 11 image generation models on various banana-themed prompts and collected over 20'000 human preferences using the Rapidata Python API. Annotators were asked a simple question:
Which image has the better bananas?
<strong>Want to evaluate your own models? Check out MRI</strong>
Results
Full leaderboard: app.rapidata.ai/mri/benchmarks/692714af8b22f2eff170f664
<a href="https://app.rapidata.ai/mri/benchmarks/692714af8b22f2eff170f664"> <img src="https://cdn-uploads.huggingface.co/production/uploads/672b7d79fd1e92e3c3567435/TCe2nhG1TryRsS2kWXK6H.png" alt="Bananamark Leaderboard"> </a>
Takeaways
- FLUX 2 Flex wins with a comfortable lead
- Nano Banana, despite the name, only manages 3rd and 4th place
- Black Forest Labs took 4 of the top 6 spots
- Wan 2.2 needs some work on its banana game
Collected with [Rapidata](https://www.rapidata.ai). Run your own benchmarks with [MRI](https://docs.rapidata.ai/mri/).