CoolFace
Modelpublic

gbstox/agronomYi-hermes-34B

sourceHugging Faceupdated 3y agoView on Hugging Face
2likes22downloads
Model Card

AgronomYi-hermes-34B

<img src="https://cdn-uploads.huggingface.co/production/uploads/63042a3d7373aacccd896484/TwXNxFw8zSLuWjiYL41Bj.jpeg" width="500" >

About

AgronomYi is a fine tune of Nous-Hermes-2-Yi-34B, which uses Yi-34B as the base model. I fine tuned this with agronomy data (exclusively textbooks & university extension guides), full training data set here). AgronomYi outperforms all models on the benchmark except for gpt-4, and consistently beats the base model by 7-9% and the hermes fine tune by 3-5%. I take this to mean that even better results can be acheived with additional fine tuning, and larger models tend to perform better in general.

Benchmark comparison

benchmark info here

Model NameScoreDate Tested
gpt-485.71%2024-01-15
agronomYi-hermes-34b79.05%2024-01-15
mistral-medium77.14%2024-01-15
nous-hermes-yi-34b76.19%2024-01-15
mixtral-8x7b-instruct72.38%2024-01-15
claude-272.38%2024-01-15
yi-34b-chat71.43%2024-01-15
norm69.52%2024-01-17
openhermes-2.5-mistral-7b69.52%2024-01-15
gpt-3.5-turbo67.62%2024-01-15
mistral-7b-instruct61.9%2024-01-15