CoolFace
Modelpublic

appvoid/palmer-004

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
1likes68downloads
Model Card

<style> @import url('https://fonts.googleapis.com/css2?family=Vollkorn:ital,wght@0,400..900;1,400..900&display=swap'); </style>

<div style="background-color: transparent; border-radius: .5rem; padding: 2rem; font-family: monospace; font-size: .85rem; text-align: justify;">

palmer-004

june update

This model has improved overall performance at the expense of small degradation on winogrande. As all palmer models, the model is biased to respond to answers without using any specific prompt, feel free to further fine-tune it for your specific use case.

ModelMMLUARC-CHellaSwagPIQAWinograndeAverage
tinyllama-3t0.25770.30290.59350.73290.59590.4966
palmer-004-old0.26010.34560.61380.74430.65110.5229
palmer-0040.26610.34900.61730.74810.64170.5244
note

Even though palmer-003 is only 2k context size, it's 0.5257 on average so if you don't need that much context size (32k) you are better off with the former one.

</div>