Modelpublic

Nexesenex/one-man-army_UNA-34Beagles-32K-v1-iMat.GGUF

sourceHugging Faceupdated 3y agoView on Hugging Face

0likes54downloads

Model Card

Model is likely broken :

—one-man-armyUNA-34Beagles-32K-v1-b1973-iMat-c32ch1000-Q4KM.gguf,-,Hellaswag,85.75,,400,2024-01-26 01:40:00,,34b,Yi,200000,,,GGUF,Fblgit,Nexesenex
—one-man-armyUNA-34Beagles-32K-v1-b1973-iMat-c32ch1000-Q4KM.gguf,-,Hellaswag_Bin,80.25,,400,2024-01-26 01:40:00,,34b,Yi,200000,,,GGUF,Fblgit,Nexesenex
—one-man-armyUNA-34Beagles-32K-v1-b1973-iMat-c32ch1000-Q4KM.gguf,-,Arc-Challenge,57.85953177,,299,2024-01-26 05:40:00,,34b,Yi,200000,,,GGUF,Fblgit,Nexesenex
—one-man-armyUNA-34Beagles-32K-v1-b1973-iMat-c32ch1000-Q4KM.gguf,-,Arc-Easy,77.89473684,,570,2024-01-26 05:40:00,,34b,Yi,200000,,,GGUF,Fblgit,Nexesenex
—one-man-armyUNA-34Beagles-32K-v1-b1973-iMat-c32ch1000-Q4KM.gguf,-,Thruthful-QA,47.73561812,,817,2024-01-26 05:40:00,,34b,Yi,200000,,,GGUF,Fblgit,Nexesenex
—one-man-armyUNA-34Beagles-32K-v1-b1973-iMat-c32ch1000-Q4KM.gguf,-,Winogrande,79.9526,,1267,2024-01-26 05:40:00,,34b,Yi,200000,,,GGUF,Fblgit,Nexesenex
—one-man-armyUNA-34Beagles-32K-v1-b1973-iMat-c32ch1000-Q4KM.gguf,-,wikitext,5.6462,512,512,2024-01-26 01:40:00,,34b,Yi,200000,,,GGUF,Fblgit,Nexesenex
—one-man-armyUNA-34Beagles-32K-v1-b1973-iMat-c32ch1000-Q4KM.gguf,-,wikitext,10.5926,4096,4096,2024-01-26 01:40:00,,34b,Yi,200000,,,GGUF,Fblgit,Nexesenex
—one-man-armyUNA-34Beagles-32K-v1-b1973-iMat-c32ch1000-Q4KM.gguf,-,MMLU,42.17252396,,313,2024-01-26 05:40:00,,34b,Yi,200000,,,GGUF,Fblgit,Nexesenex

Perplexity at 4k is 10.5. The Maths version is even worst.