Modelpublic

LoneStriker/ExLlamaV2-Measurements

sourceHugging Faceupdated 3y agoView on Hugging Face

13likes

Model Card

ExLlamaV2 Measurements

Measurement files used to quantize models uploaded here. Depending on the model type one of the following datasets is used for calibration:

—General chat or instruct model: ThePile 0007.parquet
—Coding model: WizardLM_evol_instruct_V2_196k
—RP model: pippa.parquet (from Undi of TheBloke Discord)
—Japanese model: filtered text from file Japanese Wiki file jawikibooks-20231023-cirrussearch