Modelpublic

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf1-seed1-final

sourceHugging Faceupdated 9mo agoView on Hugging Face

0likes14downloads

Model Card

facebookopt-1.3b W6A6 (lambdafactor=1, seed=1)

This repo contains the final_model checkpoint exported from: /nfs/sloanlab007/projects/foundationmodelevaluation-mazumder_proj/quantization_ryan/facebook_opt-1.3b/W6A6/lambda_factor_1/seed_1/final_model

Quantization

—weight_bits: 6
—act_bits: 6
—weightquant: perchannel
—actquant: pertoken

Metrics (if available)

split	dense ppl	fakequant ppl
wikitext-103 test	n/a	n/a
lambada validation	n/a	n/a