Modelpublic

RyanLucas3/ptq-facebook_opt-1.3b-W6A6-lf10-seed1-final

sourceHugging Faceupdated 9mo agoView on Hugging Face

0likes16downloads

Model Card

facebookopt-1.3b W6A6 (lambdafactor=10, seed=1)

This repo contains the final_model checkpoint exported from: /nfs/sloanlab007/projects/foundationmodelevaluation-mazumder_proj/quantization_ryan/facebook_opt-1.3b/W6A6/lambda_factor_10/seed_1/final_model

Quantization

—weight_bits: 6
—act_bits: 6
—weightquant: perchannel
—actquant: pertoken

Metrics (if available)

split	dense ppl	fakequant ppl
wikitext-103 test	n/a	n/a
lambada validation	n/a	n/a