Modelpublic

RyanLucas3/ptq-facebook_opt-1.3b-W4A4-lf5-seed1-final

sourceHugging Faceupdated 9mo agoView on Hugging Face

0likes14downloads

Model Card

facebookopt-1.3b W4A4 (lambdafactor=5, seed=1)

This repo contains the final_model checkpoint exported from: /nfs/sloanlab007/projects/foundationmodelevaluation-mazumder_proj/quantization_ryan/facebook_opt-1.3b/W4A4/lambda_factor_5/seed_1/final_model

Quantization

—weight_bits: 4
—act_bits: 4
—weightquant: perchannel
—actquant: pertoken

Metrics (if available)

split	dense ppl	fakequant ppl
wikitext-103 test	n/a	n/a
lambada validation	n/a	n/a