RyanLucas3/ptq-facebook_opt-1.3b-W4A4-lf10-seed1-final

facebookopt-1.3b W4A4 (lambdafactor=10, seed=1)

This repo contains the final_model checkpoint exported from: /nfs/sloanlab007/projects/foundationmodelevaluation-mazumder_proj/quantization_ryan/facebook_opt-1.3b/W4A4/lambda_factor_10/seed_1/final_model

Quantization

• —weight_bits: 4
• —act_bits: 4
• —weightquant: perchannel
• —actquant: pertoken

Metrics (if available)