Modelpublic

inference-optimization/Qwen3-8B-FP8-Dynamic

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face

0likes9downloads

generation_config.json14 linesDownload Raw Back to root

1{2  "bos_token_id": 151643,3  "do_sample": true,4  "eos_token_id": [5    151645,6    1516437  ],8  "pad_token_id": 151643,9  "temperature": 0.6,10  "top_k": 20,11  "top_p": 0.95,12  "transformers_version": "5.12.1"13}14