Modelpublic

RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face

2likes998downloads

generation_config.json15 linesDownload Raw Back to root

1{2  "bos_token_id": 151643,3  "do_sample": true,4  "eos_token_id": [5    151645,6    1516437  ],8  "pad_token_id": 151643,9  "repetition_penalty": 1.05,10  "temperature": 0.7,11  "top_k": 20,12  "top_p": 0.8,13  "transformers_version": "4.45.1"14}15