tensorrt-llm
Devstral-2-123B-NVFP4-TensorRT-LLMCodeLlama-13B-Instruct-GPTQ-TensorRT-LLM-RTX-4090Qwen3-1.7B-TensorRT-LLM-Checkpoint-NVFP4Qwen2.5-1.5B-Instruct-TensorRT-LLM-Checkpoint-NVFP4Qwen2.5-1.5B-Instruct-TensorRT-LLM-Checkpoint-BF16Qwen3-4B-TensorRT-LLM-Checkpoint-NVFP4Qwen2.5-1.5B-Instruct-TensorRT-LLM-Checkpoint-FP8Qwen2.5-1.5B-Instruct-TensorRT-LLM-Checkpoint-FP16
