gstaff/TensorRT-LLM-engine-Mistral-7B-instruct-v0.2

TensorRT-LLM Engine Files for Mistral-7B-instruct-v0.2

This repo contains TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 in single-GPU mode on a RTX 3080Ti GPU.