Modelpublic

trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda

sourceHugging Facemitupdated 7mo agoView on Hugging Face

0likes

Model Card

llama-cpp-python (Windows CUDA build)

Prebuilt wheel for:

—llamacpppython 0.3.16
—Windows x64
—Python 3.12 (cp312)
—CUDA enabled
—AVX512 disabled
—Supports NVIDIA 10 / 20 / 30 / 40 / 50 series GPUs
—Trajis SmartSRT 1.0.0

Install

Direct install:

pip install "https://huggingface.co/trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda/resolve/main/llamacpppython-0.3.16-cp312-cp312-win_amd64.whl"

Or download manually and install:

pip install llamacpppython-0.3.16-cp312-cp312-win_amd64.whl

Uninstall

pip uninstall llama-cpp-python

Requirements

—Windows 64-bit
—Python 3.12
—NVIDIA GPU
—CUDA Toolkit installed