Modelpublic

2i/llama-cpp-python-wheels

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes

README.md8 linesDownload Raw Back to root

1Linux, CUDA, AVX512.2 3```sh4$ git clone "https://github.com/abetlen/llama-cpp-python" --depth=15$ cd llama-cpp-python6$ git submodule update --init --recursive7$ CMAKE_ARGS="-DLLAMA_CUBLAS=on" python -m pip install .8```