CoolFace
Modelpublic

Felipe97/llama-cpp-compiled

sourceHugging Faceupdated 2d agoView on Hugging Face
0likes1.1kdownloads
install.md79 linesDownload Raw Back to docs
1# Install pre-built version of llama.cpp2 3| Install via | Windows | Mac  | Linux |4|-------------|---------|------|-------|5| conda-forge | ✅      | ✅   | ✅   |6| Winget      | ✅      |      |      |7| Homebrew    |         | ✅   | ✅   |8| MacPorts    |         | ✅   |      |9| Nix         |         | ✅   | ✅   |10 11## conda-forge (Windows, Mac and Linux)12 13conda-forge provides builds for:14 - CUDA (Windows and Linux)15 - Vulkan (Windows and Linux)16 - Apple Metal (macOS)17 18```sh19conda install -c conda-forge llama.cpp20```21 22```sh23mamba install -c conda-forge llama.cpp24```25 26```sh27# Project-local installation28pixi add llama.cpp29 30# Global installation31pixi global install llama.cpp32```33 34This distribution is managed on [`conda-forge/llama.cpp-feedstock`](https://github.com/conda-forge/llama.cpp-feedstock/).35 36Shall you have any problems, please open an issue on [its issue tracker](https://github.com/conda-forge/llama.cpp-feedstock/issues).37 38## Winget (Windows)39 40```sh41winget install llama.cpp42```43 44The package is automatically updated with new `llama.cpp` releases. More info: https://github.com/ggml-org/llama.cpp/issues/818845 46## Homebrew (Mac and Linux)47 48```sh49brew install llama.cpp50```51 52The formula is automatically updated with new `llama.cpp` releases. More info: https://github.com/ggml-org/llama.cpp/discussions/766853 54## MacPorts (Mac)55 56```sh57sudo port install llama.cpp58```59 60See also: https://ports.macports.org/port/llama.cpp/details/61 62## Nix (Mac and Linux)63 64```sh65nix profile install nixpkgs#llama-cpp66```67 68For flake enabled installs.69 70Or71 72```sh73nix-env --file '<nixpkgs>' --install --attr llama-cpp74```75 76For non-flake enabled installs.77 78This expression is automatically updated within the [nixpkgs repo](https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/by-name/ll/llama-cpp/package.nix#L164).79