backend/llama.cpp/docs/install.md

# Install pre-built version of llama.cpp

| Install via | Windows | Mac  | Linux |
|-------------|---------|------|-------|
| conda-forge | ✅      | ✅   | ✅   |
| Winget      | ✅      |      |      |
| Homebrew    |         | ✅   | ✅   |
| MacPorts    |         | ✅   |      |
| Nix         |         | ✅   | ✅   |

## conda-forge (Windows, Mac and Linux)

conda-forge provides builds for:
 - CUDA (Windows and Linux)
 - Vulkan (Windows and Linux)
 - Apple Metal (macOS)

```sh
conda install -c conda-forge llama-cpp
```

```sh
mamba install -c conda-forge llama-cpp
```

```sh
# Project-local installation
pixi add llama-cpp

# Global installation
pixi global install llama-cpp
```

This distribution is managed on [`conda-forge/llama-cpp-feedstock`](https://github.com/conda-forge/llama.cpp-feedstock/).

Shall you have any problems, please open an issue on [its issue tracker](https://github.com/conda-forge/llama.cpp-feedstock/issues).

## Winget (Windows)

```sh
winget install llama.cpp
```

The package is automatically updated with new `llama.cpp` releases. More info: https://github.com/ggml-org/llama.cpp/issues/8188

## Homebrew (Mac and Linux)

```sh
brew install llama.cpp
```

The formula is automatically updated with new `llama.cpp` releases. More info: https://github.com/ggml-org/llama.cpp/discussions/7668

## MacPorts (Mac)

```sh
sudo port install llama.cpp
```

See also: https://ports.macports.org/port/llama.cpp/details/

## Nix (Mac and Linux)

```sh
nix profile install nixpkgs#llama-cpp
```

For flake enabled installs.

Or

```sh
nix-env --file '<nixpkgs>' --install --attr llama-cpp
```

For non-flake enabled installs.

This expression is automatically updated within the [nixpkgs repo](https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/by-name/ll/llama-cpp/package.nix#L164).