The ollama package to use. Different packages use different hardware acceleration. ollama: default behavior; usually equivalent to ollama-cpu if nixpkgs.config.rocmSupport is enabled, is equivalent to ollama-rocm if nixpkgs.config.cudaSupport is enabled, is equivalent to ollama-cuda otherwise defaults to ollama-cpu ollama-cpu: disable GPU; only use CPU ollama-rocm: supported by most modern AMD GPUs may require overriding gpu type with services.ollama.rocmOverrideGfx if rocm doesn’t detect your AMD gpu ollama-cuda: supported by most modern NVIDIA GPUs ollama-vulkan: supported by most GPUs

pkgs.ollama

pkgs.ollama-rocm