Installing Both Ollama and Open WebUI Using Kustomize
For cpu-only pod
kubectl apply -f ./kubernetes/manifest/base
For gpu-enabled pod
kubectl apply -k ./kubernetes/manifest
Installing Both Ollama and Open WebUI Using Helm
Package Helm file first
helm package ./kubernetes/helm/
For cpu-only pod
helm install ollama-webui ./ollama-webui-*.tgz
For gpu-enabled pod
helm install ollama-webui ./ollama-webui-*.tgz --set ollama.resources.limits.nvidia.com/gpu="1"
Check the kubernetes/helm/values.yaml file to know which parameters are available for customization