The observability stack is based on kube-prom-stack.
To launch the observability stack:
Make sure to have:
- A running Kubernetes (K8s) environment with GPUs
- Run
cd utils && bash install-minikube-cluster.sh
- Or follow our tutorial
- Run
After that you can run:
sudo bash install.sh
After installing, the dashboard can be accessed through the service service/kube-prom-stack-grafana
in the monitoring
namespace.
Forward the Grafana dashboard port to the local node-port
sudo kubectl --namespace monitoring port-forward svc/kube-prom-stack-grafana 3000:80 --address 0.0.0.0
Forward the Prometheus dashboard
sudo kubectl --namespace monitoring port-forward prometheus-kube-prom-stack-kube-prome-prometheus-0 9090:9090
Open the webpage at http://<IP of your node>:3000
to access the Grafana web page. The default user name is admin
and the password can be configured in values.yaml
(default is prom-operator
).
Import the dashboard using the vllm-dashboard.json
in this folder.