Kubernetes Integration
Feed Kubernetes cluster alerts into ilert to notify on-call teams about pod failures, resource limits, or cluster health issues fast.
Last updated
Was this helpful?
Feed Kubernetes cluster alerts into ilert to notify on-call teams about pod failures, resource limits, or cluster health issues fast.
Last updated
Was this helpful?
Was this helpful?
The Kubernetes integration brings cluster metrics, such as pod crashes, high CPU/memory usage, or node failures, from Prometheus-based systems into ilert as technical alerts. On-call responders receive these alerts with context for prompt triage and remediation in containerized environments.
Go to Alert sources --> Alert sources and click on Create new alert source
Search for Kubernetes in the search field, click on the Kubernetes tile and click on Next.
Give your alert source a name, optionally assign teams and click Next.
Select an escalation policy by creating a new one or assigning an existing one.
Select you Alert grouping preference and click Continue setup. You may click Do not group alerts for now and change it later.
The next page show additional settings such as customer alert templates or notification prioritiy. Click on Finish setup for now.
On the final page, an API key and / or webhook URL will be generated that you will need later in this guide.
Add helm charts repo and update it
helm repo add ilert https://ilert.github.io/charts/
helm repo updateDeploy ilert-kube-agent with the API Key that you generated in ilert
helm upgrade --install --namespace kube-system \
ilert-kube-agent ilert/ilert-kube-agent \
--set config.settings.apiKey="<YOUR KEY HERE>"Define module and paste the API Key that you generated in ilert
module "ilert-kube-agent" {
source = "iLert/ilert-kube-agent/kubernetes"
version = "0.3.9"
replicas = 2
api_key = "<YOUR KEY HERE>"
}Apply changes
terraform init
terraform applyClone the ilert-kube-agent repository
git clone https://github.com/iLert/ilert-kube-agent.gitPaste the API Key that you generated in ilert into ./example/standard/30-deployment.yaml
...
env:
...
- name: ILERT_API_KEY
value: "<YOUR KEY HERE>"
...Apply the deployment manifest to your kubernetes cluster
kubectl apply -f deployment/standard/Verify that the ilert-kube-agent pods are running and ready
kubectl --namespace kube-system get pod -l app=ilert-kube-agent
NAME READY STATUS RESTARTS AGE
ilert-kube-agent-64f7dfd4d-nsnzp 1/1 Running 0 37h
ilert-kube-agent-64f7dfd4d-zx7fb 1/1 Running 0 37hFinished! Your Kubernetes alerts will now create alerts in ilert.
Will alerts in ilert be resolved automatically?
Yes, as soon as an alert has been resolved in ilert-kube-agent, the associated alert in ilert will be resolved automatically.
Can I connect multiple Kuberenetes namespaces with multiple alert sources from ilert?
Yes, simply create multiple deployments per namespace in Kubernetes.