Icinga Integration

The ilert Icinga Integration helps you to easily connect ilert with Icinga.

Icinga is an open-source, scalable, and extensible monitoring system that checks the availability of your network resources, notifies users of outages, and generates performance data for reporting. With the ilert Icinga Notification Plugin, you can easily integrate Icinga with ilert and extend your existing Icinga with advanced alerting by SMS, phone calls, and push notifications as well as on-call schedules.

System requirements

• Icinga 2.x.

• Python >= 3.7 (alternatively Python >= 2.7.9, we suggest 2.7.10)

Python 2.x is EOL (end of life) we suggest to use Python >= 3.7

Are you using Icinga 1.x? Please refer to our Nagios integration guide.

In ilert: Create an Icinga alert source

1. Go to Alert sources --> Alert sources and click on Create new alert source

   
2. Search for Icinga in the search field, click on the Icinga tile and click on Next.

   
3. Give your alert source a name, optionally assign teams and click Next.

4. Select an escalation policy by creating a new one or assigning an existing one.

   
5. Select you Alert grouping preference and click Continue setup. You may click Do not group alerts for now and change it later.

   
6. The next page show additional settings such as customer alert templates or notification prioritiy. Click on Finish setup for now.

7. On the final page, an API key and / or webhook URL will be generated that you will need later in this guide.

   

In Icinga: Install notification plugin

1. Download the ilert Icinga plugin and unzip it

wget https://github.com/iLert/ilert-icinga/releases/latest/download/ilert-icinga.zip
unzip ilert-icinga.zip

1. Move the plugin file ilert-icinga.py into the /usr/local/bin directory

Python 3.7 (or higher)

mv ilert-icinga.py /usr/local/bin > chmod 755 /usr/local/bin/ilert-icinga.py

Python 2.7.9 (or higher)

cd python2
mv ilert-icinga.py /usr/local/bin > chmod 755 /usr/local/bin/ilert-icinga.py

The file must be executable by both Icinga and the cron daemon

1. Open the plugin configuration file ilert-icinga.conf and paste the API Key in the pager field of the user definition, e.g.

object User "ilert" {
  display_name = "iLert"
  groups = [ "icingaadmins" ]
  states = [ OK, Warning, Critical, Unknown]
  types = [ Problem, Recovery, Acknowledgement ]
  vars.additional_notes = "This user maps to an alert source in ilert."
  pager = "12345678-abcd-efgh-ijkl-87654321"
}

1. Copy the file to the Icinga configuration directory (varies depending on the installation)

Python 3.7 (or higher)

mv ilert-icinga.conf /etc/icinga2/conf.d/

Python 2.7.9 (or higher)

cd python2
mv ilert-icinga.conf /etc/icinga2/conf.d/

1. Optional: You can enable ilert as a notification contact using vars.notification.enable_ilert = true attribute in host and service definitions. To enable ilert for all hosts and services, add the attribute to the template /etc/icinga2/conf.d/templates.conf

template Host "generic-host" {
 max_check_attempts = 5
 check_interval = 1m
 retry_interval = 30s 
 check_command = "hostalive"  

 vars.notification.enable_ilert = true
} 

template Service "generic-service" {
 max_check_attempts = 3
 check_interval = 1m
 retry_interval = 30s  

 vars.notification.enable_ilert = true 
}

1. Edit the crontab file from the icinga user

crontab -u icinga -e

1. Add the following entry:

Python 3.7 (or higher)

* * * * * python3 /usr/local/bin/ilert-icinga.py -m send

Python 2.7.9 (or higher)

* * * * * /usr/local/bin/ilert-icinga.py -m send

Via this cron job, events are sent to ilert every minute that failed in the first send attempt (e.g. due to a network error).

1. Restart Icinga:

/etc/init.d/icinga restart

1. After server restart you should see the ilert user in Icinga

FAQ

Which Icinga Notification Types are processed by the plugin?

The plugin processes the notification types PROBLEM , ACKNOWLEDGEMENT and RECOVERY . The notification types FLAPPING* and DOWNTIME* are ignored.

What happens if my internet connection is lost? Are the events generated in Icinga lost?

There are no events lost. Because the plugin stores the events locally in a temporary directory (by default in /tmp/ilert-icinga ) and tries to send them to ilert every minute. This means that as soon as your connection is available again, cached events will be sent to ilert. In addition, we recommend that you monitor your Internet connection using our Heartbeats feature.

Can I override the alert source default alert priority via the Icinga plugin?

Yes, use ICINGA_PRIORITY variable in the notification command template and set it to LOW or HIGH e.g.

Python 3.7 (or higher)

object NotificationCommand "ilert-notification" {
  import "plugin-notification-command"

  command = "python3 /usr/local/bin/ilert-icinga.py --mode save"

  env = {
    ICINGA_PRIORITY = "LOW"
    ...
  }
}

Python 2.7.9 (or higher)

object NotificationCommand "ilert-notification" {
  import "plugin-notification-command"

  command = "/usr/local/bin/ilert-icinga.py --mode save"

  env = {
    ICINGA_PRIORITY = "LOW"
    ...
  }
}

Does the plugin also support Icinga 1.x?

No, you should use the ilert Nagios Integration.

The plugin does not work. How do I find the mistake?

Please look first in the log file. The plugin uses the Unix / Linux system log for logging (eg under /var/log/messages or /var/log/syslog ). If you can not find the error, please contact our support at [e-mail].

I received the following error: import urllib.request ImportError: No module named request. This error message indicates that you are using the Python 3 script with Python 2. Please make sure that you are using the correct Python 2 script:

> cd python2 
> mv ilert-icinga.py /usr/local/bin > chmod 755 /usr/local/bin/ilert-icinga.py