Configuring alert notifications

As Administrator, you need to learn how to configure alert notifications that appear in the user notification system. The notifications supplement alert information in charts on the Manage/Hive/Compaction Observability dashboard in Grafana. You learn to use the UI for this configuration, but alternatively, you can use the Kubernetes configuration method.

In this task, you see how to funnel alerts into a user notification system. In the next task, you see how to use the Kubernetes configuration method.

In Alert Manager Configuration, configure the receiver object by following instructions in the Prometheus AlertManager v.0.20.0 documentation to configure the receiver object.

For example, a simple WebHook configuration looks something like this:

global:
  resolve_timeout: 5m
 
route:
  group_by: ['alertname', 'namespace', 'service']
  group_wait: 30s
  group_interval: 5m
  repeat_interval: 3h
  receiver: notification_system
 
receivers:
  - name: 'notification_system'
    webhook_configs:
      - url: https://co-alerting.prod.mycompany.com
        send_resolved: true
 
inhibit_rules:
  - source_match:
      severity: 'error'
    target_match:
      severity: 'warning'
    equal: ['alertid', 'namespace', 'service']

For information about integration possibilities, see the receiver section.

Click Save, and then Apply.
The alertmanager recognizes the change and automatically updates the configuration.