about prometheus alerting

1.Alerting with Prometheus is separated in to two parts

1-1Alerting rules

• Alerting rules is a file that formatted by yml,it's define some exp in to the yaml file.
• Alerting rules is in Prometheus servers send alerts to an alert manager and alert manager managed those alerts.

the rule document in there: the rules doc

1-2Alerting Manager

• AlertingManager is a command line tool and the command line tool flags has those functions

  • configure immutable system parameters
  • configuration file defines inhibition rules
  • configuration notification routing
  • configuration notification receivers
  • router editor

• Alerting notifications steps

  • Setup and configure the alert manager
  • Configure Prometheus to talk to the alert manager
  • Create alerting rules in Prometheus

1-2-1 Configs

• config.file: specify which configuration file to load ./alertmanager --config.file=alertmanager.yml
  • the file written in the YAML format and defined by the scheme described below
    • <duration>: a duration matching the regular expression [0-9]+(ms|[smhdwy])
    • <labelname>: a string matching the regular expression [a-zA-Z_][a-zA-Z0-9_]*
    • <labelvalue>: a string of unicode characters
    • <filepath>: a valid path in the current working directory
    • <boolean>: a boolean that can take the values true or false
    • <string>: a regular string
    • <secret>: a regular string that is a secret, such as a password
    • <tmpl_string>: a string which is template-expanded before usage
    • <tmpl_secret>: a string which is template-expanded before usage that is a secret
    • <int>: an integer value

there is the simple file and some configs

1-2-2 Cores

• Grouping

  • Grouping categorizes alerts of similar nature into a single notification.

• Inhibition

  • Inhibition is a concept of suppressing notifications for certain alerts if certain other alerts are already firing

• Silences

  • Silences are a straightforward way to simply mute alerts for a given time.
  • A silence is configured based on matchers, just like the routing tree.
  • Silences are configured in the web interface of the Alert manager.

1-2-3 Notification template Reference

1-2-3-1 Data structures

data

alert

kv

functions