opEvents Normalised Event Properties
Introduction
opEvents processes syslog, SNMP Traps, NMIS Events into a common format for further processing. This process is called normalisation.
The following tables represents the standard properties of normalised events - but as event properties are pretty much infinitely adaptable and extensible (e.g. from custom parser rules or event action policies), the tables cannot be exhaustive.
Standard Properties
Event Property | Description | Example |
eventid | A globally unique Event ID | 64d2192a0454aa024079fef4 |
| Unix time of the event (seconds since 1970). With decimal seconds. | 1691490602.72516 |
| The event time in human readable format Note: This Property has been deprecated | 2023-08-08T20:30:02 |
| The name of the node in question. Normally the same as the NMIS node name. | |
| The DNS hostname or IP address of the node in question, as extracted from the input data. | |
| Name of the event | Node Down, Node Up |
| What element of the node the event refers to. | FastEthernet1, Neighbor 1.2.4.5 |
| Is the state good or bad, up or down, see Involved Event Properties | up/down, open/closed, etc |
| Name of the stateful object. | Node, Interface, OSPF Neighbor |
| Other event details | |
| Where did the event originate? | cisco_syslog, trap, NMIS, (remote) API |
| Has the event been marked for escalation? | 0 or 1 |
| opEvents priority level, see opEvents priority levels vs. NMIS and Syslog levels | 0 to 10, inclusive |
| nearest NMIS severity level, computed from | Normal to Fatal |
| Has the event been acknowledged? | 0 or 1 |
| Is this event a flap? | 0 or 1 |
| Should the GUI show the event as open? | 0 or 1 |
| opEvents looks up the node in the NMIS planned outage system and sets the value of planned_outage (default value) to be true or false if a planned outage is scheduled or not. Scheduled Outages or Maintenance Windows Only available in opEvents versions 4.1.1 and newer, Release Notes: opEvents 4.1.1 | true or false |
Optional but Common Properties
In addition to those a number of properties are optional and created only under certain conditions:
Event Property | Description | Example |
|---|---|---|
| The ifAlias (or Description) of the interface in question
| |
| The server name of the system that originated the event; | |
| The URI for this event at the originating server. | |
| List of Event IDs that this one is a duplicate of. | |
| lists nodes that caused this synthetic event. Only present if this is a synthetic event. | |
| List of Event IDs that were involved in causing this synthetic event. | |
| List of Event IDs that are related to this stateful event, | |
| Unix time, until then the event is held back from processing for actions and policies | 1385079231 |
| Has the event been processed wrt. actions and policies? | 0 or 1 |
| If an event triggered a script action that is set to save output, | |
| whether this event was created by a correlation policy action, | 0 or 1 |
| Deprecated as of opEvents 2.4, see trigger_eventids for replacement. Event ID of the synthetic event that this event was a trigger for. | |
| List of synthetic event IDs that this one is a trigger of. | |
| Whether this is a watchdog expiration event | 0 or 1 |
| If the event is or was subject to escalation, then this property indicates the | 60, 900 etc. |
| If the event is or was subject to escalation, then this property lists the | |
| A list of originator- and time-tagged comments for this event | |
| A title and text field which can be used as event notes, It is a modifiable field for both title and text. |
|
| These enrichment tags are controlled by your action policy, and have no special meaning | |
| A structured record of changes and activities related to the event. | |
| A deep structure for copied node properties on event creation. See Node Properties |
Additional event properties to capture additional event data
opEvents works on an event, the event can be thought of as a document and all the contents of that document move through opEvents together, additional properties are added and updated during event processing. It is also not only possible but strongly encouraged to add additional properties as the richer the event, the more useful it will be during processing, obviously the data captured should be relevant and useful. This is easily done during event parsing and a variable is created by including a new variable name in the capture statement, see more details in opEvents EventParserRules - Adding Rules For SNMP Traps and Syslog Messages.
During event processing by EventActions, you can tag events with the tag function, and use it for event processing and conditions. If an event is tagged like this:
'1' => {
IF => 'event.details =~ "outage_current=true"',
THEN => 'tag.outageCurrent(TRUE)',
BREAK => 'false'
},The result would then be available to be used in the variable event.tag_outageCurrent, e.g.
IF => 'event.tag_outageCurrent eq "TRUE"',Using event tagging is a powerful way to implement event policies and have an easy to follow flow in EventActions.
Node vs. Host, and how opEvents handles inconsistent input data
opEvents works hard to normalize inputs from disparate and often inconsistent input data; one of the most common issues is event input data that lacks the correct node name, only has an IP adress or a DNS shortname and not an FQDN and similar.
Here is an overview of the heuristic that opEvents applies to make sure that events are associated with the correct node:
First, opEvents extracts the prospective nodes' host name from the input data.
The parser normally extracts ahostproperty from the input, which may be an FQDN, DNS short name or IP address.
(The parser may also set the finalnodeproperty, but that's not recommended and our example parsing rules don't contain such operations.)
In case of the NMIS event log being the source, only the NMIS node name is available and is used as host name for all subsequent steps.opEvents now looks for the one node that is identified by this hostname/address etc.
This is done by looking in a cache of associations between FQDNs, shortnames and IP addresses that opEvents maintains.
If this succeeds, then the node's name is set as the event'snodeproperty and the procedure is finished.If no matching association is found, then the DNS is used to find potential intermediate associations.
Thehostproperty is resolved via the DNS, forward to IP address if it was a hostname, or reverse to FQDN if it was an IP address.If this intermediate step resulted in something that is associated with a known node, then that node is used and the intermediate info is added to the cache.
(There are also some internal safeguards to reduce the number of DNS requests opEvents might perform.)If none of this worked, then the original raw, untranslatable,
hostproperty is used as a new node's name.
In opEvents 2.0.4 and newer, the configuration optionopevents_auto_create_nodescontrols the behaviour in this situation: if set to false, the event is skipped.
If set to true (or not present), then a new node record is created. (Older versions of opEvents always created new but somewhat incomplete node records in this case.)
The consequences of this normalisation setup are as follows:
An event's
event.nodeproperty will always identify the node that is associated with the event.The event's
event.hostproperty is set from the raw inputs, and is very often not the same as a known node'snode.hostproperty, nor is it guaranteed to exist.
The only thing guaranteed aboutevent.hostis that at the time of the event creation it was somehow, possibly even just temporarily, associated with the node in question.
For NMIS eventlog as source theevent.hostis always the NMIS node name.The opEvents dashboard and event-centric pages all show the
event.nodeproperty as primary id, and theevent.hostproperty as supplementary information.Editing a node's
hostoraddressesproperties in the Edit Nodes GUI does not affect any existing events; it just sets up association info for finding the right node for future events.