Analytics modules

Aggregate

Aggregate data over a time period or a number of samples. Group data per source label. Calculates average, min, and max.

Array Groupby

Group array elements into sub-arrays based on the value of a selected property.

Array Join

Combine multiple messages into an array, either by collecting messages during a specified time window, or a specified number of messages.

Array Property Get

Gets one property for each object in an array and creates a new array that only contains the values of the properties.

Array Property Omit

Omits properties from all objects in an array of objects and creates a new array with objects without the omitted properties.

Array Property Pick

Picks properties from all objects in an array of objects and creates a new array with objects containing only the picked properties.

Array Regex

Select a subset of an array by checking a selected property in each element against a regex filter.

Array Sort by List

Sort the elements of an array of objects by providing a list of values matching a selected property.

Array Sort by Property

Sort an array based on the value of a selected property.

Array Split

Splits an array into individual messages.

Array To Object

Convert an array of name/value properties into a flat object.

Base64 Decode

Decode a base64 encoded string.

Base64 Encode

Encode a byte array or string as base64 or base64url strings.

CAN J1939 Decoder

Decode raw can messages using a DBC file.

Csharp

Process message data using custom C# code.

CSV LineParser

Splits a single line of CSV into an object.

CSV TextParser

Parses CSV text into an array of objects.

Data Mapper

Transform messages using a visual configuration tool.

Deadband

Deadband filter that only lets through data that has changed by a certain amount (absolute or relative).

Delay

Delay messages during a specified time period.

Files Delete

Delete files matching a pattern.

Files Move

Move files matching a pattern.

Javascript

Process message data using Javascript code.

JSON Schema Validation

Validate message data against a JSON schema.

Join

Join multiple messages arriving from different sources into a single message. Messages can be aligned in time. Different modes are available to handle data with different sampling rates.

JSON

Converts to/from JSON and the internal data representation.

Key Value Delete

Delete an entry from the internal key/value store.

Math Expression

Evaluate generic mathematical expressions on message data.

Math

Evaluate generic mathematical expression on message data.

Memory Buffer

Buffers messages in front of output modules so that no data is lost even if the availability of external systems is intermittent. For example, due to connectivity issues. The buffer size is configurable. Supports configurable retries by looking at the status property delivered by all output modules. Can also be used to smooth out bursty message flows by specifying a message delay.

Message Counter

Calculate statistics on message value counts. For example, KPI calculations.

Object To Array

Converts an object with key=value properties to an array of objects with separate name and value properties.

Property Mapper

Renames properties on incoming messages. Can also be used to remove unwanted properties from messages.

Python Bridge

Process message data using custom Python code.

This module uses a standard Python 3 interpreter running outside .NET core, hence any library can be used.

Range Classifier

Map numerical ranges of a property on the incoming message to text strings added to the output messages.

Range Filter

Only let through messages where some numerical parameter is either within or outside a specified range.

Note: This functionality is also available using the message filters present on all modules.

Report By Exception

Only let through messages where a selected parameter has changed. Supports grouping over multiple source labels.

Scale

Scale a numerical value and/or add an offset. 

Smooth

Smooth numerical data by applying either an exponential filter or by averaging over a rolling time window.

Split

Split messages onto separate paths by defining conditions on message data.

State

Temporarily stores any message properties. Used to keep data that is updated infrequently but needs to be added to more frequent messages.

Statistics

Calculates statistics on selected data over a rolling window, specified either by time or by number of samples. Supports grouping over multiple source labels. Outputs average, median, standard deviation, min, max, and sample count.

This module will eventually replace the Standard Deviation module.

String Replace

Replace text on a selected property in a message.

String Substring

Extract a substring of a string on a selected property.

Text Template

Create a text message based on a template that uses data from the incoming message.

Throttle

Limit the peak rate of messages by discarding messages when the specified peak rate is reached.

Time Counter

Calculate statistics on message value times. For example, KPI calculations.

Time Difference

Calculate the difference between timestamps.

Timeout

Generate a message when no message (fulfilling some condition) has been received within the specified timeout period. Can be used to detect loss of connectivity with a sensor or other data source.

Timestamp

Converts between timestamp formats and can also add the current time to an incoming message.

Toggle

Toggle the value of a boolean property.

Unique Counter

Count the number of different values seen on a selected property of the incoming message.

Window

Create sliding and tumbling windows (arrays) out of a sequence of messages.

XML

Converts to/from XML and the internal data format.