Configure data filtering
- Last UpdatedFeb 27, 2023
- 2 minute read
You can specify whether to filter duplicate values from the data source to the PI System. Use data filtering to maximize the efficiency of the server load and to lower bandwidth and buffering consumption.
-
Download and extract the PI Connector data filtering configuration PowerShell script from the OSIsoft Customer Portal.
Note: The file includes instructions for using the script. You can run the script to change the mode of data filtering while the connector is running— that is, you do not need to restart the connector or the connector service for the mode change to take effect.
-
In the REST endpoint at the following location, specify 0 (None) or 1 (DuplicateDataFilter).
https://connector_IP:port/admin/api/configuration/DataFilterConfiguration
-
0 (None)
Every value from the data source is sent from the connector to the relay and then to the PI System.
-
1 (DuplicateDataFilter)
Values that are exactly equal to the previous value are not sent to the relay and the PI System. Once the value changes, that value and the previous value are sent to maintain the integrity of the data and assist with visualization.
-
Examples
For example, to enable DuplicateDataFilter, run the following PowerShell command.
.\ConnectorDataFilter -ConnectorHost 10.1.1.1:5460 -User user1 -Password **** -NewDataFilterMode 1
The following is example time-series data for a point when the setting is specified as 0 (None):
|
Time stamp |
Value |
|---|---|
|
10/10/17 9:32:14 AM |
OK |
|
10/10/17 9:31:54 AM |
Warning |
|
10/10/17 9:31:34 AM |
Warning |
|
10/10/17 9:31:14 AM |
Warning |
|
10/10/17 9:30:54 AM |
Warning |
|
10/10/17 9:30:34 AM |
OK |
If the setting were specified as 1 (DuplicateDataFilter), duplicate values between 9:30:54 and 9:31:54 would be filtered out:
|
Time stamp |
Value |
|---|---|
|
10/10/17 9:32:14 AM |
OK |
|
10/10/17 9:31:54 AM |
Warning |
|
10/10/17 9:30:54 AM |
Warning |
|
10/10/17 9:30:34 AM |
OK |