Set up and manage data sources

As an administrator, you can set up and manage AVEVA Insight data sources for your team.

Users with Administrator or Publisher roles can create data sources from various sources, including:

• InTouch applications

• Wonderware Historian

• InTouch Edge HMI

• Citect SCADA

• An OPC server

• A custom application that you have registered as a data source

• Use a CSV or JSON file as a data source (Administrator only) (Administrator only)

• Use an Azure Event Hub data source (Administrator only) (Administrator only)

• Use an Azure IoT Hub data source (Administrator only) (Administrator only)

Note the following while preparing data for upload to AVEVA Insight:

• You can upload a file with max size of 4 MB.

• You should try to consolidate data; processing data contained in one file is more efficient than data spread across several files. For example, instead of uploading 100 files for a single day of data for 100 tags, consolidate the single day data for those 100 tags into a single file.

• You should avoid uploading more than 30 days worth of data within a five minute window. Exceeding this may result in a DistributedDataPattern error that results in AVEVA Insight being unable to accept new files. For example, if you have a file containing 1 year of data, AVEVA recommends splitting the file into smaller files containing 30 days of data which should then be uploaded in sequential 5 minute windows.

The Data Sources Page (Administrator only)

If you are an administrator, the Data Sources page lets you track current data sources.

From this page, you can:

• View all available data sources for your solution

• Define a CSV/JSON data source

• Define an Event Hub data source

• Define an IoT Hub data source

• View an upload history for CSV/JSON data sources

  Important: While you can view all existing data sources from this page, you can add or update only CSV and JSON data sources here. You must use the AVEVA Insight Publisher to add other data sources. (Also see Publisher prerequisites.)

• Remove a data source and all of its tags

  Important: Before you can remove an InTouch or OPC Server data source from AVEVA Insight, you must first stop the flow of data from the server.