Purging Data from the Datastore

You can purge the dimension or measure data to permanently delete the data from the datastore. You can manually purge the data or schedule an event using the SQL Server Management Studio. It is recommended that you backup the datastore before purging any data.

You can specify a data purge execution date and time to manually purge the data. Alternatively, you can schedule a purge job and a data purge execution event. The purge job triggers a check to verify whether there was any data purge execution event since the last purge event.

If you manually specify a data purge execution date, then the data before the execution date is deleted from the datastore.

If you schedule a purge job and an execution event, for example, a purge job of one month, then at the end of each month the system triggers a check to identify if there is any data purge execution date during the last one month. The identified date is the Period End date. The data before the Period End date is deleted. The data with End Time values (aaValuePeriodEndTime) older than the Period End date and time that you specify is deleted from the datastore.

You can also specify the purge duration in days if you want to purge data for specific days. For example, if you schedule a purge job of one month and the purge job identifies a data purge execution date as August 31, 2020, then the Period End date is August 31, 2020 minus one month, that is, July 31, 2020. If you do not specify the duration, then the data before July 31, 2020 is purged. If you specify a duration, for example, 15 days, then the data before 15 days from July 31, 2020 is purged. That is, the data between July 16, 2020 and July 31, 2020 is purged.

The system purges:

• The measure data that has End Time values (aaValuePeriodEndTime) older than the Period Enddate and time that you specify.

• For a dimension that has a time-slice configured, the dimension records where the End Time values(aaValuePeriodEndTime) are older than the Period End date and time that you specify and thedimension records are not referenced by any other record in the datastore.

When you attempt to purge data, there is always a latency of 24 hrs. For example, the current date and time is August 31, 2020, 09:00:000 A.M. and the data purge Period End date and time is August 31, 2020, 09:00:000 A.M. The system purges the data before to August 30, 2020, 00:00:000 A.M. and does not delete the data between August 30, 2020, 00:00:000 A.M. and August 31, 2020 09:00:000 A.M.

Managing the Datastore For more information on configuring the data purge job provided by BI Gateway using SQL Server

Management Studio, see the Microsoft SQL Server documentation.

Note: To get the archive/purge jobs, contact technical support and request for Hotfix #2891262.