Learn about batch list description

In this section, we illustrate the capturing of data and how the interface moves through time to retrieve all batches.

Batch processing sequence

In this example, the dashed lines represent a time for the Abandoned Batch Date (AB), the Query Start Time (QST) and Query End Time (QET). You can configure the AB setting on the Time Settings tab. For additional information on the AB setting, refer to the Time Settings tab.

The batches processed by the interface are represented by the blue lines while the red lines represent the batches not processed. An arrow at the end of the line represents a batch without a QET.

Processing Data - First Round

Batches are queried from an SQL database based on the QST, QET and AB using the following formula:

start time ≤ QET and start time > AB
AND
end time = Ø OR end time ≥ QST

Using the example above, we can see that batches 1 through 5 satisfy the first half of the statement where the start time is less than the query's end time and greater than the abandoned batch date The remaining batches either have a start time greater than the query end time (batches 6 and 7) or have a start time that precedes the abandoned batch date (batches 8, 9, 10). This automatically disqualifies batches 6 through 10 from being processed because they do not satisfy the first requirement for inclusion.

The remaining batches (1 through 5) are then checked against the second requirement. Batches 1 and 2 do not have a discrete end time while batches 3 through 5 have an end time that is greater than the query start time. We can conclude then that in the first round, batches 1 through 5 will be processed.

Processing Data - Second Round

After the first round of data has been processed by the interface, the QST may change depending on the data processed. The method for determining the next query start time is to use the latest start date for a batch that has an end date.

Returning to our example diagram above, we can see that from the five remaining batches, only three have an end date (3, 4 and 5). Since Batch 5 has the latest start date, this will be the new query start time as defined in the example below.

Note: The QST will not change if the remaining batches do not have an end date.

If the query end time is not set, the interface continues to run until manually stopped. The interface stops after all batched up to the QET have been processed and the end time for the query is set.