Scenario 2 workflow: eDNA to PI migration

Note: In order to properly migrate eDNA data to the temporary Data Archive, be sure there is a valid archive registered for the entire time range that the eDNA data covers.

1. Follow the instructions in this topic: Generate PI tags for eDNA point data.

2. Review and modify the mapping file as needed (change types and names).

3. Use PI Builder to create new PI tags on the target Data Archive based on the mapping file.

4. Communicate a tag freeze during the migration process. Advise administrators not to edit or create PI tags during the migration process.

5. PI tag edits can be disabled on the target Data Archive by limiting or restricting access permissions.

6. Force an archive shift to ensure the backfilling is performed on non-primary archive files.

7. Back up the target Data Archive. See Backup your source Data Archive for instructions.

8. Install Data Archive on the temporary Data Archive. Make sure to use the same version that is installed on the target Data Archive.

9. (Optional) Download the zip file that contains the license for the temporary Data Archive from the customer support portal to the host machine. The zip file contains the required license file (pilicense.dat).

10. Restore the backup to the temporary Data Archive. See Restore a Data Archive backup to a new computer.

11. (Optional) Create new historical archives if backfilling data that is outside the range of the current, target Data Archive. For example, if the target Data Archive contains data from 2020 onward, but the eDNA server contains data from 2010 to 2023, you would need to create additional archives for data in the 2010-2020 time range. See Manage archive gaps.

    Tip: Before creating empty archives, estimate the amount of data to migrate and then size accordingly. Size archives large enough to avoid auto-dynamic sizing, which significantly slows down the backfilling process. It is more efficient to create a smaller number of larger archive files for backfilling, than to create several smaller-duration archives. Any extra, empty space will be discarded during the merge process.

12. Run the eDNA to PI Migration Utility on the temporary Data Archive using the mapping file.

13. Ensure that all data has been flushed to disk on the temporary Data Archive and then stop the temporary Data Archive.

14. Copy and move archives from the temporary Data Archive to the target Data Archive server.

15. Bring the target Data Archive online. See Start and stop Data Archive.

16. On the target Data Archive, enable PI tag editing using the Database Security tool in PI System Management Tools (SMT). See Set access permissions with the Database Security tool.

17. Ensure that all archives are registered.

18. Finalize configuration of interfaces and tags to enable data collection for collected points.

19. Validate that all data has been transferred successfully.

20. Delete the temporary Data Archive and associated infrastructure.