We use Invantive to copy consolidate a range of traditional database platforms into a central SQL Server reporting instance. It concerns hundreds of tables across multiple countries. The data volume is large and full copies take long.
Manually we can create a script to solely update records with an updated timestamp, but we would like improved SQL support for watershed loading using synchronize
or union distinct
such that it scales to beyond 100 tables and 100 GB of cold data.