429 error when retrieving database data

The advice is to check in the timeline which requests have a long processing time. You can find this in the menu on the left-hand side on Invantive Cloud.

For example, this request takes 10 minutes, whereas with PjtTimeTransactionsIncremental it is usually finished within a few seconds:

Furthermore, the advice is not to start all downloads at the same time; vary the start times by choosing non-round times such as 04:53 instead of 05:00.

It is also advisable not to start downloads around 02:00; systems are often down for maintenance at that time, and the extra processing time does still count towards the totals. It’s better to start from 04:00 UTC onwards.

The example below shows how many run simultaneously en masse (and wait):

We will also be looking into whether it’s possible to temporarily add some extra leeway to the fresh duration rate limiter.