Hi !
I’m having issues with my servers backup stuff. Recently, I got a lot of “Rate Limit Exceeded” erros stating that the Drive is not accepting any more data. But I did not use the daily 750GB … I then think it might come from any quota of requests per minute or hour and that is applied to my structure.
Can anyone help me setting that up properly so that I won’t get like 10-15 email alerts from the servers per day and per server (I have 3 and nearly 4 servers) …
Thanks !!
Yes, @LePousson. There are some rate limits when using the Google Drive API. You may refer to the documentation (Usage limits) for further details and design your system accordingly.
@mokit yes i know that there are limits and quotas, that’s exactly what I ask help for … but as i do not know which limit I have reeched to get this “RateLimitExceeded”, how can I adjust my settings to fix the problem ???
While the 750GB is the daily “bucket,” there is a separate limit on API calls (e.g., checking whether a file exists or creating a new folder). I believe it is around 1,000 requests per 100 seconds per user. With 3 or 4 servers running backups simultaneously using the same account, you’re likely hitting this threshold.
Since you have multiple servers, they are likely competing for the same “quota lane.” Try these adjustments:
Stagger the Start Times: Don’t have all 4 servers start their backup at midnight. Offset them (e.g., Server A at 00:00, Server B at 02:00, etc.).
Reduce Threads: If your backup software (like Rclone or Duplicati) uses multiple “transfers” or “checkers” at once, dial them down. Moving from 10 concurrent transfers to 3 or 4 per server can often stop the errors entirely.
Use Service Accounts: If these are separate servers, consider giving each one its own Service Account via the Google Cloud Console. This distributes the request load across different “identities,” though they still share the 750GB daily upload limit if they’re moving data to the same shared drive.
@brettfreer i have no project at all on my Workspace strucutre, nothing at all, so no API calls for projects … Where does this annoying limit comes from ? Any way to know what is causing the issue ?
My understanding is that because you haven’t set up a project, your backup software is likely using Google’s default “Global” API project.
@brettfreer Sorry if i look like a total noob but I got this Workspace structure like 8 years ago, when it was still not called Workspace … just for the nearly unlimited storage space on google drives.
I am just total noob about the API, the projects etc … so you’re probably right when you talk about “Global GDrive API” … But where should I check what is wrong ?
What backup software are you using? Does it use native Drive API integration?
@brettfreer I’m using the internal built-in CloudSync from TrueNAS Scale (now called Community), and had to OAuth to be connected … Until recently, I did not have any RateLimit problem except sometimes when I had to upload more than 750GB … So i’m not sure that this is coming from CloudSync (especially cause I only run a differential copy from source to drive onc e a day), or maybe one the quotas recently applied may cause the problem but as I can’t know which limit I reached, impossible for me to fix the problem …
I still think it is worth testing staggering start times. However, if you create your own Google Cloud Project, you get your own Client ID and Secret, which you put into your backup software:
You are no longer sharing a limit with other users of that software.
You get a dedicated “bucket” of 1,000 requests per 100 seconds just for your servers.
You can actually log in to the console and see the graphs of exactly when and why you are being throttled.
I would spend some time researching this.
@brettfreer i’m the only user, even if I have 5 accounts on my Workspace …
here is why i’m pretty sure that it does not come from the CloudSync itself …
any idea ??