Level up your Box knowledge with brand new learning paths on Box University. Visit training.box.com to get started

Box Status

Rate limit exceeded

Follow
New post
robassotti

I'm trying to upload programatically a great amount of files. Most of them are uploaded correctly, but some of them fail returning a 429 code error (rate limit exceeded).
I've been looking for more information about this rate limit on your documentation pages, but I haven't been able to find the values of this limit (file size, uploads per second/minute, time between uploads,... ?).
I've also seen in the documentation that this error should return a "time-to-retry" value, nevertheless I'm not able to find this value within the returned error.

What uploading strategy do you suggest to avoid this issue?

0

Comments

3 comments

Date Votes
  • rocks

    Hi ,

     

    In certain cases, Box needs to enforce rate-limiting in order to prevent abuse by third-party services and/or users. In the event that an excessive level of usage is reached, a standard 429 Too Many Requests error will be returned, with an indication of when to retry the request. In the event that back-to-back 429s are received, an exponential backoff algorithm is recommended.

     

    The limits are set on a per user basis and is based of number of uploads /s (this exact number may vary over time)

     

    Here are some common solutions to Rate Limiting:

     

    1. Backing off when rate limits are hit using an exponential back off method
    1. Caching information when possible to reduce necessary calls
    1. Imposing throttling on calls made from the application to Box
    1. Gathering estimates for the calls that are hitting the rate limits (what calls, how many, burst versus consistent) so that we can work with you to explore alternative solutions.


    Depending on the business urgency and amount of data which needs to be transferred to Box you could consider "Box Shuttle" our new managed content migration service provided by Box Consulting.

     

    Our User Services Team would be happy to clarify specific questions around the API Rate Limits and why you are not seeing a "time-to-retry" value. To get started, please submit a case here and select "API/Developer question..." to ensure your inquiry is routed appropriately.

     

    Peter

    0
    Comment actions Permalink
  • truedat101

    While the answer is detialed, the answer is not sufficient to explain why this is happening for my specific circumstances.  I need to know what criteria is applied to my account.  I uploaded three files this AM, using the node.js sdk for box.  I have no retry setup explicitly in my config.  I have noted the retryIntervalMS is default to 2000ms (https://github.com/box/box-node-sdk/blob/master/lib/util/config.js#L40) .  It looks like it will retry 5 times max before reporting an error.  Why should this get me a 429 error uploading only two files, with the box.net sdk defaults?  Are these defaults not suitable?

    0
    Comment actions Permalink
  • truedat101

    No reply, I guess I will file a ticket with support.

    0
    Comment actions Permalink

Please sign in to leave a comment.