Level up your Box knowledge with brand new learning paths on Box University. Visit training.box.com to get started

Box Status

Is it possible to change part_size of a chunked upload session ?

Answered
Follow
New post
ashok_k

It seems like the Box Platform auto-determines the part_size of a chunk during a chunked upload session. Is it possible to modify or specify a desired part_size ?

 

For a trial I did, the part_size was 8Mb when I was uploading a 50Mb file; was 16Mb for a 200Mb file and 32Mb for a 1Gb file. For the network bandwidth that I'm using, a 32Mb chunk is just too large to handle and hence requires multiple resumes of the chunked uploader. A smaller chunk size would be ideal. But I don't see a way to specify it.

 

API reference:

"part_size" is one of the response parameters (https://developer.box.com/reference/resources/upload-session/#param-part_size) for a call to "Create upload session" (https://developer.box.com/reference/post-files-upload-sessions/)

 

0

Comments

5 comments

Date Votes
  • cbetta

    Hi , we currently do not support changing the part size when using chunked uploads. 

    0
    Comment actions Permalink
  • ashok_k

    Thanks for your response. I'd appreciate any other ideas you might have on how to handle file uploads in a slow network area ? I have to upload a file that is ~500Mb in size.

    When I tried tests with a 20Mb & 30 Mb files,
    * The effective upload rate is ~65kbps for the direct file uploader with the accelerator URL turned on.
    * The effective upload rate is ~50kbps for the chunked file uploader. But for these smaller sized files, the chunk size is 8Mb with which the network is able to complete upload of all the parts. With larger file sizes, the chunk size increases to 16Mb and 32Mb, and at this chunk size, there is a proxy error or some other network related errors that abort a chunk upload. Doesn't matter how many times I resume, the same thing happens.

    On the same computer, connected to the same slow network, I can open Box in the Web browser and am able to upload the 500Mb file. So I'm assuming that Box has other upload techniques that I'm not aware of.

    0
    Comment actions Permalink
  • cbetta

     interesting. Would your users be able to use the UI elements to upload a file? As far as I know we don't use different part sizes in our app that we use in the API.

    0
    Comment actions Permalink
  • ashok_k

    Thanks . 

    I will check on the UI piece ... our original use-case was to run this without user interaction - will see if using the UI would be acceptable to the user group. I'm also checking if they can bump up their network bandwidth.

    I have clarity on the options available ... we can consider this thread as closed.

     

    BTW, thought you might be interested ... While digging into this, I think there is a possibility in the Python SDK for file digests to be incorrect when using the chunked uploader. I raised this issue at GitHub https://github.com/box/box-python-sdk/issues/495. This file digest issue is unrelated to the issue in this thread ... but something associated that I thought might be of interest.

    0
    Comment actions Permalink
  • cbetta

    Tnx  . As for that Python issue, you listed it directly with the SDK team and they will look into it shortly.

    0
    Comment actions Permalink

Please sign in to leave a comment.