File.download_to hangs

We have quite a large folder ( in terabytes with a lot of files about 20GB each) that I need to download to my local external hard drive.

Trying to use Box native application does not work as it tries to get the files into a cache first ( which is limited and difficult to change ) and I get disk full error even before the first file is downloaded to the final location.

To overcome the issue I wrote some simple python script that uses Box API to get IDs of all files I need then calls File.download_to in a loop.

That works for the first few files then I get:

Request "GET https://api.box.com/2.0/files/<id>/content" failed with ConnectionError exception: ConnectionError(ProtocolError('Connection aborted.', TimeoutError(60, 'Operation timed out')))

File.download_to call never returns after that, even after waiting more than 24 hours.

I understand the connection can be aborted but it should error out instead of hanging. Any way to fix this ?

Papa Carlo

23 juillet 2024 17:19

The workaround we did was: Instead of using File.download_to we use File.get_download_url and then download the file using other means where we have full control over timeouts, retires etc.

Rona

24 juillet 2024 20:02

Hi there,

Welcome to Box Community and glad to assist!

To help address your error, please take it to our Developer team by posting it to forum.box.com.

Thanks for posting!

Commentaires