Resumable simultaneous multipart upload to GCS bucket

Hello,

I have a react application which uses resumable.js to chunk a selected video file and send individual chunks to a backend Node.js API which uploads the chunks to GCS.
I was previously using Amazon S3 multipart upload. With that I was able to achieve parallel chunk uploads from frontend where the backend API does not have knowledge about the original file. But with GCS I am unable to achieve that.

I am currently using GCS JSON API to upload chunks. But I am able to send file chunks one after another. This is making my upload process were long and time consuming. I want my file upload to be faster which can be achieved only by resumable parallel chunk upload.

I tried using XML API, but I was encountering the error “read eCONNRESET” randomly and somehow managed to upload the file. But the uploaded file in the bucket was corrupted.

I need to my application to be able to upload video files as large as 5GB smoothly to GCS bucket.

Please let me know if simultaneous chunk upload to a backend Server via HTTP is possible while creating a resumable session and the backend server does not have any knowledge about the original file path.

Any thoughts/ideas that can help me proceed here are appreciated. Thank you!

1 Like

Have you considered using GCS Compose operation after uploading the chucks into GCS bucket?