Transfer files from GS bucket to Filestore instance between different projects using Python client

[Wojciech2]

I want to transfer files from GS bucket in a project A to a Filestore instance in a project B . My current approach is to run python client in a notebook in the project A and copy files to notebook’s memory with gs client. Next I am streaming copied files from the notebook to a pod in project B which is mounted to Filestore.

Is there a way to stream files directly from gs bucket to a filestore instance between different projects?

[robertcarlos]

Hi @Wojciech2 ,

Welcome to Google Cloud Community!

There are several ways to transfer objects from Cloud Storage on project A to Filestore on project B.

• Transfer Appliance: If you’re looking to transfer data to Google Cloud offline or from an area with poor internet connectivity.
• Storage Transfer Service: If you want to transfer data to Google Cloud from an online data source, such as another cloud product.
• Transfer service for on-premises data: If you want to transfer data from on-premises to Google Cloud.

You could also use Compute Engine VM to mount Filestore file share. You could follow this documentation for the steps.

You could also check this documentation on transferring large datasets from Cloud Storage to Filestore.

Hope this helps.