You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We move files from GCP object store to PV for processing and there are more then 100+ files (ranging from 15 to 30GB) to be transferred daily.
Dapr supports one by one file transfer and hence not been able to use dapr object store binding for this. One by one file transfer takes long time to complete.
Using GCP SDK (java) completes the 100+ file transfers in around 1 minutes or less.
We would like to go with dapr binding for this requirement as well.
Can we have feature similar to how GCP sdk provides for transfer of files from a object store to PV. Provision to transfer files in parallel from one object store to PV makes it very fast.
Likewise, support for Azure and AWS will be helpful.
The text was updated successfully, but these errors were encountered:
rahulpoddar-fyndna
changed the title
Bulk file transfer in parallel from Object store to PV
GCP Storage Bucket binding: Bulk file transfer
Jan 24, 2025
We move files from GCP object store to PV for processing and there are more then 100+ files (ranging from 15 to 30GB) to be transferred daily.
Dapr supports one by one file transfer and hence not been able to use dapr object store binding for this. One by one file transfer takes long time to complete.
Using GCP SDK (java) completes the 100+ file transfers in around 1 minutes or less.
We would like to go with dapr binding for this requirement as well.
Can we have feature similar to how GCP sdk provides for transfer of files from a object store to PV. Provision to transfer files in parallel from one object store to PV makes it very fast.
Likewise, support for Azure and AWS will be helpful.
The text was updated successfully, but these errors were encountered: