AWS Storage Bucket binding: Bulk file transfer

[rahulpoddar-fyndna]

We move files from AWS object store to PV for processing and there are more then 100+ files (ranging from 15 to 30GB) to be transferred daily.

Dapr supports one by one file transfer and hence not been able to use dapr object store binding for this. One by one file transfer takes long time to complete.

Using AWS SDK (java) completes the 100+ file transfers in around 1 minutes or less.

We would like to go with dapr binding for this requirement as well.

Can we have feature similar to how AWS sdk provides for transfer of files from a object store to PV. Provision to transfer files in parallel from one object store to PV makes it very fast.

[github-actions]

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

[github-actions]

This issue has been automatically closed because it has not had activity in the last 37 days. If this issue is still valid, please ping a maintainer and ask them to label it as pinned, good first issue, help wanted or triaged/resolved. Thank you for your contributions.

[nelson-parente]

not stale!

[github-actions]

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

[alicejgibbons]

not stale!