How can we optimize performance when we upload large files to object storage service such as S3?
You may want to refer S3 transfer acceleration for faster uploads
For really large files the S3 multipart upload limits(like 10k parts) can be a problem. You still can upload a 5TB file, but it will be really slow(parts are pretty big).
Any suggestions other than using dedicated products like Aspera?
You may want to refer S3 transfer acceleration for faster uploads
For really large files the S3 multipart upload limits(like 10k parts) can be a problem. You still can upload a 5TB file, but it will be really slow(parts are pretty big).
Any suggestions other than using dedicated products like Aspera?