Skip to content

fix(services/s3): Batch max operations from config#2354

Closed
manulpatel wants to merge 14 commits intoapache:mainfrom
manulpatel:batch_max_operations-from-config
Closed

fix(services/s3): Batch max operations from config#2354
manulpatel wants to merge 14 commits intoapache:mainfrom
manulpatel:batch_max_operations-from-config

Conversation

@manulpatel
Copy link
Copy Markdown
Contributor

Related issue: #2228

This PR allows to read batch_max_operations from config and takes default value of 1000 if not specified explicity.

Comment thread core/src/services/s3/backend.rs Outdated
Comment thread core/src/services/s3/backend.rs Outdated
/// the part size of s3 multipart upload, which should be 5 MiB to 5 GiB.
/// There is no minimum size limit on the last part of your multipart upload
write_min_size: Option<usize>,

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please add a new function for batch_max_operations so that users can assign it.

Comment thread core/src/services/s3/backend.rs Outdated
@github-actions github-actions Bot added the releases-note/fix The PR fixes a bug or has a title that begins with "fix" label May 30, 2023
@Xuanwo
Copy link
Copy Markdown
Member

Xuanwo commented Jun 1, 2023

The next step is load batch_max_operations (set to default if not user set) in build.

use std::fmt::Debug;
use std::fmt::Formatter;
use std::fmt::Write;
use std::string;
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am not seeing why we need to use std::string here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

releases-note/fix The PR fixes a bug or has a title that begins with "fix"

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants