Skip to content

Increase robustness of dsync#1

Open
johnholiver wants to merge 1 commit intomasterfrom
joao/dgraph_backup_process_already_in_progress
Open

Increase robustness of dsync#1
johnholiver wants to merge 1 commit intomasterfrom
joao/dgraph_backup_process_already_in_progress

Conversation

@johnholiver
Copy link

  • centralize file processing in processEvent
  • improve error handling
  • enhance S3 transport settings
  • add README.

- centralize file processing in processEvent
- improve error handling
- enhance S3 transport settings
- add README.
@johnholiver johnholiver force-pushed the joao/dgraph_backup_process_already_in_progress branch from d829158 to 2fc176f Compare February 17, 2026 16:31
if strings.Contains(err.Error(), "This multipart completion is already in progress") {
syn.Logger.Warn("Detected concurrent completion, verifying if object exists...")
time.Sleep(5 * time.Second)
_, statErr := syn.MinioClient.StatObject(ctx, syn.bucketName, syn.findObject(stat.Name()), minio.StatObjectOptions{})
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is that really helping? An object could exist, but its content might be corrupt. Also, we are overwriting the same object on each export, meaning this will never fail (as long as we don't reset the bucket)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants