Skip to content

ci: Refactor sync-test-datasets workflow to use s5cmd for S3 sync#142

Open
edmundmiller wants to merge 1 commit intomainfrom
improve-test-datasets
Open

ci: Refactor sync-test-datasets workflow to use s5cmd for S3 sync#142
edmundmiller wants to merge 1 commit intomainfrom
improve-test-datasets

Conversation

@edmundmiller
Copy link
Contributor

  • Replace AWS CLI with s5cmd for improved performance and efficiency in syncing branches to S3.
  • Add caching for s5cmd installation to speed up workflow execution.
  • Update branch checkout process to use actions/checkout for better handling of specific branches.

@edmundmiller edmundmiller requested a review from maxulysse as a code owner June 3, 2025 22:17
@edmundmiller edmundmiller self-assigned this Jun 3, 2025
- Replace AWS CLI with s5cmd for improved performance and efficiency in syncing branches to S3.
- Add caching for s5cmd installation to speed up workflow execution.
- Update branch checkout process to use actions/checkout for better handling of specific branches.
@edmundmiller edmundmiller force-pushed the improve-test-datasets branch from a743f6c to 54cd327 Compare June 30, 2025 22:10
@edmundmiller edmundmiller requested a review from a team as a code owner June 30, 2025 22:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant