Skip to content

Ballista: Make shuffle partitions configurable #701

@andygrove

Description

@andygrove

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
When running the benchmarks, I would like to be able to specify the default number of shuffle partitions, rather than have it hard-coded.

Describe the solution you'd like
Introduce a new configuration struct that can be passed to the constructor for a BallistaContext and propagate the settings to the scheduler when executing a query.

Describe alternatives you've considered
None

Additional context
None

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions