Backend
VL (Velox)
Bug description
In vanilla spark, the stage id of the WholeStageCodegenExec always starts with 1 in each SQL query
However in Gluten, the stage id is generated from a global counter, which accumulates across different queries. This number can grow very large in a long running spark session.
Gluten version
No response
Spark version
None
Spark configurations
No response
System information
No response
Relevant logs
Backend
VL (Velox)
Bug description
In vanilla spark, the stage id of the
WholeStageCodegenExecalways starts with 1 in each SQL queryHowever in Gluten, the stage id is generated from a global counter, which accumulates across different queries. This number can grow very large in a long running spark session.
Gluten version
No response
Spark version
None
Spark configurations
No response
System information
No response
Relevant logs