Skip to content

The spilled bytes metric of CometSort is not a size metric #983

@Kontinuation

Description

@Kontinuation

Describe the bug

The metrics of CometSort nodes shown in the SQL tab of Spark UI have invalid spilled bytes metrics. It shows spilled bytes as time instead of size.

image

Steps to reproduce

Run any SQL queries involving native sort with comet enabled.

Expected behavior

Spill size shown as size instead of time.

Additional context

This problem is reproduced using the latest commit of the main branch: f64553b

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions