Skip to content

Add version field to ExecutionContext #1517

@tfeda

Description

@tfeda

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

#1514 points out a secondary goal for the python library to expose the datafusion and arrow-rust versions.
I think Spark has a good implementation of this by binding the spark version to SparkContext in the jvm code, then exposing it to the pyspark API. pyspark's version itself is hard-coded.

Describe the solution you'd like

Add a version field to the ExecutionContext struct, and expose it to the datafusion-python library. The version could then be retrieved by users by calling ExecutionContext.version

Describe alternatives you've considered

Leaving it out of the rust implementation and just putting it in the python version.

Additional context
I'm not sure how arrow-rust's version would be added, but a similar approach could be taken.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions