-
Notifications
You must be signed in to change notification settings - Fork 1.9k
Description
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
#1514 points out a secondary goal for the python library to expose the datafusion and arrow-rust versions.
I think Spark has a good implementation of this by binding the spark version to SparkContext in the jvm code, then exposing it to the pyspark API. pyspark's version itself is hard-coded.
Describe the solution you'd like
Add a version field to the ExecutionContext struct, and expose it to the datafusion-python library. The version could then be retrieved by users by calling ExecutionContext.version
Describe alternatives you've considered
Leaving it out of the rust implementation and just putting it in the python version.
Additional context
I'm not sure how arrow-rust's version would be added, but a similar approach could be taken.