-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-13993][PySpark] Add pyspark Rformula/RforumlaModel save/load #11807
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
test it please |
|
Test build #53487 has finished for PR 11807 at commit
|
|
@jkbradley This is a follow-up for #9884 |
python/pyspark/ml/feature.py
Outdated
| +---+---+---+---------+-----+ | ||
| ... | ||
| >>> rf.fit(df, {rf.formula: "y ~ . - s"}).transform(df).show() | ||
| >>> model = rf.fit(df, {rf.formula: "y ~ . - s"}) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
How about reusing the fit model from above?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do you mean use the rf.fit(df) other than this rf.fit(df, {rf.formula: "y ~ . - s"}) ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Oh, sorry, I originally thought this was a new fit() being added, and I wanted to avoid unnecessary model fitting. I now see it was already there, so it's fine either way.
|
Test build #53602 has finished for PR 11807 at commit
|
|
LGTM |
## What changes were proposed in this pull request? https://issues.apache.org/jira/browse/SPARK-13993 ## How was this patch tested? doctest Author: Xusen Yin <yinxusen@gmail.com> Closes apache#11807 from yinxusen/SPARK-13993.
What changes were proposed in this pull request?
https://issues.apache.org/jira/browse/SPARK-13993
How was this patch tested?
doctest