Skip to content

feat: hyperparameter optimization for classical models#843

Merged
sibre28 merged 118 commits intomainfrom
264-hyperparameter-optimization
Aug 31, 2024
Merged

feat: hyperparameter optimization for classical models#843
sibre28 merged 118 commits intomainfrom
264-hyperparameter-optimization

Conversation

@sibre28
Copy link
Contributor

@sibre28 sibre28 commented Jun 19, 2024

Closes #264

Adjusted classical ML-Models to support taking a Choice Parameter

New Features for Classifiers and Regressors:

  • combined Linear,Lasso,Ridge and ElasticNetRegressor into ElasticNetRegressor

  • changed property methods and parameter types

  • added fit_by_exhaustive_search(), to fit a model with all combinations of given Choices

  • added Errors for using the wrong fit method (fit with or fit_by_exhaustive_search without Choice Parameter)

  • added Enums ClassifierMetric and RegressorMetric, which are passed to fit_by_exhaustive_search to determine the optimization metric

  • added cross validation in fit_by_exhaustive_search

  • added multiprocessing in fit_by_exhaustive_search

  • added tests for all methods and classes

@sibre28 sibre28 linked an issue Jun 19, 2024 that may be closed by this pull request
@github-actions
Copy link
Contributor

github-actions bot commented Jun 19, 2024

🦙 MegaLinter status: ✅ SUCCESS

Descriptor Linter Files Fixed Errors Elapsed time
✅ PYTHON black 45 0 0 1.75s
✅ PYTHON mypy 45 0 3.84s
✅ PYTHON ruff 45 0 0 0.37s
✅ REPOSITORY git_diff yes no 0.58s

See detailed report in MegaLinter reports
Set VALIDATE_ALL_CODEBASE: true in mega-linter.yml to validate all sources, not only the diff

MegaLinter is graciously provided by OX Security

@sibre28 sibre28 changed the title feat: hyperparameter optimization feat: hyperparameter optimization for classical models Jul 11, 2024
@sibre28 sibre28 self-assigned this Jul 14, 2024
@sibre28 sibre28 marked this pull request as draft July 15, 2024 11:27
@sibre28 sibre28 marked this pull request as ready for review July 18, 2024 16:28
@sibre28 sibre28 merged commit d8f7491 into main Aug 31, 2024
@sibre28 sibre28 deleted the 264-hyperparameter-optimization branch August 31, 2024 13:19
lars-reimann pushed a commit that referenced this pull request Sep 17, 2024
## [0.28.0](v0.27.0...v0.28.0) (2024-09-17)

### Features

* hyperparameter optimization for classical models ([#843](#843)) ([d8f7491](d8f7491)), closes [#264](#264)
* hyperparamteroptimization for rnns and cnns ([#923](#923)) ([b1e8933](b1e8933)), closes [#912](#912)
@lars-reimann
Copy link
Member

🎉 This PR is included in version 0.28.0 🎉

The release is available on:

Your semantic-release bot 📦🚀

@lars-reimann lars-reimann added the released Included in a release label Sep 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

released Included in a release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Hyperparameter optimization

4 participants