This repository was archived by the owner on Nov 17, 2023. It is now read-only.
This repository was archived by the owner on Nov 17, 2023. It is now read-only.
Feature Request- Add Mish Activation Function #16841
Description
Mish is a new novel activation function proposed in this paper.
It has shown promising results so far and has been adopted in several packages including:
- TensorFlow-Addons
- SpaCy (Tok2Vec Layer)
- Thinc - SpaCy's official NLP based ML library
- Echo AI
- CNTKX - Extension of Microsoft's CNTK
- FastAI-Dev
- Darknet
- Yolov3
- BeeDNN - Library in C++
- Gen-EfficientNet-PyTorch
- dnet
All benchmarks, analysis and links to official package implementations can be found in this repository
It would be nice to have Mish as an option within the activation function group.