Adaptive activation functions in convolutional neural networks
Adaptive activation functions in convolutional neural networks
Sheng Qian,Hua Liu,2 Authors,Hau-San Wong
2018 · DOI: 10.1016/j.neucom.2017.06.070
Neurocomputing · 170 Citations
TLDR
This work explores three strategies to learn the activation functions, and allows the activation operation to be adaptive to inputs, and explores a strategy that basic activation functions are combined in a way of a hierarchical integration.