Activation functions in deep learning: A comprehensive survey and benchmark
Activation functions in deep learning: A comprehensive survey and benchmark
S. Dubey,S. Singh,B. Chaudhuri
2021 · DOI: 10.1016/j.neucom.2022.06.111
Neurocomputing · 890 Zitierungen
TLDR
A comprehensive overview and survey is presented for AFs in neural networks for deep learning, covering different classes of AFs such as Logistic Sigmoid and Tanh based, ReLU based, ELU based, and Learning based.