Activation Functions - EXPLAINED!
We start with the whats/whys/hows. Then delve into details (math) with examples.
Follow me on M E D I U M: https://towardsdatascience.com/likeli...
REFERENCES
[1] Amazing discussion on the "dying relu problem": https://www.quora.com/What-is-the-dyi...
[2] Saturating functions that "squeeze" inputs: https://stats.stackexchange.com/quest...
[3] Plot math functions beautifully with desmos: https://www.desmos.com/
[4] The paper on Exponential Linear units (ELU): https://arxiv.org/abs/1511.07289
[5] Relatively new activation function (swish): https://arxiv.org/pdf/1710.05941v1.pdf
[6] Used an Image of activation functions from this Pawan Jain's Blog: https://towardsdatascience.com/comple...
[7] Why bias in Neural Networks? https://stackoverflow.com/questions/7...
Watch video Activation Functions - EXPLAINED! online without registration, duration hours minute second in high quality. This video was added by user CodeEmporium 18 March 2020, don't forget to share it with your friends and acquaintances, it has been viewed on our site 117,353 once and liked it 4.1 thousand people.