Relu Variants Explained | Leaky Relu | Parametric Relu | Elu | Selu | Activation Functions Part 2

Published: 09 June 2022
on channel: CampusX
29,757
1.3k

This is part 2 of the Activation Function Series. In this video, we will discuss the dying relu problem and then learn about the following variants of Relu activation function:

1. Leaky Relu
2. Parametric Relu
3. Elu
4. Selu

Digital Notes for Deep Learning: https://shorturl.at/NGtXg

👍If you find this video helpful, consider giving it a thumbs up and subscribing for more educational videos on data science! Share your thoughts, experiences, or questions in the comments below. I love hearing from you!

============================
Do you want to learn from me?
Check my affordable mentorship program at : https://learnwith.campusx.in
============================

📱 Grow with us:
CampusX' LinkedIn:   / campusx-official  
CampusX on Instagram for daily tips:   / campusx.official  
My LinkedIn:   / nitish-singh-03412789  
Discord:   / discord  

✨ Hashtags✨
#ActivationFunctions #ReluVariants #NeuralNetworksExplained

⌚Time Stamps⌚

00:00 - Intro
00:44 - Dying Relu Problem
17:12 - Solutions
20:05 - Leaky Relu
22:47 - Advantages
24:29 - Parametric Relu
25:44 - Exponential Linear Unit
28:40 - Disadvantages
29:09 - Scaled Exponential Linear Unit
33:00 - Outro


Watch video Relu Variants Explained | Leaky Relu | Parametric Relu | Elu | Selu | Activation Functions Part 2 online without registration, duration hours minute second in high quality. This video was added by user CampusX 09 June 2022, don't forget to share it with your friends and acquaintances, it has been viewed on our site 29,757 once and liked it 1.3 thousand people.