Deep Learning: Unit 1 (B) Notes: Deep Learning Fundamentals Part2 Notes

 UNIT-1 B

Deep Learning: Fundamentals

1.     The Softmax Function

2.     Cross-Entropy Loss Function

3.     Activation Functions

4.     Preprocessing

5.     Momentum

6.     Learning Rate Decay

7.     Weight Initialization

8.     Regularization

9.     Dropout