ML topics I love exploring
Tag

optimization

#optimization

More content

Read more stories on Hashnode

Articles with this tag

The Kaiming initialization and Batch Normalization in Neural Networks

Jan 7, 202517 min read

In my last blog post, we discussed and solved through code, how to initialize the hidden layer in neural network properly, to get rid of dead neurons....

The Kaiming initialization and Batch Normalization in Neural Networks

Identifying and Removing Dead Neurons in Training Neural Networks: Mechanistic Interpretability Part 2

Dec 30, 20249 min read

My last blog explained how to correctly initialize the last softmax layer of a neural network to reduce high but incorrect confidence when predicting...

Identifying and Removing Dead Neurons in Training Neural Networks: Mechanistic Interpretability Part 2