ML topics I love exploring
Tag

Activation Function

#activation-function

More content

Read more stories on Hashnode

Articles with this tag

Identifying and Removing Dead Neurons in Training Neural Networks: Mechanistic Interpretability Part 2

Dec 30, 20249 min read

My last blog explained how to correctly initialize the last softmax layer of a neural network to reduce high but incorrect confidence when predicting...

Identifying and Removing Dead Neurons in Training Neural Networks: Mechanistic Interpretability Part 2