|
|
|
|
|
linguist.page@gmail.com
Home
»
Computational Linguistics
»
Machine Learning
»
Neural Networks & Deep Learning
»
Foundations
Biological inspiration (neuron analogy)
Perceptron
Activation functions (sigmoid, tanh, ReLU, GELU, softmax)
Multi-layer perceptron (MLP)
Forward propagation
Loss functions (MSE, cross-entropy, NLL)
Backpropagation (chain rule in action)
Weight initialization
Batch normalization
Dropout regularization
Epochs, batches, iterations