Biological inspiration (neuron analogy)

Perceptron

Activation functions (sigmoid, tanh, ReLU, GELU, softmax)

Multi-layer perceptron (MLP)

Forward propagation

Loss functions (MSE, cross-entropy, NLL)

Backpropagation (chain rule in action)

Weight initialization

Batch normalization

Dropout regularization

Epochs, batches, iterations