Artificial neuron calculator
Compute z=w₁x₁+w₂x₂+b, then apply sigmoid.
One complete source for Neural Networks and Deep Learning: concept → formula → worked example → exam cue. Thodi Hinglish, taaki definitions yaad nahi—samajh aaye.
Every plot has labels and a text readout.
Compute z=w₁x₁+w₂x₂+b, then apply sigmoid.
Text equivalent: selected function, current output and derivative are shown above.
Enter layer widths, e.g. 4, 3, 2. Each dense layer has nᵢnᵢ₊₁+nᵢ₊₁ parameters.
Rule: w←w+η(y−ŷ)x; b←b+η(y−ŷ).
Objective J(θ)=θ², gradient 2θ.
For ŷ=wx+b; L=½(ŷ−y)².
Same gradient sequence; compare adaptive step sizes.
| Optimizer | θ now | Memory | Interpretation |
|---|
Complexity moves model from underfit → useful fit → overfit.
One screen before the exam.
| Compare | First | Second | Exam-safe distinction |
|---|---|---|---|
| Parameter / hyperparameter | W, b; learned | η, batch size, depth; chosen | Model learns parameters; validation helps choose hyperparameters. |
| Batch / SGD / mini-batch | All samples / one sample | Small subset | Mini-batch balances stable vectorized updates and useful noise. |
| Underfit / overfit | Train & validation errors high | Train low, validation high | High bias versus high variance. |
| L1 / L2 | Sparse, absolute penalty | Smooth shrinkage, squared penalty | L1 can set weights exactly zero; L2 usually does not. |
| Backprop / optimizer | Computes gradients | Uses gradients to update | Backprop is not an optimizer. |
| Neural bias / statistical bias | Trainable offset b | Systematic modeling error | Same word, different concepts. |
Score is saved locally.