DL EXAM SPRINT
0 / 22 mastered
B.Tech III Year · Mid-term field manual

Train your intuition.
Then show the math.

One complete source for Neural Networks and Deep Learning: concept → formula → worked example → exam cue. Thodi Hinglish, taaki definitions yaad nahi—samajh aaye.

22 topics9 interactive labsformula sheetmixed testoffline after load
x₁ × w₁x₂ × w₂x₃ × w₃Σwᵢxᵢ+ bf(z)ŷ
Signal flow: weights scale evidence, bias shifts the threshold, activation introduces nonlinearity.
Interactive bench

Change inputs. Watch the mechanism.

Every plot has labels and a text readout.

Artificial neuron calculator

Compute z=w₁x₁+w₂x₂+b, then apply sigmoid.

1.0
0.8
2.0
-0.5
0.2

Activation oscilloscope

1.0

Text equivalent: selected function, current output and derivative are shown above.

DNN parameter counter

Enter layer widths, e.g. 4, 3, 2. Each dense layer has nᵢnᵢ₊₁+nᵢ₊₁ parameters.

Perceptron: one update

Rule: w←w+η(y−ŷ)x; b←b+η(y−ŷ).

Gradient descent trajectory

Objective J(θ)=θ², gradient .

0.20

Backprop chain-rule tracer

For ŷ=wx+b; L=½(ŷ−y)².

Optimizer stepper

Same gradient sequence; compare adaptive step sizes.

AdagradRMSPropAdadelta
Optimizerθ nowMemoryInterpretation

Dropout visualizer

0.3

Bias–variance curve explorer

Complexity moves model from underfit → useful fit → overfit.

5
training errorvalidation error
Mechanism maps

Where information moves

x ∈ R²inputz¹,a¹ ∈ R²W¹: 2×2b¹: 2ŷ ∈ RW²: 1×2affine+σaffine+σ
Canonical 2→2→1 tensor flow: 4+2+2+1=9 trainable parameters.
(0,0) class 0(1,1) class 0(0,1) class 1(1,0) class 1Any line leavesone same-class pointon the wrong side.
XOR needs a nonlinear hidden representation; a single perceptron can draw only one line.
input a⁰hidden a¹loss Lactivationsprediction∂L/∂a¹∂L/∂a⁰
Forward computes values; backprop reuses them to pass gradients in reverse. The optimizer updates parameters afterward.
TRAIN 70%VALIDATE 15%TEST 15%fit W,btune η, depthevaluate onceselected model
Leakage-safe flow: preprocessing statistics also come only from training data; the test set never guides tuning.
Rapid recall

Formula + comparison sheet

One screen before the exam.

CompareFirstSecondExam-safe distinction
Parameter / hyperparameterW, b; learnedη, batch size, depth; chosenModel learns parameters; validation helps choose hyperparameters.
Batch / SGD / mini-batchAll samples / one sampleSmall subsetMini-batch balances stable vectorized updates and useful noise.
Underfit / overfitTrain & validation errors highTrain low, validation highHigh bias versus high variance.
L1 / L2Sparse, absolute penaltySmooth shrinkage, squared penaltyL1 can set weights exactly zero; L2 usually does not.
Backprop / optimizerComputes gradientsUses gradients to updateBackprop is not an optimizer.
Neural bias / statistical biasTrainable offset bSystematic modeling errorSame word, different concepts.
Test mode

10-question mid-term drill

Score is saved locally.