03 / LEARNING CENTER · AIS BENNETT UNIVERSITY

Learning Center.

Visual essays, mathematical derivations, and interactive simulations. Follow the pedagogical curriculum from linear regression and classification to tree ensembles, deep neural networks, and sequence models.

CANONICAL CURRICULUM SEQUENCE
16 MODULES · FIRST PRINCIPLES
01 Linear Regression→02 Logistic Regression→03 Confusion Matrix & F1→04 ROC & AUC→05 Cross-Validation→06 Trees & Random Forests→07 Neural Networks & Deep Learning (CNNs / RNNs)→08 Random Forests→09 Bias-Variance→10 Train / Test / Validation→11 Double Descent→12 Equality of Odds→13 Reinforcement Learning→16 The Transformer: Attention Is All You Need
01 /6 min read
REGRESSION

Linear Regression: Ordinary Least Squares

Minimizing orthogonal Euclidean residuals in parameter space. Closed-form normal equations versus iterative gradient descent steps.

February 2024READ ESSAY →
σ(z)02 /7 min read
CLASSIFICATION

Logistic Regression & The Sigmoid Curve

Projecting continuous feature combinations onto calibrated probability bounds. Analyzing logit slopes, odds ratios, and linear decision boundaries.

March 2024READ ESSAY →
F1 Max (0.84)03 /9 min read
EVALUATION

Confusion Matrix, Precision-Recall & F1

Navigating severe class imbalance where baseline accuracy fails. Harmonic balance between false positive alarms, missed detections, and F1 optimization.

January 2024READ ESSAY →
AUC = 0.8904 /8 min read
EVALUATION

ROC & AUC: Diagnostic Power

Mapping the sensitivity vs. specificity tradeoff across continuous decision thresholds with confusion matrix projections and integral AUC estimation.

April 2024READ ESSAY →
05 /7 min read
VALIDATION

K-Fold Partitioning & Generalization

Mitigating sample bias and estimating performance variance through rotational holdout splits and out-of-fold validation.

December 2023READ ESSAY →
X ≤ 3.5Gini: 0.12Gini: 0.28ENSEMBLE FOREST BAGGING06 /10 min read
TREE ENSEMBLES

Decision Trees & Random Forests

Recursive feature space partitioning, Gini impurity minimization, and bootstrap aggregation (bagging) with random feature sub-sampling to suppress variance.

June 2024READ ESSAY →
← ∂L/∂w BACKPROPx₁x₂f(x)ŷ07 /15 min read
DEEP LEARNING

Neural Networks: A Visual Introduction

Constructing feed-forward computational graphs from first principles: layer activations, synaptic weights, Adam optimization, and live backpropagation feedback loops.

May 2024READ ESSAY →
2D InputFeature Map08 /12 min read
DEEP LEARNING

Convolutional Neural Networks (CNNs)

Spatial receptive fields, 2D discrete convolution kernels, hierarchical feature maps, and spatial invariance through pooling layers.

July 2024READ ESSAY →
x_t-1h_t-1x_th_tx_t+1h_t+109 /14 min read
DEEP LEARNING

Recurrent Networks (RNNs, LSTMs & Sequence Models)

Sequential temporal dynamics, Backpropagation Through Time (BPTT), vanishing gradients, LSTM memory gates, and Transformer self-attention.

August 2024READ ESSAY →
T1T2T3MAJORITY10 /11 min read
ENSEMBLE LEARNING

The Random Forest Algorithm

Bagging, random feature sub-sampling, and majority voting. How averaging many decorrelated trees collapses variance without adding bias.

September 2024READ ESSAY →
BIAS+ VARIANCE11 /10 min read
FOUNDATIONS

The Bias-Variance Tradeoff

Decomposing expected error into bias squared, variance, and irreducible noise. Underfitting, overfitting, and the KNN knob that dials between them.

September 2024READ ESSAY →
TRAIN 60%VAL 20%TESTONCE↻ REUSEDFITS PARAMSONE DATASET · THREE JOBS12 /9 min read
FOUNDATIONS

Train, Test & Validation: The Honest Split

Why one dataset must become three, what each partition is actually for, and how a single careless peek turns your final number into fiction.

September 2024READ ESSAY →
THRESHOLDcapacity →second descent ↘13 /12 min read
FOUNDATIONS

Double Descent

Error that rises at the interpolation threshold and then falls again. Why over-parameterised models generalise, and what minimum-norm bias has to do with it.

September 2024READ ESSAY →
TPR ✓FPR ✗PARITY PER GROUP14 /11 min read
FAIRNESS

Equality of Odds

Defining and measuring parity in true and false positive rates across groups, the equal-opportunity relaxation, and the three stages at which you can intervene.

September 2024READ ESSAY →
PITGOALSTATE →ACTION →REWARD15 /13 min read
SEQUENTIAL

Reinforcement Learning

Learning from delayed consequences instead of labels. Markov decision processes, the explore-exploit dilemma, grid worlds, and the Bellman recursion.

September 2024READ ESSAY →
Transformer Causal Attention Matrix PickerQ \ KTheneuralnetworklearnsfastThe100%3.0-∞mask-∞mask-∞mask-∞maskneural6%1.394%4.0-∞mask-∞mask-∞masknetwork2%0.926%3.572%4.5-∞mask-∞masklearns3%0.67%1.416%2.374%3.8-∞maskfast1%0.32%0.84%1.320%3.073%4.316 /16 min read
DEEP LEARNING

The Transformer: Attention Is All You Need

Eliminating recurrence with constant-path multi-head self-attention. Interactive dual-tower architecture, coreference attention simulator, and autoregressive generation.

September 2026READ ESSAY →