|
Download README.md from vishwajeet456/NumPy: direct link, hf CLI and curl.
- Browser
- Download file 2.26 kB
-
https://huggingface.co/vishwajeet456/NumPy/resolve/main/README.md
- Command line
-
hf download hf://vishwajeet456/NumPy/README.md
-
curl -L -o README.md https://huggingface.co/vishwajeet456/NumPy/resolve/main/README.md
2.26 kB
metadata
license: mit
tags:
- image-classification
- mnist
- numpy
- from-scratch
- educational
datasets:
- mnist
metrics:
- accuracy
Four-Layer Neural Network from Scratch (NumPy)
A fully-connected network built with only NumPy: hand-derived backpropagation and mini-batch SGD, no deep-learning framework. It reaches 97.83% test accuracy on MNIST and trains in about 88 seconds on a Colab CPU.
Model Details
- Author: Vishwajeet Adkine
- Architecture:
784 → 128 → 64 → 32 → 10(four weight layers, 111,146 parameters) - Activations / loss: ReLU hidden layers, softmax output, cross-entropy with optional L2
- Initialisation: He (normal, variance 2 / fan-in)
- Implementation: NumPy
NeuralNetworkclass withforward,backward,stepandfit; backprop verified against numerical gradients before training
Intended Use
Learning and demonstration: seeing exactly how forward propagation, backpropagation and SGD work, without framework abstractions. Not intended for production use.
Training
| Data | MNIST (90% train / 10% validation split of the training set, official test set held out) |
| Preprocessing | pixels scaled to [0, 1], flattened to 784 |
| Optimiser | mini-batch SGD, batch size 128 |
| Learning rate | 0.1 with ×0.95 decay per epoch |
| Regularisation | L2, λ = 1e-4 |
| Epochs | 30 (default notebook config) |
| Hardware | Colab CPU |
Results
| Metric | Value |
|---|---|
| Test accuracy | 97.83% |
| Test loss | 0.0824 |
| Training time | 88.2 s (Colab CPU) |
Limitations
- Fully-connected layers ignore image structure, so accuracy is below convolutional models (the CIFAR-10 CNN project in this series covers that step).
- Plain SGD with a fixed decay: no momentum, Adam, dropout or batch normalisation.
- Evaluated on MNIST only, which is an easy, clean benchmark. Do not expect this accuracy on other digit images (different handwriting, backgrounds or scanning).
- No robustness or calibration analysis.
How to Use
net = load_weights("nn_weights.npz") # helper defined in the notebook
pred = net.predict(X_test[:5])
Licence
Code and weights: MIT. MNIST is by LeCun, Cortes and Burges.