Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -14,7 +14,7 @@ datasets:
|
|
| 14 |
metrics:
|
| 15 |
- accuracy
|
| 16 |
model-index:
|
| 17 |
-
- name: Catalyst SHD SNN Benchmark
|
| 18 |
results:
|
| 19 |
- task:
|
| 20 |
type: audio-classification
|
|
@@ -26,25 +26,37 @@ model-index:
|
|
| 26 |
- name: Float Accuracy (N3)
|
| 27 |
type: accuracy
|
| 28 |
value: 91.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
---
|
| 30 |
|
| 31 |
-
# Catalyst SHD SNN Benchmark
|
| 32 |
|
| 33 |
-
Spiking Neural Network
|
| 34 |
|
| 35 |
## Model Description
|
| 36 |
|
| 37 |
- **Architecture (N3)**: 700 β 1536 (recurrent adLIF) β 20
|
|
|
|
|
|
|
| 38 |
- **Neuron model**: Adaptive Leaky Integrate-and-Fire (adLIF) with learnable per-neuron thresholds
|
| 39 |
-
- **Training**: Surrogate gradient BPTT, fast-sigmoid surrogate (scale=25)
|
| 40 |
-
- **Hardware target**: Catalyst N3 neuromorphic
|
| 41 |
|
| 42 |
## Results
|
| 43 |
|
| 44 |
-
|
|
| 45 |
-
|--------|-------|
|
| 46 |
-
|
|
| 47 |
-
|
|
|
|
|
| 48 |
|
| 49 |
## Reproduce
|
| 50 |
|
|
@@ -52,16 +64,29 @@ Spiking Neural Network for spoken digit classification on SHD. Achieves 91.0% wi
|
|
| 52 |
git clone https://github.com/catalyst-neuromorphic/catalyst-benchmarks.git
|
| 53 |
cd catalyst-benchmarks
|
| 54 |
pip install -e .
|
|
|
|
|
|
|
| 55 |
python shd/train.py --neuron adlif --hidden 1536 --epochs 200 --device cuda:0 --amp
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 56 |
```
|
| 57 |
|
| 58 |
## Links
|
| 59 |
|
| 60 |
- **Benchmark repo**: [catalyst-neuromorphic/catalyst-benchmarks](https://github.com/catalyst-neuromorphic/catalyst-benchmarks)
|
| 61 |
-
- **
|
| 62 |
- **N3 paper**: [Zenodo DOI 10.5281/zenodo.18881283](https://zenodo.org/records/18881283)
|
| 63 |
- **N2 paper**: [Zenodo DOI 10.5281/zenodo.18728256](https://zenodo.org/records/18728256)
|
| 64 |
-
- **N1 paper**: [Zenodo DOI 10.5281/zenodo.18727094](https://zenodo.org/records/18727094)
|
| 65 |
|
| 66 |
## Citation
|
| 67 |
|
|
|
|
| 14 |
metrics:
|
| 15 |
- accuracy
|
| 16 |
model-index:
|
| 17 |
+
- name: Catalyst SHD SNN Benchmark
|
| 18 |
results:
|
| 19 |
- task:
|
| 20 |
type: audio-classification
|
|
|
|
| 26 |
- name: Float Accuracy (N3)
|
| 27 |
type: accuracy
|
| 28 |
value: 91.0
|
| 29 |
+
- name: Float Accuracy (N2)
|
| 30 |
+
type: accuracy
|
| 31 |
+
value: 84.5
|
| 32 |
+
- name: Float Accuracy (N1)
|
| 33 |
+
type: accuracy
|
| 34 |
+
value: 90.6
|
| 35 |
+
- name: Quantised Accuracy (N3, int16)
|
| 36 |
+
type: accuracy
|
| 37 |
+
value: 90.8
|
| 38 |
---
|
| 39 |
|
| 40 |
+
# Catalyst SHD SNN Benchmark
|
| 41 |
|
| 42 |
+
Spiking Neural Network trained on the Spiking Heidelberg Digits (SHD) dataset using surrogate gradient BPTT. Achieves 91.0% on SHD with adaptive LIF neurons (90.8% quantised int16).
|
| 43 |
|
| 44 |
## Model Description
|
| 45 |
|
| 46 |
- **Architecture (N3)**: 700 β 1536 (recurrent adLIF) β 20
|
| 47 |
+
- **Architecture (N2)**: 700 β 512 (recurrent adLIF) β 20
|
| 48 |
+
- **Architecture (N1)**: 700 β 1024 (recurrent LIF) β 20
|
| 49 |
- **Neuron model**: Adaptive Leaky Integrate-and-Fire (adLIF) with learnable per-neuron thresholds
|
| 50 |
+
- **Training**: Surrogate gradient BPTT, fast-sigmoid surrogate (scale=25), cosine LR scheduling
|
| 51 |
+
- **Hardware target**: Catalyst N1/N2/N3 neuromorphic processors
|
| 52 |
|
| 53 |
## Results
|
| 54 |
|
| 55 |
+
| Generation | Architecture | Float Accuracy | Params | vs SOTA |
|
| 56 |
+
|------------|-------------|----------------|--------|---------|
|
| 57 |
+
| **N3** | 700β1536β20 (rec, adLIF) | **91.0%** | 3.47M | Matches Loihi 2 (90.9%) |
|
| 58 |
+
| N2 | 700β512β20 (rec, adLIF) | 84.5% | 759K | β |
|
| 59 |
+
| N1 | 700β1024β20 (rec, LIF) | 90.6% | 1.79M | Basic LIF baseline |
|
| 60 |
|
| 61 |
## Reproduce
|
| 62 |
|
|
|
|
| 64 |
git clone https://github.com/catalyst-neuromorphic/catalyst-benchmarks.git
|
| 65 |
cd catalyst-benchmarks
|
| 66 |
pip install -e .
|
| 67 |
+
|
| 68 |
+
# N3 (91.0%)
|
| 69 |
python shd/train.py --neuron adlif --hidden 1536 --epochs 200 --device cuda:0 --amp
|
| 70 |
+
|
| 71 |
+
# N2 (84.5%)
|
| 72 |
+
python shd/train.py --neuron adlif --hidden 512 --epochs 200 --device cuda:0
|
| 73 |
+
|
| 74 |
+
# N1 (90.6%)
|
| 75 |
+
python shd/train.py --neuron lif --hidden 1024 --epochs 200 --device cuda:0
|
| 76 |
+
```
|
| 77 |
+
|
| 78 |
+
## Deploy to Catalyst Hardware
|
| 79 |
+
|
| 80 |
+
```bash
|
| 81 |
+
python shd/deploy.py --checkpoint shd_model.pt --threshold-hw 1000
|
| 82 |
```
|
| 83 |
|
| 84 |
## Links
|
| 85 |
|
| 86 |
- **Benchmark repo**: [catalyst-neuromorphic/catalyst-benchmarks](https://github.com/catalyst-neuromorphic/catalyst-benchmarks)
|
| 87 |
+
- **Hardware**: [catalyst-neuromorphic.com](https://catalyst-neuromorphic.com)
|
| 88 |
- **N3 paper**: [Zenodo DOI 10.5281/zenodo.18881283](https://zenodo.org/records/18881283)
|
| 89 |
- **N2 paper**: [Zenodo DOI 10.5281/zenodo.18728256](https://zenodo.org/records/18728256)
|
|
|
|
| 90 |
|
| 91 |
## Citation
|
| 92 |
|