Henry Shulayev Barnes commited on
Commit
5ef04df
Β·
1 Parent(s): 82bac7a

Reconcile SHD accuracy and drop SOTA column

Browse files
Files changed (1) hide show
  1. README.md +9 -9
README.md CHANGED
@@ -31,7 +31,7 @@ model-index:
31
  value: 84.5
32
  - name: Float Accuracy (N1)
33
  type: accuracy
34
- value: 90.6
35
  - name: Quantised Accuracy (N3, int16)
36
  type: accuracy
37
  value: 90.8
@@ -52,11 +52,11 @@ Spiking Neural Network trained on the Spiking Heidelberg Digits (SHD) dataset us
52
 
53
  ## Results
54
 
55
- | Generation | Architecture | Float Accuracy | Params | vs SOTA |
56
- |------------|-------------|----------------|--------|---------|
57
- | **N3** | 700β†’1536β†’20 (rec, adLIF) | **91.0%** | 3.47M | Matches Loihi 2 (90.9%) |
58
- | N2 | 700β†’512β†’20 (rec, adLIF) | 84.5% | 759K | β€” |
59
- | N1 | 700β†’1024β†’20 (rec, LIF) | 90.6% | 1.79M | Basic LIF baseline |
60
 
61
  ## Reproduce
62
 
@@ -65,13 +65,13 @@ git clone https://github.com/catalyst-neuromorphic/catalyst-benchmarks.git
65
  cd catalyst-benchmarks
66
  pip install -e .
67
 
68
- # N3 (91.0%)
69
  python shd/train.py --neuron adlif --hidden 1536 --epochs 200 --device cuda:0 --amp
70
 
71
- # N2 (84.5%)
72
  python shd/train.py --neuron adlif --hidden 512 --epochs 200 --device cuda:0
73
 
74
- # N1 (90.6%)
75
  python shd/train.py --neuron lif --hidden 1024 --epochs 200 --device cuda:0
76
  ```
77
 
 
31
  value: 84.5
32
  - name: Float Accuracy (N1)
33
  type: accuracy
34
+ value: 85.9
35
  - name: Quantised Accuracy (N3, int16)
36
  type: accuracy
37
  value: 90.8
 
52
 
53
  ## Results
54
 
55
+ | Generation | Architecture | Float Accuracy | Params |
56
+ |------------|-------------|----------------|--------|
57
+ | **N3** | 700β†’1536β†’20 (rec, adLIF) | **91.0%** | 3.47M |
58
+ | N2 | 700β†’512β†’20 (rec, adLIF) | 84.5% | 759K |
59
+ | N1 | 700β†’1024β†’20 (rec, LIF) | 85.9% | 1.79M |
60
 
61
  ## Reproduce
62
 
 
65
  cd catalyst-benchmarks
66
  pip install -e .
67
 
68
+ # N3
69
  python shd/train.py --neuron adlif --hidden 1536 --epochs 200 --device cuda:0 --amp
70
 
71
+ # N2
72
  python shd/train.py --neuron adlif --hidden 512 --epochs 200 --device cuda:0
73
 
74
+ # N1
75
  python shd/train.py --neuron lif --hidden 1024 --epochs 200 --device cuda:0
76
  ```
77