SAGE2000 commited on
Commit
7d1360c
·
verified ·
1 Parent(s): f81181c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -0
README.md CHANGED
@@ -4,6 +4,26 @@ license: mit
4
 
5
  **Spiking Neural Network as Adaptive Event Stream Slicer (NeurIPS'24)**
6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  More details can be found at [paper](https://arxiv.org/pdf/2410.02249) and [code](https://github.com/AndyCao1125/SpikeSlicer).
8
 
9
  We provide example Test Logs and Weights in this HF hub:
 
4
 
5
  **Spiking Neural Network as Adaptive Event Stream Slicer (NeurIPS'24)**
6
 
7
+ *Abstract:*
8
+ Event-based cameras are attracting significant interest as they provide rich edge information, high dynamic range, and high temporal resolution. Many state-of-the-art
9
+ event-based algorithms rely on splitting the events into fixed groups, resulting in the
10
+ omission of crucial temporal information, particularly when dealing with diverse
11
+ motion scenarios (e.g., high/low speed). In this work, we propose SpikeSlicer, a
12
+ novel-designed plug-and-play event processing method capable of splitting events
13
+ stream adaptively. SpikeSlicer utilizes a low-energy spiking neural network (SNN)
14
+ to trigger event slicing. To guide the SNN to fire spikes at optimal time steps, we
15
+ propose the Spiking Position-aware Loss (SPA-Loss) to modulate the neuron’s state.
16
+ Additionally, we develop a Feedback-Update training strategy that refines the slicing decisions using feedback from the downstream artificial neural network (ANN).
17
+ Extensive experiments demonstrate that our method yields significant performance
18
+ improvements in event-based object tracking and recognition. Notably, SpikeSlicer
19
+ provides a brand-new SNN-ANN cooperation paradigm, where the SNN acts as an
20
+ efficient, low-energy data processor to assist the ANN in improving downstream
21
+ performance, injecting new perspectives and potential avenues of exploration.
22
+
23
+ <p align="left">
24
+ <img src="spikeslicer.gif" alt="Logo" width="38%">
25
+ </p>
26
+
27
  More details can be found at [paper](https://arxiv.org/pdf/2410.02249) and [code](https://github.com/AndyCao1125/SpikeSlicer).
28
 
29
  We provide example Test Logs and Weights in this HF hub: