Update README.md
Browse files
README.md
CHANGED
|
@@ -4,6 +4,26 @@ license: mit
|
|
| 4 |
|
| 5 |
**Spiking Neural Network as Adaptive Event Stream Slicer (NeurIPS'24)**
|
| 6 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
More details can be found at [paper](https://arxiv.org/pdf/2410.02249) and [code](https://github.com/AndyCao1125/SpikeSlicer).
|
| 8 |
|
| 9 |
We provide example Test Logs and Weights in this HF hub:
|
|
|
|
| 4 |
|
| 5 |
**Spiking Neural Network as Adaptive Event Stream Slicer (NeurIPS'24)**
|
| 6 |
|
| 7 |
+
*Abstract:*
|
| 8 |
+
Event-based cameras are attracting significant interest as they provide rich edge information, high dynamic range, and high temporal resolution. Many state-of-the-art
|
| 9 |
+
event-based algorithms rely on splitting the events into fixed groups, resulting in the
|
| 10 |
+
omission of crucial temporal information, particularly when dealing with diverse
|
| 11 |
+
motion scenarios (e.g., high/low speed). In this work, we propose SpikeSlicer, a
|
| 12 |
+
novel-designed plug-and-play event processing method capable of splitting events
|
| 13 |
+
stream adaptively. SpikeSlicer utilizes a low-energy spiking neural network (SNN)
|
| 14 |
+
to trigger event slicing. To guide the SNN to fire spikes at optimal time steps, we
|
| 15 |
+
propose the Spiking Position-aware Loss (SPA-Loss) to modulate the neuron’s state.
|
| 16 |
+
Additionally, we develop a Feedback-Update training strategy that refines the slicing decisions using feedback from the downstream artificial neural network (ANN).
|
| 17 |
+
Extensive experiments demonstrate that our method yields significant performance
|
| 18 |
+
improvements in event-based object tracking and recognition. Notably, SpikeSlicer
|
| 19 |
+
provides a brand-new SNN-ANN cooperation paradigm, where the SNN acts as an
|
| 20 |
+
efficient, low-energy data processor to assist the ANN in improving downstream
|
| 21 |
+
performance, injecting new perspectives and potential avenues of exploration.
|
| 22 |
+
|
| 23 |
+
<p align="left">
|
| 24 |
+
<img src="spikeslicer.gif" alt="Logo" width="38%">
|
| 25 |
+
</p>
|
| 26 |
+
|
| 27 |
More details can be found at [paper](https://arxiv.org/pdf/2410.02249) and [code](https://github.com/AndyCao1125/SpikeSlicer).
|
| 28 |
|
| 29 |
We provide example Test Logs and Weights in this HF hub:
|