Spiking nets can track human pose in video: SpikePose cuts estimated arithmetic energy 91.4% for 1.12 points of accuracy
Spiking neural networks save energy but struggle with ordinary video that arrives frame by frame. SpikePose gives per-frame spatial encoding to a spiking encoder that resets each frame and runs a single inference step, and gives cross-frame reasoning to a lightweight heatmap memory module outside the backbone that estimates joint displacement, aligns historical heatmaps and fuses them adaptively. On a fixed NTU60 test subset, against an architecture-matched artificial neural network with the same memory module, SpikePose lowers estimated arithmetic energy by 91.4% at a cost of 1.12 points in head-bone-normalised PCK at 0.5 threshold.