Boosting Throughput and Efficiency of Hardware Spiking Neural
  Accelerators using Time Compression Supporting Multiple Spike Codes
  Spiking neural networks (SNNs) are the third generation of neural networks
and can explore both rate and temporal coding for energy-efficient event-driven
computation. However, the decision accuracy of existing SNN designs is
contingent upon processing a large number of spikes over a long period.
Nevertheless, the switching power of SNN hardware accelerators is proportional
to the number of spikes processed while the length of spike trains limits
throughput and static power efficiency. This paper presents the first study on
developing temporal compression to significantly boost throughput and reduce
energy dissipation of digital hardware SNN accelerators while being applicable
to multiple spike codes. The proposed compression architectures consist of
low-cost input spike compression units, novel input-and-output-weighted spiking
neurons, and reconfigurable time constant scaling to support large and flexible
time compression ratios. Our compression architectures can be transparently
applied to any given pre-designed SNNs employing either rate or temporal codes
while incurring minimal modification of the neural models, learning algorithms,
and hardware design. Using spiking speech and image recognition datasets, we
demonstrate the feasibility of supporting large time compression ratios of up
to 16x, delivering up to 15.93x, 13.88x, and 86.21x improvements in throughput,
energy dissipation, the tradeoffs between hardware area, runtime, energy, and
classification accuracy, respectively based on different spike codes on a
Xilinx Zynq-7000 FPGA. These results are achieved while incurring little extra
hardware overhead.
