Image Reconstruction from Events. Why learn it?
  Traditional cameras measure image intensity. Event cameras, by contrast,
measure per-pixel temporal intensity changes asynchronously. Recovering
intensity from events is a popular research topic since the reconstructed
images inherit the high dynamic range (HDR) and high-speed properties of
events; hence they can be used in many robotic vision applications and to
generate slow-motion HDR videos. However, state-of-the-art methods tackle this
problem by training an event-to-image recurrent neural network (RNN), which
lacks explainability and is difficult to tune. In this work we show, for the
first time, how tackling the joint problem of motion and intensity estimation
leads us to model event-based image reconstruction as a linear inverse problem
that can be solved without training an image reconstruction RNN. Instead,
classical and learning-based image priors can be used to solve the problem and
remove artifacts from the reconstructed images. The experiments show that the
proposed approach generates images with visual quality on par with
state-of-the-art methods despite only using data from a short time interval
(i.e., without recurrent connections). Our method can also be used to improve
the quality of images reconstructed by approaches that first estimate the image
Laplacian; here our method can be interpreted as Poisson reconstruction guided
by image priors.
