Space-Time Super-Resolution

Eli Shechtman, Yaron Caspi and Michal Irani




Temporal Super-Resolution: Examples



    1) Handling motion aliasing (e.g., the "wagon wheel effect")


4 Input Sequences
4 input sequences of the vent scene

Slow-motion interpolation
Super-resolved output
slow-motion interpolation  vs.  super-resolved output
(preserves motion aliasing)
(overcomes motion aliasing)






    2) Handling motion blur in "fast events"



3 out of 18 low temporal-resolution input sequences (simulated):

The images show super-position of all frames in each sequence, CLICK to view the sequences.

Super-Resolved Output
Basketball - Super-resololved Output


Close-up view of input and output of the the ball, showing the resulting "motion deblurring":

Input frame of the ball
Zoom on ball - Input frame
Matching output frame
Zoom on ball - Output frame




Combining input sources of different space-time resolution

   - e.g., combining still images and a video sequence:

Input Stil Image #1
Input Image #1
(high spatial resolution)
Input Stil Image #2
Input Image #2
(high spatial resolution)

Input Video
Input Video Sequence
(high temporal resolution)

Magnified Input Video Magnified input video


Output Video Output video
  • Improved spatial resolution (w.r.t. the video)
  • Improved temporal resolution (w.r.t. the still images)
  • Using more input sources would enable true super-resolution.