Faster than realtime detection of shot boundaries, sampling structure and dynamic keyframes in video

The detection of shot boundaries (hardcuts and short dissolves), sampling structure (progressive / interlaced / pulldown) and dynamic keyframes in a video are fundamental video analysis tasks which have to be done before any further highlevel analysis tasks. We present a novel algorithm which does all these analysis tasks in an unified way, by utilizing a combination of interframe and intraframe measures derived from the motion field and normalized cross correlation. The algorithm runs four times faster than realtime due to sparse and selective calculation of these measures. An initial evaluation furthermore shows that the proposed algorithm is extremely robust even for challenging content showing large camera or object motion, flashlights, flicker or low contrast / noise.