Multi-frame super resolution robust to local and global motion

Zhengping Ji; Qiang Zhang; Lilong Shi; Ilia Ovsiannikov

doi:10.1117/12.2256140

13 March 2017 Multi-frame super resolution robust to local and global motion

Zhengping Ji, Qiang Zhang, Lilong Shi, Ilia Ovsiannikov

Proceedings Volume 10137, Medical Imaging 2017: Biomedical Applications in Molecular, Structural, and Functional Imaging; 101370Y (2017) https://doi.org/10.1117/12.2256140
Event: SPIE Medical Imaging, 2017, Orlando, Florida, United States

Abstract

Super resolution (SR) is to produce a higher resolution image from one or a sequence of low resolution images of a scene. It is essential in medical image analysis as a zooming of a specific area of interest is often required. This paper presents a new multi-frame super resolution (SR) method that is robust to both global and local motion. One of major challenges in multi-frame SR is concurrent global and local motion emergent in the sequence of low resolution images. It poses difficulties in aligning the low resolution images, resulting in artifacts or blurred pixels in the computed high resolution image. We solve the problem via a series of new methods. We first align the upscaled images from bicubic interpolation, and analyze the pixel distribution for the presence of local motion. If local motion is identified, we conduct the local image registration using dense SIFT features. Based on the local registration of images, we analyze pixel locations whose cross-frame variation is high and adaptively select subset of frame pixels in those locations. The adaptive selection of frame pixels is based on a clustering analysis of luminance values of pixels aligned at the same position, such that noise and motion biases are excluded. At the end, a median filter is applied for the selected pixels at each pixel location for super resolution image. We conduct experiments for multi-frame SR, where the proposed method delivers favorable results, especially better than state-of-the-art in dealing with concurrent local and global motions across frames.

Conference Presentation

Citation Download Citation

Zhengping Ji, Qiang Zhang, Lilong Shi, and Ilia Ovsiannikov "Multi-frame super resolution robust to local and global motion", Proc. SPIE 10137, Medical Imaging 2017: Biomedical Applications in Molecular, Structural, and Functional Imaging, 101370Y (13 March 2017); https://doi.org/10.1117/12.2256140

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available