A Framework for Wavelet-Based Analysis and Processing of Color FIlter Array Images

Summary Background

In digital imaging applications, data are typically obtained via a spatial subsampling procedure implemented as a color filter array (CFA). CFA assigns a separate primary color to each pixel by placing a filter of that color over the pixel. The most well known CFA is the Bayer pattern which uses a checkerboard pattern with alternating rows of filters. The Bayer filter has twice as many green pixels as red or blue and takes advantage of the human eye’s tendency to see green luminance as the strongest influence in defining image quality. The term demosaicing refers to the inverse problem of reconstructing an image from the partial raw data received from the color-filtered image sensors internal to many digital cameras in the form of a matrix of colored pixels. It is well known that the most efficient solution to this inverse problem produces unacceptable visual distortions and artifacts. Aside from the spatial undersampling inherent in the Bayer pattern, this phenomenon can be attributed to the observation that values of the color triple exhibit significant correlation, particularly at high spatial frequencies: such content often signifies the presence of edges, whereas low-frequency information contributes to distinctly perceived color content. As such, most demosaicing algorithms attempt to make use of this correlation structure in the spatial frequency domain.


The invention describes a new approach to demosaicing of spatially sampled image data observed through a CFA. The invention employs properties of Smith-Barnwell filterbanks to exploit the correlation of color components in order to reconstruct a subsampled image. In particular, the invention admits a new framework for wavelet-based CFA image denoising and demosaicing methods, which in turn enables the application of existing wavelet-based image denoising techniques directly to sparsely sampled data. This capability is important because various noise sources inherent to the charge-coupled device or other imaging technique employed must be taken into account in practice; any noise reduction procedure should ideally take place prior to demosaicing (both to improve interpolation results and to avoid introducing additional correlation structure into the noise). While earlier work has been focused primarily on demosaicing prior to denoising, this new method suggests a natural way to perform wavelet-based denoising and demosaicing together in tandem. Results indicate that this new method performs on a par with the state of the art for far lower computational cost, and provides a versatile, effective, and low-complexity solution to the problem of interpolating color filter array data observed in noise.

Applications Demosaicing of color image data for digital still cameras and digital video cameras; color image processing. For Further Information Please Contact the Director of Business Development Alan Gordon Email: alan_gordon@harvard.edu Telephone: (617) 384-5000

Inventor(s): Wolfe, Patrick J

Type of Offer: Licensing

« More Engineering - Electrical Patents
« More Software Patents

Share on      

CrowdSell Your Patent