Spatiotemporal-chromatic structure of natural scenes

Authors: 

Steven Bergner, Mark S. Drew

We investigate the implications of a unified spatiotemporalchromatic basis for compression and reconstruction of images sequences. Different adaptive methods (PCA and ICA) are applied to generate basis functions.

While typically such bases with spatial and temporal extent are investigated in terms of their correspondence to human visual perception, we are interested in their applicability to multimedia encoding. The performance of the extracted spatiotemporal-chromatic patch bases is evaluated in terms of quality of reconstruction with respect to their potential for data compression. The results discussed here are intended to provide another path towards perceptually-based encoding of visual data. This leads to a deeper understanding of the role played by chromatic features in data reduction.

ica compression

Compression rate for different patch sizes (spaceX x spaceY x time x RGB) using an ICA basis generation.

pca compression

Compression rate for different patch sizes (spaceX x spaceY x time x RGB) using PCA basis generation. ICA has significantly higher compression (better quality) for larger patch sizes and lower bitrates.