Selectively lossy, lossless, and/or error robust data compression method

mi iiiiiii ill mi mi ip mi mill mi mi mi

(12) United States Patent

Gladkova et al.

(io) Patent No.: (45) Date of Patent:

US 7,907,784 B2 Mar. 15, 2011

(54) SELECTIVELY LOSSY, LOSSLESS, AND/OR ERROR ROBUST DATA COMPRESSION METHOD

(75) Inventors: Irina Gladkova, West Nyack, NY (US);

Michael Grossberg, New York, NY
(US); Leonid Roytman, Port
Washington, NY (US)

(73) Assignee: The United States of America as

represented by the Secretary of the
Commerce, Washington, DC (US)

( * ) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 U.S.C. 154(b) by 917 days.

(21) Appl.No.: 11/774,704

(22) Filed: Jul. 9, 2007

(65) Prior Publication Data

US 2009/0018801 Al Jan. 15, 2009

FOREIGN PATENT DOCUMENTS

EP 1209917 A2 5/2002

EP 1209627 A2 5/2006

WO WO2005022399 A2 3/2005

OTHER PUBLICATIONS

D. Salomon, Data Compression: The Complete Reference, Springer, New York, 2004 (third edition).

(Continued)

Primary Examiner — Anh Hong Do

(74) Attorney, Agent, or Firm — Robert Piatt Bell

Lossless compression techniques provide efficient compression of hyperspectral satellite data. The present invention combines the advantages of a clustering with linear modeling. A number of visualizations are presented, which help clarify why the approach of the present invention is particularly effective on this dataset. At each stage, the algorithm achieves an efficient grouping of the data points around a relatively small number of lines in a very large dimensional data space. The parametrizafion of these lines is very efficient, which leads to efficient descriptions of data points. The method of the present invention yields compression ratios that compare favorably with what is currently achievable by other approaches.

23 Claims, 23 Drawing Sheets

OTHER PUBLICATIONS

H.H. Aumann, M.T. Chahine, C. Gautier, M. D. Goldberg, E. Kalnay, L.M. McMillan, H. Revercomb, P.W. Rosenkranz, W.L. Smith, D.H. Staelin, L.L. Strow, andJ. Susskind, "AIRS/AMSU/HSB ontheAqua Mission: design, science objectives, data products, and processing systems," IEEE Trans. Geosci. Remote Sensing 41(2), pp. 253-264, 2003.

M. Goldberg, Y. Qu, L. M. McMillan, W. Wolf, L. Zhou, and M. Divakarla, "AIRS near-real-time products and algorithms in support of operational numerical weather prediction," IEEE Transactions on Geoscience and RemoteSensing 41, pp. 379-389, 2003. D. Huffman, "A method for the construction of minimum redundancy codes," Proc of IRE 40, pp. 1098-1101, 1952.

C. E. Shannon, "Communications in the presence of noise," Proc. of IRE 37, pp. 10-21, 1949.

C. E. Shannon, "A Mathematical Theory of Communication," The Bell System Technical Journal 27, pp. 379-423, 623-656, 1948. H. H. Aumann, D.T. Gregorich, S.L. Gaiser, D.F. Hagan, T.S. Pagano, L. Strow, and D. Ting, "AIRS level lb algorithm theoretical basis document (ATBD) part 1 (IR)," Nov. 10, 2000. G. Davis and A. Nosratinia, "Wavelet-based image coding: An overview," Applied and Computational Control, Signals, and Circuits 1(1), 1998.

R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, S.E, Wiley Interscience, 2000.

* cited by examiner