Arazi, et al., "Intuition, Perception, and Secure Communications," IEEE Transactionson Systems, Man, and Cybernetics, vol. 19, No. 5, Sep./Oct. 1989, pp. 1016-1020. Arthur, "Digital Fingerprints Protect Artwork," New Scientist, Nov. 12, 1994, p. 24.
Aura, "Invisible Communication," Helskinki University of Technology, Digital Systems Laboratory, Nov. 5, 1995, 13 pages.
Aura, "Practical Invisibility in Digital Communication," Information Hiding, First Int. Workshop Proc. May 30-Jun. 1, 1996, pp. 265-278.
Bartlett, et al., "An Overview of HighWater FBI Technol-
ogy," Posted on Internet Mar. 22, 1996, 12 pages.
Bender et al, "Techniques for Data Hiding," Draft Preprint,
Private Correspondence, dated Oct. 30, 1995, 45 pages.
Bender et al., "Techniques for Data Hiding," Massachusetts
Institute of Technology, Media Laboratory, Draft Preprint,
Apr. 13, 1995, 10 pages.
Bender, Techniques for Data Hiding, Proc. SPIE, Vo. 2420,
Feb. 9, 1995, pp. 164-173.
Boland et al, "Watermarking Digital Images for Copyright Protection," Fifth International Conference on Image Processing and its Applications, Conference Date Jul. 4—6, 1995, Conf. Publ. No. 410, p. 326-330. Boneh, "Collusion-Secure Fingerprinting for Digital Data," Department of Computer Science, Princeton University,
1995, 31 pages.
Boney et al., "Digital Watermarks for Audio Signals," Proceedings of Multimedia '96, 1996 IEEE, pp. 473-480. Bors et al., "Embedding Parametric Digital Signatures in Images," EUSIPCO-96, Trieste, Italy, accepted for publication, Sep. 1996 (Published on internet Apr. 9, 1996, (http://
poseidon.csd.auth.gr/papers/confers: 1 ind.html)), 4 pages.
Boucqueau et al., Equitable Conditional Access and Copy-
right Protection for Image Based on Trusted Third Parties,
Teleservices & Multimdia Communications, 2nd Int. Cost
237 Workshop, Second International Cost 237 Workshop,
Nov., 1995; published 1996, pp. 229-243.
Brandt et al., "Representations that Uniquely Characterize
Images Modulo Translation, Rotation, and Scaling," Pattern
Recognition Letters, Aug. 1, 1996, pp. 1001-1015.
Brassil et al., Electronic Marking and Identification Tech-
niques to Discourage Document Copying, Proceedings of
INFOCOM '94 Conference on Computer, IEEE Commun.
Soc Conference, Jun. 12-16, 1994, pp. 1278-1287.
Brassil et al., "Hiding Information in Document Images,"
Nov., 1995, 7 pages.
Braudaway et al., "Protecting Publicly-Available Images with a Visible Image Watermark," SPIE vol. 2659, Feb. 1,
1996, pp. 126-133.
Brown, "S-Tools for Windows, Version 1.00; What is Steganography," Internet reference, Mar. 6, 1994, 6 pages.
Bruckstein, A.M.; Richardson, T.J., A holographic transform domain image watermarking method, Circuits, Systems, and Signal Processing vol. 17, No. 3 p. 361-89,1998. This paper includes an appendix containing an internal memo of Bell Labs, which according to the authors of the paper, was dated Sep. 1994.
Bruyndonckx et al., Neural Network Post-Processing of Coded Images Using Perceptual Masking, 1994, 3 pages. Bruyndonckx et al., "Spatial Method for Copyright Labeling of Digital Images," 1994, 6 pages.
Burgett et al., "A Novel Method for Copyright Labeling Digitized Image Data," requested by e-mail from author (unavailable/password protected on IGD WWW site); 12 pages.
Caronni, "Assuring Ownership Rights for Digital Images," Published in the Proceedings of 'Reliable IT Systems,' VIS '95, HH. Briiggermann and W. Gerhardt-Hackl (Ed.), Vieweg Publishing Company, Germany, 1995, Jun. 14, 1994, 10 pages. (Originally published as an ETH (Zurich) Technical Report, "Ermitteln Unauthorisierter Verteiler von Maschinenlesbaren Daten," Aug. 1993. Caruso, "Digital Commerce, 2 plans for watermarks, which can bind proof of authorship to electronic works." New York Times, Aug. 7, 1995, one page.
Castro et al., "Registration of Translated and Rotated Images Using Finite Fourier Transforms," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-9, No. 5, Sep. 1987, pp. 700-703.
Cha et al., "A Solution to the On-Line Image Downgrading Problem," Proc. 11th Annual Computer Security Applications Conf., Dec. 11, 1995, pp. 108-112.
Cheong, "Internet Agent, Spiders, Wanderers, Brokers, and Bots," New Riders Publising, Indianapolis, IN, 1996, 413 pages.
Choudhury, et al., "Copyright Protection for Electronic Publishing over Computer Networks," IEEE Network Magazine, Jun. 1994, 18 pages.
Chudy, "Handcuff Digital Thieves," Byte Magazine, Apr., 1996, 4 pages.
Clarke, "Invisible Code Tags Electronic Images," Electronic Engineering Times, Jun. 12, 1995, n. 852, p. 42.
Cox et al., "A Secure, Imperceptable Yet Perceptually Salient, Spread Spectrum Watermark for Multimedia," IEEE, Southcon/96, Conference Record, pp. 192-197,1996.
Cox et al., "Secure Spread Spectrum Watermarking for Multimedia," NEC Research Institute Technical Report, Dec. 5, 1995, 33 pages.
* cited by examiner
1
INTEGRATING DIGITAL WATERMARKS IN
MULTIMEDIA CONTENT
RELATED APPLICATION DATA
This patent application claims priority from U.S. provi- 5 sional patent application No. 60/180,364, filed Feb. 4, 2000. This patent application is also a continuation-in-part of application Ser. No. 09/503,881, filed Feb. 14, 2000, and application Ser. No. 09/186,962, filed Nov. 5, 1998, which is a continuation of application Ser. No. 08/649,419, filed 10 May 16, 1996, now U.S. Pat. No. 5,862,260. Application Ser. No. 08/649,419 is a continuation-in-part of application Ser. No. 08/508,083, filed Jul. 27, 1995 (now U.S. Pat. No. 5,841,978) and application Ser. No. 08/436,098 (now U.S. Pat. No. 5,636,292), filed May 8, 1995, which is a 15 continuation-in-part of application Ser. No. 08/327,426, filed Oct. 21, 1994 (now U.S. Pat. No. 5,768,426), application Ser. No. 08/215,289, filed Mar. 17, 1994 (now abandoned), and application Ser. No. 08/154,866, filed Nov. 18, 1993 (now abandoned). 20
TECHNICAL FIELD
The invention relates to digital watermarking, and more specifically relates to applications of digital watermarks in multimedia data. 25
BACKGROUND AND SUMMARY
Digital watermarking is a process for modifying media content to embed a machine-readable code into the data
30
content. The data may be modified such that the embedded code is imperceptible or nearly imperceptible to the user, yet may be detected through an automated detection process. Most commonly, digital watermarking is applied to media such as images, audio signals, and video signals. However, 3J it may also be applied to other types of data, including documents (e.g., through line, word or character shifting), software, multi-dimensional graphics models, and surface textures of objects.
Digital watermarking systems have two primary compo- 4Q nents: an embedding component that embeds the watermark in the media content, and a reading component that detects and reads the embedded watermark. The embedding component embeds a watermark pattern by altering data samples of the media content in the spatial or frequency domains. 45 The reading component analyzes target content to detect whether a watermark pattern is present. In applications where the watermark encodes information, the reader extracts this information from the detected watermark.
Recently, digital watermarks have been used in applica- 50 tions for encoding auxiliary data in video, audio and still images. Despite the pervasiveness of multimedia content, such applications generally focus on ways to embed and detect watermarks in a single media type.
One aspect of the invention is a method for decoding 55 auxiliary data in multimedia content with two or more media signals of different media types. This method decodes watermarks in the media signals, uses the watermarks from the different media signals to control processing of the multimedia content. There are many applications of this method. 60 One application is to use the watermark in one media signal to locate the watermark in another media signal. This is applicable to movies where a watermark in one media signal, such as the audio or video track, is used to locate the watermark in another media signal. 65
The watermark messages from different media signals may be combined for a variety of applications. One such
2
application is to control processing of the multimedia signal. For example, the combined message can be used to control playback, copying or recording of the multimedia content.
Another aspect of the invention is a method for copy control of multimedia content where a watermark from one media signal is used to control processing of the multimedia content. An audio watermark may be used to control processing of the video signal in a movie, or a video watermark may be used to control processing of the audio signal in the movie.
Another aspect of the invention is a method for watermark decoding where a watermark decoded from a first media signal of a first media type is used to decoding a second media signal. The first and second media signals may be of the same or different types. Also, they may be part of the same composite media signal, such as an audio or video sequence. The term, "composite, " refers to a collection of media signals, which may be temporal portions (e.g., time frames in audio or video), or spatial portions (e.g., blocks of pixels in an image or video frame) of a visual, audio, or audio visual work. As an example, the first media signal may be an audio or video frame (or frames) in an audio or video sequence and the second media signal may be subsequent frames in the same sequence.
This method may be used in a variety of applications. The watermark in the first media signal may be used to de-scramble, decrypt, or decompress the second media signal. In addition, the watermark in the first media signal may be used to decode a different watermark from the second signal.
Another aspect of the invention is a method that uses a watermark decoded from a first media signal of a first media type to decode metadata associated with the first media signal. The watermark may be used to locate the metadata, which may be hidden for security purposes. The metadata located from the watermark may be located on the same storage medium that includes the first media signal. For example, the metadata may be located on portable storage device, such as flash memory, a magnetic memory device (e.g., tape or disk), or an optical memory device (e.g., CD, DVD, minidisk, etc.). The metadata may be located in a file header or some other place (e.g., encoded in the disk wobble).
There are a variety of applications of the watermark in this context. It may carry a key to decrypt, decompress, descramble, or locate the metadata. The metadata, in turn, may be used to control processing of the media signal in a computer or consumer electronic device. For example, it may be used to control usage rights, playback, recording, copying, transfer, etc.
Yet another aspect of the invention is a method that decodes first and second watermarks and forms a key for decoding data from the first and second watermarks. The watermarks may be decoded from the same or different media signals. For example, the watermarks may be decoded from media signals from the same composite signal. They may be derived from different types of media signals, such as the audio and video tracks of a movie. Alternatively, they may be derived from different parts of the same type of media signal, such as an audio sequence, video sequence, or image. The watermarks may be extracted from a signal or signals stored in a storage device, such as a portable storage device (e.g., optical or magnetic disk or tape, flash memory, etc.).
The key formed from the watermarks may be used for a variety of applications. It may be used as a watermark key
|
