US20060136728A1 - Method and apparatus for authentication of data streams with adaptively controlled losses - Google Patents

Method and apparatus for authentication of data streams with adaptively controlled losses Download PDF

Info

Publication number
US20060136728A1
US20060136728A1 US10/543,640 US54364005A US2006136728A1 US 20060136728 A1 US20060136728 A1 US 20060136728A1 US 54364005 A US54364005 A US 54364005A US 2006136728 A1 US2006136728 A1 US 2006136728A1
Authority
US
United States
Prior art keywords
data stream
blocks
receiver
values
hash
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/543,640
Inventor
Craig Gentry
Alejandro Hevia
Ravi Kumar
Toshiro Kawahara
Zulfikar Ramzan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NTT Docomo Inc
Original Assignee
NTT Docomo Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NTT Docomo Inc filed Critical NTT Docomo Inc
Priority to US10/543,640 priority Critical patent/US20060136728A1/en
Assigned to DOCOMO COMMUNICATIONS LABORATORIES USA, INC. reassignment DOCOMO COMMUNICATIONS LABORATORIES USA, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KAWAHARA, TOSHIRO, GENTRY, CRAIG B., JAIN, RAVI KUMAR, RAMZAN, ZULFIKAR AMIN, HEVIA, ALEJANDRO
Assigned to NTT DOCOMO INC. reassignment NTT DOCOMO INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DOCOMO COMMUNICATIONS LABORATORIES USA, INC.
Publication of US20060136728A1 publication Critical patent/US20060136728A1/en
Priority to US12/560,963 priority patent/US20100005310A1/en
Priority to US12/560,959 priority patent/US8256015B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/32Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials
    • H04L9/3236Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials using cryptographic hash functions
    • H04L9/3242Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials using cryptographic hash functions involving keyed hash functions, e.g. message authentication codes [MACs], CBC-MAC or HMAC
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/32Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials
    • H04L9/3247Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials involving digital signatures
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/00086Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/00086Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
    • G11B20/0021Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L2209/00Additional information or applications relating to cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00
    • H04L2209/30Compression, e.g. Merkle-Damgard construction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L2209/00Additional information or applications relating to cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00
    • H04L2209/34Encoding or coding, e.g. Huffman coding or error correction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L2209/00Additional information or applications relating to cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00
    • H04L2209/80Wireless
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/50Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols using hash chains, e.g. blockchains or hash trees
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/167Systems rendering the television signal unintelligible and subsequently intelligible
    • H04N7/1675Providing digital key or authorisation information for generation or regeneration of the scrambling sequence

Definitions

  • the present invention relates to data stream authentication, and more specifically to authentication schemes with adaptively controlled packet loss.
  • both the original source and the ultimate receiver must possess knowledge of a shared secret key.
  • the sender applies a mathematical transformation involving the original data and secret key, and produces a tag.
  • the receiver can then apply a similar transformation with the data, the tag, and the secret key to verify the origin and the integrity of the data.
  • the key is split into two parts: a secret signing key and a public verification key.
  • the public verification key can be used to verify anything signed using the secret signing key.
  • the key is split in such a way that it is not possible to derive the private portion from the public portion.
  • the sender applies a mathematical transformation involving the original data and secret signing key, and produces a signature.
  • the recipient can then apply a similar transformation with the data, the signature, and the public verification key to ascertain the identity of the sender and the integrity of the data.
  • Digital signatures have a non-repudiation property that MACs do not. Namely, the signer cannot later deny having signed the document since the signing key is secret and was in the signer's possession. Of course, the signature owner can always claim that the secret signing key was stolen by some adversary.
  • scalable video coding schemes a high-level picture of the principle of which is shown in FIG. 1 , have the property that a subset of the stream can be decoded and the quality is commensurate with the amount decoded.
  • These schemes may encode video into a base layer and then zero or more “enhancement” layers. Just the base layer alone would be sufficient to view the stream. Enhancement layers are utilized to improve the overall quality.
  • the splicing situation can be considered a special case of a lossy situation where the quality of signal transmission is poor or otherwise is degraded, for example, by viewing the three data streams as one huge layered stream and imagining that two out of three frames are being discarded.
  • a source may include in a given slot a number of advertisements that can be displayed. An intermediary can then choose from among these choices which advertisement it would like to display. The choice can, for example, be based upon what the intermediary thinks will be the best advertisement for the target audience.
  • the advertisements themselves can be created by an intermediary or some other party, and can be provided to the source either in their original form or may be hashed. The source would then include them when signing the stream.
  • each packet contains authentication information.
  • is the size, in bytes, of a Merkle tree node
  • h is the height of the Merkle tree
  • each data element transmitted must be accompanied by
  • the present invention addresses the following problems:
  • simulcast authentication wherein several data streams are intertwined and only one data chunk is taken at a time from a given stream, and the data from the other streams is dropped;
  • the present invention provides the following schemes:
  • the schemes use cryptographic hash functions to process the blocks of the original stream and create a short digest.
  • a digital signature or MAC is then applied to the digest, thereby providing authentication information. If the receiver is given the entire stream, then it can recompute the digest and verify the signature. When specific portions of the stream need to be removed, the remover sends information that allows the receiver to efficiently compute the digest.
  • the amount of information provided to the receiver in this setting is related to the output size of the cryptographic hash function and is otherwise independent of the actual data stream.
  • the intermediary or source can remove arbitrary blocks (irrespective of their location) while still permitting the receiver to authenticate information.
  • the scheme involves computing a two-layer hash chain and providing the recipient with various values in this chain. The scheme is online for the receiver in the sense that the receiver does not have to incur any delay in verifying the authentication information.
  • several first-layer hashes are aggregated before performing the second-layer hash. Consequently, fewer second-layer hashes need to be performed.
  • the intermediary or source is provided with multiple streams and can arbitrarily switch among which stream it transmits while still permitting the receiver to authenticate information.
  • the scheme involves computing a multi-layer hash chain and providing the recipient with various values in this chain.
  • the scheme is online for the tone power source lines by 1 ⁇ 2, 1 ⁇ 4, 1 ⁇ 8, . . . . Then, the area occupied by the authentication information.
  • the intermediary or source can remove arbitrary blocks (irrespective of their location) while still permitting the receiver to authenticate information.
  • the scheme involves computing a hash tree and providing the recipient with various values in this tree.
  • some subset (of size greater than one) of dropped blocks constitute a subtree of the hash tree
  • the hashed scheme is more efficient with respect to bandwidth than the corresponding linear scheme.
  • the scheme is not online for the receiver in the sense that the receiver must wait for all blocks before being able to verify the authentication information.
  • Tree Scheme for Simulcast Authentication the intermediary or source is provided with multiple streams and can arbitrarily switch among which stream it transmits while still permitting the receiver to authenticate information.
  • the scheme involves computing a hash tree and providing the receiver with various values in this tree. The scheme is not online for the receiver in the sense that the receiver must wait for all blocks before being able to verify the authentication information.
  • the present invention permits a situation in which an intermediary may adaptively and intelligently decide which blocks are to be dropped.
  • the schemes of the present invention readily adapt to any model for dropping blocks.
  • the intermediary is not required to know of any cryptographic keying material.
  • the source provides the intermediary with various hash values, then the intermediary can avoid having to do any cryptographic related computation. Instead, it just has to forward the blocks it desired together with the hash information for those blocks that are dropped.
  • Both the linear and tree-based schemes can take advantage of correlation among blocks of data. For example, in the tree-based scheme, if a given subset of blocks has the behavior that all will be dropped or all will be kept, then these blocks can be placed as all the leaves of the same subtree. In the event that all packets in the given subset are dropped, only the root has to be transmitted. However, this concept applies even if the correlation is probabilistic. For example, if a given block being dropped makes it more likely that another block will be dropped, then these blocks should also be clustered. Likewise, in the linear schemes, if a given sequence of frames are to be all kept or dropped, these frames can be treated as a single block unit to be hashed. Then, if the entire sequence of frames is dropped only a single hash value needs to be sent.
  • FIG. 1 shows a high-level depiction of a scalable coder.
  • FIG. 2 shows a block diagram of a sender or source.
  • FIG. 3 shows a block diagram of a receiver.
  • FIG. 4 shows a block diagram of an intermediary.
  • FIG. 5 shows a block diagram of a system including a sender, a receiver, and an intermediary.
  • FIG. 6 illustrates a Merkle Tree with eight leaves.
  • FIG. 7 illustrates a basic linear subsequence authentication scheme according to one embodiment of the present invention.
  • FIG. 9 illustrates a basic linear simulcast authentication scheme according to one embodiment of the present invention.
  • FIG. 10 illustrates a tree-based subsequence authentication scheme according to one embodiment of the present invention.
  • FIG. 11 illustrates a tree-based simulcast authentication scheme according to one embodiment of the present invention.
  • an initial sender 200 in FIG. 2 is responsible for authenticating the data stream.
  • each sender 200 includes a processor 201 in bidirectional communication with a memory 202 .
  • the processor 201 executes program code for carrying out the schemes of the present invention to generate, transmit or receive data streams.
  • the memory 202 stores cryptographic keys, program codes, as well as intermediate results and other information used during execution of the schemes.
  • a communications network 203 is provided over which the sender may communicate with receivers.
  • FIG. 3 shows a block diagram of a receiver which receives data streams from the sender or server or an intermediary over a communication network according to one embodiment of the present invention.
  • the system of the present invention includes a number of receivers, which verify the received data.
  • Each receiver 300 includes a processor 301 in bidirectional communication with a memory 302 .
  • the processor 301 executes program code for carrying out the schemes of the present invention to generate, transmit, and receive data streams. Program code may be created according to methods known in the art.
  • the memory 302 stores cryptographic keys and the program code, as well as intermediate results and other information used during execution of the schemes.
  • a communications network 303 is provided over which the sender and the receivers may communicate.
  • the communications network may be of various common forms, including, for example, a local area network (LAN), a wide area network (WAN), and/or a mobile telephone network.
  • the network may permit either wired or wireless communications.
  • FIG. 4 shows a block diagram of an intermediary.
  • the data for the sender may pass through one or more intermediaries shown in FIG. 4 on its way to the sender or receiver.
  • the intermediaries may choose to perform certain transformations on the data.
  • Each intermediary 400 includes a processor 401 in bidirectional communication with a memory 402 .
  • the processor 401 executes program code for carrying out the schemes of the present invention to generate, transmit, and receive data streams.
  • the memory 402 may store cryptographic keys.
  • FIG. 5 shows a block diagram of a system according to one embodiment of the present invention, including a sender 501 , an intermediary 503 , a receiver 505 , and communication networks 502 and 504 .
  • the sender 501 transmits an original data stream with signature and optional helper information to the intermediary 503 via the communication network 502 , which then transmits a reduced data stream with signature and relevant helper information to receiver 505 via communication network 504 .
  • the above-mentioned transformations involve removing certain portions of the data. If an intermediary modifies the data stream, it will determine what information, if any, is required by the receiver to verify the authentication information associated with the stream.
  • b, 1 ⁇ i ⁇ n.
  • H denotes a cryptographic compression function that takes as input a b-bit payload as well as a v-bit initialization vector or IV, and produces a v-bit output where typically v ⁇ b.
  • cryptographic compression functions examples are found in SHA-1 or MD5.
  • the compression function in SHA-1 has an output and IV size of 160-bits whereas the compression function in MD5 works with 128-bit values. Both allow for a 512-bit payload size.
  • application of the compression function is repeated.
  • Functions that operate as such while still retaining the collision resistance property are termed cryptographic hash functions. For simplicity, this term is used below even if a data block that fits within the payload is dealt with.
  • the schemes of the present invention make use of conventional constructs involving cryptographic compression functions.
  • One such construct is an iterated hash function which is built from cryptographic compression functions as follows.
  • H is a cryptographic compression function with a b-bit payload and a v-bit output.
  • FIG. 6 shows a graphical depiction of a Merkle tree with eight leaves. Each leaf is the hash of the message below it. Each interior node represents the hash of its children. The root is signed.
  • the Merkle tree associated with M under hash function H is a binary tree in which each node is associated with a specific value. There are n leaves, and each leaf l i takes on the hash of M i —that is, H(IV 0 , M i ).
  • Each interior (non-leaf) node then takes on the value associated with the hash of the concatenations of the values of its two children. That is, if vertex v has children v 1 and v 2 where v 1 has value x 1 and v 2 has value x 2 , then the value associated with v is H(IV 0 , x 1 x 2 ).
  • the present invention also makes use of the notion of the co-nodes for a given vertex in a Merkle tree.
  • the co-nodes of a vertex v consist of the direct siblings of the vertices on the path from v to the root. Given a vertex v and its co-nodes, one can compute the sequence of hash functions that lead from v to the root.
  • the linear subsequence authentication scheme of the present invention allows stream authentication even when arbitrary blocks from the message are removed. As long as the blocks sent by an intermediate node are a proper subsequence of the original message, the receiver can authenticate the stream.
  • FIG. 7 illustrates a basic linear subsequence authentication scheme according to one embodiment of the present invention. Given a message M, signature generation follows a similar paradigm to an iterated hash, except that it uses “two hashing layers”.
  • the scheme shown in FIG. 7 computes auxiliary hash values g 1 , . . . , g n which are not sent.
  • the initial sender S transmits (M, ⁇ Sk (h n )).
  • the value of IV 0 can be used as the IV for the computation of all the g i values.
  • the sender S may decide to transmit the hash values h i along with the message blocks (M 1 , h n ⁇ 1 , ⁇ Sk (h n )), (M 2 , h n ⁇ 2 ) . . . (M n ,h 0 ) .
  • an intermediate node wants to strip off k arbitrarily located message blocks, the node generates a resulting “message” M′, identical to M but where k blocks have been removed.
  • the receiver needs to be able to authenticate M′.
  • the intermediate node finally transmits M 1 ′, . . . M n ′ ⁇ Sk (h n ), h n ⁇ t )
  • the intermediate node transmits (M 1 ′,h n ⁇ 1 , ⁇ Sk (h n )), (M 2 ′,h n ⁇ 2 ), . . . (M n ′, h 0 )
  • the receiver can then verify the signature on h n as normal using the verification algorithm v.
  • the iterated hash construction is collision resistant so long as the underlying hash function H is as well.
  • the underlying hash function H is as well.
  • an adversary can come up with a non-subsequence forgery (that is, a message/signature pair that is not obtained by merely taking a subsequence of the original message), then it is possible to show that one can demonstrate either a collision in the hash function or a forgery on the underlying signature scheme. Therefore, as long as the signature scheme is not easily susceptible to forgery and the hash function is not easily susceptible to collisions, the scheme presented above is secure.
  • the intermediary When the intermediary removes blocks, it only needs to compute the hash of the block being removed. This computation does not involve any public-key steps and is fairly efficient. In fact, the throughput of algorithms like SHA-1 is on the order of a few hundred megabits per second. Moreover, if the intermediate nodes are resource bounded with respect to computation, the source can follow the alternative approach and include the intermediate h i values. In the case of SHA-1, each such value is 20-bytes long, so the bandwidth overhead will likely be quite small.
  • a tradeoff between bandwidth usage and buffering/computation is possible by sending some intermediate h i values selectively. If the receiver can store up to b message blocks, then the intermediate node can send the hash value h n ⁇ b only after b message blocks. Authentication can be done as described above starting from h n ⁇ b . Then, the intermediate node sends a second “bundle” (next b message blocks and h n ⁇ 2b ), which is authenticated by recomputing the partial hashes h n ⁇ b , . . . , h n ⁇ 2b+1 and then verifying the recomputed hash value h n ⁇ b matching the one received in the first bundle.
  • the scheme of the first embodiment permits the role of an intermediary which can adaptively and intelligently choose to remove any number of blocks without requiring knowledge of any cryptographic keying material.
  • the intermediary can be proximate to the receiver and can control the loss (and therefore the amount of hash information) dynamically.
  • the authentication information can be verified in an online manner by the receiver. That is, the receiver can verify the authentication information as it receives the stream, and will not be required to do any form of extensive buffering.
  • the first layer hash computations are not required for any block that will not be dropped. For example, an MPEG I-frame or the base layer of a scalable coding scheme will not be intentionally dropped. For these blocks, only the second layer is required.
  • the above scheme is even more advantageous since it can cluster these as a single block before hashing.
  • the second embodiment of the present invention provides an efficiency improvement to the basic linear subsequence authentication, by aggregating several first layer hashes before performing the second layer hashes. As a result, the method according to the second embodiment performs fewer second layer hashes.
  • the payload size is 64 bytes whereas the digest size is 20 bytes.
  • three digests can be concatenated together before the second layer function is called.
  • r hashes are aggregated.
  • ⁇ a ⁇ denotes the smallest integer greater or equal than a
  • ⁇ a ⁇ denotes the largest integer less or equal than a.
  • the scheme of the second embodiment computes auxiliary hash values g 1 , . . . , g n which are not sent.
  • the initial sender transmits (M, ⁇ Sk (h m )), and the value of IV 0 can be used as the IV for the computation of all the g i values.
  • the sender may decide to transmit the hash value h i along with every r-th message block (M 1 , ⁇ Sk (h m )),(M 2 ), . . . ,(M r , h m ⁇ 1 ),(M r+1 ), . . . , (M 2r ,h m ⁇ 2 ), . . . (M n ,h 0 ) .
  • the hash values h m , . . . , h 1 are computed as in the signing operation.
  • the intermediary finally transmits M 1 ′ . . . M n ′k, ⁇ Sk (h m ) .
  • the intermediary may transmit the hash values hi along with the “new” message blocks (M 1 ′, ⁇ Sk (h m )),(M 2 ′), . . . ,(M r ′, h m ⁇ 1 ),(M r+1 ′), . . . , (M 2r ′,h m ⁇ 2 ), . . . , (M n ′,h 0 ) .
  • h 1 H ⁇ ⁇ ( IV 0 , g 1 ′ , ... ⁇ , g r ′ )
  • h 2 H ⁇ ⁇ ( h 1 , g r + 1 ′ , ... ⁇ , g 2 ⁇ r ′ )
  • h m H ⁇ ⁇ ( h m - 1 , g r ⁇ ⁇ ⁇ n r ⁇ + 1 , ... ⁇ , g n ) ( 9 )
  • the receiver can then verify the signature on h m as normal using the verification algorithm v.
  • the receiver needs to be able to compute the intermediate hash h i . To do so, the receiver needs to buffer r blocks so it can compute the appropriate g values.
  • the online verification of this scheme is analogous to that of the first embodiment.
  • the scheme of the second embodiment is secure.
  • the intermediary when the intermediary removes blocks, it only needs to compute the hash of the block being removed.
  • each second-layer hash only requires a single call to the compression function. So, in the second embodiment, only ⁇ n r ⁇ compression function calls are made in the second layer compared to the n calls in the first embodiment.
  • the receiver of the second embodiment can verify the authentication information after receiving every r blocks.
  • r will be fairly small—on the order of 2 or 3, thus reducing the number of the second layer hashes.
  • the scheme of the third embodiment allows the intermediate node not only to select one stream and retransmit it in an authenticated fashion, but also to “switch” to some other stream adaptively (at any point during block transmission). Of course, the receiver should be able to authenticate the resulting stream.
  • FIG. 9 shows a basic linear simulcast authentication scheme according to one embodiment of the present invention.
  • signature generation follows the same approach as in the first and second embodiments, i.e., reverse iterated hash, but computing partial hashes of every block in each stream.
  • d 1 ( 1 ) H ⁇ ⁇ ( M n ( 1 ) )
  • d 1 ( 2 ) H ⁇ ⁇ ( M n ( 2 ) )
  • d 1 ( k ) H ⁇ ⁇ ( M n ( k )
  • h 1 H ⁇ ⁇ ( h 0 , d 1 ( 1 ) , ... ⁇ , d 1 ( k ) )
  • d n ( 1 ) H ⁇ ⁇ ( M 1 ( 1 ) )
  • d n ( 2 ) H ⁇ ⁇ ( M 1 ( 2 ) )
  • d n ( 2 ) H ⁇ ⁇ ( M 1 ( 2 ) )
  • d n ( k ) H ⁇ ⁇ ( M 1 ( k ) )
  • h n H ⁇ ⁇ ( h n - 1 , d n ( 1 ) , ... ⁇ , d n ( k
  • the initial sender transmits ⁇ Sk (h n ) and then sends M (1) , . . . , M (k) simultaneously.
  • the message blocks of the different streams will be interleaved in the transmission.
  • an intermediate node wants to select a possibly different stream (message) for each message block received. For instance, if each message encodes a video stream of different quality, the intermediate node may want to select a lower or higher quality depending on network congestion. It generates a “resulting message” M′, comprising “chunks” (consecutive message blocks) of the different streams. The intermediate node may pick a single stream (message) at each moment. It should be understood that the present invention allows for the possibility of layered streams. The receiver needs to be able to authenticate M′.
  • the intermediate node Given the received n-block messages M (1) , . . . , M (k) , the intermediate node computes “new” blocks M′ 1 , . . . , M′ n . For each set of message blocks M n ⁇ i+1 (1) , . . .
  • the intermediate node finally transmits M′ 1 . . . M′ n , ⁇ Sk (h n ) .
  • the intermediate node transmits (M′ 1 ,h n ⁇ 1 , ⁇ Sk (h n )),(M′ 2 ,h n ⁇ 2 ), . . . , (M′ n ,h 0 ) (13) 3.3 Verification
  • the receiver can then verify the signature on h n as normal using the verification algorithm v.
  • the alternative on-line verification procedure is straightforward.
  • the hash step of the scheme of the third embodiment can be iterated using a compression function with either the linear chaining scheme or a Merkle scheme.
  • the fourth embodiment of the present invention is a scheme for authenticating subsequences using Merkle Trees.
  • the tree-based scheme allows stream authentication even when arbitrary blocks from the message are removed. As long as the blocks sent by the intermediate node are a proper subsequence of the original message, the receiver can authenticate the stream.
  • the tree scheme is more efficient with respect to bandwidth than the linear scheme.
  • FIG. 10 illustrates a tree-based subsequence authentication scheme according to one embodiment of the present invention.
  • the intermediary If an intermediary wants to strip off k arbitrarily located message blocks, the intermediary generates a resulting “message” M′, identical to M, but with k blocks removed.
  • the receiver needs to be able to authenticate M′.
  • Let d 1 , . . . , d k denote the indices of the blocks that will be dropped and let s 1 , . . . , s n ⁇ k denote the blocks that will stay.
  • the intermediate node Given the received n-block message M, the intermediate node computes the corresponding authentication information as follows.
  • the intermediary For all blocks M d 1 , . . . , M d k that are to be dropped, the intermediary first determines the set of vertices corresponding to leaves l d 1 , . . . l d k in the Merkle tree associated with these blocks.
  • the intermediary takes this set of vertices, and computes the Merkle tree values x 1 , . . . , x r associated with them. The intermediary can easily perform this step since the
  • the intermediate node finally transmits M s 1 . . . M s n ⁇ k , ⁇ Sk (x),x 1 , . . . x r (15)
  • applying standard encoding to the block contents facilitates distinguishing between “message blocks” and “hashes”.
  • the receiver verifies the signature by computing the value of the root of the Merkle tree, using the following algorithm:
  • the above algorithm constitutes the standard algorithm for computing the root of a Merkle tree.
  • the receiver receives some hashes x 1 , . . . , x r , these come from the intermediary running the same algorithm on the subset of missing blocks. Therefore, the intermediary and receiver have together run the algorithm on all n blocks which yield the value of the Merkle root. This is why the above computation yields the Merkle root.
  • the receiver can verify the signature it receives.
  • the Merkle hash construction is collision resistant so long as the underlying hash function H is collision resistant.
  • the underlying hash function H is collision resistant.
  • an adversary can come up with a non-subsequence forgery (that is, come up with a message/signature pair that is not obtained by merely taking a subsequence of the original message), then one can demonstrate either a collision in the hash function or a forgery on the underlying signature scheme. Therefore, as long as the signature scheme is not easily susceptible to forgery and the hash function is not easily susceptible to collisions, the scheme of the fourth embodiment is secure.
  • the intermediary When the intermediary removes blocks, it needs to provide the receiver with a sufficient number of internal hashes to compute the Merkle root of the tree without those message blocks.
  • the intermediary will require k hashes for each of the blocks to be dropped and then at most k ⁇ 1 hashes when replacing pairs of hashes with a single hash (since a single hash results in replacing two values with a single one, thereby reducing the net number by one).
  • the total computation is therefore at most 2k ⁇ 1 hashes.
  • the total hashes computed by a single common switch (the number of switching elements is 12) to be shared.
  • the receiver When the receiver receives the stream, it needs to compute the root. If it has all the message blocks, this would require 2n ⁇ 1 hashes ⁇ n to initially hash each block, and then n ⁇ 1 additional hashes when replacing pairs of hash values with a single hash (since a single function computation results in replacing two values with a single one, and at the end only one value is remaining). However, t of these hashes are computed by the intermediary. Therefore the receiver only has to compute 2n ⁇ 1 ⁇ t hashes.
  • the fifth embodiment of the present invention is a tree-based scheme for authenticating multiple parallel streams in which one data block is selected from one stream at each step of the transmission.
  • the original sender S transmits k different streams M (1) , M (2) , . . . , M (k) simultaneously.
  • This scheme allows the intermediate node not only to select one stream and retransmit it in an authenticated fashion, but also to “switch” to some other stream adaptively (at any point during block transmission).
  • the receiver is able to authenticate the resulting stream.
  • the scheme of the fifth embodiment exploits certain aspects of the tree structure, so as to be more efficient with respect to bandwidth than the analogous linear scheme.
  • the scheme of the fifth embodiment does not readily lend itself to online verification. Instead, the receiver has to wait for all packets before it can verify. In practice, the delay can be reduced by splitting the stream into segments of reasonable size and authenticating each segment separately.
  • an intermediate node wants to select a possibly different stream (message) for each message block received. For instance, if each message encodes a video stream of different quality, the intermediate node may want to select a lower or higher quality depending on network congestion. It generates a resulting “message” M′, comprising “chunks” (consecutive message blocks) of the different streams. The receiver needs to be able to authenticate M′.
  • the intermediary simply has to provide the user with the information necessary to compute these values.
  • the intermediary can compute the set of required values as it did in the Merkle scheme of the fourth embodiment.
  • the intermediary transmits these values to the receiver which can then compute the x i values and in-turn verify the authentication information.
  • M′ (i) M s 1 ⁇ ( i ) ( i ) ⁇ ... ⁇ ⁇ M s ks ⁇ ( i ) ( i ) ( 16 )
  • kd(i) denote the number of blocks that will actually be dropped from stream M (i) .
  • d 1 (i) , . . . , d kd(i) (i) denote the indices of the blocks that will be dropped.
  • the intermediary computes the values necessary for the receiver to verify as follows:
  • the intermediary For all blocks M d 1 ( i ) ( i ) , ... ⁇ , M d k ( i ) ( i ) that are to be dropped, the intermediary first determines the set of vertices corresponding to leaves l d 1 ( i ) , ... ⁇ , l d kd ⁇ ( i ) ( i ) in the Merkle tree associated with these blocks.
  • the intermediary can easily perform this step since the cryptographic hash function is globally computable.
  • the intermediate node finally transmits the following information: ⁇ M′ (1) , . . . , M′ (n) ⁇ , ⁇ Sk (x), X (1) , . . . , X (k) (17)
  • the stream is sent in the proper order, that is, blocks from each of the M′ (i) may be interleaved so that the receiver can view the stream.
  • Some standard encoding is applied to the block contents so the receiver can distinguish between message blocks versus hash values.
  • the receiver verifies the signature by first computing the values of the roots of each of the Merkle trees—after that it hashes these values and verifies the signature. It achieves this goal using the following algorithm which is run for each i:
  • the above algorithm constitutes the standard algorithm for computing the root of a Merkle tree.
  • the receiver receives some hashes x 1 (i) , . . . , x r (i) , these come from the intermediary running the same algorithm on the subset of missing blocks. Therefore, the intermediary and receiver have together run the algorithm on all n blocks which yield the value of the Merkle root. This is why the above computation yields the Merkle root.
  • FIG. 11 illustrates the signing and verification of the fifth embodiment of the invention, an example with four streams and four message blocks.
  • each of the four streams M (1) , M (2) , M (3) , M (4) consists of four blocks.
  • the black leaves denote the message blocks that are actually sent. The remaining ones are dropped.
  • the shaded vertices represent the cover; that is, the values corresponding to these vertices are sent to the receiver.
  • the roots of the four Merkle trees are x (1) , x (2) , x (3) , and x (4) respectively.
  • the final root value x is computed by hashing the Merkle roots x (1) , x (2) , x (3) , x (4) . This hash can be also be performed in a Merkle-like fashion.
  • the value x is actually signed. In this scheme only six hash values are sent to the receiver. In the linear simulcast scheme, twelve hashes (three per each block transmitted) would have been transmitted. Thus, savings is achieved whenever dropped blocks are clustered. For example, in FIG. 11 , all blocks in the stream M (4) are dropped. As a result, one only needs to send the root x (4) of the associated Merkle tree.
  • the fifth embodiment is secure as long as the signature scheme is not easily susceptible to forgery, and the hash function is not easily susceptible to collisions.
  • the invention presented above is secure.
  • the performance of the fifth embodiment can be analyzed by extending the analysis for the tree-based subsequence scheme and the linear simulcast scheme.
  • a hash function with a specific payload size and a specific IV is used.
  • the chaining constructions tend to take some existing output and use that as the IV of the next block.
  • the current output instead of loading the current output as an IV, the current output can be concatenated to the next payload.
  • a scheme starts by splitting each stream M (i) into segments of length b blocks. Then, a tree scheme is applied on the first segment of all streams to compute the Merkle root x 1 , then the root on the second segment, and so on, until all segments are processed. In this way, Merkle roots x 1 , . . . , x ⁇ n/b ⁇ are obtained. Instead of signing each one of these roots, as in the tree schemes described above, the roots are combined using the linear scheme. Hence, if the receiver can buffer b blocks, then verification can be done “on-line”.
  • the communication overhead is decreased compared to the plain linear scheme since for each segment of b blocks, the number of transmitted hashes may be much less than the number of dropped blocks (although equal on the worst case).
  • a similar approach can be taken for subsequence authentication. This hybrid approach allows trading buffer space for communication overhead.
  • a linear scheme is applied to each stream, and then a Merkle tree is computed on the results.
  • the Merkle tree construction could be optimized.
  • one of the streams will more likely be used than the others, it is advantageous to use a lopsided Merkle tree in which the priority stream is close to the root (e.g., perhaps right below it).
  • the streams are prioritized, so that the high priority streams are closer to the final value in the chain. This ordering particularly makes sense when layered streams are used. In such cases, the voltage difference between V(T 1 ) and V(,, 2 ) to 2:1.
  • the schemes of the present invention can be interpreted as having two phases. In the first phase, it finds a convenient way to hash each data block. In the second phase, it signs the hashes. The reason for doing so is that if a block is dropped, it is not necessary to retransmit it in its entirety. Instead, only the hash computed in the first phase is transmitted. This information is sufficient to allow the receiver to verify, since the signature can be viewed as being performed on the hashes. dividing the voltage difference between V(T 1 ) and V(,, 2 ) to 2:1. In FIG. 6 , the is, the sender drops particular blocks on purpose. Of course, in many practical applications, one may have to deal with uncontrolled loss situations.
  • the present invention can be used to deal with the uncontrolled loss by replicating the hashes that would be sent if the packet were dropped.
  • FEC Forward Error Correction
  • schemes of the present invention involve an intermediary which can adaptively choose the amount of forward error correction to the authentication information (i.e., hash outputs).
  • the source can choose not to include authentication forward error correction information at all, and instead allow an intermediary to include the authentication forward error correction information dynamically to further increase the probability that the stream can be authenticated.
  • the intermediary becomes an integral part of a scheme which considers both uncontrolled losses handled through forward error correction as well as adaptive and intelligent controlled losses. For example, in the Merkle tree constructions, it may suffice for the recipient to recover intermediate nodes (as opposed to just leaf nodes). In such a case, the intermediary can choose to supply forward error correction information to allow recovery of the (possibly interior) nodes necessary to authenticate, thus requiring possibly less forward error correction information.
  • the intermediary can recycle the work effort.
  • the source can provide the intermediary with any necessary hash computations for assisting with authentication. Then, the intermediary is not required to perform any work of a cryptographic nature. Instead, it can choose which blocks to drop and select the corresponding authentication information to be transmitted.
  • Another application of the present invention is insertion and selection of advertisements in a stream.
  • the intermediary or some other party provides advertisements or a hash of advertisements, for example hashed using a Merkle tree, to the source.
  • the source then includes the Merkle hash in its stream as a placeholder, allowing the intermediary to choose which advertisement it would like to use.
  • this concept is not necessarily limited to advertisers.
  • the above scheme can also be used in conjunction with an encryption scheme provided that the scheme is designed to permit the recipient to decrypt a given block without requiring the decryption of or presence of many other blocks.
  • Two block cipher encryption modes facilitate this approach.
  • One is counter-mode encryption and the other is electronic code book (ECB) encryption.
  • EBC electronic code book
  • One may be able to use chaining or feedback modes (cipher block chaining (CBC), output feed back (OFB), etc) provided that the receiver receives any intermediate information to decrypt.
  • CBC cipher block chaining
  • OFB output feed back
  • Such information may include intermediate IVs or actual ciphertext blocks.
  • a chaining or feedback mode can be used; whereas for other blocks, a counter mode or ECB mode can be used.
  • I-frames are never dropped intentionally, so they can be treated differently and encrypted using CBC mode.
  • a similar remark applies to the base layer of any scalable coding scheme.

Abstract

Methods, components, and systems for efficient authentication, either through a digital signature or message authentication codes, and verification of a digital stream sent from a source to a receiver via zero or more intermediaries, such that the source or intermediary (or both) can remove certain portions of the data stream without inhibiting the ability of the ultimate receiver to verify the authenticity and integrity of the data received. According to the invention, a source may sign an entire data stream once, but may permit either itself or an intermediary to efficiently remove certain portions of the stream before transmitting the stream to the ultimate recipient, without having to re-sign the entire stream. Applications may include the signing of media streams which often need to be further processed to accommodate the resource requirements of a particular environment. Another application allows an intermediary to choose an advertisement to include in a given slot.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application claims the benefit of Provisional Application No. 60/495,787, filed Aug. 15, 2003. The present application incorporates the disclosure of this provisional application by reference.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The present invention relates to data stream authentication, and more specifically to authentication schemes with adaptively controlled packet loss.
  • 2. Description of the Related Art
  • In many cases, it is desirable to append authentication information to a stream of data to assure a recipient that the data came from a specific source and was not modified en-route. For example, if the data is being provided to an application, then it would be important for the application that the data has not been corrupted either maliciously or by accident.
  • In cryptography, there are two traditional mechanisms for permitting such authentication:
  • 1. Message Authentication Codes (MAC)
  • 2. Digital Signatures
  • With a MAC, both the original source and the ultimate receiver must possess knowledge of a shared secret key. The sender applies a mathematical transformation involving the original data and secret key, and produces a tag. The receiver can then apply a similar transformation with the data, the tag, and the secret key to verify the origin and the integrity of the data.
  • With Digital Signatures, the key is split into two parts: a secret signing key and a public verification key. The public verification key can be used to verify anything signed using the secret signing key. The key is split in such a way that it is not possible to derive the private portion from the public portion. The sender applies a mathematical transformation involving the original data and secret signing key, and produces a signature. The recipient can then apply a similar transformation with the data, the signature, and the public verification key to ascertain the identity of the sender and the integrity of the data.
  • Digital signatures have a non-repudiation property that MACs do not. Namely, the signer cannot later deny having signed the document since the signing key is secret and was in the signer's possession. Of course, the signature owner can always claim that the secret signing key was stolen by some adversary.
  • Because of their nature, traditional authentication schemes do not tolerate any transformations to the data made by the source or by an intermediate. If a document is modified after it is signed, the verification step will so indicate, and will fail.
  • But for many applications, it is not only convenient, but sometimes necessary, to permit some specific types of modifications. For example, scalable video coding schemes, a high-level picture of the principle of which is shown in FIG. 1, have the property that a subset of the stream can be decoded and the quality is commensurate with the amount decoded. These schemes may encode video into a base layer and then zero or more “enhancement” layers. Just the base layer alone would be sufficient to view the stream. Enhancement layers are utilized to improve the overall quality.
  • Now, in an environment that is resource constrained, one might want to strip the enhancement layers and only send the base layers. If the entire stream has been digitally signed or authenticated in conventional ways, then by removing the enhancement layers, the original tag or signature becomes invalid. Thus the entire stream would have to be reauthenticated.
  • Alternatively, one may want to splice several streams of different qualities as in a simulcast situation. There may be one high-quality version of the stream, one medium-quality version of the stream, and one low-quality version of the stream. If network resources are available, then the high-quality stream may be sent, but if the network congestion goes up, then one may want to shift to the medium or low quality streams. In an alternate scenario, it could be the case that the receiver is mobile and is leaving one network environment and entering another that has different resource restrictions. The splicing situation can be considered a special case of a lossy situation where the quality of signal transmission is poor or otherwise is degraded, for example, by viewing the three data streams as one huge layered stream and imagining that two out of three frames are being discarded.
  • Yet another application is dynamic advertising. A source may include in a given slot a number of advertisements that can be displayed. An intermediary can then choose from among these choices which advertisement it would like to display. The choice can, for example, be based upon what the intermediary thinks will be the best advertisement for the target audience. The advertisements themselves can be created by an intermediary or some other party, and can be provided to the source either in their original form or may be hashed. The source would then include them when signing the stream.
  • Thus, signature schemes that can handle these types of losses in a secure manner are needed. Here, “secure” means that the ultimate end receiver can determine with overwhelmingly high confidence that the data it receives comes from a stream that was originally signed validly, but for which certain portions were removed. In addition, there is also a need for an intermediary that can adaptively and intelligently decide which blocks to drop.
  • One conventional solution to the controlled loss authentication problem is to authenticate each packet individually. This solution has two substantial drawbacks. First, in the case of using digital signatures, a fairly expensive computation must be performed for each packet. Second, in both the digital signature and MAC case, authentication information must be appended to each packet, which may not be feasible in consideration of efforts to remove portions of the stream stem to meet bandwidth constraints. levels. Then, the decoder 984 is designed to select one of the tone voltages of 64 IEEE/ACM Transactions on Networking, 7(4):502:513, August 1999, the authors propose a solution in which each data element is hashed, and then the resulting hashes are digested using a Merkle-tree. The root of the Merkle tree is authenticated. Then, with each data element, the co-nodes are sent, thereby allowing the receiver to authenticate without it. Since Wong and Lam deal with per-packet authentication, each packet contains authentication information. In particular, if |v| is the size, in bytes, of a Merkle tree node, h is the height of the Merkle tree, then each data element transmitted must be accompanied by |v|×|h| bytes. Thus, this approach does not deal with the controlled loss authentication problem, and is not bandwidth efficient.
  • In R. Johnson, D. Molnar, D. Song, and D. Wagner, Homomorphic Signature Schemes—RSA 2002, Cryptographer's Track, the authors propose a redactable signature scheme. It permits certain specific transformations on the data while still allowing the receiver to verify. It also allows arbitrary deletion of substrings in a signed document and has applications for censoring. Suppose n message blocks m=m1, . . . , mn are to be signed, and assume that n is a power of 2. The scheme starts with an initial secret key k and uses it to generate n keys k1, . . . , kn with the aid of a tree-like construction such as that of Goldreich, Goldwasser, and Micali (GGM), O. Goldreich, S. Goldwasser, and S. Micali, How to Construct Random Functions, Journal of the ACM, vol. 33, No. 4, 1986, pages 210-217. Then, to sign message m, the triplets (0, m1, k1), . . . , (0, mn, kn) are hashed in a Merkle-like tree and the root r is signed to produce the signature s. The difference between this tree and a regular Merkle tree is that the value 1 is pre-pended before the internal hashes are computed. With knowledge of k, anyone can verify s. However, in order to censor the data stream, the value of k is never published. Instead, only certain intermediate values of the GGM tree are published. These values correspond to the information needed to derive the final keys ki corresponding to the data elements which are not censored. With uncensored blocks, the intermediate GGM values, and the co-nodes in the Merkle-like tree, the signature can be verified. However, the above Homomorphic Signature Scheme takes precautions, via a GGM tree, to protect the confidentiality of censored data and requires all uncensored message blocks, all co-nodes, and all keying information in order to permit verification, and thus is not efficient.
  • Accordingly, there has been a need for a secure authentication scheme that permits controlled removal of certain blocks in a stream without weakening the receiver's ability to verify the authentication information, and without requiring confidentiality of censored data.
  • SUMMARY OF THE INVENTION
  • In view of the foregoing, it is an object of the present invention to provide schemes for secure authentication under adaptive data loss both in the symmetric setting (with MAC) or in the asymmetric setting (with digital signatures), which are efficient with respect to the computation requirements of the sender, receiver, and intermediary, as well as the bandwidth requirements of the channels over which these parties communicate.
  • Briefly, the present invention addresses the following problems:
  • 1. adaptive loss (subsequence) authentication, wherein data chunks are removed arbitrarily;
  • 2. simulcast authentication, wherein several data streams are intertwined and only one data chunk is taken at a time from a given stream, and the data from the other streams is dropped; and
  • 3. adaptively lossy simulcast authentication, wherein sometimes the entire data chunk is dropped altogether.
  • The present invention provides the following schemes:
  • 1. Linear Scheme for Subsequence Authentication;
  • 2. Linear Scheme for Simulcast Authentication;
  • 3. Tree Scheme for Subsequence Authentication; and
  • 4. Tree Scheme for Simulcast Authentication.
  • Each of the above schemes may incorporate either a digital signature or a MAC. Therefore, the present invention implicitly provides 8 (=4×2) schemes.
  • The schemes use cryptographic hash functions to process the blocks of the original stream and create a short digest. A digital signature or MAC is then applied to the digest, thereby providing authentication information. If the receiver is given the entire stream, then it can recompute the digest and verify the signature. When specific portions of the stream need to be removed, the remover sends information that allows the receiver to efficiently compute the digest. The amount of information provided to the receiver in this setting is related to the output size of the cryptographic hash function and is otherwise independent of the actual data stream.
  • According to one aspect of this invention, Linear Scheme for Subsequence Authentication, the intermediary or source can remove arbitrary blocks (irrespective of their location) while still permitting the receiver to authenticate information. The scheme involves computing a two-layer hash chain and providing the recipient with various values in this chain. The scheme is online for the receiver in the sense that the receiver does not have to incur any delay in verifying the authentication information. In an optimization and generalization to this scheme, one second layer-hash is computed for every bundle of r first-layer hashes. When r=1, the scheme is the original linear scheme for subsequence authentication. In an improvement to this scheme, several first-layer hashes are aggregated before performing the second-layer hash. Consequently, fewer second-layer hashes need to be performed.
  • According to a second aspect of this invention, Linear Scheme for Simulcast Authentication, the intermediary or source is provided with multiple streams and can arbitrarily switch among which stream it transmits while still permitting the receiver to authenticate information. The scheme involves computing a multi-layer hash chain and providing the recipient with various values in this chain. The scheme is online for the tone power source lines by ½, ¼, ⅛, . . . . Then, the area occupied by the authentication information.
  • According to a third aspect of this invention, Tree Scheme for Subsequence Authentication, the intermediary or source can remove arbitrary blocks (irrespective of their location) while still permitting the receiver to authenticate information. The scheme involves computing a hash tree and providing the recipient with various values in this tree. In the case that some subset (of size greater than one) of dropped blocks constitute a subtree of the hash tree, the hashed scheme is more efficient with respect to bandwidth than the corresponding linear scheme. The scheme is not online for the receiver in the sense that the receiver must wait for all blocks before being able to verify the authentication information.
  • According to a fourth aspect of this invention, Tree Scheme for Simulcast Authentication, the intermediary or source is provided with multiple streams and can arbitrarily switch among which stream it transmits while still permitting the receiver to authenticate information. The scheme involves computing a hash tree and providing the receiver with various values in this tree. The scheme is not online for the receiver in the sense that the receiver must wait for all blocks before being able to verify the authentication information.
  • In all aspects of this invention, it is assumed that the sender has possession of all data to be signed at the onset. In most cases, such as when media is pre-recorded, this will not be a concern. In the case of a live stream, the present invention breaks the stream into smaller chunks and applies the schemes specified herein. Those skilled in the art will recognize that variations and modifications can be made without departing from the spirit of the invention.
  • The present invention permits a situation in which an intermediary may adaptively and intelligently decide which blocks are to be dropped. The schemes of the present invention readily adapt to any model for dropping blocks. Moreover, the intermediary is not required to know of any cryptographic keying material. Furthermore, if the source provides the intermediary with various hash values, then the intermediary can avoid having to do any cryptographic related computation. Instead, it just has to forward the blocks it desired together with the hash information for those blocks that are dropped.
  • All of the inventive schemes have the property that, given knowledge ahead of time that a given block will not be dropped, then the first layer hash on that block will not be performed. That is, the first layer hash for just that block can be replaced with the identity function (h(x)=x).
  • Both the linear and tree-based schemes can take advantage of correlation among blocks of data. For example, in the tree-based scheme, if a given subset of blocks has the behavior that all will be dropped or all will be kept, then these blocks can be placed as all the leaves of the same subtree. In the event that all packets in the given subset are dropped, only the root has to be transmitted. However, this concept applies even if the correlation is probabilistic. For example, if a given block being dropped makes it more likely that another block will be dropped, then these blocks should also be clustered. Likewise, in the linear schemes, if a given sequence of frames are to be all kept or dropped, these frames can be treated as a single block unit to be hashed. Then, if the entire sequence of frames is dropped only a single hash value needs to be sent.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The present invention is described herein with reference to the accompanying drawings, similar reference numbers being used to indicate functionally similar elements.
  • FIG. 1 shows a high-level depiction of a scalable coder.
  • FIG. 2 shows a block diagram of a sender or source.
  • FIG. 3 shows a block diagram of a receiver.
  • FIG. 4 shows a block diagram of an intermediary.
  • FIG. 5 shows a block diagram of a system including a sender, a receiver, and an intermediary.
  • FIG. 6 illustrates a Merkle Tree with eight leaves.
  • FIG. 7 illustrates a basic linear subsequence authentication scheme according to one embodiment of the present invention.
  • FIG. 8 illustrates an optimized linear subsequence authentication scheme with r=3 and with n a multiple of r, according to one embodiment of the present invention.
  • FIG. 9 illustrates a basic linear simulcast authentication scheme according to one embodiment of the present invention.
  • FIG. 10 illustrates a tree-based subsequence authentication scheme according to one embodiment of the present invention.
  • FIG. 11 illustrates a tree-based simulcast authentication scheme according to one embodiment of the present invention.
  • DETAILED DESCRIPTION OF EMBODIMENTS
  • In the schemes of the present invention, an initial sender 200 in FIG. 2 is responsible for authenticating the data stream. As shown, each sender 200 includes a processor 201 in bidirectional communication with a memory 202. The processor 201 executes program code for carrying out the schemes of the present invention to generate, transmit or receive data streams. The memory 202 stores cryptographic keys, program codes, as well as intermediate results and other information used during execution of the schemes. A communications network 203 is provided over which the sender may communicate with receivers.
  • FIG. 3 shows a block diagram of a receiver which receives data streams from the sender or server or an intermediary over a communication network according to one embodiment of the present invention. The system of the present invention includes a number of receivers, which verify the received data. Each receiver 300 includes a processor 301 in bidirectional communication with a memory 302. The processor 301 executes program code for carrying out the schemes of the present invention to generate, transmit, and receive data streams. Program code may be created according to methods known in the art. The memory 302 stores cryptographic keys and the program code, as well as intermediate results and other information used during execution of the schemes.
  • A communications network 303 is provided over which the sender and the receivers may communicate. The communications network may be of various common forms, including, for example, a local area network (LAN), a wide area network (WAN), and/or a mobile telephone network. The network may permit either wired or wireless communications.
  • FIG. 4 shows a block diagram of an intermediary. There may be more than one intermediary; alternatively, the source and intermediary may be identical. If the intermediary and source are not identical, then the intermediary needs not have any cryptographic keying material. The data for the sender may pass through one or more intermediaries shown in FIG. 4 on its way to the sender or receiver. The intermediaries may choose to perform certain transformations on the data. Each intermediary 400 includes a processor 401 in bidirectional communication with a memory 402. The processor 401 executes program code for carrying out the schemes of the present invention to generate, transmit, and receive data streams. The memory 402 may store cryptographic keys.
  • FIG. 5 shows a block diagram of a system according to one embodiment of the present invention, including a sender 501, an intermediary 503, a receiver 505, and communication networks 502 and 504. As shown, the sender 501 transmits an original data stream with signature and optional helper information to the intermediary 503 via the communication network 502, which then transmits a reduced data stream with signature and relevant helper information to receiver 505 via communication network 504.
  • The above-mentioned transformations involve removing certain portions of the data. If an intermediary modifies the data stream, it will determine what information, if any, is required by the receiver to verify the authentication information associated with the stream.
  • M denotes a media stream that can be broken up into it blocks of length b: M=M1M2 . . . Mn, |Mi|=b, 1≦i≦n. H denotes a cryptographic compression function that takes as input a b-bit payload as well as a v-bit initialization vector or IV, and produces a v-bit output where typically v<b. These cryptographic compression functions are collision resistant, that is, it is hard to find two inputs m1 and m2 with m1≠m2 such that H(IV,m1)=H(IV, m2) for a fixed IV. It is assumed that there is a standard IV, called IV0, that is fixed and publicly known. For notational simplicity, the description below will not explicitly list the IV as an argument in the hash function—though it should be thought of as being there implicitly.
  • Examples of such cryptographic compression functions are found in SHA-1 or MD5. The compression function in SHA-1 has an output and IV size of 160-bits whereas the compression function in MD5 works with 128-bit values. Both allow for a 512-bit payload size. When it is necessary to operate on data blocks that are larger than the payload size, application of the compression function is repeated. Functions that operate as such while still retaining the collision resistance property are termed cryptographic hash functions. For simplicity, this term is used below even if a data block that fits within the payload is dealt with.
  • For the schemes involving digital signatures, it is assumed that a public-key infrastructure exists, and that the sender has a key pair (Pk, Sk). Sk is the sender's private signing key—which can be used for appending a digital signature to a message, and Pk is the sender's public verification key which can be used to verify the authenticity of any signature issued using Pk. σ(Sk, M) denotes the digital signature algorithm on message M under signing key Sk, and v(Pk, M, σ) denotes the verification algorithm. The intermediate does not need to know either the signing or the verification key. For the schemes involving MAC, it is assumed that both the initial sender S and the ultimate receiver R share knowledge of a symmetric key, which need not be known by the intermediaries.
  • The schemes of the present invention make use of conventional constructs involving cryptographic compression functions. One such construct is an iterated hash function which is built from cryptographic compression functions as follows. Suppose a message M can be broken up into n blocks of length b, and H is a cryptographic compression function with a b-bit payload and a v-bit output. The iterated hash function defined by H is the value xn where: x 1 = H ( IV 0 , M 1 ) x 2 = H ( x 1 , M 2 ) x n = H ( x n - 1 , M n )
  • Assuming that it is hard to find collisions in the compression function H, it is then hard to find collisions in the iterated hash. Typically, when one wants to digitally sign a message, an iterated hash is applied to the message, and the resulting output is signed. The methods, systems, and components of the present invention will involve similar constructions, but intermediate values will be provided to aid in verification.
  • Another conventional construct involving cryptographic compression functions is a Merkle tree. FIG. 6 shows a graphical depiction of a Merkle tree with eight leaves. Each leaf is the hash of the message below it. Each interior node represents the hash of its children. The root is signed. Suppose that M can be broken up into n blocks M=M1 . . . Mn. For least 2K bits so that voltages of 4K different voltage levels can be output from the incorporate powers other than 2. The Merkle tree associated with M under hash function H is a binary tree in which each node is associated with a specific value. There are n leaves, and each leaf li takes on the hash of Mi—that is, H(IV0, Mi). Each interior (non-leaf) node then takes on the value associated with the hash of the concatenations of the values of its two children. That is, if vertex v has children v1 and v2 where v1 has value x1 and v2 has value x2, then the value associated with v is H(IV0, x1 x2).
  • the selection circuit receives as input first through m-th (=2K, where K is a root of the tree associated with the message M forming the digest is signed. If the underlying compression or hash function is collision resistant, then it will be hard to find two different messages whose Merkle root value is identical.
  • The present invention also makes use of the notion of the co-nodes for a given vertex in a Merkle tree. The co-nodes of a vertex v consist of the direct siblings of the vertices on the path from v to the root. Given a vertex v and its co-nodes, one can compute the sequence of hash functions that lead from v to the root.
  • 1. Subsequence Authentication
  • The linear subsequence authentication scheme of the present invention allows stream authentication even when arbitrary blocks from the message are removed. As long as the blocks sent by an intermediate node are a proper subsequence of the original message, the receiver can authenticate the stream.
  • 1.1 Signing
  • FIG. 7 illustrates a basic linear subsequence authentication scheme according to one embodiment of the present invention. Given a message M, signature generation follows a similar paradigm to an iterated hash, except that it uses “two hashing layers”.
  • Given a message M=M1M2 . . . Mn, in one embodiment, the present invention generates partial hash computations h1, . . . , hn as follows: h 0 = IV 0 g 1 = H ( h 0 , M n ) h 1 = H ( h 0 , g 1 ) g 2 = H ( h 1 , M n - 1 ) h 2 = H ( h 1 , g 2 ) g n = H ( h n - 1 , M 1 ) h n = H ( h n - 1 , g n ) ( 1 )
  • In the process of computing h1, . . . , hn, the scheme shown in FIG. 7 computes auxiliary hash values g1, . . . , gn which are not sent. The initial sender S transmits (M, σSk(hn)). The value of IV0 can be used as the IV for the computation of all the gi values.
  • Alternatively, the sender S may decide to transmit the hash values hi along with the message blocks
    Figure US20060136728A1-20060622-P00900
    (M1, hn−1, σSk(hn)), (M2, hn−2) . . . (Mn,h0)
    Figure US20060136728A1-20060622-P00901
    .
  • 1.2 Signature Update
  • If an intermediate node wants to strip off k arbitrarily located message blocks, the node generates a resulting “message” M′, identical to M but where k blocks have been removed. The receiver needs to be able to authenticate M′.
  • Given the received n-block message M, the intermediate node computes “new” blocks M1′, . . . , Mn′. For each message block Mn−i+1 (starting from the end, i=1 to i=n), the intermediate node computes the corresponding auxiliary and partial hashes as follows:
    g i =H(h i−1 , M n−i+1),
    h i =H(h i−1 , g i)  (2)
  • Depending on whether the block will be forwarded or dropped, the intermediate node computes
    M′ n−i+1 =M n−i+1, if block M i is forwarded, or g i, if block M i is dropped  (3)
  • Let t be the index of the last message block that the intermediate node wants to send to the receiver, such that Mt′=Mt, and Ml′≠Ml for all l>t. The intermediate node finally transmits
    Figure US20060136728A1-20060622-P00900
    M1′, . . . Mn′σSk(hn), hn−t)
  • Some standard encoding is applied to the block contents to facilitate distinguishing between “message blocks” and “hashes”. Skilled artisans would appreciate that there are numerous ways to perform this encoding.
  • Alternatively, to enable on-line verification, the intermediate node transmits
    Figure US20060136728A1-20060622-P00900
    (M1′,hn−1Sk(hn)), (M2′,hn−2), . . . (Mn′, h0)
    Figure US20060136728A1-20060622-P00901
  • 1.3 Verification
  • The receiver can verify the signature by computing hn from M1′, . . . , Mk′ and hn−t as follows: for each message block M′n−i+1 (starting from the end, i=1 to i=n), and depending on whether the received block is a “message block” or a “hash”, it computes
    h i =H(h i−1 , H(h i−1 , M′ n−i+1)), if M′ n−i+1 is a “message block” H(h i−1 , M′n−i+1 )), if M′ n−i+1 is a “hash”  (4)
  • The receiver can then verify the signature on hn as normal using the verification algorithm v.
  • The alternative on-line verification proceeds as follows: the receiver computes the partial hash hn from (M′1, hn−1) using relation (4) and then it verifies the signature on the partial hash hn. Afterwards, for i=2, . . . , n, it computes the partial hash hi from (M′i, hn−i) using (4) and verifies that the so computed hash matches the hash value received in iteration i−1.
  • 1.4 Security
  • As mentioned above, the iterated hash construction is collision resistant so long as the underlying hash function H is as well. In particular, if one finds a collision in the iterated construction, then at some point there is an internal collision, which means one can find a collision on the hash function H. If an adversary can come up with a non-subsequence forgery (that is, a message/signature pair that is not obtained by merely taking a subsequence of the original message), then it is possible to show that one can demonstrate either a collision in the hash function or a forgery on the underlying signature scheme. Therefore, as long as the signature scheme is not easily susceptible to forgery and the hash function is not easily susceptible to collisions, the scheme presented above is secure.
  • 1.5 Performance
  • When the intermediary removes blocks, it only needs to compute the hash of the block being removed. This computation does not involve any public-key steps and is fairly efficient. In fact, the throughput of algorithms like SHA-1 is on the order of a few hundred megabits per second. Moreover, if the intermediate nodes are resource bounded with respect to computation, the source can follow the alternative approach and include the intermediate hi values. In the case of SHA-1, each such value is 20-bytes long, so the bandwidth overhead will likely be quite small.
  • A tradeoff between bandwidth usage and buffering/computation is possible by sending some intermediate hi values selectively. If the receiver can store up to b message blocks, then the intermediate node can send the hash value hn−b only after b message blocks. Authentication can be done as described above starting from hn−b. Then, the intermediate node sends a second “bundle” (next b message blocks and hn−2b), which is authenticated by recomputing the partial hashes hn−b, . . . , hn−2b+1 and then verifying the recomputed hash value hn−b matching the one received in the first bundle.
  • The computations of this embodiment do not require storing the entire stream in memory since only a single input block to the hash function is needed at any given time.
  • The scheme of the first embodiment permits the role of an intermediary which can adaptively and intelligently choose to remove any number of blocks without requiring knowledge of any cryptographic keying material. Moreover, the intermediary can be proximate to the receiver and can control the loss (and therefore the amount of hash information) dynamically. Furthermore, the authentication information can be verified in an online manner by the receiver. That is, the receiver can verify the authentication information as it receives the stream, and will not be required to do any form of extensive buffering. Also, the first layer hash computations are not required for any block that will not be dropped. For example, an MPEG I-frame or the base layer of a scalable coding scheme will not be intentionally dropped. For these blocks, only the second layer is required. In this instance, the first layer hash function for that block can be replaced with the identity function h(x)=x. In a similar spirit, if a given sequence of frames will either all be dropped or all be kept, then the above scheme is even more advantageous since it can cluster these as a single block before hashing.
  • 2. An Efficiency Improvement to the Subsequence Authentication
  • The second embodiment of the present invention provides an efficiency improvement to the basic linear subsequence authentication, by aggregating several first layer hashes before performing the second layer hashes. As a result, the method according to the second embodiment performs fewer second layer hashes. For a typical compression function, such as the one accompanying SHA-1, the payload size is 64 bytes whereas the digest size is 20 bytes. As a result, in this situation, three digests can be concatenated together before the second layer function is called. In the second embodiment, it is assumed that r hashes are aggregated. In addition, for any decimal number a, └a┘ denotes the smallest integer greater or equal than a, and ┌a┐ denotes the largest integer less or equal than a.
  • 2.1 Signing
  • For a message M, signature generation according to the second embodiment follows a similar paradigm to the scheme of the first embodiment, and uses “two hashing layers”. However, the scheme of the second embodiment involves fewer hashes than that of the first embodiment. FIG. 8 shows an improved linear subsequence authentication scheme according to one embodiment of the present invention, with r=3 and with n a multiple of r. In this scheme groups of r first-layer hashes are hashed in the second layer. Given a message M=M1M2 . . . Mn, the scheme of the second embodiment generates the partial hash computations h1, . . . , hm, where m = n r as follows : g 1 = H ( IV 0 , M n ) g 2 = H ( IV 0 , M n - 1 ) g r = H ( IV 0 , M n - ( r - 1 ) ) h 1 = H ( IV 0 , g 1 , , g r ) g r + 1 = H ( IV 0 , M n - r ) g r + 2 = H ( IV 0 , M n - ( r + 1 ) ) g 2 r = H ( IV 0 , M n - ( 2 r - 1 ) ) h 2 = H ( h 1 , g r + 1 , , g 2 r ) g r n r - r + 1 = H ( IV 0 , M n - ( r n r - r ) ) g r n r - r + 2 = H ( IV 0 , M n - ( r n r - r + 1 ) ) g r n r = H ( IV 0 , M n - ( r n r - 1 ) ) h m - 1 = H ( h m - 2 , g r n r - r + 1 , , g r n r ) g r n r + 1 = H ( IV 0 , M n - ( r n r ) ) g n = H ( IV 0 , M 1 ) h m = H ( h m - 1 , g r n r + 1 , , g n ) ( 5 )
  • Similarly to the scheme of the first embodiment, in the process of computing h1, . . . , hm, the scheme of the second embodiment computes auxiliary hash values g1, . . . , gn which are not sent. The initial sender transmits (M, σSk(hm)), and the value of IV0 can be used as the IV for the computation of all the gi values.
  • Alternatively, the sender may decide to transmit the hash value hi along with every r-th message block
    Figure US20060136728A1-20060622-P00900
    (M1Sk(hm)),(M2), . . . ,(Mr, hm−1),(Mr+1), . . . , (M2r,hm−2), . . . (Mn,h0)
    Figure US20060136728A1-20060622-P00901
    .
  • 2.2 Signature Update
  • Now, suppose an intermediate node wants to strip off n−k arbitrarily located message blocks. It generates a resulting “message” M′, identical to M but where n−k blocks have been removed. The receiver needs to be able to authenticate M′.
  • Given the received n-block message M, the intermediate node computes “new” blocks M′1, . . . , M′n. For each message block Mn−i+1 (starting from the end, i=1 to i=n), it computes the corresponding auxiliary and partial hashes
    g i =H(IV 0 , M n−i+1)  (6)
  • Depending on whether the block will be forwarded or dropped, the intermediate node computes
    M′ n−i+1 =M n−i+1, if block M i is forwarded, or g i, if block M i is dropped  (7)
  • The hash values hm, . . . , h1 are computed as in the signing operation. The intermediary finally transmits
    Figure US20060136728A1-20060622-P00900
    M1′ . . . Mn′k,σSk(hm)
    Figure US20060136728A1-20060622-P00901
    .
  • The above transmission requires buffering r packets to perform verification. In practice r will be quite small. For a SHA-1 based scheme r=3 and for an MD-5 based scheme, r=4.
  • Alternatively, the intermediary may transmit the hash values hi along with the “new” message blocks
    Figure US20060136728A1-20060622-P00900
    (M1′,σSk(hm)),(M2′), . . . ,(Mr′, hm−1),(Mr+1′), . . . , (M2r′,hm−2), . . . , (Mn′,h0)
    Figure US20060136728A1-20060622-P00901
    .
  • 2.3 Verification
  • The receiver can verify the signature by computing hm from M′1, . . . , M′n as follows. First, for each message block M′n−i+1 (starting from the end, i=1 to i=n), and depending on whether the received block is a “message block” or a “hash”, the receiver computes
    g′ i =H(h i−1 ,M′ n−i+1), if M′ n−i+1 is a “message block” M′ n−i+1, if M′ n−i+1 is a “hash”  (8)
  • Finally, the receiver computes hm: h 1 = H ( IV 0 , g 1 , , g r ) h 2 = H ( h 1 , g r + 1 , , g 2 r ) h m = H ( h m - 1 , g r n r + 1 , , g n ) ( 9 )
  • The receiver can then verify the signature on hm as normal using the verification algorithm v.
  • To perform online verification, the receiver needs to be able to compute the intermediate hash hi. To do so, the receiver needs to buffer r blocks so it can compute the appropriate g values. The online verification of this scheme is analogous to that of the first embodiment.
  • 2.4 Security
  • Similarly to the first embodiment, so long as the signature scheme is not easily susceptible to forgery and the hash function is not easily susceptible to collisions, the scheme of the second embodiment is secure.
  • 2.5 Performance
  • Similarly to the first embodiment, when the intermediary removes blocks, it only needs to compute the hash of the block being removed.
  • It takes less time for the subsequence scheme of the second embodiment to both compute and verify the signature compared to the subsequence scheme of the first embodiment, since only one second-layer hash is performed for every r first layer hashes. If r is chosen carefully (for example, setting r=3 for SHA-1 or r=4 for MD-5), then each second-layer hash only requires a single call to the compression function. So, in the second embodiment, only n r
    compression function calls are made in the second layer compared to the n calls in the first embodiment.
  • In addition to the advantages of the first embodiment, the receiver of the second embodiment can verify the authentication information after receiving every r blocks. In practice, r will be fairly small—on the order of 2 or 3, thus reducing the number of the second layer hashes.
  • 3. Simulcast Authentication: the Multiplex Scheme
  • Now, assume the original sender S transmits k different streams M(1), M(2), . . . , M(k) simultaneously. Each stream consists of n blocks of length b, M(j)=M1 (j), . . . , Mn (j). The scheme of the third embodiment allows the intermediate node not only to select one stream and retransmit it in an authenticated fashion, but also to “switch” to some other stream adaptively (at any point during block transmission). Of course, the receiver should be able to authenticate the resulting stream.
  • 3.1 Signing
  • FIG. 9 shows a basic linear simulcast authentication scheme according to one embodiment of the present invention. Given a message M, signature generation follows the same approach as in the first and second embodiments, i.e., reverse iterated hash, but computing partial hashes of every block in each stream.
  • Given messages M(1), M(2), . . . , M(k), where M(j)=M1 (j), M2 (j), . . . , Mn (j), the scheme of the third embodiment of the present invention generates the partial hash computations h1, . . . , hn as follows: d 1 ( 1 ) = H ( M n ( 1 ) ) d 1 ( 2 ) = H ( M n ( 2 ) ) d 1 ( k ) = H ( M n ( k ) ) h 1 = H ( h 0 , d 1 ( 1 ) , , d 1 ( k ) ) d n ( 1 ) = H ( M 1 ( 1 ) ) d n ( 2 ) = H ( M 1 ( 2 ) ) d n ( k ) = H ( M 1 ( k ) ) h n = H ( h n - 1 , d n ( 1 ) , , d n ( k ) ) ( 10 )  .
    d n (1) =H(M 1 (1))
    d n (2) =H(M 1 (2))
    .
    .
    .
    d n (k) =H(M 1 (k))
    h n =H(h n−1 ,d n (1) , . . . ,d n (k))  (10)
  • The initial sender transmits σSk(hn) and then sends M(1), . . . , M(k) simultaneously. In practice, the message blocks of the different streams will be interleaved in the transmission.
  • 3.2 Signature Update
  • Suppose an intermediate node wants to select a possibly different stream (message) for each message block received. For instance, if each message encodes a video stream of different quality, the intermediate node may want to select a lower or higher quality depending on network congestion. It generates a “resulting message” M′, comprising “chunks” (consecutive message blocks) of the different streams. The intermediate node may pick a single stream (message) at each moment. It should be understood that the present invention allows for the possibility of layered streams. The receiver needs to be able to authenticate M′.
  • Given the received n-block messages M(1), . . . , M(k), the intermediate node computes “new” blocks M′1, . . . , M′n. For each set of message blocks Mn−i+1 (1), . . . , Mn−i+1 (k), (starting from the end, i=1 to i=n), it computes the partial hashes d i ( 1 ) = H ( M n - i + 1 ( 1 ) ) d i ( 2 ) = H ( M n - i + 1 ( 2 ) ) d i ( k ) = H ( M n - i + 1 ( k ) ) h i = H ( h i - 1 , d i ( 1 ) , , d i ( k ) ) ( 11 )
  • Then if stream l is chosen, 1≦l≦k, it computes
    M′ n−i+1=(d i (1) , . . . ,d i l−1) ,M n−i+1 (l) ,d i (l+1) , . . . ,d i (k)).  (12)
  • The intermediate node finally transmits
    Figure US20060136728A1-20060622-P00900
    M′1 . . . M′nSk(hn)
    Figure US20060136728A1-20060622-P00901
    .
  • Alternatively, to enable on-line verification, the intermediate node transmits
    Figure US20060136728A1-20060622-P00900
    (M′1,hn−1Sk(hn)),(M′2,hn−2), . . . , (M′n,h0)
    Figure US20060136728A1-20060622-P00901
      (13)
    3.3 Verification
  • The receiver can verify the signature by computing hn, from M′1, . . . , M′k and h0=IV0. For each message block M′n−i+1 (starting from the end, i=1 to i=n) if M′n−i+1 is of the form
    M′ n−i+1=(d i (1) , . . . ,d i (l−1) ,M n−i+1 (l) ,d i (l+1) , . . . ,d i (k))
  • then, the receiver computes
    d i (k) =H(M n−i+1 (k))
    h i =H(h i−1 ,d i (1) , . . . ,d i (l−1) ,d i ,d i (l+1) , . . . ,d i (k))  (14)
  • The receiver can then verify the signature on hn as normal using the verification algorithm v.
  • The alternative on-line verification procedure is straightforward. The receiver computes the partial hash hn from (M′1, hn−1) using relation (14) and then it verifies the signature on the partial hash hn. Afterwards, for i=2, . . . , n, it computes the partial hash hi from (M′i, hn−i) using (14) and verifies the so computed hash matches the hash value received in iteration i−1.
  • 3.4 Performance
  • In addition to the advantages of the scheme of the first embodiment, the hash step of the scheme of the third embodiment can be iterated using a compression function with either the linear chaining scheme or a Merkle scheme.
  • By using a Merkle tree-like construction to hash down each sequence of blocks Mi (1), . . . , Mi (k), bandwidth can be saved at the cost of more intensive computation (by the intermediate node).
  • 4. Tree Scheme for Subsequence Authentication
  • The fourth embodiment of the present invention is a scheme for authenticating subsequences using Merkle Trees. Like the linear subsequence authentication scheme, the tree-based scheme allows stream authentication even when arbitrary blocks from the message are removed. As long as the blocks sent by the intermediate node are a proper subsequence of the original message, the receiver can authenticate the stream. By exploiting certain aspects of the tree structure, the tree scheme is more efficient with respect to bandwidth than the linear scheme.
  • 4.1 Signing
  • FIG. 10 illustrates a tree-based subsequence authentication scheme according to one embodiment of the present invention. Given a message M=M1M2 . . . Mn, the scheme of the fourth embodiment generates a Merkle tree shown in FIG. 6. If v denotes the root of the tree and x denotes the value associated with the root, then the initial sender transmits (M, σSk(x)).
  • 4.2 Signature Update
  • If an intermediary wants to strip off k arbitrarily located message blocks, the intermediary generates a resulting “message” M′, identical to M, but with k blocks removed. The receiver needs to be able to authenticate M′. Let d1, . . . , dk denote the indices of the blocks that will be dropped and let s1, . . . , sn−k denote the blocks that will stay. Given the received n-block message M, the intermediate node computes the corresponding authentication information as follows.
  • 1) For all blocks Md 1 , . . . , Md k that are to be dropped, the intermediary first determines the set of vertices corresponding to leaves ld 1 , . . . ld k in the Merkle tree associated with these blocks.
  • 2) If any pair of vertices are siblings in the Merkle tree, the intermediary replaces these two vertices both with their parent.
  • 3) The intermediary keeps repeating the above process until no two vertices in the set are siblings.
  • 4) The intermediary takes this set of vertices, and computes the Merkle tree values x1, . . . , xr associated with them. The intermediary can easily perform this step since the
  • fifth and sixth switches (405, 406) connected between the first terminal
  • The intermediate node finally transmits
    Figure US20060136728A1-20060622-P00900
    Ms 1 . . . Ms n−k Sk(x),x1, . . . xr
    Figure US20060136728A1-20060622-P00901
      (15)
  • Similarly to other embodiments of the present invention, applying standard encoding to the block contents facilitates distinguishing between “message blocks” and “hashes”.
  • 4.3 Verification
  • The receiver verifies the signature by computing the value of the root of the Merkle tree, using the following algorithm:
  • 1) For every actual message block Ms i received, compute the value yi=H(IV0,Ms i ).
  • 2) Consider the set of all hashes y1, . . . , yn−k, x1, . . . , xr. Each of these corresponds to values of vertices in a Merkle tree.
  • 3) For each pair of values, if they correspond to vertices who are siblings, then replace the pair with their hash (which corresponds to the parent node).
  • 4) Repeat the above step until only one value remains—this value is the root.
  • If one has all the initial message blocks, then the above algorithm constitutes the standard algorithm for computing the root of a Merkle tree. Whenever the receiver receives some hashes x1, . . . , xr, these come from the intermediary running the same algorithm on the subset of missing blocks. Therefore, the intermediary and receiver have together run the algorithm on all n blocks which yield the value of the Merkle root. This is why the above computation yields the Merkle root.
  • With the value of the Merkle root, the receiver can verify the signature it receives.
  • 4.4 Security
  • The Merkle hash construction is collision resistant so long as the underlying hash function H is collision resistant. In particular, if one finds a collision in the Merkle tree, then at some point there is a collision at an internal node, which means one can find a collision on the hash function H. If an adversary can come up with a non-subsequence forgery (that is, come up with a message/signature pair that is not obtained by merely taking a subsequence of the original message), then one can demonstrate either a collision in the hash function or a forgery on the underlying signature scheme. Therefore, as long as the signature scheme is not easily susceptible to forgery and the hash function is not easily susceptible to collisions, the scheme of the fourth embodiment is secure.
  • 4.5 Performance
  • When the intermediary removes blocks, it needs to provide the receiver with a sufficient number of internal hashes to compute the Merkle root of the tree without those message blocks. The intermediary will require k hashes for each of the blocks to be dropped and then at most k−1 hashes when replacing pairs of hashes with a single hash (since a single hash results in replacing two values with a single one, thereby reducing the net number by one). The total computation is therefore at most 2k−1 hashes. The total hashes computed by a single common switch (the number of switching elements is 12) to be shared.
  • When the receiver receives the stream, it needs to compute the root. If it has all the message blocks, this would require 2n−1 hashes−n to initially hash each block, and then n−1 additional hashes when replacing pairs of hash values with a single hash (since a single function computation results in replacing two values with a single one, and at the end only one value is remaining). However, t of these hashes are computed by the intermediary. Therefore the receiver only has to compute 2n−1−t hashes.
  • The total work in this scheme between the intermediary and the receiver is at most 2n−1 hashes. In the previous linear schemes 2n hashes were required.
  • In terms of bandwidth, the tree based scheme may be much more efficient. Only r≦k hashes are finally sent. In the best case, if all k blocks to be dropped entirely constitute all leaves of a subtree in the Merkle tree, then only the single value corresponding to the root of this subtree is sent, that is r=1. In the worst case, if no pair of blocks are siblings, then the bandwidth requirements are the exact same as in the linear case, and k hash values need to be sent.
  • 5. Tree Scheme for Simulcast Authentication
  • The fifth embodiment of the present invention is a tree-based scheme for authenticating multiple parallel streams in which one data block is selected from one stream at each step of the transmission. As in the linear multiplex setting of the third embodiment, it is assumed that the original sender S transmits k different streams M(1), M(2), . . . , M(k) simultaneously. Each stream consists of n blocks of length b, M(j)=MI (j), . . . , Mn (j). This scheme allows the intermediate node not only to select one stream and retransmit it in an authenticated fashion, but also to “switch” to some other stream adaptively (at any point during block transmission). Of course, the receiver is able to authenticate the resulting stream. As in the tree-based scheme for subsequence authentication of the fourth embodiment, the scheme of the fifth embodiment exploits certain aspects of the tree structure, so as to be more efficient with respect to bandwidth than the analogous linear scheme. On the other hand, like the tree construct of the fourth embodiment, the scheme of the fifth embodiment does not readily lend itself to online verification. Instead, the receiver has to wait for all packets before it can verify. In practice, the delay can be reduced by splitting the stream into segments of reasonable size and authenticating each segment separately.
  • 5.1 Signing
  • Given k different streams M(1), M(2), . . . , M(k), the signature generation of the scheme of the fifth embodiment works as follows.
  • 1) The signer first generates a separate Merkle tree for each stream. Let v(1), . . . , v(k) denote the k roots of the tree, and let x(1), . . . , x(k) denote the respective values associated with these roots.
  • 2) The signer then computes x=H(IV, x(1), . . . , x(k)). Here the hash function H can be computed using a Merkle tree construction as well.
  • 3) Finally, the signer transmits (M, σSk(x)).
  • 5.2 Signature Update
  • Now, suppose an intermediate node wants to select a possibly different stream (message) for each message block received. For instance, if each message encodes a video stream of different quality, the intermediate node may want to select a lower or higher quality depending on network congestion. It generates a resulting “message” M′, comprising “chunks” (consecutive message blocks) of the different streams. The receiver needs to be able to authenticate M′.
  • If the receiver can accurately compute each of the xi values, then it can verify the signature. Therefore, the intermediary simply has to provide the user with the information necessary to compute these values. By treating each Merkle tree separately, the intermediary can compute the set of required values as it did in the Merkle scheme of the fourth embodiment. The intermediary transmits these values to the receiver which can then compute the xi values and in-turn verify the authentication information.
  • Specifically, for each i with 1≦i≦k, let ks(i) denote the number of blocks that will actually be sent from stream M(i). For the stream M(i), let s1 (i), . . . , sks(i) (i) denote the indices of the blocks that will be included. Let M′(i) denote these blocks: M ( i ) = M s 1 ( i ) ( i ) M s ks ( i ) ( i ) ( i ) ( 16 )
  • As to the indices of blocks that are to be dropped, for each i with 1≦i≦k, let kd(i) denote the number of blocks that will actually be dropped from stream M(i). For the stream M(i), let d1 (i), . . . , dkd(i) (i) denote the indices of the blocks that will be dropped.
  • As in the tree scheme of the fourth embodiment, for each stream M(i) the intermediary computes the values necessary for the receiver to verify as follows:
  • 1) For all blocks M d 1 ( i ) ( i ) , , M d k ( i ) ( i )
    that are to be dropped, the intermediary first determines the set of vertices corresponding to leaves l d 1 ( i ) , , l d kd ( i ) ( i )
    in the Merkle tree associated with these blocks.
  • 2) Now, if any pair of vertices are siblings in the Merkle tree, the intermediary replaces these two vertices both with their parent, i.e., the hash of concatenation of the values associated with the siblings.
  • 3) The intermediary keeps repeating the above process until no two vertices in the set are siblings.
  • 4) The intermediary takes this set of vertices, and computes the Merkle tree values X(i)=x1 (i), . . . , xr (i) associated with them. The intermediary can easily perform this step since the cryptographic hash function is globally computable.
  • The intermediate node finally transmits the following information:
    Figure US20060136728A1-20060622-P00900
    {M′(1), . . . , M′(n)}, σSk (x), X(1), . . . , X(k)
    Figure US20060136728A1-20060622-P00901
      (17)
  • The stream is sent in the proper order, that is, blocks from each of the M′(i) may be interleaved so that the receiver can view the stream. Some standard encoding is applied to the block contents so the receiver can distinguish between message blocks versus hash values.
  • 5.3 Verification
  • The receiver verifies the signature by first computing the values of the roots of each of the Merkle trees—after that it hashes these values and verifies the signature. It achieves this goal using the following algorithm which is run for each i:
  • 1) First, for every actual message block Msj (i) received, the receiver computes the value yj (i)=H(IV0,Msj (i)).
  • 2) Consider the set of all hashes computed above in the previous step as well the hash values contained in sets X(1), . . . , X(k) received in the transmissions.
  • 3) For each pair of values, if the pair corresponds to vertices who are siblings, then replace the pair with their hash (which corresponds to the parent node in the Merkle tree).
  • 4) Repeat the above step until only one value remains—this value is the root x(i).
  • If one has all the initial message blocks, then the above algorithm constitutes the standard algorithm for computing the root of a Merkle tree. Whenever the receiver receives some hashes x1 (i), . . . , xr (i), these come from the intermediary running the same algorithm on the subset of missing blocks. Therefore, the intermediary and receiver have together run the algorithm on all n blocks which yield the value of the Merkle root. This is why the above computation yields the Merkle root.
  • With the values of the Merkle roots, x(1), . . . , x(k), the receiver can compute x=H(IV, x(1), . . . , x(k)) and verify the signature it receives.
  • FIG. 11 illustrates the signing and verification of the fifth embodiment of the invention, an example with four streams and four message blocks. As shown, each of the four streams M(1), M(2), M(3), M(4) consists of four blocks. The black leaves denote the message blocks that are actually sent. The remaining ones are dropped. The shaded vertices represent the cover; that is, the values corresponding to these vertices are sent to the receiver. The roots of the four Merkle trees are x(1), x(2), x(3), and x(4) respectively. The final root value x is computed by hashing the Merkle roots x(1), x(2), x(3), x(4). This hash can be also be performed in a Merkle-like fashion. Finally, the value x is actually signed. In this scheme only six hash values are sent to the receiver. In the linear simulcast scheme, twelve hashes (three per each block transmitted) would have been transmitted. Thus, savings is achieved whenever dropped blocks are clustered. For example, in FIG. 11, all blocks in the stream M(4) are dropped. As a result, one only needs to send the root x(4) of the associated Merkle tree.
  • Also, because the Merkle roots are themselves hashed in a Merkle-like construction, there is room for further optimization. In particular, suppose that all blocks are dropped for two entire subtrees whose Merkle roots are siblings in the even larger tree. Then, instead of sending the two Merkle roots, their hash could be sent.
  • 5.4 Security
  • Similarly to the fourth embodiment, the fifth embodiment is secure as long as the signature scheme is not easily susceptible to forgery, and the hash function is not easily susceptible to collisions. Thus the invention presented above is secure.
  • 5.5 Performance
  • The performance of the fifth embodiment can be analyzed by extending the analysis for the tree-based subsequence scheme and the linear simulcast scheme.
  • In all embodiments above, a hash function with a specific payload size and a specific IV is used. The chaining constructions tend to take some existing output and use that as the IV of the next block. In a further embodiment, instead of loading the current output as an IV, the current output can be concatenated to the next payload.
  • The linear and tree schemes of the present invention can be combined to obtain hybrid solutions, giving rise to useful tradeoffs. In a further embodiment, a scheme starts by splitting each stream M(i) into segments of length b blocks. Then, a tree scheme is applied on the first segment of all streams to compute the Merkle root x1, then the root on the second segment, and so on, until all segments are processed. In this way, Merkle roots x1, . . . , x└n/b┘ are obtained. Instead of signing each one of these roots, as in the tree schemes described above, the roots are combined using the linear scheme. Hence, if the receiver can buffer b blocks, then verification can be done “on-line”. Moreover, the communication overhead is decreased compared to the plain linear scheme since for each segment of b blocks, the number of transmitted hashes may be much less than the number of dropped blocks (although equal on the worst case). A similar approach can be taken for subsequence authentication. This hybrid approach allows trading buffer space for communication overhead.
  • In a further embodiment, a linear scheme is applied to each stream, and then a Merkle tree is computed on the results.
  • Although the embodiments described above use binary Merkle trees, the constructions can be applied to general trees. It may be more advantageous to group certain blocks together if they have similar behavior; i.e., they either all will be dropped or all will be kept.
  • If there are correlations among blocks, then it makes sense to cluster these blocks together in the tree-based schemes. For example, if a group of blocks will either all be dropped or all be kept, it is advantageous to have these blocks constitute all the leaves of a subtree. Then, if the packets are dropped, only the root of the subtree must be sent.
  • In addition, the Merkle tree construction could be optimized. In one embodiment, if one of the streams will more likely be used than the others, it is advantageous to use a lopsided Merkle tree in which the priority stream is close to the root (e.g., perhaps right below it). In conjunction with the hybrid scheme mentioned previously, the streams are prioritized, so that the high priority streams are closer to the final value in the chain. This ordering particularly makes sense when layered streams are used. In such cases, the voltage difference between V(T1) and V(,, 2) to 2:1.
  • There are blocks that should never be dropped, such as, an I frame in an MPEG stream, or the base layer in a scalably coded stream. The signer can avoid directly computing the initial first-layer hash on a block that will not be dropped. In the linear schemes, there are two hash layers. If a block will not be dropped, then there is no need to compute the hash in the first layer; instead only the second layer needs to be computed.
  • The schemes of the present invention can be interpreted as having two phases. In the first phase, it finds a convenient way to hash each data block. In the second phase, it signs the hashes. The reason for doing so is that if a block is dropped, it is not necessary to retransmit it in its entirety. Instead, only the hash computed in the first phase is transmitted. This information is sufficient to allow the receiver to verify, since the signature can be viewed as being performed on the hashes. dividing the voltage difference between V(T1) and V(,, 2) to 2:1. In FIG. 6, the is, the sender drops particular blocks on purpose. Of course, in many practical applications, one may have to deal with uncontrolled loss situations. These situations may occur, for example, if the transport protocol is not reliable such as the case with UDP, or if the environment is subject to lossy behavior such as is the case with wireless networks. The present invention can be used to deal with the uncontrolled loss by replicating the hashes that would be sent if the packet were dropped.
  • By applying Forward Error Correction (FEC) techniques such as Erasure Codes to the hashes of the present invention, it is possible to deal with the uncontrolled loss situation without having to replicate. This approach might be especially useful in a multicast setting where different receivers have lost different packets but can be provided with identical error-correcting information. One consideration of this approach is that the receiver must perform a decoding step so may have to compromise the ability to verify authentication information in an online manner.
  • Moreover, schemes of the present invention involve an intermediary which can adaptively choose the amount of forward error correction to the authentication information (i.e., hash outputs). In other words, rather than having a source estimate how much loss will occur and include sufficient authentication forward error correction information to accommodate that, the source can choose not to include authentication forward error correction information at all, and instead allow an intermediary to include the authentication forward error correction information dynamically to further increase the probability that the stream can be authenticated.
  • The intermediary becomes an integral part of a scheme which considers both uncontrolled losses handled through forward error correction as well as adaptive and intelligent controlled losses. For example, in the Merkle tree constructions, it may suffice for the recipient to recover intermediate nodes (as opposed to just leaf nodes). In such a case, the intermediary can choose to supply forward error correction information to allow recovery of the (possibly interior) nodes necessary to authenticate, thus requiring possibly less forward error correction information.
  • If the intermediary is sending different versions of the same stream to multiple receivers, because, for example, each has a different resource constraint with respect to the quality they view, the intermediary can recycle the work effort. In particular, the between the terminals T1, T2 and adapted to receive as input data bit signals D1B, most one full set of first-layer hashes.
  • Along these lines, work can be recycled between the source and the intermediary. That is, the source can provide the intermediary with any necessary hash computations for assisting with authentication. Then, the intermediary is not required to perform any work of a cryptographic nature. Instead, it can choose which blocks to drop and select the corresponding authentication information to be transmitted.
  • Another application of the present invention is insertion and selection of advertisements in a stream. The intermediary or some other party provides advertisements or a hash of advertisements, for example hashed using a Merkle tree, to the source. The source then includes the Merkle hash in its stream as a placeholder, allowing the intermediary to choose which advertisement it would like to use. Of course, this concept is not necessarily limited to advertisers.
  • Although the focus of the present invention is on authenticating information, the above scheme can also be used in conjunction with an encryption scheme provided that the scheme is designed to permit the recipient to decrypt a given block without requiring the decryption of or presence of many other blocks. Two block cipher encryption modes facilitate this approach. One is counter-mode encryption and the other is electronic code book (ECB) encryption. Alternatively, it is possible to use a stream cipher, though a caveat is that the receiver may need to perform work that is proportional to the size of the original stream as opposed to the portion of it that he receives. One may be able to use chaining or feedback modes (cipher block chaining (CBC), output feed back (OFB), etc) provided that the receiver receives any intermediate information to decrypt. Such information may include intermediate IVs or actual ciphertext blocks. Yet another approach is to mix the modes, i.e., for large segments which will not be dropped, a chaining or feedback mode can be used; whereas for other blocks, a counter mode or ECB mode can be used. For example, in an MPEG stream, I-frames are never dropped intentionally, so they can be treated differently and encrypted using CBC mode. A similar remark applies to the base layer of any scalable coding scheme.
  • While the invention has been described in detail above with respect to various embodiments, the ordinarily skilled artisan will appreciate that variations of these embodiments are possible without departing from the scope and spirit of the invention. Therefore, the invention should be considered as limited only by the scope of the appended claims.

Claims (82)

1. A method for communicating data between a server and a receiver, said method comprising:
signing at least one original data stream which includes a plurality of blocks;
generating an intermediate data stream for the signed data stream, with arbitrary blocks adaptively removed without censoring the blocks of the original data stream;
communicating the intermediate data stream to the receiver; and
authenticating the intermediate data stream at the receiver.
2. The method according to claim 1, wherein signing the original data stream further comprises generating a hash computation comprising auxiliary hash values and partial voltage levels equal to square of the number of input voltages m=42, or sixteen
3. The method according to claim 2, wherein generating the intermediate data stream further comprises computing the partial hash values and auxiliary hash values for each block of the signed data stream.
4. The method according to claim 2, wherein the intermediate data stream comprises:
data stream blocks to be sent to the receiver; and
auxiliary hash values for the blocks to be removed.
5. The method according to claim 4, further comprising determining, at the receiver, whether a received block is a data stream block.
6. The method according to claim 4, further comprising recomputing, at the receiver, the partial hash value for the data stream block.
7. The method according to claim 6, further comprising verifying, at the receiver, the signature on the recomputed partial hash value.
8. The method according to claim 2, further comprising aggregating several auxiliary hash values before computing a partial hash value.
9. The method according to claim 1, wherein signing the original data stream further comprises generating a Merkle tree for the original data stream and computing a value associated with a root of the Merkle tree.
10. The method according to claim 9, wherein the intermediate data stream comprises:
Merkle tree values for the receiver to recompute the root of the Merkle tree; and
data stream blocks.
11. The method according to claim 9, wherein generating the intermediate data stream further comprises:
determining a set of vertices corresponding to leaves in the Merkle tree associated with the blocks to be removed;
if any pair of vertices are siblings in the Merkle tree, replacing these two vertices with their parent; and
otherwise, computing the Merkle tree values associated with vertices.
12. The method according to claim 11, further comprising recomputing, at the receiver, the value of the root of the Merkle tree.
13. The method according to claim 11, wherein the replacing step is repeated until there are no pair of vertices that are siblings remaining.
14. The method according to claim 12, further comprising verifying, at the receiver, the signature with the value of the root of the Merkle tree.
15. The method according to claim 1, wherein signing the original data stream further comprises computing partial hash values of each block of each original data stream to compute a multi-layer hash chain.
16. The method according to claim 15, wherein generating the intermediate data stream further comprises computing the partial hash values for each block of each signed data stream.
17. The method according to claim 15, wherein the intermediate data stream comprises data stream blocks adaptively selected from different data streams.
18. The method according to claim 15, further comprising recomputing, at the receiver, the partial hash value for each block of the intermediate data stream.
19. The method according to claim 18, further comprising verifying, at the receiver, the signature on the recomputed partial hash value.
20. The method according to claim 1, wherein signing the original data streams further comprises:
generating a Merkle tree for each of the original data streams;
computing a value associated with a root of each of the Merkle trees; and
generating a final root value by hashing the values of the roots of the Merkle trees.
21. The method according to claim 20, wherein the intermediate data stream comprises:
data stream blocks; and
Merkle tree values for the receiver to recompute the root of the Merkle tree.
22. The method according to claim 20, wherein generating the intermediate data stream further comprises:
determining, for each signed data stream, a set of vertices corresponding to leaves in the Merkle tree associated with the blocks to be removed;
if any pair of vertices are siblings in the Merkle tree, replacing these two vertices with their parent; and
otherwise, computing the Merkle tree values associated with vertices.
23. The method according to claim 22, wherein the replacing step is repeated until there are no pair of vertices that are siblings remaining.
24. The method according to claim 20, further comprising recomputing, at the receiver, the values of the roots of each Merkle tree.
25. The method according to claim 24, further comprising recomputing, at the receiver, the final root value by hashing the values of the roots of the Merkle trees.
26. The method according to claim 25, further comprising verifying, at the receiver, the signature with the final root value.
27. The method according to claim 25, wherein the final root value is recomputed by an iterated hash.
28. The method according to claim 25, wherein the final root value is recomputed by a Merkle hash.
29. The method according to claim 9, wherein the Merkle tree is lopsided.
30. The method according to claim 20, wherein the Merkle tree is lopsided.
31. The method according to claim 9, further comprising forming a subtree by a group of blocks which will all be removed.
32. The method according to claim 20, further comprising forming a subtree by a group of blocks which will all be removed.
33. The method according to claim 9, further comprising forming a subtree by a group of blocks which will all be sent.
34. The method according to claim 20, further comprising forming a subtree by a group of blocks which will all be sent.
35. The method according to claim 20, wherein the final root value is generated by an iterated hash.
36. The method according to claim 20, wherein the final root value is generated by a Merkle hash.
37. The method according to claim 1, further comprising determining blocks that will never be removed.
38. The method according to claim 37, further comprising applying identity function as a first layer hash when the blocks will never be removed.
39. The method according to claim 2, further comprising applying Forward Error Correction (FEC) techniques to the hash values.
40. The method according to claim 15, further comprising applying Forward Error Correction (FEC) techniques to the hash values.
41. The method according to claim 1, wherein signing the original data stream uses a digital signature.
42. The method according to claim 41, wherein the digital signature is applied to final hash values of the blocks of the original data stream.
43. The method according to claim 1, wherein signing the original data stream uses message authentication codes.
44. The method according to claim 43, wherein the message authentication codes are applied to final hash values of the blocks of the original data stream.
45. The method according to claim 1, wherein the removed data stream blocks include advertisements.
46. A system for communicating data between a server and a receiver, comprising:
a signer signing at least one original data stream which includes a plurality of blocks;
a data stream generator generating an intermediate data stream for the signed data stream, with arbitrary blocks adaptively removed without censoring the blocks of the original data stream;
a receiver authenticating the intermediate data stream.
47. The system according to claim 46, wherein the signer generates a hash computation comprising auxiliary hash values and partial hash values.
48. The system according to claim 47, wherein the data stream generator receives the signed data stream, and computes the partial hash values and auxiliary hash values for each block thereof.
49. The system according to claim 47, wherein the receiver receives the intermediate data stream and recomputes the partial hash value for the data stream block.
50. The system according to claim 47, wherein the signer aggregates several auxiliary hash values before computing a partial hash value.
51. The system according to claim 46, wherein the signer computes values associated with a root of a Merkle tree generated for an original data stream.
52. The system according to claim 51, wherein the data stream generator:
receives the signed data stream;
determines a set of vertices corresponding to leaves in the Merkle tree associated with the blocks to be removed;
if any pair of vertices are siblings in the Merkle tree, replaces these two vertices with their parent; and
otherwise, computes the Merkle tree values associated with vertices.
53. The method according to claim 52, wherein the replacing step is repeated until there are no pair of vertices that are siblings remaining.
54. The system according to claim 51, wherein the receiver receives the intermediate data stream and recomputes the value of the root of the Merkle tree.
55. The system according to claim 46, wherein the signer computes partial hash values of each block of each data stream to compute a multi-layer hash chain.
56. The system according to claim 55, wherein the data stream generator receives the signed data stream and computes the partial hash values for each block of each signed data stream.
57. The system according to claim 55, wherein the receiver receives the intermediate data stream and recomputes the partial hash value for each block of the intermediate data stream.
58. The system according to claim 46, wherein the signer:
generates a Merkle tree for each of the original data streams;
computes a value associated with a root of each of the Merkle trees; and
generates a final root value by hashing the values of the roots of the Merkle trees.
59. The system according to claim 58, wherein the data stream generator:
receives the signed data stream;
determines, for each signed data stream, a set of vertices corresponding to leaves in the Merkle tree associated with the blocks to be removed;
if any-pair of vertices are siblings in the Merkle tree, replaces these two vertices with their parent; and
otherwise, computes the Merkle tree values associated with vertices.
60. The method according to claim 59, wherein the replacing step is repeated until there are no pair of vertices that are siblings remaining.
61. The system according to claim 58, wherein the receiver receives the intermediate data stream and recomputes the values of the roots of each Merkle tree.
62. A computer program product containing program code for performing a method of signing an original data stream, the method comprising:
decomposing at least one original data stream into a plurality of blocks;
computing ancillary information selected from the group consisting of partial hash values of blocks of the signed data stream, values associated with a root of a Merkle tree generated for the original data stream, a multi-layer hash chain computed from partial hash values of each block of each data stream, and a final root value computed by hashing values of roots of Merkle trees, each of which corresponds to an original data stream;
computing authentication information for each block based on the ancillary information;
generating a signed data stream comprising the original data stream and the authentication information; and
generating an intermediate data stream by adaptively removing arbitrary blocks without censoring the original data stream, wherein the intermediate data stream can be authenticated by a receiver.
63. The computer program product according to claim 62, wherein a digital signature is used for authentication.
64. The method according to claim 63, wherein the digital signature is applied to final hash values of the blocks of the original data stream.
65. The computer program product according to claim 62, wherein message authentication codes are used for authentication.
66. The method according to claim 65, wherein the message authentication codes are applied to final hash values of the blocks of the original data stream.
67. The method according to claim 62, wherein the ancillary information is computed at a signer.
68. The method according to claim 62, wherein the ancillary information is computed at an intermediary.
69. A computer program product containing program code for performing a method of adaptively removing arbitrary blocks from a signed data stream for an original data stream, the method comprising:
determining to-be-sent data stream blocks in the signed data stream without censoring the original data stream;
adaptively removing other blocks in the signed data stream by generating an intermediate data stream; and
sending the intermediate data stream to a receiver for authentication.
70. The computer program product according to claim 69, wherein the method further comprises computing the partial hash values and auxiliary hash values for each block of the signed data stream.
71. The computer program product according to claim 70, wherein the intermediate data stream comprises to-be-sent data stream blocks and the auxiliary hash values for the blocks to be removed.
72. The method according to claim 70, further comprising transmitting the partial hash values and auxiliary hash values.
73. The computer program product according to claim 69, wherein the method further comprises:
determining a set of vertices corresponding to leaves in the Merkle tree associated with the blocks to be removed;
if any pair of vertices are siblings in the Merkle tree, replacing these two vertices with their parent; and
otherwise, computing the Merkle tree values associated with vertices.
74. The computer program product according to claim 73, wherein the intermediate data stream comprises to-be-sent data stream blocks and Merkle tree values associated with the blocks to be removed.
75. The method according to claim 73, wherein the replacing step is repeated until there are no pair of vertices that are siblings remaining.
76. The computer program product according to claim 69, wherein the intermediate data stream comprises data stream blocks adaptively selected from different data streams.
77. A computer program product containing program code for performing a method of authenticating an intermediate data stream, the method comprising:
distinguishing data stream blocks in the intermediate data stream, which is derived from an original data stream, but has some data removed from it;
computing ancillary information for blocks in the intermediate data stream, the ancillary information being selected from the group consisting of partial hash values of blocks of the intermediate data stream, values associated with a root of a Merkle tree generated for the original data stream, a multi-layer hash chain, and a final root value computed by hashing values of roots of Merkle trees generated for original data streams; and
verifying authentication information.
78. The computer program product according to claim 77, wherein a digital signature is used for authentication.
79. The computer program product according to claim 77, wherein message authentication codes are used for authentication.
80. A server in a data communication network, comprising a processor and the computer program product according to claim 62.
81. An intermediate node in a data communication network, comprising a processor and the computer program product according to claim 69.
82. A receiver in a data communication network, comprising a processor and the computer program product according to claim 77.
US10/543,640 2003-08-15 2004-08-04 Method and apparatus for authentication of data streams with adaptively controlled losses Abandoned US20060136728A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US10/543,640 US20060136728A1 (en) 2003-08-15 2004-08-04 Method and apparatus for authentication of data streams with adaptively controlled losses
US12/560,963 US20100005310A1 (en) 2003-08-15 2009-09-16 Method and apparatus for authenication of data streams with adaptively controlled losses
US12/560,959 US8256015B2 (en) 2003-08-15 2009-09-16 Method and apparatus for authentication of data streams with adaptively controlled losses

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US49578703P 2003-08-15 2003-08-15
US10/543,640 US20060136728A1 (en) 2003-08-15 2004-08-04 Method and apparatus for authentication of data streams with adaptively controlled losses
PCT/US2004/025513 WO2005017809A2 (en) 2003-08-15 2004-08-04 Method and apparatus for authentication of data streams with adaptively controlled losses

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US12/560,959 Division US8256015B2 (en) 2003-08-15 2009-09-16 Method and apparatus for authentication of data streams with adaptively controlled losses
US12/560,963 Division US20100005310A1 (en) 2003-08-15 2009-09-16 Method and apparatus for authenication of data streams with adaptively controlled losses

Publications (1)

Publication Number Publication Date
US20060136728A1 true US20060136728A1 (en) 2006-06-22

Family

ID=34193346

Family Applications (3)

Application Number Title Priority Date Filing Date
US10/543,640 Abandoned US20060136728A1 (en) 2003-08-15 2004-08-04 Method and apparatus for authentication of data streams with adaptively controlled losses
US12/560,963 Abandoned US20100005310A1 (en) 2003-08-15 2009-09-16 Method and apparatus for authenication of data streams with adaptively controlled losses
US12/560,959 Expired - Fee Related US8256015B2 (en) 2003-08-15 2009-09-16 Method and apparatus for authentication of data streams with adaptively controlled losses

Family Applications After (2)

Application Number Title Priority Date Filing Date
US12/560,963 Abandoned US20100005310A1 (en) 2003-08-15 2009-09-16 Method and apparatus for authenication of data streams with adaptively controlled losses
US12/560,959 Expired - Fee Related US8256015B2 (en) 2003-08-15 2009-09-16 Method and apparatus for authentication of data streams with adaptively controlled losses

Country Status (3)

Country Link
US (3) US20060136728A1 (en)
JP (1) JP4809766B2 (en)
WO (1) WO2005017809A2 (en)

Cited By (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030145060A1 (en) * 2001-10-18 2003-07-31 Martin Anthony G. Presentation of information to end-users
US20070005425A1 (en) * 2005-06-28 2007-01-04 Claria Corporation Method and system for predicting consumer behavior
US20070022293A1 (en) * 2005-07-25 2007-01-25 Canon Kabushiki Kaisha Information processing apparatus and method
US20070038855A1 (en) * 2005-08-12 2007-02-15 Research In Motion Limited System and method for authenticating streamed data
US20070106908A1 (en) * 2005-11-04 2007-05-10 Kunihiko Miyazaki Electronic document authenticity guarantee method, and electronic document disclosure system
US20080216151A1 (en) * 2006-12-27 2008-09-04 Kunihiko Miyazaki Electronic data authenticity assurance method and program
US20080256362A1 (en) * 2007-01-22 2008-10-16 Fujitsu Limited Method and apparatus for digital signature authentication, and computer product
US20080294903A1 (en) * 2007-05-23 2008-11-27 Kunihiko Miyazaki Authenticity assurance system for spreadsheet data
US20090019520A1 (en) * 2004-10-29 2009-01-15 International Business Machines Corporation Systems and Methods for Efficiently Authenticating Multiple Objects Based on Access Patterns
US20090034785A1 (en) * 2007-08-04 2009-02-05 International Business Machines Corporation System and Method for Solving the "Birthday Problem" with Watermarking
US20090204818A1 (en) * 2008-02-13 2009-08-13 Samsung Electronics Co., Ltd. Method and apparatus for generating and verifying electronic signature of software data, and computer readable recording medium thereof
US20090210715A1 (en) * 2006-08-01 2009-08-20 Fujitsu Limited Document verification apparatus, document verification method, and computer product
US20090319227A1 (en) * 2008-06-20 2009-12-24 International Business Machines Corporation Adaptive traitor tracing
US20090320130A1 (en) * 2008-06-20 2009-12-24 International Business Machines Corporation Traitor detection for multilevel assignment
US20100040231A1 (en) * 2008-08-15 2010-02-18 International Business Machines Corporation Security Classes in a Media Key Block
US20100146040A1 (en) * 2008-12-10 2010-06-10 At&T Corp. System and Method for Content Validation
US20100212017A1 (en) * 2009-02-18 2010-08-19 International Business Machines Corporation System and method for efficient trust preservation in data stores
US20100251067A1 (en) * 2009-03-31 2010-09-30 Qualcomm Incorporated Systems and methods for protecting a multi-part broadcast control message
US8073866B2 (en) 2005-03-17 2011-12-06 Claria Innovations, Llc Method for providing content to an internet user based on the user's demonstrated content preferences
US8078602B2 (en) 2004-12-17 2011-12-13 Claria Innovations, Llc Search engine for a computer network
US8086697B2 (en) 2005-06-28 2011-12-27 Claria Innovations, Llc Techniques for displaying impressions in documents delivered over a computer network
US8132073B1 (en) * 2009-06-30 2012-03-06 Emc Corporation Distributed storage system with enhanced security
US8255413B2 (en) 2004-08-19 2012-08-28 Carhamm Ltd., Llc Method and apparatus for responding to request for information-personalization
US8316003B2 (en) 2002-11-05 2012-11-20 Carhamm Ltd., Llc Updating content of presentation vehicle in a computer network
US20120303990A1 (en) * 2011-05-26 2012-11-29 Google Inc. Postponing suspend
US8381062B1 (en) * 2007-05-03 2013-02-19 Emc Corporation Proof of retrievability for archived files
US8571209B2 (en) 2009-01-19 2013-10-29 International Business Machines Recording keys in a broadcast-encryption-based system
RU2509424C2 (en) * 2009-08-07 2014-03-10 Долби Интернешнл Аб Data stream authentication
US8689238B2 (en) 2000-05-18 2014-04-01 Carhamm Ltd., Llc Techniques for displaying impressions in documents delivered over a computer network
US20140173682A1 (en) * 2008-09-19 2014-06-19 Interdigital Patent Holdings, Inc. Authentication for secure wireless communication
US8832466B1 (en) * 2006-01-27 2014-09-09 Trustwave Holdings, Inc. Methods for augmentation and interpretation of data objects
US20140365026A1 (en) * 2013-06-11 2014-12-11 Kabushiki Kaisha Toshiba Signature generating apparatus, signature generating method, computer program product, and electrical power consumption calculation system
US9322974B1 (en) 2010-07-15 2016-04-26 Proxense, Llc. Proximity-based system for object tracking
US20160204942A1 (en) * 2013-08-23 2016-07-14 Nec Europe Ltd. Method and system for authenticating a data stream
US9495446B2 (en) 2004-12-20 2016-11-15 Gula Consulting Limited Liability Company Method and device for publishing cross-network user behavioral data
US20160357544A1 (en) * 2015-06-05 2016-12-08 Apple Inc. On demand resources
US9536016B2 (en) * 2013-01-16 2017-01-03 Google Inc. On-disk multimap
US20170054619A1 (en) * 2015-08-21 2017-02-23 Barefoot Networks, Inc. Fast detection and identification of lost packets
US9621630B2 (en) 2014-02-24 2017-04-11 Fujitsu Limited Distribution method, distribution apparatus, and terminal apparatus
US9679276B1 (en) * 2016-01-26 2017-06-13 Stampery, Inc. Systems and methods for using a block chain to certify the existence, integrity, and/or ownership of a file or communication
US9960920B2 (en) 2016-01-26 2018-05-01 Stampery Inc. Systems and methods for certification of data units and/or certification verification
US10333696B2 (en) 2015-01-12 2019-06-25 X-Prime, Inc. Systems and methods for implementing an efficient, scalable homomorphic transformation of encrypted data with minimal data expansion and improved processing efficiency
US10412069B2 (en) 2015-01-19 2019-09-10 Mitsubishi Electric Corporation Packet transmitting apparatus, packet receiving apparatus, and computer readable medium
US10698989B2 (en) 2004-12-20 2020-06-30 Proxense, Llc Biometric personal data key (PDK) authentication
US10764044B1 (en) 2006-05-05 2020-09-01 Proxense, Llc Personal digital key initialization and registration for secure transactions
US10769939B2 (en) 2007-11-09 2020-09-08 Proxense, Llc Proximity-sensor supporting multiple application services
US10909229B2 (en) 2013-05-10 2021-02-02 Proxense, Llc Secure element as a digital pocket
US10943471B1 (en) 2006-11-13 2021-03-09 Proxense, Llc Biometric authentication using proximity and secure information on a user device
US10971251B1 (en) 2008-02-14 2021-04-06 Proxense, Llc Proximity-based healthcare management system with automatic access to private information
US11080378B1 (en) 2007-12-06 2021-08-03 Proxense, Llc Hybrid device having a personal digital key and receiver-decoder circuit and methods of use
US11086979B1 (en) 2007-12-19 2021-08-10 Proxense, Llc Security system and method for controlling access to computing resources
US11095640B1 (en) 2010-03-15 2021-08-17 Proxense, Llc Proximity-based system for automatic application or data access and item tracking
US11113482B1 (en) 2011-02-21 2021-09-07 Proxense, Llc Implementation of a proximity-based system for object tracking and automatic application initialization
US11120449B2 (en) 2008-04-08 2021-09-14 Proxense, Llc Automated service-based order processing
WO2021248226A1 (en) * 2020-06-09 2021-12-16 Quantropi Inc. Methods and systems for encryption, decryption, signing, verification and hashing of digital messages
US11206664B2 (en) 2006-01-06 2021-12-21 Proxense, Llc Wireless network synchronization of cells and client devices on a network
US11258791B2 (en) 2004-03-08 2022-02-22 Proxense, Llc Linked account system using personal digital key (PDK-LAS)
US11431476B2 (en) * 2020-04-30 2022-08-30 Dell Products L.P. Install time creation of forward error correction data and integrity checksums
US11553481B2 (en) 2006-01-06 2023-01-10 Proxense, Llc Wireless network synchronization of cells and client devices on a network
US11641347B2 (en) 2021-03-10 2023-05-02 Quantropi Inc. Quantum-safe cryptographic methods and systems
US11922395B2 (en) 2022-01-18 2024-03-05 Proxense, Llc Linked account system using personal digital key (PDK-LAS)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4809766B2 (en) * 2003-08-15 2011-11-09 株式会社エヌ・ティ・ティ・ドコモ Data stream authentication method and apparatus adaptively controlling loss
WO2007052477A1 (en) 2005-11-04 2007-05-10 Nec Corporation Message authentication device, message authentication method, message authentication program, and recording medium therefor
EP1989822B1 (en) * 2006-01-25 2017-11-29 Orange Reliability system for multicast data transmission
WO2007093925A1 (en) * 2006-02-14 2007-08-23 Koninklijke Philips Electronics N.V. Improved method of content protection
WO2007093946A1 (en) * 2006-02-14 2007-08-23 Koninklijke Philips Electronics N.V. Improved method of content protection
US8323087B2 (en) 2006-09-18 2012-12-04 Igt Reduced power consumption wager gaming machine
JP4584300B2 (en) * 2007-12-19 2010-11-17 富士通株式会社 Electronic signature program, computer-readable recording medium, electronic signature device, and electronic signature method
GB0802585D0 (en) * 2008-02-12 2008-03-19 Mtld Top Level Domain Ltd Determining a property of communication device
DE602008003667D1 (en) * 2008-03-03 2011-01-05 Fujitsu Ltd Method and apparatus for digital signature authentication, and computer product
US8386785B2 (en) 2008-06-18 2013-02-26 Igt Gaming machine certificate creation and management
US8595504B2 (en) * 2008-08-12 2013-11-26 Industrial Technology Research Institute Light weight authentication and secret retrieval
GB2465138B (en) * 2008-10-10 2012-10-10 Afilias Technologies Ltd Transcoding web resources
JPWO2010067820A1 (en) 2008-12-11 2012-05-24 日本電気株式会社 Zero knowledge proof system, zero knowledge proof device, zero knowledge verification device, zero knowledge proof method and program thereof
US9141724B2 (en) 2010-04-19 2015-09-22 Afilias Technologies Limited Transcoder hinting
GB2481843A (en) 2010-07-08 2012-01-11 Mtld Top Level Domain Ltd Web based method of generating user interfaces
US8538938B2 (en) * 2010-12-02 2013-09-17 At&T Intellectual Property I, L.P. Interactive proof to validate outsourced data stream processing
GB2508343A (en) * 2012-11-28 2014-06-04 Ibm Replacing a hash function if a second hash function is more effective
US10200199B2 (en) * 2013-08-05 2019-02-05 Guardtime Holdings Limited Strengthened entity identity for digital record signature infrastructure
WO2017053468A1 (en) * 2015-09-21 2017-03-30 Dolby Laboratories Licensing Corporation Efficient delivery of customized content over intelligent network
KR101977109B1 (en) * 2015-11-17 2019-08-28 (주)마크애니 Large simultaneous digital signature service system based on hash function and method thereof
WO2019157227A1 (en) * 2018-02-07 2019-08-15 Safetraces, Inc. Source and sanitation assurance testing of foodstuffs and sensitive applications
RU2745518C9 (en) * 2018-12-13 2021-05-26 Эдванст Нью Текнолоджиз Ко., Лтд. Data isolation in the blockchain network

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6490627B1 (en) * 1996-12-17 2002-12-03 Oracle Corporation Method and apparatus that provides a scalable media delivery system
US20030126400A1 (en) * 2001-12-27 2003-07-03 Jacques Debiez Data integrity check method using cumulative hash function
US6886098B1 (en) * 1999-08-13 2005-04-26 Microsoft Corporation Systems and methods for compression of key sets having multiple keys
US6959384B1 (en) * 1999-12-14 2005-10-25 Intertrust Technologies Corporation Systems and methods for authenticating and protecting the integrity of data streams and other data
US6970602B1 (en) * 1998-10-06 2005-11-29 International Business Machines Corporation Method and apparatus for transcoding multimedia using content analysis

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6065008A (en) * 1997-10-01 2000-05-16 Microsoft Corporation System and method for secure font subset distribution
JP3434251B2 (en) * 1999-11-02 2003-08-04 日本電信電話株式会社 Message recovery type signature system and program recording medium thereof
US20030123546A1 (en) * 2001-12-28 2003-07-03 Emblaze Systems Scalable multi-level video coding
US7313814B2 (en) * 2003-04-01 2007-12-25 Microsoft Corporation Scalable, error resilient DRM for scalable media
JP4809766B2 (en) * 2003-08-15 2011-11-09 株式会社エヌ・ティ・ティ・ドコモ Data stream authentication method and apparatus adaptively controlling loss

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6490627B1 (en) * 1996-12-17 2002-12-03 Oracle Corporation Method and apparatus that provides a scalable media delivery system
US6970602B1 (en) * 1998-10-06 2005-11-29 International Business Machines Corporation Method and apparatus for transcoding multimedia using content analysis
US6886098B1 (en) * 1999-08-13 2005-04-26 Microsoft Corporation Systems and methods for compression of key sets having multiple keys
US6959384B1 (en) * 1999-12-14 2005-10-25 Intertrust Technologies Corporation Systems and methods for authenticating and protecting the integrity of data streams and other data
US20030126400A1 (en) * 2001-12-27 2003-07-03 Jacques Debiez Data integrity check method using cumulative hash function

Cited By (110)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8689238B2 (en) 2000-05-18 2014-04-01 Carhamm Ltd., Llc Techniques for displaying impressions in documents delivered over a computer network
US20030145060A1 (en) * 2001-10-18 2003-07-31 Martin Anthony G. Presentation of information to end-users
US8521827B2 (en) 2001-10-18 2013-08-27 Carhamm Ltd., Llc Presentation of information to end-users
US8316003B2 (en) 2002-11-05 2012-11-20 Carhamm Ltd., Llc Updating content of presentation vehicle in a computer network
US11258791B2 (en) 2004-03-08 2022-02-22 Proxense, Llc Linked account system using personal digital key (PDK-LAS)
US8255413B2 (en) 2004-08-19 2012-08-28 Carhamm Ltd., Llc Method and apparatus for responding to request for information-personalization
US8127134B2 (en) * 2004-10-29 2012-02-28 International Business Machines Corporation Systems and methods for efficiently authenticating multiple objects based on access patterns
US20090019520A1 (en) * 2004-10-29 2009-01-15 International Business Machines Corporation Systems and Methods for Efficiently Authenticating Multiple Objects Based on Access Patterns
US8078602B2 (en) 2004-12-17 2011-12-13 Claria Innovations, Llc Search engine for a computer network
US9495446B2 (en) 2004-12-20 2016-11-15 Gula Consulting Limited Liability Company Method and device for publishing cross-network user behavioral data
US10698989B2 (en) 2004-12-20 2020-06-30 Proxense, Llc Biometric personal data key (PDK) authentication
US8073866B2 (en) 2005-03-17 2011-12-06 Claria Innovations, Llc Method for providing content to an internet user based on the user's demonstrated content preferences
US8086697B2 (en) 2005-06-28 2011-12-27 Claria Innovations, Llc Techniques for displaying impressions in documents delivered over a computer network
US20070005425A1 (en) * 2005-06-28 2007-01-04 Claria Corporation Method and system for predicting consumer behavior
US7958361B2 (en) * 2005-07-25 2011-06-07 Canon Kabushiki Kaisha Information processing apparatus and method
US20070022293A1 (en) * 2005-07-25 2007-01-25 Canon Kabushiki Kaisha Information processing apparatus and method
US8407468B2 (en) 2005-08-12 2013-03-26 Research In Motion Limited System and method for authenticating streamed data
US20070038855A1 (en) * 2005-08-12 2007-02-15 Research In Motion Limited System and method for authenticating streamed data
US8078867B2 (en) * 2005-08-12 2011-12-13 Research In Motion Limited System and method for authenticating streamed data
US7941667B2 (en) * 2005-11-04 2011-05-10 Hitachi, Ltd. Electronic document authenticity guarantee method, and electronic document disclosure system
US20070106908A1 (en) * 2005-11-04 2007-05-10 Kunihiko Miyazaki Electronic document authenticity guarantee method, and electronic document disclosure system
US11800502B2 (en) 2006-01-06 2023-10-24 Proxense, LL Wireless network synchronization of cells and client devices on a network
US11212797B2 (en) 2006-01-06 2021-12-28 Proxense, Llc Wireless network synchronization of cells and client devices on a network with masking
US11206664B2 (en) 2006-01-06 2021-12-21 Proxense, Llc Wireless network synchronization of cells and client devices on a network
US11219022B2 (en) 2006-01-06 2022-01-04 Proxense, Llc Wireless network synchronization of cells and client devices on a network with dynamic adjustment
US11553481B2 (en) 2006-01-06 2023-01-10 Proxense, Llc Wireless network synchronization of cells and client devices on a network
US9992014B2 (en) * 2006-01-27 2018-06-05 Trustwave Holdings, Inc. Methods for cryptographic delegation and enforcement of dynamic access to stored data
US8832466B1 (en) * 2006-01-27 2014-09-09 Trustwave Holdings, Inc. Methods for augmentation and interpretation of data objects
US9559837B2 (en) 2006-01-27 2017-01-31 Trustwave Holdings, Inc. Methods for cryptographic delegation and enforcement of dynamic access to stored data
US20170207910A1 (en) * 2006-01-27 2017-07-20 Trustwave Holdings, Inc. Methods for cryptographic delegation and enforcement of dynamic access to stored data
US11157909B2 (en) 2006-05-05 2021-10-26 Proxense, Llc Two-level authentication for secure transactions
US11182792B2 (en) 2006-05-05 2021-11-23 Proxense, Llc Personal digital key initialization and registration for secure transactions
US11551222B2 (en) 2006-05-05 2023-01-10 Proxense, Llc Single step transaction authentication using proximity and biometric input
US10764044B1 (en) 2006-05-05 2020-09-01 Proxense, Llc Personal digital key initialization and registration for secure transactions
US20090210715A1 (en) * 2006-08-01 2009-08-20 Fujitsu Limited Document verification apparatus, document verification method, and computer product
US10943471B1 (en) 2006-11-13 2021-03-09 Proxense, Llc Biometric authentication using proximity and secure information on a user device
US20080216151A1 (en) * 2006-12-27 2008-09-04 Kunihiko Miyazaki Electronic data authenticity assurance method and program
US8108906B2 (en) * 2006-12-27 2012-01-31 Hitachi, Ltd. Electronic data authenticity assurance method and program
US20080256362A1 (en) * 2007-01-22 2008-10-16 Fujitsu Limited Method and apparatus for digital signature authentication, and computer product
US8037312B2 (en) * 2007-01-22 2011-10-11 Fujitsu Limited Method and apparatus for digital signature authentication, and computer product
US8381062B1 (en) * 2007-05-03 2013-02-19 Emc Corporation Proof of retrievability for archived files
US8984363B1 (en) * 2007-05-03 2015-03-17 Emc Corporation Proof of retrievability for archived files
US20080294903A1 (en) * 2007-05-23 2008-11-27 Kunihiko Miyazaki Authenticity assurance system for spreadsheet data
US20090034785A1 (en) * 2007-08-04 2009-02-05 International Business Machines Corporation System and Method for Solving the "Birthday Problem" with Watermarking
US20090034783A1 (en) * 2007-08-04 2009-02-05 International Business Machines Corporation System and method for solving the birthday problem with watermarking
US8023693B2 (en) * 2007-08-04 2011-09-20 International Business Machines Corporation System and method for solving the “birthday problem” with watermarking
US7885427B2 (en) * 2007-08-04 2011-02-08 International Business Machines Corporation System and method for solving the “birthday” problem with watermarking
US10769939B2 (en) 2007-11-09 2020-09-08 Proxense, Llc Proximity-sensor supporting multiple application services
US11562644B2 (en) 2007-11-09 2023-01-24 Proxense, Llc Proximity-sensor supporting multiple application services
US11080378B1 (en) 2007-12-06 2021-08-03 Proxense, Llc Hybrid device having a personal digital key and receiver-decoder circuit and methods of use
US11086979B1 (en) 2007-12-19 2021-08-10 Proxense, Llc Security system and method for controlling access to computing resources
US8806212B2 (en) * 2008-02-13 2014-08-12 Samsung Electronics Co., Ltd. Method and apparatus for generating and verifying electronic signature of software data, and computer readable recording medium thereof
US20090204818A1 (en) * 2008-02-13 2009-08-13 Samsung Electronics Co., Ltd. Method and apparatus for generating and verifying electronic signature of software data, and computer readable recording medium thereof
US11727355B2 (en) 2008-02-14 2023-08-15 Proxense, Llc Proximity-based healthcare management system with automatic access to private information
US10971251B1 (en) 2008-02-14 2021-04-06 Proxense, Llc Proximity-based healthcare management system with automatic access to private information
US11120449B2 (en) 2008-04-08 2021-09-14 Proxense, Llc Automated service-based order processing
US20090320130A1 (en) * 2008-06-20 2009-12-24 International Business Machines Corporation Traitor detection for multilevel assignment
US8122501B2 (en) 2008-06-20 2012-02-21 International Business Machines Corporation Traitor detection for multilevel assignment
US8108928B2 (en) 2008-06-20 2012-01-31 International Business Machines Corporation Adaptive traitor tracing
US20090319227A1 (en) * 2008-06-20 2009-12-24 International Business Machines Corporation Adaptive traitor tracing
US20100040231A1 (en) * 2008-08-15 2010-02-18 International Business Machines Corporation Security Classes in a Media Key Block
US8422684B2 (en) 2008-08-15 2013-04-16 International Business Machines Corporation Security classes in a media key block
US9596599B2 (en) * 2008-09-19 2017-03-14 Interdigital Patent Holdings, Inc. Authentication for secure wireless communication
US20140173682A1 (en) * 2008-09-19 2014-06-19 Interdigital Patent Holdings, Inc. Authentication for secure wireless communication
US8812587B2 (en) 2008-12-10 2014-08-19 At&T Intellectual Property Ii, L.P. System and method for content validation
US9602882B2 (en) 2008-12-10 2017-03-21 At&T Intellectual Property I, L.P. System and method for content validation
US10511893B2 (en) 2008-12-10 2019-12-17 At&T Intellectual Property I, L.P. System and method for content validation
US20100146040A1 (en) * 2008-12-10 2010-06-10 At&T Corp. System and Method for Content Validation
US8108544B2 (en) 2008-12-10 2012-01-31 At&T Intellectual Property I, Lp System and method for content validation
US8571209B2 (en) 2009-01-19 2013-10-29 International Business Machines Recording keys in a broadcast-encryption-based system
US20100212017A1 (en) * 2009-02-18 2010-08-19 International Business Machines Corporation System and method for efficient trust preservation in data stores
CN102379124A (en) * 2009-03-31 2012-03-14 高通股份有限公司 Systems and methods for protecting a multi-part broadcast control message
US20100251067A1 (en) * 2009-03-31 2010-09-30 Qualcomm Incorporated Systems and methods for protecting a multi-part broadcast control message
WO2010117847A3 (en) * 2009-03-31 2011-03-17 Qualcomm Incorporated Systems and methods for protecting a multi-part broadcast control message
US8627184B2 (en) 2009-03-31 2014-01-07 Qualcomm Incorporated Systems and methods for protecting a multi-part broadcast control message
US8132073B1 (en) * 2009-06-30 2012-03-06 Emc Corporation Distributed storage system with enhanced security
US8885818B2 (en) 2009-08-07 2014-11-11 Dolby International Ab Authentication of data streams
RU2509424C2 (en) * 2009-08-07 2014-03-10 Долби Интернешнл Аб Data stream authentication
US11095640B1 (en) 2010-03-15 2021-08-17 Proxense, Llc Proximity-based system for automatic application or data access and item tracking
US10313336B2 (en) 2010-07-15 2019-06-04 Proxense, Llc Proximity-based system for object tracking
US11546325B2 (en) 2010-07-15 2023-01-03 Proxense, Llc Proximity-based system for object tracking
US9322974B1 (en) 2010-07-15 2016-04-26 Proxense, Llc. Proximity-based system for object tracking
US9450956B1 (en) * 2010-07-15 2016-09-20 Proxense, Llc Proximity-based system for automatic application initialization
US11132882B1 (en) 2011-02-21 2021-09-28 Proxense, Llc Proximity-based system for object tracking and automatic application initialization
US11113482B1 (en) 2011-02-21 2021-09-07 Proxense, Llc Implementation of a proximity-based system for object tracking and automatic application initialization
US11669701B2 (en) 2011-02-21 2023-06-06 Proxense, Llc Implementation of a proximity-based system for object tracking and automatic application initialization
US20120303990A1 (en) * 2011-05-26 2012-11-29 Google Inc. Postponing suspend
US8671299B2 (en) * 2011-05-26 2014-03-11 Google Inc. Delaying the initiation of transitioning to a lower power mode by placing a computer system into an intermediate power mode between a normal power mode and the lower power mode
US9116704B1 (en) 2011-05-26 2015-08-25 Google Inc. Delaying the initiation of transitioning to a lower power mode by placing a computer system into an intermediate power mode between a normal power mode and the lower power mode
US9536016B2 (en) * 2013-01-16 2017-01-03 Google Inc. On-disk multimap
US11914695B2 (en) 2013-05-10 2024-02-27 Proxense, Llc Secure element as a digital pocket
US10909229B2 (en) 2013-05-10 2021-02-02 Proxense, Llc Secure element as a digital pocket
US20140365026A1 (en) * 2013-06-11 2014-12-11 Kabushiki Kaisha Toshiba Signature generating apparatus, signature generating method, computer program product, and electrical power consumption calculation system
US20160204942A1 (en) * 2013-08-23 2016-07-14 Nec Europe Ltd. Method and system for authenticating a data stream
US10263783B2 (en) * 2013-08-23 2019-04-16 Nec Corporation Method and system for authenticating a data stream
US9621630B2 (en) 2014-02-24 2017-04-11 Fujitsu Limited Distribution method, distribution apparatus, and terminal apparatus
US10333696B2 (en) 2015-01-12 2019-06-25 X-Prime, Inc. Systems and methods for implementing an efficient, scalable homomorphic transformation of encrypted data with minimal data expansion and improved processing efficiency
US10412069B2 (en) 2015-01-19 2019-09-10 Mitsubishi Electric Corporation Packet transmitting apparatus, packet receiving apparatus, and computer readable medium
US20160357544A1 (en) * 2015-06-05 2016-12-08 Apple Inc. On demand resources
US10447812B2 (en) * 2015-06-05 2019-10-15 Apple Inc. On demand resources
US11818224B2 (en) * 2015-06-05 2023-11-14 Apple Inc. On demand resources
US10044583B2 (en) * 2015-08-21 2018-08-07 Barefoot Networks, Inc. Fast detection and identification of lost packets
US20170054619A1 (en) * 2015-08-21 2017-02-23 Barefoot Networks, Inc. Fast detection and identification of lost packets
US10110454B2 (en) 2015-08-21 2018-10-23 Barefoot Networks, Inc. Fast detection and identification of lost packets
US9679276B1 (en) * 2016-01-26 2017-06-13 Stampery, Inc. Systems and methods for using a block chain to certify the existence, integrity, and/or ownership of a file or communication
US9960920B2 (en) 2016-01-26 2018-05-01 Stampery Inc. Systems and methods for certification of data units and/or certification verification
US11431476B2 (en) * 2020-04-30 2022-08-30 Dell Products L.P. Install time creation of forward error correction data and integrity checksums
WO2021248226A1 (en) * 2020-06-09 2021-12-16 Quantropi Inc. Methods and systems for encryption, decryption, signing, verification and hashing of digital messages
US11641347B2 (en) 2021-03-10 2023-05-02 Quantropi Inc. Quantum-safe cryptographic methods and systems
US11922395B2 (en) 2022-01-18 2024-03-05 Proxense, Llc Linked account system using personal digital key (PDK-LAS)

Also Published As

Publication number Publication date
US20100005310A1 (en) 2010-01-07
WO2005017809A3 (en) 2005-09-22
WO2005017809A2 (en) 2005-02-24
JP4809766B2 (en) 2011-11-09
US8256015B2 (en) 2012-08-28
US20100005309A1 (en) 2010-01-07
JP2007503134A (en) 2007-02-15

Similar Documents

Publication Publication Date Title
US8256015B2 (en) Method and apparatus for authentication of data streams with adaptively controlled losses
CN109559122B (en) Block chain data transmission method and block chain data transmission system
US7558954B2 (en) Method and apparatus for ensuring the integrity of data
Park et al. Efficient multicast stream authentication using erasure codes
Golle et al. Authenticating Streamed Data in the Presence of Random Packet Loss.
US10263783B2 (en) Method and system for authenticating a data stream
US7685415B2 (en) Exclusive encryption
US7298840B2 (en) Method and system for data integrity protection
RU2638639C1 (en) Encoder, decoder and method for encoding and encrypting input data
US8457304B2 (en) Efficient encoding processes and apparatus
CN114710558B (en) Asynchronous secure transmission channel construction method based on cloud storage
Zhang et al. An optimized content-aware authentication scheme for streaming JPEG-2000 images over lossy networks
Pannetrat et al. Authenticating real time packet streams and multicasts
Sun et al. Quality-optimized and secure end-to-end authentication for media delivery
Habib et al. A tree-based forward digest protocol to verify data integrity in distributed media streaming
Gentry et al. End-to-end security in the presence of intelligent data adapting proxies: The case of authenticating transcoded streaming media
US10148285B1 (en) Abstraction and de-abstraction of a digital data stream
Habib et al. Verifying data integrity in peer-to-peer media streaming
Deng et al. A study of content authentication in proxy-enabled multimedia delivery systems: Model, techniques, and applications
Wang et al. Energy-distortion-authentication optimized resource allocation for secure wireless image streaming
Tartary et al. Achieving multicast stream authentication using MDS codes
Gong et al. U-EPS: An Ultra-small and Efficient Post-quantum Signature Scheme
Zhang et al. Research on the application of network coding technology in cloud storage and digital signature
Gennaro Cryptographic algorithms for multimedia traffic
Zhu et al. A joint layered coding scheme for unified reliable and secure media transmission with implementation on JPEG 2000 images

Legal Events

Date Code Title Description
AS Assignment

Owner name: DOCOMO COMMUNICATIONS LABORATORIES USA, INC., CALI

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:GENTRY, CRAIG B.;HEVIA, ALEJANDRO;JAIN, RAVI KUMAR;AND OTHERS;REEL/FRAME:015126/0015;SIGNING DATES FROM 20040805 TO 20040830

AS Assignment

Owner name: NTT DOCOMO INC.,JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DOCOMO COMMUNICATIONS LABORATORIES USA, INC.;REEL/FRAME:017213/0760

Effective date: 20051107

Owner name: NTT DOCOMO INC., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DOCOMO COMMUNICATIONS LABORATORIES USA, INC.;REEL/FRAME:017213/0760

Effective date: 20051107

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION