CA2361431A1 - Interactive system allowing association of interactive data with objects in video frames - Google Patents

Interactive system allowing association of interactive data with objects in video frames Download PDF

Info

Publication number
CA2361431A1
CA2361431A1 CA002361431A CA2361431A CA2361431A1 CA 2361431 A1 CA2361431 A1 CA 2361431A1 CA 002361431 A CA002361431 A CA 002361431A CA 2361431 A CA2361431 A CA 2361431A CA 2361431 A1 CA2361431 A1 CA 2361431A1
Authority
CA
Canada
Prior art keywords
frame
data
attributes
objects
sequence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002361431A
Other languages
French (fr)
Other versions
CA2361431C (en
Inventor
Patrick J. Rainsford
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
emuse Media Ltd
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CA2361431A1 publication Critical patent/CA2361431A1/en
Application granted granted Critical
Publication of CA2361431C publication Critical patent/CA2361431C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8583—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by creating hot-spots
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2542—Management at additional data server, e.g. shopping server, rights management server for selling goods, e.g. TV shopping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H04N21/4725—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content using interactive regions of the image, e.g. hot spots
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/47815—Electronic shopping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4782—Web browsing, e.g. WebTV
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/812—Monomedia components thereof involving advertisement data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8545—Content authoring for generating interactive applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309—Transmission or handling of upstream communications
    • H04N7/17318—Direct or substantially direct transmission and handling of requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/24—Systems for the transmission of television signals using pulse code modulation
    • H04N7/52—Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99941—Database schema or data structure
    • Y10S707/99944—Object-oriented database structure
    • Y10S707/99945—Object-oriented database structure processing
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99941—Database schema or data structure
    • Y10S707/99948—Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

An interactive system provides a video programme signal and generates interactive content data to be associated with at least one object within a frame of the video programme. The interactive content data is embedded with the object and the object is tracked through a sequence of frames and the interactive content data is embedded into each one of the frames. The programme frames with the embedded data are multiplexed with video and audio signals and may be broadcast. A receiver identifies an object of interest an d the embedded data associated with the object is retrieved. The embedded data may be used for e-commerce.

Claims (28)

1. An apparatus for associating data representative of an object with a digital video programme including means for providing a digital video programme having plural individual frames at least some of which incorporate said object, means for parsing the video programme by identifying separate shots in the video programme to produce an edit list, means for identifying shots containing related content to form a sequence of shots containing related content, means for selecting at least one key-frame from within each sequence of shots, means for selecting said object within the key-frame with which data is to be associated, means for extracting attributes of the object from the key-frame, means for associating interactive data with the object in the key-frame, tracking means for utilising the attributes of the object for tracking the object through the sequence of shots, whereby said interactive data is associated with the object in the sequence of shots and said interactive content data is embedded with data representative of said object in a data sequence.
2. An apparatus as claimed in claim 1, wherein the means for identifying shots containing related content to form a sequence of shots containing related content includes means for producing a hierarchy of groups of shots.
3. An apparatus as claimed in claims 1 or 2, wherein said means for parsing include means for inputting criteria to be used to recognise a change of shot.
4. An apparatus as claimed in any of claims 1 to 3, wherein the means for extracting attributes of the object includes means for isolating the object within a boundary formed on the frame, means for performing edge detection within the boundary to identify and locate edges of said object, and storing means for storing a geometric model of said object.
5. An apparatus as claimed in any of claims 1 to 4, wherein said means for extracting attributes of said object also includes means for recording at least one of the attributes of shape, size, position, colour, texture, intensity gradient of said object, and time series statistics based on said attributes.
6. An apparatus as claimed in any of the preceding claims, wherein said means for extracting attributes of said object includes means for comparing said attributes of said object with attributes of objects previously stored to determine whether the object is distinguishable therefrom, and when said object is determined not to be distinguishable, providing means for re-defining the object.
7. An apparatus as claimed in any of the preceding claims, wherein said means for extracting attributes of said object includes means for comparing the location in the frame of said object with the location of objects already stored for that frame to determine whether that object is distinguishable therefrom, and where the location of said object is not distinguishable from the location of another object providing means for assigning rank to the objects to determine which object will be associated with that location.
8. An apparatus, as claimed in any of the preceding claims, wherein the means for utilising the attributes of the object for tracking the object includes means for updating the stored attributes of the object as the attributes of the object change from frame to frame.
9. An apparatus as claimed in any of the preceding claims, wherein said tracking means utilising the attributes of the object for tracking the object includes plural algorithm means for calculation of independent tracks of objects for use depending on the visual complexity of a sequence to automatically track said objects in different types of visual environment.
10. An apparatus as claimed in any of the preceding claims, wherein said tracking means for utilising the attributes of the object for tracking the object includes means for converting all the frames to be tracked to a low-level representation, means for determining the position of each object in the frames by minimising a distance measure to locate each object in each frame, means for processing the positions of said object to smooth over occlusions and the entrances and exits of objects into and out of said frames, and means for reviewing the object within a tracked sequence and for correcting the location attributes of any misplaced objects.
11. An apparatus, as claimed in any of the preceding claims, wherein the means for associating interactive data with the object in the key-frame includes means for providing a database of different types of data including one or more of URLs, HTML pages, video clips, audio clips, text files and multimedia catalogues, and means for selecting said interactive content data from the database to associate with said object.
12. An apparatus, as claimed in any of the preceding claims, wherein the means for associating interactive data with the object in the key-frame produces said data sequence using means for determining whether the embedded interactive content data is frame synchronous data associated with object positions, shapes, ranks and pointers in a frame, or group-synchronous data associated with all the objects in a group, or is data to be streamed just in time, wherein means are provided for associating frame synchronous data with the corresponding frame, means are provided for associating group synchronous data with the frame at which a group changes, and means are provided for streaming just in time data to a user before it is required to be associated with the corresponding objects.
13. An apparatus as claimed in any of the preceding claims, wherein means are provided to associate different interactive content data with respectively different objects.
14. A method for associating interactive data representative of an object with a digital video programme including the steps of:
a) providing a digital video programme having a plurality of individual frames at least some of which incorporate said object with which data is to be associated, b) parsing the video programme by identifying separate shots in the video programme to produce an edit list, c) identifying, from the edit list, shots containing related content to form a sequence of shots containing related content, d) selecting at least one key-frame containing the object from within the sequence of shots, e) locating said object within the at least one key-frame, f) extracting attributes of the object from the at least one key-frame, g) associating interactive data with the object in the at least one key-frame, h) tracking the object through the sequence of shots utilising the attributes of the object, i) associating said interactive data with the object in frames in the sequence of shots, and j) embedding said interactive data with data representative of said object in a data sequence representative of the digital video programme.
15. A method as claimed in claim 14, wherein step b) includes the step of inputting criteria to be used to recognise a change of shot.
16. A method as claimed in claims 14 or 15, wherein step c) includes the step of producing a hierarchy of groups of sequences of shots.
17. A method as claimed in any of claims 14 to 16, wherein step e) includes the steps of: isolating the object within a boundary formed on the frame, performing edge detection within the boundary to identify and locate edges of said object, and step f) includes storing a geometric model of said object.
18. A method as claimed in any of claims 14 to 17, wherein step f) includes the step of recording at least one of the attributes of shape, size, position, colour, texture, intensity gradient of said object, and time series statistics based on said attributes.
19. A method as claimed in any of claims 14 to 18, wherein step f) includes the step of comparing said attributes of said object with attributes of objects previously stored to determine whether the object is distinguishable therefrom, and when said object is determined not to be distinguishable, the step of re-defining the object.
20. A method as claimed in any of claims 14 to 19, wherein step f) includes the step of comparing the location in the frame of said object with the location of objects already stored for that frame to determine whether that object is distinguishable therefrom, and where the location of said object is not distinguishable from the location of another object, the step of assigning rank to the objects to determine which object will be associated with that location.
21. A method, as claimed in any of claims 14 to 20, wherein step h) includes the step of updating the stored attributes of the object as the attributes of the object change from frame to frame.
22. A method as claimed in any of claims 14 to 21, wherein step h) includes the step of using plural algorithm means for calculation of independent tracks of objects for use depending on the visual complexity of a sequence automatically to track said objects in different types of visual environment.
23. A method as claimed in any of claims 14 to 22, wherein step h) includes the steps of converting all the frames to be tracked to a low-level representation, determining the position of each object in the frames by minimising a distance measure to locate each object in each frame, processing the positions of said object to smooth over occlusions and the entrances and exits of objects into and out of said frames, reviewing the object within a tracked sequence and correcting the location attributes of any misplaced objects.
24. A method, as claimed in any of claims 14 to 23, wherein step g) includes the steps of providing a database of different types of data including one or more of URLs, HTML pages, video clips, audio clips, text files and multimedia catalogues, and selecting said interactive content data from the database to associate with said object.
25. A method, as claimed in any of claims 14 to 24, wherein step j) includes determining whether the embedded interactive content data is frame synchronous data associated with object positions, shapes, ranks and pointers in a frame, or group-synchronous data associated with all the objects in a group, or is data to be streamed just in time, and associating frame synchronous data with the corresponding frame, associating group synchronous data with the frame at which a group changes, and streaming just in time data to a user before it is required to be associated with the corresponding objects, respectively.
26. A method as claimed in any of claims 14 to 25, wherein in steps d) to j) different interactive content data are associated with respectively different objects.
27. A computer program comprising code means for performing all the steps of the method of any of claims 14 to 26 when the program is run on one or more computers.
28. A computer program as claimed in claim 27, wherein the computer program is embodied on a computer-readable medium.
CA2361431A 1999-02-01 2000-01-28 Interactive system allowing association of interactive data with objects in video frames Expired - Fee Related CA2361431C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
GB9902235.2 1999-02-01
GBGB9902235.2A GB9902235D0 (en) 1999-02-01 1999-02-01 Interactive system
PCT/IB2000/000135 WO2000045599A2 (en) 1999-02-01 2000-01-28 Interactive system

Publications (2)

Publication Number Publication Date
CA2361431A1 true CA2361431A1 (en) 2000-08-03
CA2361431C CA2361431C (en) 2010-04-20

Family

ID=10846915

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2361431A Expired - Fee Related CA2361431C (en) 1999-02-01 2000-01-28 Interactive system allowing association of interactive data with objects in video frames

Country Status (13)

Country Link
US (1) US7158676B1 (en)
EP (1) EP1157554B1 (en)
JP (1) JP4059631B2 (en)
AT (1) ATE230195T1 (en)
AU (1) AU772462B2 (en)
CA (1) CA2361431C (en)
CY (1) CY1100787T1 (en)
DE (1) DE60001057T2 (en)
DK (1) DK1157554T3 (en)
ES (1) ES2185560T3 (en)
GB (1) GB9902235D0 (en)
HK (1) HK1040341B (en)
WO (1) WO2000045599A2 (en)

Families Citing this family (121)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9700854D0 (en) * 1997-01-16 1997-03-05 Scient Generics Ltd Sub-audible acoustic data transmission mechanism
GB9917985D0 (en) 1999-07-30 1999-09-29 Scient Generics Ltd Acoustic communication system
US8464302B1 (en) 1999-08-03 2013-06-11 Videoshare, Llc Method and system for sharing video with advertisements over a network
AU2001245575A1 (en) 2000-03-09 2001-09-17 Videoshare, Inc. Sharing a streaming video
GB2365704B (en) * 2000-04-14 2002-11-06 Actv Inc A method and system for providing additional information to a user receiving a video or audio program
AU2001288552A1 (en) * 2000-08-30 2002-03-13 Watchpoint Media, Inc. A method and apparatus for hyperlinking in a television broadcast
AU2001283384A1 (en) * 2000-08-31 2002-03-13 Intel Corporation Mapping enhancements to network identifiers
US6774908B2 (en) * 2000-10-03 2004-08-10 Creative Frontier Inc. System and method for tracking an object in a video and linking information thereto
WO2002032137A1 (en) * 2000-10-13 2002-04-18 Eye 2 Buy Technology Company System for communicating information to viewers of a video presentation
US6642966B1 (en) * 2000-11-06 2003-11-04 Tektronix, Inc. Subliminally embedded keys in video for synchronization
AU2211102A (en) * 2000-11-30 2002-06-11 Scient Generics Ltd Acoustic communication system
ES2388357T3 (en) * 2000-11-30 2012-10-11 Intrasonics S.A.R.L. Mobile phone to collect audience index data
EP1241887A3 (en) * 2000-12-26 2004-04-14 Pioneer Corporation System for serving information relating to broadcast video information
JP4854156B2 (en) * 2000-12-27 2012-01-18 パナソニック株式会社 Link mark position information transmission method, display method and system thereof
US6961953B2 (en) 2000-12-29 2005-11-01 Nokia Corporation System and method for broadcasting advertisements
US8035612B2 (en) * 2002-05-28 2011-10-11 Intellectual Ventures Holding 67 Llc Self-contained interactive video display system
US7259747B2 (en) 2001-06-05 2007-08-21 Reactrix Systems, Inc. Interactive video display system
US8300042B2 (en) * 2001-06-05 2012-10-30 Microsoft Corporation Interactive video display system using strobed light
KR100765740B1 (en) * 2001-06-26 2007-10-15 삼성전자주식회사 Method for recording and searching A/V signal and apparatus thereof
GB2381154B (en) * 2001-10-15 2004-06-30 Jacobs Rimell Ltd Object distribution
JP2005515510A (en) 2001-12-24 2005-05-26 サイエンティフィック ジェネリクス リミテッド Caption system
US7710391B2 (en) * 2002-05-28 2010-05-04 Matthew Bell Processing an image utilizing a spatially varying pattern
JP2004054435A (en) * 2002-07-17 2004-02-19 Toshiba Corp Hypermedia information presentation method, hypermedia information presentation program and hypermedia information presentation device
WO2004010694A2 (en) * 2002-07-22 2004-01-29 Intellocity Usa, Inc. Broadcast enhancement database replication
AU2003301043A1 (en) 2002-12-13 2004-07-09 Reactrix Systems Interactive directed light/sound system
WO2004072935A2 (en) 2003-02-11 2004-08-26 Nds Limited Apparatus and methods for handling interactive applications in broadcast networks
KR101109023B1 (en) * 2003-04-14 2012-01-31 코닌클리케 필립스 일렉트로닉스 엔.브이. Method and apparatus for summarizing a music video using content analysis
US20040255338A1 (en) * 2003-06-13 2004-12-16 Apple Computer, Inc. Interface for sending synchronized audio and video data
KR20050036526A (en) * 2003-10-16 2005-04-20 삼성전자주식회사 Transport stream, apparatus and method for providing value added service during channel changing time in a digital multimedia broadcasting system and mobile terminal equipment capable of displaying the digital multimedia broadcasting
US20050088407A1 (en) * 2003-10-24 2005-04-28 Matthew Bell Method and system for managing an interactive video display system
WO2005041579A2 (en) 2003-10-24 2005-05-06 Reactrix Systems, Inc. Method and system for processing captured image information in an interactive video display system
DE102004057230A1 (en) * 2004-11-26 2006-06-01 Imelauer, Heinz Information transmitting and displaying method, involves assigning code to sequence of images that represent moving images, and enabling code to read image and to represent image with related information on request
US9128519B1 (en) 2005-04-15 2015-09-08 Intellectual Ventures Holding 67 Llc Method and system for state-based control of objects
JP2006311462A (en) * 2005-05-02 2006-11-09 Toshiba Corp Apparatus and method for retrieval contents
US7764717B1 (en) * 2005-05-06 2010-07-27 Oracle America, Inc. Rapid datarate estimation for a data stream multiplexer
US20060256868A1 (en) * 2005-05-16 2006-11-16 Ensequence, Inc. Methods and systems for repositioning mpeg image content without recoding
EP2309738A1 (en) 2005-05-23 2011-04-13 Thomas S. Gilley Distributed scalable media environment
US9648281B2 (en) 2005-05-23 2017-05-09 Open Text Sa Ulc System and method for movie segment bookmarking and sharing
US8145528B2 (en) 2005-05-23 2012-03-27 Open Text S.A. Movie advertising placement optimization based on behavior and content analysis
US8141111B2 (en) 2005-05-23 2012-03-20 Open Text S.A. Movie advertising playback techniques
US8081822B1 (en) 2005-05-31 2011-12-20 Intellectual Ventures Holding 67 Llc System and method for sensing a feature of an object in an interactive video display
US8074248B2 (en) 2005-07-26 2011-12-06 Activevideo Networks, Inc. System and method for providing video content associated with a source image to a television in a communication network
US8098277B1 (en) 2005-12-02 2012-01-17 Intellectual Ventures Holding 67 Llc Systems and methods for communication between a reactive video system and a mobile communication device
JP2009521170A (en) * 2005-12-22 2009-05-28 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Script synchronization method using watermark
US20080215620A1 (en) * 2006-01-13 2008-09-04 Yahoo! Inc. Method and system for social remixing of media content
US20100146139A1 (en) * 2006-09-29 2010-06-10 Avinity Systems B.V. Method for streaming parallel user sessions, system and computer software
US8155202B2 (en) * 2007-01-12 2012-04-10 Activevideo Networks, Inc. System and method for encoding scrolling raster images
US20080212942A1 (en) * 2007-01-12 2008-09-04 Ictv, Inc. Automatic video program recording in an interactive television environment
US9826197B2 (en) 2007-01-12 2017-11-21 Activevideo Networks, Inc. Providing television broadcasts over a managed network and interactive content over an unmanaged network to a client device
US8286069B2 (en) * 2007-01-26 2012-10-09 Myspace Llc System and method for editing web-based video
US8218830B2 (en) * 2007-01-29 2012-07-10 Myspace Llc Image editing system and method
US8438480B2 (en) * 2007-03-26 2013-05-07 Avago Technologies General Ip (Singapore) Pte. Ltd. System and method for tracking an input device using a display screen in captured frames of image data
US20080244466A1 (en) * 2007-03-26 2008-10-02 Timothy James Orsley System and method for interfacing with information on a display screen
US20080240572A1 (en) * 2007-03-26 2008-10-02 Seiko Epson Corporation Image Search Apparatus and Image Search Method
US20080252596A1 (en) * 2007-04-10 2008-10-16 Matthew Bell Display Using a Three-Dimensional vision System
WO2008137608A1 (en) * 2007-05-01 2008-11-13 Flektor, Inc. System and method for flow control in web-based video editing system
CN101035279B (en) * 2007-05-08 2010-12-15 孟智平 Method for using the information set in the video resource
US20080295129A1 (en) * 2007-05-21 2008-11-27 Steven Laut System and method for interactive video advertising
WO2008149367A2 (en) * 2007-06-06 2008-12-11 Seambi Ltd. Preparing and presenting a preview of video placement advertisements
US8744118B2 (en) 2007-08-03 2014-06-03 At&T Intellectual Property I, L.P. Methods, systems, and products for indexing scenes in digital media
WO2009035705A1 (en) 2007-09-14 2009-03-19 Reactrix Systems, Inc. Processing of gesture-based user interactions
US8739200B2 (en) 2007-10-11 2014-05-27 At&T Intellectual Property I, L.P. Methods, systems, and products for distributing digital media
US8159682B2 (en) 2007-11-12 2012-04-17 Intellectual Ventures Holding 67 Llc Lens system
US8209223B2 (en) * 2007-11-30 2012-06-26 Google Inc. Video object tag creation and processing
US20110191809A1 (en) 2008-01-30 2011-08-04 Cinsay, Llc Viral Syndicated Interactive Product System and Method Therefor
US11227315B2 (en) 2008-01-30 2022-01-18 Aibuy, Inc. Interactive product placement system and method therefor
US8312486B1 (en) 2008-01-30 2012-11-13 Cinsay, Inc. Interactive product placement system and method therefor
US8259163B2 (en) 2008-03-07 2012-09-04 Intellectual Ventures Holding 67 Llc Display with built in 3D sensing
WO2009137368A2 (en) 2008-05-03 2009-11-12 Mobile Media Now, Inc. Method and system for generation and playback of supplemented videos
GB2460306B (en) 2008-05-29 2013-02-13 Intrasonics Sarl Data embedding system
US8595218B2 (en) * 2008-06-12 2013-11-26 Intellectual Ventures Holding 67 Llc Interactive display management systems and methods
US8235870B2 (en) 2008-08-15 2012-08-07 Phresh, Llc Method and apparatus for integrating physical exercise and interactive multimedia
US9665965B2 (en) * 2009-01-14 2017-05-30 Innovid Inc. Video-associated objects
US9110517B2 (en) * 2009-09-14 2015-08-18 Broadcom Corporation System and method for generating screen pointing information in a television
US9185445B2 (en) 2009-09-24 2015-11-10 At&T Intellectual Property I, L.P. Transmitting a prioritized audio stream along with multimedia content
US20160182971A1 (en) * 2009-12-31 2016-06-23 Flickintel, Llc Method, system and computer program product for obtaining and displaying supplemental data about a displayed movie, show, event or video game
US8627379B2 (en) * 2010-01-07 2014-01-07 Amazon Technologies, Inc. Offering items identified in a media stream
CN101782324B (en) * 2010-02-05 2011-09-28 新星化工冶金材料(深圳)有限公司 Electromagnetic induction electric melting furnace for controlling average nominal diameter of TiB2(TiC) particle group in Al-Ti-B (Al-Ti-C) alloy
US9538209B1 (en) 2010-03-26 2017-01-03 Amazon Technologies, Inc. Identifying items in a content stream
JP2012010311A (en) 2010-05-26 2012-01-12 Sony Corp Transmitter, transmission method, receiver, reception method and transmission/reception system
US9171578B2 (en) * 2010-08-06 2015-10-27 Futurewei Technologies, Inc. Video skimming methods and systems
JP5866125B2 (en) 2010-10-14 2016-02-17 アクティブビデオ ネットワークス， インコーポレイテッド Digital video streaming between video devices using a cable TV system
US9204203B2 (en) 2011-04-07 2015-12-01 Activevideo Networks, Inc. Reduction of latency in video distribution networks using adaptive bit rates
US11087424B1 (en) 2011-06-24 2021-08-10 Google Llc Image recognition-based content item selection
US8688514B1 (en) 2011-06-24 2014-04-01 Google Inc. Ad selection using image data
US10972530B2 (en) 2016-12-30 2021-04-06 Google Llc Audio-based data structure generation
JP2014529930A (en) * 2011-08-05 2014-11-13 フォックス スポーツ プロダクションズ，インコーポレイティッド Selective capture and display of a portion of a native image
US11039109B2 (en) 2011-08-05 2021-06-15 Fox Sports Productions, Llc System and method for adjusting an image for a vehicle mounted camera
RU2733103C2 (en) 2011-08-29 2020-09-29 ЭйБай, Инк. Container software for virus copying from one endpoint to another
US9654816B2 (en) * 2011-11-04 2017-05-16 Cisco Technology, Inc. Synchronizing a video feed with internet content displayed on a second device
US10586127B1 (en) 2011-11-14 2020-03-10 Google Llc Extracting audiovisual features from content elements on online documents
US11093692B2 (en) 2011-11-14 2021-08-17 Google Llc Extracting audiovisual features from digital components
EP2815582B1 (en) 2012-01-09 2019-09-04 ActiveVideo Networks, Inc. Rendering of an interactive lean-backward user interface on a television
US9800945B2 (en) 2012-04-03 2017-10-24 Activevideo Networks, Inc. Class-based intelligent multiplexing over unmanaged networks
US9123084B2 (en) 2012-04-12 2015-09-01 Activevideo Networks, Inc. Graphical application integration with MPEG objects
US10789631B2 (en) 2012-06-21 2020-09-29 Aibuy, Inc. Apparatus and method for peer-assisted e-commerce shopping
US9607330B2 (en) 2012-06-21 2017-03-28 Cinsay, Inc. Peer-assisted shopping
US9535577B2 (en) 2012-07-16 2017-01-03 Questionmine, LLC Apparatus, method, and computer program product for synchronizing interactive content with multimedia
RU2493602C1 (en) * 2012-08-10 2013-09-20 Корпорация "САМСУНГ ЭЛЕКТРОНИКС Ко., Лтд." Method and system for selecting key frames from video sequences
US20140201778A1 (en) * 2013-01-15 2014-07-17 Sap Ag Method and system of interactive advertisement
WO2014145921A1 (en) 2013-03-15 2014-09-18 Activevideo Networks, Inc. A multiple-mode system and method for providing user selectable video content
JP5599959B1 (en) * 2013-05-20 2014-10-01 楽天株式会社 Information processing device
US11030239B2 (en) 2013-05-31 2021-06-08 Google Llc Audio based entity-action pair based selection
US9953085B1 (en) 2013-05-31 2018-04-24 Google Llc Feed upload for search entity based content selection
US9294785B2 (en) 2013-06-06 2016-03-22 Activevideo Networks, Inc. System and method for exploiting scene graph information in construction of an encoded video sequence
WO2014197879A1 (en) 2013-06-06 2014-12-11 Activevideo Networks, Inc. Overlay rendering of user interface onto source video
US9219922B2 (en) 2013-06-06 2015-12-22 Activevideo Networks, Inc. System and method for exploiting scene graph information in construction of an encoded video sequence
KR102361213B1 (en) 2013-09-11 2022-02-10 에이아이바이, 인크. Dynamic binding of live video content
AU2014324843A1 (en) 2013-09-27 2016-03-10 Aibuy, Inc. Apparatus and method for supporting relationships associated with content provisioning
EP3049954A4 (en) 2013-09-27 2017-04-05 Cinsay, Inc. N-level replication of supplemental content
US9788029B2 (en) 2014-04-25 2017-10-10 Activevideo Networks, Inc. Intelligent multiplexing using class-based, multi-dimensioned decision logic for managed networks
US10638194B2 (en) 2014-05-06 2020-04-28 At&T Intellectual Property I, L.P. Embedding interactive objects into a video session
US9232173B1 (en) * 2014-07-18 2016-01-05 Adobe Systems Incorporated Method and apparatus for providing engaging experience in an asset
US11159854B2 (en) 2014-12-13 2021-10-26 Fox Sports Productions, Llc Systems and methods for tracking and tagging objects within a broadcast
US11758238B2 (en) 2014-12-13 2023-09-12 Fox Sports Productions, Llc Systems and methods for displaying wind characteristics and effects within a broadcast
CN106934326B (en) * 2015-12-29 2020-07-07 同方威视技术股份有限公司 Method, system and device for security check
US10555051B2 (en) 2016-07-21 2020-02-04 At&T Mobility Ii Llc Internet enabled video media content stream
US10657380B2 (en) 2017-12-01 2020-05-19 At&T Mobility Ii Llc Addressable image object
US10939182B2 (en) 2018-01-31 2021-03-02 WowYow, Inc. Methods and apparatus for media search, characterization, and augmented reality provision
US11531701B2 (en) * 2019-04-03 2022-12-20 Samsung Electronics Co., Ltd. Electronic device and control method thereof
CN112055225B (en) * 2019-06-06 2023-02-17 阿里巴巴集团控股有限公司 Live broadcast video interception, commodity information generation and object information generation methods and devices

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5539871A (en) * 1992-11-02 1996-07-23 International Business Machines Corporation Method and system for accessing associated data sets in a multimedia environment in a data processing system
US5481296A (en) * 1993-08-06 1996-01-02 International Business Machines Corporation Apparatus and method for selectively viewing video information
US5590262A (en) * 1993-11-02 1996-12-31 Magic Circle Media, Inc. Interactive video interface and method of creation thereof
US5611037A (en) * 1994-03-22 1997-03-11 Casio Computer Co., Ltd. Method and apparatus for generating image
US6205231B1 (en) * 1995-05-10 2001-03-20 Identive Corporation Object identification in a moving video image
US5708845A (en) * 1995-09-29 1998-01-13 Wistendahl; Douglass A. System for mapping hot spots in media content for interactive digital media program
US5966120A (en) * 1995-11-21 1999-10-12 Imedia Corporation Method and apparatus for combining and distributing data with pre-formatted real-time video
US5929849A (en) * 1996-05-02 1999-07-27 Phoenix Technologies, Ltd. Integration of dynamic universal resource locators with television presentations
US5903816A (en) * 1996-07-01 1999-05-11 Thomson Consumer Electronics, Inc. Interactive television system and method for displaying web-like stills with hyperlinks
US6570587B1 (en) * 1996-07-26 2003-05-27 Veon Ltd. System and method and linking information to a video
EP0976089A4 (en) * 1996-11-15 2001-11-14 Sarnoff Corp Method and apparatus for efficiently representing, storing and accessing video information
JP3814903B2 (en) * 1996-12-25 2006-08-30 株式会社日立製作所 Video / data display method and apparatus
US5818935A (en) * 1997-03-10 1998-10-06 Maa; Chia-Yiu Internet enhanced video system
EP0866616A1 (en) * 1997-03-21 1998-09-23 CANAL+ Société Anonyme Method of and apparatus for transmitting data
US6801575B1 (en) * 1997-06-09 2004-10-05 Sharp Laboratories Of America, Inc. Audio/video system with auxiliary data
JPH11146325A (en) * 1997-11-10 1999-05-28 Hitachi Ltd Video retrieval method, device therefor, video information generating method and storage medium storing its processing program
US6426778B1 (en) * 1998-04-03 2002-07-30 Avid Technology, Inc. System and method for providing interactive components in motion video
US6357042B2 (en) * 1998-09-16 2002-03-12 Anand Srinivasan Method and apparatus for multiplexing separately-authored metadata for insertion into a video data stream
CN1229996C (en) * 1999-01-29 2005-11-30 三菱电机株式会社 Method of image features encoding and method of image search

Also Published As

Publication number Publication date
DE60001057T2 (en) 2003-04-30
WO2000045599A3 (en) 2000-12-28
EP1157554B1 (en) 2002-12-18
WO2000045599A2 (en) 2000-08-03
CA2361431C (en) 2010-04-20
EP1157554A2 (en) 2001-11-28
HK1040341B (en) 2003-04-17
JP2002541684A (en) 2002-12-03
AU2125400A (en) 2000-08-18
CY1100787T1 (en) 2009-11-04
DK1157554T3 (en) 2003-02-17
ES2185560T3 (en) 2003-05-01
GB9902235D0 (en) 1999-03-24
US7158676B1 (en) 2007-01-02
ATE230195T1 (en) 2003-01-15
AU772462B2 (en) 2004-04-29
HK1040341A1 (en) 2002-05-31
JP4059631B2 (en) 2008-03-12
DE60001057D1 (en) 2003-01-30

Similar Documents

Publication Publication Date Title
CA2361431A1 (en) Interactive system allowing association of interactive data with objects in video frames
CN111683209B (en) Mixed-cut video generation method and device, electronic equipment and computer-readable storage medium
CN110263650B (en) Behavior class detection method and device, electronic equipment and computer readable medium
EP1225518B1 (en) Apparatus and method for generating object-labelled images in a video sequence
US6928233B1 (en) Signal processing method and video signal processor for detecting and analyzing a pattern reflecting the semantics of the content of a signal
CN101281540B (en) Apparatus, method and computer program for processing information
US6587574B1 (en) System and method for representing trajectories of moving objects for content-based indexing and retrieval of visual animated data
US7181757B1 (en) Video summary description scheme and method and system of video summary description data generation for efficient overview and browsing
KR101341808B1 (en) Video summary method and system using visual features in the video
EP1083567A2 (en) System and method for editing source metadata to produce an edited metadata sequence
EP1067786B1 (en) Data describing method and data processor
CA2951849A1 (en) Selection of thumbnails for video segments
Pua et al. Real time repeated video sequence identification
CA2387404A1 (en) Video summary description scheme and method and system of video summary description data generation for efficient overview and browsing
US20130311522A1 (en) Metadata record generation
US20090251614A1 (en) Method and apparatus for automatically generating a summary of a multimedia content item
KR20090093904A (en) Apparatus and method for scene variation robust multimedia image analysis, and system for multimedia editing based on objects
Zhang Content-based video browsing and retrieval
Snoek et al. Time interval maximum entropy based event indexing in soccer video
WO2006092765A2 (en) Method of video indexing
US20100169248A1 (en) Content division position determination device, content viewing control device, and program
Hampapur Designing video data management systems
CN114691923A (en) System and method for computer learning
WO2016203469A1 (en) A digital media reviewing system and methods thereof
Xu et al. Automatic generated recommendation for movie trailers

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed

Effective date: 20170130