CN103907137A - Virtual advertising platform - Google Patents

Abstract

In embodiments, a virtual advertising platform may use a three-dimensional mapping algorithm to insert a virtual image within a digital video stream. The virtual advertising platform may apply a three-dimensional mapping algorithm to the virtual digital image, wherein the three-dimensional mapping algorithm causes the virtual digital image to be recomposited within a plurality of frames within a received two-dimensional digital data feed in place of a spatial region within the two- dimensional data feed. The mapping algorithm may enable application of analogous geometric changes to the virtual digital image that are present in the spatial region within the plurality of video frames within the two-dimensional digital video data feed, and may send the recomposited digital data feed for display to a user, wherein the recomposited digital data feed is a virtualized digital data feed that includes the virtual digital image in place of the spatial region.

Description

Virtual ads platform

the cross reference of related application

The application requires the rights and interests of the following Britain owning together and Singapore's patented claim, its full content is herein incorporated each application by reference: submit on November 14th, 2011, the UK Patent Application No.1119612.8 that is entitled as " Chameleon Project ", and with Singapore patented claim No.201106633-9 that submit to, that be entitled as " Chameleon Project " on September 14th, 2011.

Technical field

The present invention relates to the method and system for virtual video content being inserted to digital of digital video data.

Background technology

There is various forms of digital advertisements and vision operation method.Television system grows up, and wherein for example digital content is present on the green screen of static state in gymnasium.These technology are subject to various forms of restrictions, therefore exist they are carried out to improved demand.

Summary of the invention

Current, exist for virtual video content being projected in the fixed area of frame of video as the method and system of the replacement of the content at digital of digital video data feed-in (feed) raw readings.For example, but these method and systems use the fixed venue (, the region, competition field of competitive sports) with restriction girth to determine the region of inserting virtual video content in digital of digital video data feed-in conventionally.Such method and system can not make virtual video content be inserted in the area of space that has experienced regional change in digital video feed-in, this regional change is the variation for the area of space in the multiple frame of video in digital of digital video data feed-in, and this variation is for example because the movement of the human motion person's who records in digital of digital video data feed-in sport shirt causes.

Thereby, there are the needs that for user, virtual video content inserted in to the method and system in digital of digital video data feed-in, wherein virtual video content is changed spatially in the mode of the area of space that is similar to digital of digital video data feed-in, and in the area of space of this digital of digital video data feed-in, virtual content is placed in the digital of digital video data feed-in reconfiguring.

In an embodiment, the method and system that the present invention can provide a kind of space of the region that quantizes two-dimensional video image with three-dimensional artificial to change, change in this space is that the movement between the first frame of video and the second frame of video causes by this region, and this quantification is at least for virtual video content item is inserted into the object in digital video feed-in.In an embodiment, virtual ads platform can receive the feed-in of two-dimensional digital video data, and applicating geometric surface on the multiple area of space based in the frame of two-dimensional digital video data feed-in at least in part, in simulated environment, build the three-dimensional artificial of two-dimensional digital video data feed-in, wherein multiple area of space are to shine upon to define by the coordinate of two-dimensional digital video data feed-in at least in part.Virtual ads platform can be mapped to the position of this area of space in the second frame of video by area of space in the first frame of video, in multiple area of space, wherein the second frame of video is captive in the first frame time subsequently, described mapping realizes by carrying out following steps: step 1: the mapping point in two-dimensional video data feed-in based on area of space at least in part, select the area of space in the first frame of video; Step 2: the difference between the geometric jacquard patterning unit surface of applying in the first frame of video by quantification area of space and the geometric jacquard patterning unit surface of applying in the second frame of video, the interior Geometrical change for area of space of identification the second frame of video; And step 3: the difference being quantized is summarized as to three-dimensional mapping matrix.Virtual ads platform can, by execution step one, step 2 and step 3, be processed the each frame of video in the multiple frame of video in the feed-in of two-dimensional digital video, to create multiple three-dimensional mapping matrixes iteratively; And the association of the quantity between multiple three-dimensional mapping matrixes can be summarized as to three-dimensional mapping algorithm, wherein three-dimensional mapping algorithm has defined three-dimensional geometry position data at least in part, and this three-dimensional geometry position data makes can be applied to for the Geometrical change of area of space intrinsic in multiple frame of video the virtual digit video image not being presented in the feed-in of two-dimensional digital video data.

In an embodiment, virtual digit video image can be to be inserted in the area of space of two-dimensional digital data feed-in and the advertisement of having replaced area of space, and two-dimensional digital video image is reconfigured as new virtual digit video feed-in.Digital video feed-in can obtain from infrared camera.Digital video feed-in can receive from live event.Digital video feed-in can receive from the digital video medium of having stored, and this digital video medium of having stored is in this way all but be not limited to DVD.Can be from internet receiving digital video feed-in.

In an embodiment, in virtual ads platform for the selection of area of space also the mapping point based on area of space be stored in and data facility that three-dimensional artificial environmental facies are associated in known spatial characteristics between interrelated.This known spatial characteristics can be the spatial character of advertisement logo, clothing class commodity (article of clothing) or other types.

In an embodiment, virtual ads platform can use three-dimensional mapping algorithm to insert virtual image in the video flowing based on internet.Virtual ads platform can receive the request of checking from the two-dimensional digital video data feed-in of internet from user, and selects virtual digit image.Virtual ads platform can be applied to virtual digit image by three-dimensional mapping algorithm, wherein three-dimensional mapping algorithm makes the area of space in alternative two-dimensional digital feed-in in multiple frames of virtual digit image in the feed-in of two-dimensional digital data and is reconfigured, and wherein three-dimensional mapping algorithm makes it possible to the similar Geometrical change of virtual digit image applications to presenting in the area of space in the multiple frame of video in the feed-in of two-dimensional digital video data; And the numerical data feed-in reconfiguring can be sent to user and show, the numerical data feed-in wherein reconfiguring is the virtualized numerical data feed-in that comprises the virtual digit image that has substituted area of space.In an embodiment, this request is accompanied by least one data relevant with user's characteristic, and for the selection of virtual digit image at least in part based on the correlativity of data.

Virtual digit image can be the content that item is supported, and includes but not limited to advertisement.Virtual digit image can be the advertisement logo relevant with at least a portion of two-dimensional digital video feed-in.That between the 2nd logo identifying based on advertisement logo and in the feed-in of two-dimensional digital video at least in part with the correlativity of advertisement logo, has stored is associated, wherein for the detection of the 2nd logo at least in part the image based on identifying in the feed-in of two-dimensional digital video mate with the quantification between the logo being stored in database.Correlativity is the geometric position based on being associated with the feed-in of two-dimensional digital video also.Correlativity is the geometric position based on the client device being sent to being associated with the digital video feed-in reconfiguring also.

In an embodiment, virtual ads platform can be replaced the digital of digital video data of damage and insert virtual image in the feed-in of two-dimensional digital video by three-dimensional mapping algorithm interpolate video data.Virtual ads platform can receive the feed-in of two-dimensional digital video data, wherein the area of space in the multiple frames in two-dimensional video data feed-in comprises because the part of the advertisement that causes of digital of digital video data damaging is described, and carrys out unspoiled digital of digital video data in computer memory region and the correlativity of the collection of the digital video image stored with image array algorithm.The virtual ads platform at least in part correlativity based on calculated is identified the digital video image of having stored, and the digital video image of having stored based on identified is selected virtual digit image at least in part.Virtual ads platform can be applied to virtual digit image by three-dimensional mapping algorithm, wherein three-dimensional mapping algorithm is reconfigured the area of space substituting in two-dimensional digital feed-in in multiple frames of virtual digit image in the feed-in of two-dimensional digital data, and wherein three-dimensional mapping algorithm makes it possible to the similar Geometrical change of virtual digit image applications to presenting in the area of space in the multiple frame of video in the feed-in of two-dimensional digital video data, and virtual ads platform can be sent to user to show by the numerical data feed-in reconfiguring, the numerical data feed-in wherein reconfiguring is the virtualized numerical data feed-in that comprises the virtual digit image that has substituted area of space.

In an embodiment, virtual digit image can be the full release of parts of images, and wherein virtual digit image is at least in part based on creating with the digital of digital video data that the digital video image of having stored is interpolated.The digital of digital video data damaging is caused by the physical deformation of the object of describing in the feed-in of two-dimensional digital video data at least partly.

According to the following detailed description for preferred embodiments and drawings, it will be appreciated by those skilled in the art that these and other system, method, object, feature and advantage of the present invention.Here all documents of mentioning are all herein incorporated it by reference.

Accompanying drawing explanation

Can understand the present invention and the following detailed description for specific embodiment thereof by reference to the following drawings:

Fig. 1 shows and comprises virtual ads platform and the simplification framework about facility.

Fig. 2 shows the image capture that can be used by virtual ads platform and the embodiment of identification.

Fig. 3 shows the embodiment of video image mapping that can be used by virtual ads platform, in three-dimensional environment.

Fig. 4 shows and can process with the amplification (augmentation) that comprises the virtual video content in virtual ads platform for reconfiguring video data.

Fig. 5 shows short-cut method and the system for the algorithm in development& testing virtual ads platform.

Embodiment

Specific embodiments of the invention are disclosed this; But, should be appreciated that the disclosed embodiments are only the examples of invention, it can be implemented as various forms.Therefore, concrete structural and functional details disclosed herein is not interpreted as restrictive, and only instructs those skilled in the art to implement variedly the basis that represents of the present invention with any in fact applicable concrete structure as being used for.In addition, word used and phrase are not intended to limit here, and are to provide for intelligible description of the present invention.

Word used herein " one " or " one " are defined as more than one one or more.Word used herein " another " is defined as at least the second or at least multiple.Word used herein " comprises " and/or " having " is defined as " comprising " (, open conjunction).Word used herein " is coupled " or " can operate to be coupled " is defined as connecting, but may not directly connect and may not mechanically connect.

With reference to figure 1, in an embodiment of the present invention, virtual ads platform 120 is arranged in the video broadcasting context of simplification, and wherein virtual ads platform 120 can be used to virtual video content to be inserted into that the digital of digital video data feed-in (feed) 118 being received by virtual ads platform 120 is interior creates virtualized digital video feed-in 142.Digital video feed-in 118 can be derived from record in real time live event 102 or with broadcast delays broadcast the camera 104 at the live event place of live event 102.Digital video feed-in 118 can also be derived from repeat programme 108, as is derived from the network branches that product (as sitcom) are recorded in film studio to previously having recorded or the competitive sports (as international soccer match) of previously having recorded are replayed.In an embodiment, digital video feed-in 118 can be derived from the digital video medium 110 of having stored, such as DVD, Video Camera, mobile device, computing machine or can store a certain other medium of digital video.In an embodiment, digital video feed-in 118 can be derived from the video platform based on internet, such as website, e-mail attachment, live video streams (for example, web camera or the internet voice procedure such as Skype), computer user is uploaded to internet (for example, to website) such as www.YouTube.com or some other means based on internet video transmission.

In an embodiment, virtual ads platform 120 can receiving digital video feed-in 118.The reception of digital video feed-in 118 can be passive, and as third party in following examples sends digital video feed-in 118 to virtual ads platform 120 on one's own initiative, virtual ads platform is receiving digital video feed-in 118 passively; Or digital video feed-in 118 can be found out and obtain to virtual ads platform 120 on one's own initiative, this comprises seeks to obtain standard compliant digital video feed-in 118 or multiple digital video feed-in on one's own initiative.In example, virtual ads platform 120 can be programmed comparing data collection and data information (datum) or data (as key word, position, play position or some other standards) about digital video feed-in.Virtual ads platform 120 can comprise searches for and fetches facility, and this search and retrieval facility can be searched for according to one or more standards between available digital video feed-in 118.For example, virtual ads platform 120 can search website to look for the digital video feed-in 118 being associated with key word " music video ", and for example fetch this video for further presenting and reconfiguring in virtual ads platform 120 by download.

Digital video feed-in 118 can be received by virtual ads platform 120, this virtual ads platform 120 is carried out a series of step digital video feed-in 118 is reconfigured as virtualized digital video feed-in 142, the digital video feed-in 118 wherein initially receiving be rendered as comprise at least one assembly virtual video content (for example, advertisement), this virtual video content does not appear in the digital video feed-in 118 initially receiving.In an embodiment, virtual video content can be that completely new video element or it can be improvement or the enhancing of the project of the video content to finding in the digital video feed-in 118 initially receiving, as to being that the new video that fuzzy video content is corrected strengthens under some modes in the video data damaging and/or initial digital video feed-in 118.

With reference to figure 2, in an embodiment, in virtual ads platform 120 or the image processing platform being associated can be responsible for the following: analyze in real time the digital video feed-in 118 (being also known as " video ", " video content ", " video flowing " etc. here) that arrives, carry out detection to logo or other video contents (including but not limited to ad content), recover detected logo or geometric parameter and the formal parameter of the content that detects and transmit the required encoded metadata of follow-up enhancing and the logo of replacement.

Processing can start from virtual ads platform 120 and uses present frame 204 or prior to the frame 204 of present frame, the digital video feed-in 118 arriving decoded, and therefore extracts original color pixel to analyze.Processing can be used to select prototype logo208 (being called logo N here), with at least part of ground in carrying out the detection of present frame 204 and/or previous frame 202 by access detection database and optional database, this Test database comprises the prototype logo212 for concrete event of arbitrary number, the specific prototype figure picture of event (target context) 210 that this optional database comprises the object that occurs logo thereon.In an embodiment, the local matching of the video content of the logo based on in digital video feed-in 118 or other types or the identification and be detected at least in part of the logo in digital video feed-in 118.Prototype figure picture in Test database can experience image analysis step, thus comprising but the information that is not limited to the following is extracted the unique expression that forms logo (and optional target context):

Virtual ads platform 120 can enable the detection 220 for prominent feature, and wherein outstanding region comprises in other respects the roughly miscellaneous area (heterogeneousregion) evenly or in the image of homogeneity.

Virtual ads platform 120 can enable the detection 222 for space pattern, and wherein space pattern comprises structure and the coding in same color/colourity (intensity) region and their spatial relationship.

Virtual ads platform 120 can enable the detection 224 distributing for spectrum, and wherein spectrum distributes and comprises the summary of color and chrominance information.

Virtual ads platform 120 can enable the comparison 228 of zoom-level, and the algorithm of the part as image recognition and detection described herein can enable being suitable for for the multiple zoom levels presenting in video feed-in.

The video image arriving can experience the extraction similarly distributing for high-lighting, space pattern and spectrum, is then the comparison (detection) between these features and the feature of prototype logo.Detection-phase can be carried out the comparison of these features under multiple zoom levels, and can detect the Multi-instance of same logo.Thereby can carry out same processing to the each logo in database and determine for example, coupling 230 between image or the logo (, logo N) storing in video image in the video flowing 118 that receives and prototype logo212 and/or prototypical object 210 databases.The time smoothing of testing result can be based on for from previous picture frame the storage of detection, utilize physical constraint and predictive filtering to reduce shake 232.Detection-phase can be indicated position and the identity of the logo in scene, as shown in Figure 3, follow and estimate (pose-estimation) algorithm process by pose, the geometric position of processing the logo detecting in Scene at this pose algorithm for estimating is determined 3D environment 128 is interior.This algorithm is responsible for detecting pruning (shearing) 312 and the distortion (warping) 310 of logo translation 302 compared with prototype database, logo convergent-divergent 308, logo rotation 304, detected logo, and result is the metadata 320 that coding has these spatial parameters.Thereby the logo with how much corrigendums detecting can experience alignment step and (for example rebuild two logo, the logo X404 obtaining from the logo N218 of digital video feed-in 118 with from replacing logo database 400) between the mapping of pixel to pixel, be used as virtual content entry and be inserted into and in digital video feed-in 118, replace logo N (referring to Fig. 4) for selecting to replace logo402.The Main Differences that logo X can be aligned between a pair of logo N and the logo X of (316) and alignment can block mask (occlusion mask) 314 for building, this at least in part the geometric properties based on logo to the application 410 of alignment step and be therefore responsible for the partial occlusion that exists between camera and target and for example, because the vision of visual angle or a certain other type hinders or (blocks, due to folding of structure, such as performing artist's sweater, or from the light reflection of a side of object) part fuzzy (obscuration) that causes.Blocking mask can be encoded in metadata 320 structures of output and be applied to and strengthen a part of processing for the enhancing stage and 412.In next stage, aberration between logo and the prototype of recovering can and be encoded as color conversion matrix (color transformation matrix) 318 by assessment, and strengthen process during in the 414 follow-up corrigendums of logo that are used to strengthening.Conversion parameter may be added to metadata 320 structures.The irregular illumination pattern of image pair that can align by detection similarly, is considered specular light (contrary with uniform light) effect.This information can be encoded in metadata structure to carry out mirror-reflection compensation in the enhancing stage.Mix the additional pixel property of logo that (blending) algorithm 418 can comprise that extraction detects.These attributes can be encoded in metadata 320 structures to make it possible to carrying out nature mixing in the enhancing stage, particularly in the edge that replaces logo400.Hybrid algorithm can be used to create augmented video stream 420.Augmented video stream can be to be transferred to the virtualized digital video frequency flow 142 that other entities and client device 158 are checked.

As shown in Figure 5, virtual ads platform 120 can comprise test of heuristics and study facility, and this facility can carry out virtual video Content placement rank, preferentially use and optimize to the performance of the algorithm in digital video feed-in being used for by virtual ads platform 120.After detection algorithm 214, as described herein, can must assign to the algorithm 500 detecting test and carry out rank or otherwise assess in the value of identifying and detect on target logo504 for it for standard and its performance.

Refer again to Fig. 1, in an embodiment, the data video feed-in 118 initially receiving interior to the combination of virtual video element after, virtualized digital video feed-in can be created and distribute by virtual ads platform 120.Virtualized digital video feed-in can be dispensed to entity, these entities such as, but not limited to: as the main control room 114 being associated with netcast business, region such as netcast business's local branch play business 152, such as the internet 154 of website or a certain other entities that can receiver, video distribution.Data and/or metadata can be associated with virtualized digital video feed-in 142, these data and/or metadata comprise but be not limited to the tracking data 144 such as cookie148 or pixel tracking data 150, and permit, record tracked to the distribution of virtualized digital video feed-in 142 and with the sharing of each side that comprises virtual ads platform 120 and so on.The entity of playing business 152,154 websites, internet or a certain other entity such as region can receive virtual video feed-in 142 and it is transferred to client device 158, and this client device 158 includes but not limited to: enable equipment 160, TV162, the phone 164 of internet or can show a certain miscellaneous equipment of digital video.Then the user of client device 158 can check the example 168 of virtualized digital video feed-in, and confirms that these data of checking example can also for example be transferred to the entity such as virtual ads platform 120 based on tracking data.The data of checking that virtual ads platform 120 can receive and store this user checks data and multiple users, and determine at least in part the correlativity of the type of the virtual video content being inserted in digital video feed-in 118 by this information.Such as demographics 172, economy 174 and use are historical, the user data 170 relevant with user can be associated with client device 158, and these data can also be received and be stored by virtual ads platform 120 together with multiple users' data, and determine at least in part the correlativity of the type of the virtual video content being inserted in digital video feed-in 118 by this information.

In an embodiment, the virtual video content that is used to be included in virtualized digital video feed-in 168 by virtual ads platform 120 can be the content 180 of being supported, as advertisement.The content 180 of being supported can also be associated with advertising renewal 182 or advertising network, and wherein advertiser 188 can bid for the power that the given content of being supported 180 is placed as to the virtual content in virtualized digital video feed-in 168 with bid platform 184.

In an embodiment of the present invention, virtual ads platform 120 can, for the virtual content outside insertion of advertising or the content of being supported, include but not limited to: the non-ad content of entertainment content, fan's video, special-effect or a certain other type.

In an embodiment of the present invention, virtual ads platform 120 can be used for virtual video content to be inserted in the feed-in of 3-dimensional digital video data.

In an embodiment of the present invention, virtual ads platform 120 can the feed-in of receiving digital video data.Digital of digital video data feed-in can obtain from the camera of 2D camera, 3D camera, infrared camera, stereoscopic camera or a certain other type.Virtual ads platform 120 can map to the region in the second frame of video by the region in the first frame of video of digital of digital video data feed-in by carrying out following steps: (i) at least in part for example, based on to the region of match video data standard (, thumbnail/the video-frequency band of known advertisement) in data (for example, pixel data, secret writing data etc.) identification, select the region in the first frame of video; (ii) from second frame of video of being caught in the first frame time subsequently by stereoscopic camera in digital of digital video data feed-in, select region, and the primary importance in the region in the 3 D video space in the first frame of video is associated with the second place in the region in 3 D video space in the second frame of video, wherein as described herein, this association is based in part on the quantitative test for the data in the region in the first frame and the second frame; And (iii) three-dimensional mapping matrix is concluded and is stored as in this association.Virtual ads platform 120 can be segmented into region multiple area segments, and by each area segments execution step i, ii and iii are processed to multiple area segments iteratively, to create multiple three-dimensional mapping matrixes, wherein each three-dimensional mapping matrix has been concluded each area segments in multiple area segments and has crossed in three dimensions the position of each frame in digital of digital video data feed-in.Virtual ads platform can be summarized as three-dimensional mapping algorithm by the association between multiple three-dimensional mapping matrixes, and replace video area and can be mapped to the region in the first frame of video, wherein this mapping is the region in the first frame of video and the quantitative association of replacing the data (for example, pixel data, secret writing data) in video area.Virtual ads platform can be at least in part the video data of replacing video area of should being used for handling based on three-dimensional mapping algorithm replace video area and be suitable for being placed into the second version in the second frame of video to present, wherein replace presenting visually and/or quantitatively equal and changing in the three dimensions in the region in the first and second frames of video area, this replacing is concluded by three-dimensional mapping matrix.

In an embodiment of the present invention, virtual ads platform 120 can the feed-in of receiving digital video data.Digital of digital video data feed-in can obtain from the camera of 2D camera, 3D camera, infrared camera, stereoscopic camera or a certain other type.Virtual ads platform 120 can map to the region in the second frame of video by the region in the first frame of video of digital of digital video data feed-in by carrying out following steps: (i) at least in part for example, based on to the region of match video data standard (, thumbnail/the video-frequency band of known advertisement) in data (for example, pixel data, secret writing data etc.) identification, select the region in the first frame of video; (ii) from second frame of video of being caught in the first frame time subsequently by stereoscopic camera in digital of digital video data feed-in, select region, and the primary importance in the region in the 3 D video space in the first frame of video is associated with the second place in the region in 3 D video space in the second frame of video, and wherein this association is based in part on the quantitative test for the data in the region in the first frame and the second frame; And (iii) three-dimensional mapping matrix is concluded and is stored as in this association.Virtual ads platform 120 can be segmented into region multiple area segments, and by each area segments execution step i, ii and iii are processed to multiple area segments iteratively, to create multiple three-dimensional mapping matrixes, wherein each three-dimensional mapping matrix concluded each area segments in multiple area segments in three dimensions, cross over each frame in digital of digital video data feed-in position.Virtual ads platform can be summarized as three-dimensional mapping algorithm by the association between multiple three-dimensional mapping matrixes, and replace video area and can be mapped to the region in the first frame of video, wherein this mapping is the region in the first frame of video and the quantitative association of replacing the data (for example, pixel data, secret writing data) in video area.Virtual ads platform can be at least in part the video data of replacing video area of should being used for handling based on three-dimensional mapping algorithm replace video area and be suitable for being placed into the second version in the second frame of video to present, wherein replace presenting visually and/or quantitatively equal and changing in the three dimensions in the region in the first and second frames of video area, this replacing is concluded by three-dimensional mapping matrix.In an embodiment, virtual ads platform 120 can be at least in part the video data that should be used for handling iteratively multiple replacements video area based on three-dimensional mapping algorithm, wherein the manipulation of iteration produces multiple replacements video area, and each region is wherein corresponding to a frame in the series of frames in digital of digital video data feed-in.The each region of virtual ads platform 120 in can the multiple replacements of polymerization video area creates multiple compound replacement video images, and wherein the each image in multiple compound replacement video images is corresponding to each frame of the multiple frames in the series of frames in digital of digital video data feed-in.Each image in compound replacement video image can be replaced image for standard and verify, wherein this checking is summarized as quantitative verification matrix (quantitative validity metric), and the prediction that three-dimensional mapping algorithm can be adjusted to optimize quantitative verification matrix is iteratively verified.

In an embodiment of the present invention, virtual ads platform 120 can be compound to numerical data feed-in in new numerical data feed-in again, and replay new numerical data feed-in, in this new numerical data feed-in, place the content in compound replacement video image Alternative digital video feed-in.

In an embodiment of the present invention, virtual ads platform 120 can enable data interpolation be filled the loss video image causing due to fuzzy, and this is fuzzy for example from sunshine reflection or dim illumination, folding clothing, the image that becomes piece, the image being blocked etc.

In an embodiment of the present invention, virtual ads platform 120 can be inserted into tracking data again in compound virtual video feed-in, thereby makes to follow the tracks of to the service condition in downstream (for example, Internet streaming content).

In an embodiment of the present invention, virtual ads platform 120 can use distributed computing environment and at server place from digital of digital video data feed-in (for example, from main control room) receiving video data be multiple video-data fragment by video data segment, multiple video-data fragment are distributed to multiple servers (wherein, the plurality of server is in distributed computing environment).

In an embodiment of the present invention, virtual ads platform 120 can (use method described herein) selects to be used for being placed into virtual video content in digital of digital video data feed-in, wherein select the information based on being associated with at least one item in the following at least in part: the area code that (i) broadcasting branch, (ii) and distribution destination are associated and/or (iii) digital video feed-in for example, by shown equipment (, cable set top box or cell phone) thereon.

In an embodiment of the present invention, the selection of the virtual video content based on to from dictionary (dictionary) is by virtual video Content placement in video data feed-in at least in part for virtual ads platform 120, and the video content of wherein storing in this dictionary is associated with the mapping (replaceable this known advertisement of video in dictionary) of metadata partly described to(for) known advertisement.

In an embodiment, advertising renewal 182 can be associated with virtual ads platform 120, as shown here, can present a kind of for example, by for the integrated various entities that relate to the preparation of the content 180 of being supported and send (creating, advertisement) platform carry out enable pass and cross the pattern of various for example, advertisements at line cap (, website).It can be used as the single platform for enabling the transaction between advertiser and publisher (publisher).Various services for example, allow etc. in identification, Rich Media's illegitimate traffic (trafficking), the algorithm of extensibility, output management, the data of integrated bid (, using in real time bid platform 184), Dynamic Pricing, customizable reporting capabilities, targeted advertisements business and the market nicke that can assist advertisement of single platform.In addition, for for example, with other platforms (, virtual ads platform 120) thereby, advertising network, middle man etc. carry out mutual API and can be provided the facility of setting up seamless integrated distribution on global.Various electronics and communication facilities that advertising renewal 182 can be networked by support are realized.Some examples of such equipment can include but not limited to: desktop computer, palmtop computer, laptop computer, mobile phone, cell phone etc.Ordinary skill in the art personnel can recognize: various wired or wireless technology may be utilized to support the network of these equipment with PERCOM peripheral communication platform, as honeycomb, WIFI, LAN, WAN, MAN, internet etc.The holonomic system (hereinafter in order to describe, being called as advertising renewal 182) of advertising renewal 182 can comprise the entity such as advertising renewal 182 servers, advertisement listings, advertising network, advertisement agency, advertiser, publisher, virtual ads platform 120 facilities etc.Simple and clear for what describe, the detailed description of some entities in these entities provides here separatedly.

Advertising renewal 182 servers can comprise and can be configured to provide the service of web services or other kinds to assist one or more servers of the placement (for example, being subject to the insertion of sponsored content 180 on website) of the content 180 of being supported.Equally, advertising renewal 182 servers can be the computer servers such as web server, and this computer server can be carried out storage online advertisement and the task to website user or beholder, mobile network provider, other platforms (as virtual ads platform 120) etc. by ad delivery.Relevant advertisements when advertising renewal 182 servers can assist each visitor or user to use web browser accessed web page or refreshed web page and the demonstration of information.Advertisement can be virtual video content, advertisement bar, based on contextual advertisement, behavior advertisement, interest advertisement etc.Advertising renewal 182 servers can be carried out following task: safeguard that daily record, user's the IP address of recording data on flows number, user of the number of impression and click is for identification spam.Daily record can be used to create the statistical graph of traffic flow for analyzing grouping, routed path etc.In addition, can store the information relevant with client device 158 with the user of webpage and store their behavioural information and contextual information by advertising renewal 182 server maintenance databases.Behavioural information and contextual information can present relevant advertisement for the form of the virtual video content to be inserted into digital video feed-in 118 to user by advertising renewal 182 servers and by virtual ads platform 120.For example, can to indicate the language of setting on this equipment to be set to default language be " English " to the contextual information relevant with client device 158.This contextual information can be at least in part by virtual ads platform 120 for selecting the virtual video content based on English to be inserted into the interior element that substitutes the non-English presenting in digital video feed-in 118 of digital video feed-in 118.Database can be updated periodically by advertising renewal 182 servers or upgrade in the time being triggered by the owner of advertising renewal 182 servers.Database can be self contained data base or can be distributed data base, and can be associated with virtual ads platform 120.

In an embodiment, publisher can be the owner of advertising renewal 182 servers.Such deployment can be known as local advertising and exchange 182 servers because advertising renewal 182 servers be by publisher control and safeguard and advertising renewal 182 servers can only serve publisher.But advertising renewal 182 servers can also be disposed and be presided over by third party.Such deployment is known as third-party server or remote server, because the owner of advertising renewal 182 servers is different from web server.In this scene, the direct link between advertising renewal 182 server owners (third party) and publisher can be maintained to keep the renewal of any transaction of publisher to the online advertisement on webpage and its place.In the deployment of the remote server pattern of advertising renewal 182 servers, advertising renewal 182 servers can differently be served the numerous territories that had by various publishers.

According to various embodiments of the present invention, several other tasks can be carried out by advertising renewal 182 servers.Advertising renewal 182 servers can contribute to uploading of advertisement on webpage or any other similar content, comprise the content of injecting digital video feed-in 118 and so on is loaded on to virtual ads platform 120.Advertising renewal 182 servers can also be assisted the downloadable content of advertisement or the download of the advertisement part that the constraint that applied by advertiser limits.In addition, advertising renewal 182 servers can also be used for avoiding the advertisement illegitimate traffic on one or more webpages.Illegitimate traffic can based on definition the parameter about the feasibility of business and business and the standard of importance and avoided.

In an embodiment, advertising renewal 182 servers can adopt the upper limit (cap) or the restriction of the number of times shown for the content (as virtual video content) of receiving patronage, thereby the money based on online advertisement is dropped into is set the restriction of service condition.In other situations, the background that advertising renewal 182 servers can be based on user and behavior and close the demonstration of some advertisement.In addition, show that to user the time period of advertisement can be by advertising renewal 182 server controls, and this information by virtual ads platform 120 for selecting the type of virtual content to be included in virtualized digital video feed-in 142.In example, the time period can be set uniformly or can or be changed for various users by other information of advertising renewal 182 server aggregates or the contextual information being previously stored in database (comprising the database being associated with virtual ads platform 120) based on behavior, context for all users.Of the present invention during some realizes, advertising renewal 182 servers at least in part the interest based on user and user data 170 notify used by virtual ads platform 120 for virtual content being placed on to the sequence of advertisements in digital video feed-in.

In an embodiment, the owner of advertisement listings can be the advertiser that wants displaying contents, and this content is all is placed into virtual content in digital video feed-in 118 etc. in this way by virtual ads platform 120.Advertiser can buy inventory and the advertisement that a part of space in digital video feed-in 118 shows them.Advertisement listings can be stored in advertising renewal 182 servers or virtual ads platform 120 or by they access, this inventory can be crawled to be presented in digital video feed-in 118 from advertising renewal 182 servers or virtual ads platform 120.Then these inventories can be added into the allocation space in digital video feed-in by the owner of virtual ads platform 120 and/or digital video feed-in 118.Demonstration for the allocation of space of advertisement listings and the content of advertisement listings can and/or be managed by the parameter in virtual ads platform 120 by advertising renewal 182 servers.

In an embodiment, advertiser is the entity of buying in advertising renewal 182, it can provide the content of being supported 180, the advertisement content similar with other to the each side that can place content, comprises and video content can be placed into the virtual ads platform 120 in digital video feed-in 118.In general scene, thousands of advertisers can be connected to numerous publishers by advertising renewal 182 servers.Advertiser may not be directly linked to advertising renewal 182 servers, but links to the intermediate system such as advertising network or advertisement agency, and in this intermediate system, various advertisers can be linked or be presented in advertising renewal 182.Advertiser can submit a tender to buy presumptive area in virtualized digital video feed-in 142 for the placement that is subject to sponsored content 180 and the required space with other details of advertisement such as advertisement.Advertisement can be classified according to the standard that define in intermediate system (as correlativity of cost, context, the content relevant to digital video feed-in 118 etc.) by virtual ads platform 120.Then the sponsored content 180 that is subject to through classification can be sorted and priorization by virtual ads platform 120, and the content of being supported 180 is placed in virtualized digital video feed-in 142 by being provided required space with the advertiser of the highest bid.Advertiser can also select to buy space from several publishers of digital video feed-in 118.

In an embodiment, publisher can be the seller who has or run display position (for example website), this display position can show digital video feed-in 118 and virtualized digital video feed-in 142, and can sell advertiser by the predetermined space on webpage for example.Advertiser can pass through intermediate system (for example, advertising network, advertising renewal 182), by virtual ads platform 120, carry out alternately for buying in or sell etc. with publisher as shown here.The space of publisher in can distribute digital video feed-in 118, and virtual ads platform 120 can add the content of being supported, video inventory or ad content in the space of being distributed to the form of video.Publisher and/or virtual ads platform 120 can be estimated the number of the impression for example, occurring on concrete webpage during the specific time period (, one day or one month).According to the information of this expectation and the information relevant with the space of distributing, publisher and/or virtual ads platform 120 can estimate that space is by the number being sold.Can be regarded as assets by selling to advertiser, agency or any other space of buying in entity.Publisher and/or virtual ads platform 120 can also the several standards based on definition here be classified to inventory and video media.Classification can manually be performed or use automated system (for example, passing through programmed algorithm) to carry out.Manual classification can relate to check and analyze digital video feed-in 118 video content people and based on checking and analyzing, video content can be classified in various classifications.Classification can also be carried out by automated system, for example, by virtual ads platform 120 described here.Programmed algorithm for mechanized classification can be stored in Virtual Advertisement System 120, and this Virtual Advertisement System 120 can be checked and analyze digital video feed-in 118 and digital video feed-in 118 is categorized in the classification defining.Differential count can provide additional advantage to publisher and advertiser by several means.For example, by estimating video inventory, the video content of being supported or the ad content rank for the degree of correlation of given digital video feed-in 118, the charge that publisher can have relatively high expectations, because in the time that user checks virtualized digital video feed-in 142 (the relevant video content of being supported 180 is inserted into wherein), increase is higher for the possibility of the interest of ad content.Similarly, check if more likely digital video feed-in 118 is carried out to the more video of big figure at time per unit, digital video feed-in 118 can preferentially be turned to more relevant so.Can be collected, store and analyze by virtual ads platform 120 with the historical relevant data of checking of digital video feed-in 118.

In an embodiment, advertising renewal 182 can realize and can allow publisher in real time advertising impression to be fixed a price between tender period.Except selecting bidder in predetermined standard, advertising renewal 182 can guarantee that the bid of being submitted to by advertiser neither can be underestimated also and can not be over-evaluated.Advertising renewal 182 can automatically generate the maximal rewards in each impression.In addition, the report of sales data can be held intelligible simple format and is presented to publisher.Publisher can be authorized to identify brand and/or the product that they like and replace advertising impression.Equally, advertising renewal 182 can allow the preference of publisher based on them to limit some brand, content, form etc.

In an embodiment, advertising network can be one group of publisher and/or the advertiser connecting together.Advertising network can be to want to preside over the web website and the tissue of wanting the advertiser that moves advertisement to be connected or entity of advertisement.Advertising network can be classified as representative network, blindness network (blind network) and objective network.Representative network allows content for gray completely transparent.On the other hand, the degree of freedom that blindly network can be placed take the advertisement determining on publisher's webpage provides lower price as cost to advertiser.Objective network can point to concrete guiding technique, and this concrete guiding technique comprises behavioural information or the contextual information of analysis user, and as shown here, and these information can be collected, store and analyze by virtual ads platform 120.

In an embodiment, available and be created in the virtual video content being associated in virtual ads platform 120 or with virtual ads platform 120 and can use the pushed client device 158 to user of propelling movement (syndication) facility in virtual ads platform 120, the contextual information that this pushes to small part based on being associated with virtual video content and/or similar to virtual video content and comprise the use of the content of the content 180 of being supported, to determine the degree of correlation of virtual video content and standard room by determine facility by correlativity, the key word being for example associated with virtual video content, the use history of content, and/or the metadata being associated with virtual video content.The degree of correlation is the degree of correlation of the context data based on being associated with virtual video content and user data 170 at least in part.In example, virtual video content choice standard can be derived for the previous service condition of client device 158 and the behavior in client device 158 based on user at least in part by virtual ads platform 120, and this service condition and behavior include but not limited to the previous video-see situation of making on the client device 158 the equipment 160 enabling such as internet.For example, on client device 158, watch from virtual ads platform 120 user of the virtualized digital video feed-in 142 of deriving previously to have searched for, and fetch, use or the mutual virtual video content being associated with metadata, for example point to hobby video and throw in the URL of website (as, YouTube) or the key word such as " world cup (The World Cup) ".The program being associated in the interior operation of virtual ads platform 120 or with virtual ads platform 120 or be under the jurisdiction of the self-action of virtual ads platform 120 can be identified key word, metadata or the other materials in this video content of previously having watched, and this key word, metadata or other materials have been indicated the degree of correlation with virtual video content type " physical culture (Sports) ".Be based in part on this, user can be associated with and indicate user for the interesting user profiles data/data of physical culture.For selection user data and the user profile data based on having indicated for the interest of physical culture at least in part of virtual video content that pushes to user, and can by virtual ads platform 120 individual automatically initiate, and/or can be by initiating user or the founder of the interior virtual video content available or that be associated with virtual ads platform 120 of virtual ads platform 120, this virtual video content is to be for example submitted to website such as YouTube to handle.

The contextual information being associated with video content can also comprise: the key word that is positioned at video content and/or virtual video content or is associated with video content and/or virtual video content, word, or short sentence, to the link of video content, from the link of video content, the point blow mode being associated with the previous use in video and number of clicks (clickthrough) (comprise and manifesting the some blow mode and the number of clicks that be associated by sponsored content that are associated with virtual video content), metadata, comprise the time that video content uses, length, the degree of depth and frequency are used pattern at interior video content, the initial hosting (origination host) of video content, (one or more) type relevant to video content, and contextual other designators of video content.

The degree of correlation of the contextual information being associated with video content can be by being used the degree of correlation must assign to indicate.Degree of correlation score can be for example contextual video and virtual video content parameters (for example, the type of video content) and customer parameter (type of the video content that for example, user had previously downloaded) between the numerical value of statistical association conclude.Degree of correlation score can be the proprietary score that the third party service provider that is associated by virtual ads platform 120 or with virtual ads platform 120 is distributed to video content or virtual video content.The degree of correlation score of the virtualized video content pushing can be stored in virtual video content degree of correlation dictionary.

In an embodiment, use pattern can obtain from the database of the user data relevant with the user of virtual ads platform 120 170 and/or metadata.The broad range of use pattern can be for helping the formation of (implicit with clear and definite) inquiry and helping such as recipient's the fetching and organizing of video contents search result that is presented to virtualized video data feed-in 142 from virtual ads platform 120.Algorithm facility (algorithm facility) can comprise and is suitable for analyzing use pattern to help one or more modules or the engine of the function that forms inquiry.The pattern of the video content of the time that for example, algorithm facility can be based on every day, number of days weekly, number of days monthly, annual number of days, working day pattern, holiday pattern, time hourly, trade mode, arrival and output, the pattern of click and number of clicks, communication pattern and can from user data 170 and/or watch the interior use of client device 158 of video content thereon or data associated with it any other pattern of picking out.Can analyze use pattern with various prediction algorithms, this prediction algorithm is for example regression technique (least square method etc.), neural network algorithm (neural net algorithm), learning algorithm, random walk, Monte Carlo simulation and other algorithms described here.

In an embodiment, one or more API can be provided to enable and assist user data such as user profiles use and management, virtual ads platform 120 in or the operation of the propelling movement that is associated with virtual ads platform 120.

In an embodiment, as described herein, virtual video content, user and and the two metadata being associated between correlativity, the degree of correlation, the degree of association, can make based on statistical study at least in part other measurements definite and associated and relation of response.Statistical study can include but not limited to following technology: as linear regression, logistic regression, decision tree analysis, Bayes (Bayes) technology (comprise naive Bayesian ( bayes)), k nearest neighbor (K nearest neighbors) analysis, collaborative filtering, data mining and other statistical techniques that may use.

In example, linear regression analysis can for example, for (determining one or more independent variables, user profile data) and another correlated variables between relation, this another correlated variables be for example the data that is associated with virtual video content (for example, authors' name, type etc.), and linear regression analysis can, by least square function modelling, be known as linear regression formula.This function is the linear combination that is known as one or more model parameters of regression coefficient.

In another example, bayesian theory can be used to analysis of user profile and/or video content data and virtual video content, the context data being for example associated with video content, relevant data or the data in a certain other types of virtual ads platform 120 interior uses with the virtualized digital video feed-in 142 that created by virtual ads platform 120.Use bayesian theory, conditional probability for example can be assigned to user profiles variable, wherein this probability estimate video content or the viewed possibility of virtual video content and at least in part based on the previously previous mutual observation to user and video content.Naive Bayes Classifier can also be used for analyzing video content and virtual video content-data.Naive Bayes Classifier is based on bayesian theory being applied to the probability sorter of (simplicity) independence assumption by force.Naive Bayes Classifier supposes that the specific features of a certain class (class) present (or not presenting) had nothing to do with any other feature present (or not presenting).For example, if the user of video content previously searched for, fetched, downloaded, used and/or mutual relevant with Singapore and with the corresponding video content of virtual video content about Singapore or content of other types etc., he can be classified as for the video content relevant with Singapore interested in user profiles so.Bayes classifier can be considered the previous download of the video content relevant such as previous use, the Singapore of Singapore's video content, contributes to independently this user to the interested probability of the relevant video content of Singapore and can respond well such as advertisement the virtual video content relevant with tissue in Singapore and Singapore for the search of Singapore's video content etc. attribute.(be for example assigned with once be sorted in user profiles, user X=Singapore fan), user's information just can be stored by virtual ads platform 120 and (for example share, send data to Advertisement Server, wherein classification " Singapore fan " can be used for selecting Singapore relevant be subject to sponsored content (the virtual video content for example, being used by virtual ads platform 120) to send to user and the sending and show the content that is associated or the content of other related subjects of Singapore).Unique user profile can comprise multiple sorters.For example, Singapore fan's user profiles can also comprise and uses with user data set 170 and the data indicating user that the user action in any other data source and behavior are associated is as described herein the sorter of " native speaker of English " or " playing card player online " etc.The advantage of Naive Bayes Classifier is that it needs a small amount of training data necessary parameter (average of variable and variance) of estimating to classify.Because suppose that variable is independently, so only need to be determined rather than whole covariance matrix for the variance of the variable of each class.This characteristic of naive Bayesian can make classification realize.

In an embodiment, behavioral data analytical algorithm can be used for developing behavior profile with the selection for video content and virtual video content by virtual ads platform 120, and selected video content and virtual video content are included in and will be presented in the virtualized digital video feed-in 142 of client device 158.Behavior profile then can be used to lead advertisement and other virtual video contents.Behavior profile can comprise that this conclusion comprises accessed content and the type of application for the conclusion of user's video-see activity and other behavior properties.The impression that user's activity is concluded can comprise search, browse, buy, click, nothing responds or a certain other activities described here.Behavior property can be summarized as the continuous interest score of video content categories, passing response (for example, watching the transaction of making after advertisement virtual video content) or a certain other attributes to virtual video content.The nearly score of cline frequency score and consecutive hours (recency score) (for example, the movable time occurring has how close) can be regarded as the behavior property for building behavior profile.User's activity conclusion and behavior property can be for example, by using analytical technology (, Naive Bayes Classifier) described here classified.Video content data and characteristic thereof, and can for example, can also be used to the generation of behavior profile with the sponsored content (, advertisement) that is subject to that video content was associated to presenting of user such as virtual video content.For example, can use the data such as advertisement identity, advertising sign, user identity, advertisement point (advertisement spot) identity, date and user's response.In addition, content type can be used to the part based on behavior profile or behavior profile by the client device of virtualized digital video feed-in 142 oriented users and/or advertisement.In addition, content type can be with each search, browse, download, buy or other behavioral activities and/or transaction are associated.

The context data based on being associated with video content and Given information about user or groups of users be (for example at least in part for the program that automatically pushes virtual video content to user, user profile data, the degree of correlation as described herein).The robotization of pushing video content and virtualized digital video feed-in 142 can be at least in part associated based on metadata and virtual video content.What comprise in metadata can be and the information of the correlativity of virtual video content and all types of user and/or groups of users.The example how metadata can comprise in multiple examples of correlation information can comprise: for example indicate virtual video content, to the metadata of user's correlativity, data (, video playback capability) relevant to user's client device or indicate and the data of a certain other types of the average degree of correlation score being associated by the video content of watching from the user of given class of subscriber and/or metadata etc. based on user data 170 at least in part.

In an embodiment, the one or more servers application that is designed to fetch with virtual ads platform 120 video content can read search website, push feed-in or other guide and/or data finds video content, and this video content is used as using virtual ads platform 120 to create a part for virtualized digital video feed-in 142.In another embodiment, virtual ads platform 120 can be associated with one or more databases, in these one or more databases, corresponding to and the URL or other data that have identified video content and entity stored video content.Once (one or more) server is confirmed website or other video content memory locations and will be received and/or provide pushed video content (comprise from virtual ads platform 120 and receive virtualized digital video feed-in 142), server can automatically receive, indicates and/or provide video content to website or other entities, and/or sends virtualized digital video feed-in 142 to this website.In an embodiment, can provide mark by the different entities of arbitrary number or source.For example, mark can be provided by virtual ads platform 120, third party's i-services or a certain other mark provider.

In an embodiment, the video push project (program) of self-action and/or virtualized digital video feed-in 142 propelling movement projects can for example obtain income in the following manner: platform expense, income is shared, or the service routine that is free of charge providing to advertiser, website, advertising renewal, advertising network, publisher, televise business or a certain other entities.In an embodiment, all if each side of user of the client device 158 of displaying video and so on can be required to pay that usage charges visit, establishment, use, the distribution of establishment, polymerization and/or mutual virtual content and virtualized digital video feed-in 142 and watch.The content (for example, advertisement) of being supported in another embodiment, can be presented to user in combination with presenting of virtual video content.The owner of the content of being supported, or other interested certain sides can be required for the right defrayment that presents the content of being supported to user's client device, this presents is to carry out with the form of the virtualized digital video feed-in 142 that created by virtual ads platform 120.This income can for example, be shared by virtual ads platform 120 and third party's (, website owner).The sponsor that income can push from participating in self-action the virtual video content of project obtains.Expense can obtain from the sponsor of virtual video content, emulative tendering process, auction, platform service expense etc.Fee structure and the degree of correlation score based on being associated with virtual video content at least in part of submitting a tender.

In an embodiment, Data Integration and method can be used as a part for virtual ads platform 120, as described herein, to collect, to add, to merge, to verify, to analyze and to carry out other data processing operations for digital of digital video data, virtual video content-data, user data, client device data (for example,, for carrying out mutual application with virtual video content) and other data types described here.Thereby Data Integration and method can be used to process the information of collecting from multiple digital video data source and draw the inference (inference) in collected information, the information identification based on recently receiving is verified this change for database for the possible change of database and based on this inference.

In an embodiment, Data Integration and method can be used to information extraction etc. from multiple digital video data source, data source has multiple distinguishes data types, to be converted to the data type representing in the database that for example can use at virtual ads platform 120 from the data of data source, thus database integrated from the information of this distinguishes data type.

In an embodiment, distinguishes data type can be selected from comprise the group of the following: content-data, user data, contextual information, user behavior information (comprise user profiles), the demographics information relevant with virtual video content with video content, use historical and other data sources and data type as described herein.In an embodiment, Data Integration and method for example can be used to be applied to by regulation engine the rule that establishment, renewal and the maintenance of data set are connected, and this rule is for example a data set of storing explicitly or using with virtual ads platform 120.Regulation engine is applicable to less important change data, in other words, and the data that need to change in data centralization from one or more data sources and indication; Or this regulation engine is applicable to inference data, the data that draw from the inference of one or more data centralizations in other words.For example, rule can be indicated: if low priority data source acknowledgement inference, if or inference with consistent by the indicated data of data source, will make change in data centralization so.Similarly, rule may require multiple confirmations, for example, confirming that the change (or the new feature of data centralization or establishment of attribute) to data set requires more than one data set or more than one inference before.Rule could is asked the confirmation of any fixed number, no matter is by other data sets or by the inference drawing from these data centralizations.Rule can also realize various processing or workflow, for example, require specific people or entity to ratify the change of given type or the change for the data of particular type.

In an embodiment, Data Integration and method can be used to: information extraction from multiple digital video data source (digital video data source has multiple distinguishes data types), the change request for example, being associated at conventional data centralized stores data, consideration and database (database, being associated with virtual ads platform 120) and verify this change request with conventional data collection.

In an embodiment, Data Integration and method can be used to: information extraction from multiple digital video data source (digital video data source has multiple different data types), in conventional data centralized stores data, consideration conventional data collection is identified for example, may change and initiate to change request based on conventional data collection for database (database, being associated with virtual ads platform 120).

In an embodiment, data integration facility can be used to the integrated data from multiple digital video data source, this data source comprises the attribute relevant to virtual ads platform 120, and wherein data integration facility is to select the group from comprising following facility: extract facility, data-switching facility, the structure that is written into facility, Message Agent, connector, service orientation, queue, bridge joint, reptile (spider), filtration facility, cluster facility, push facility and searching facility.

In an embodiment, data integration facility can be for: the integrated data from multiple digital video data source, receive according to the inference drawing for the analysis of the data of being collected by multiple data sources, application data set become rule to determine to apply the scope of this inference and should be used for upgrading data set based on this rule.

In an embodiment, data integration facility can be for: the integrated data from multiple digital video data source, receive according to the inference, the application data set that draw for the analysis of the data of being collected by multiple data sources become regular stratum (rule hierarchy) to determine to apply the scope of this inference and should be used for upgrading data set based on this rule.

In an embodiment, data integration facility can provide regular stratum determine with system (for example, virtual ads platform 120) the concentrated data type using of relevant data, at least one item of rule stratum based in the following comes application rule: rich (richness) of data item, data item, reliability, the freshness of data item and the source of data item of data item, and in data integration regular matrix, show regular stratum, the application that wherein the auxiliary different regular stratum of matrix arrives dissimilar data.

In an embodiment, data integration facility can be for: the integrated data from multiple digital video data source, receive according to the inference, the application data set that draw for the analysis of the data of being collected by data source become regular matrix to determine to apply the scope of this inference and should be used for upgrading data set based on this rule.

Data integration facility can use explicitly with the system such as virtual ads platform 120, and to collect iteratively data and to make the inference about data, these data are collected for the use in virtual ads platform 120.Can carry out continuously iteration to collect and to make the inference about data attribute in multiple times or as ongoing process.Iteration can be the function of whole data set (for example, user's whole virtual video content is used historical), or the function of particular piece of data (for example, being less than the virtual video content use history of 24 hours).Data attribute can be stored the comparison for data inference attribute follow-up and previous collection.In an embodiment, this process can be continuous, and represents the comparison of the ongoing attribute for institute's inference, thereby detects difference in time.

Data integration facility can comprise at least one in bridge joint, Message Agent, queue and connector.Therefore, useful data source can be associated with data integration facility via computer code, hardware or the two, and this computer code, hardware or the two have been set up being connected between source and data integration facility.For example, bridge joint can comprise the code of carrying out following action: (for example receive the data of original data type, the data of markup language), extract the relative section of data and these data be converted to different forms, be for example suitable for being stored in virtual ads platform 120 form of the data that use or used by the user of virtual ads platform 120.Message Agent can from data source, extract data, by data placement in queue or memory location for example, for to target location (, virtual ads platform 120 servers) send and the suitable time and with suitable form by data delivery for example, to target location the user of virtual ads platform 120 (, to).In an embodiment, target location can be virtual ads platform 120 databases, Data Mart (data mart), metadata facility or for the facility at the interior storage of virtual ads platform 120 or relating attribute.Connector can comprise and be suitable for for example having or not having, in the situation of middle facility (, Data Mart or data bag (data bag)), the application programming interface of connection source and target data facility or other codes.Connector for example can comprise AJAX code, SOAP connector, Java connector, WSDL connector etc.

In an embodiment, data integration facility can be for the integrated data from multiple digital video data source, and data source comprises for example relevant to virtual ads platform 120 attribute.Data integration facility can comprise propelling movement facility.Pushing facility can release news with applicable form, to be further used for helping establishment, renewal or the maintenance of virtual ads platform 120 databases by computing machine, service etc., this database is for example the data of a database, the publisher relevant with user behavior profile or a certain other types that used by virtual ads platform 120, as described herein.For example, push facility can with RSS, XML, OPML or similarly form issue relevant data, these data are for example the information of user data, cellular carrier data, advertisement translation data, publisher's data and many other types that can be used by virtual ads platform 120.Pushing facility can by data feed-in virtual ads platform 120 databases (be for example configured to directly by data integration facility, user profiles database), thereby to padding data in the domain of dependence of database, the attribute in padding data storehouse, metadata in padding data storehouse etc.In an embodiment, the data that push can be used in combination with regulation engine, for example, to help various inference processing, help to confirm other data etc.

In an embodiment, data integration facility can comprise the framework facility of service orientation.In the framework facility of service orientation, one or more data integration steps can be deployed as can various computing machines and the addressable service of service, and this addressable service comprises the exploitation, renewal and the maintenance that contribute to such as virtual ads platform 120 databases of user profiles database etc.Service can comprise the service that helps reasoning such as stratum by implementation rule, rule etc., for example, help the confirmation from the data of each provenance.Service can be distributed in registration table with the form of the information with about how accessing this service, thereby makes various data integration facilities can use this service.Access can be API, connector etc., for example, use web services definitional language, enterprise-level Java beans or be suitable for integrated various other codes of management data in the framework of service orientation.

In an embodiment, data integration facility can comprise at least one in the following: crawl facility (spidering facility), web grabber (crawler), cluster facility, acquisition facility (scraping facility) and filtration facility.Crawling facility or other similar facilities therefore can search data (for example, from the available data in various territories, service, operator, publisher and source, available data on internet or other networks), extract data (for example looking like by acquisition or cluster the data that are applicable to type), carry out filtering data and delivering data for example arrives virtual ads platform 120 databases based on various filtrators.Therefore, by crawling relevant data source, data integration facility can find relevant data, as the information of user behavior data, the context data relevant with content, publisher's data and a lot of other types (here previously as described in type).Relevant data can be used for by inference engine: infer, support inference, reject inference, for example, help establishment, maintenance or the renewal of virtual ads platform 120 databases.Data can also be used for: the attribute that directly padding data section, filling are associated with data item or metadata is provided.

Can some or all ofly dispose method and system described herein by network infrastructure.Network infrastructure can comprise element as known in the art, such as computing equipment, server, router, hub, fire wall, client, personal computer, communication facilities, routing device and other active and inactive component, module and/or parts.(one or more) associated with network infrastructure calculate and/or non-computing equipment can also comprise storage medium except other assembly, such as flash memory, impact damper, stack, RAM, R0M etc.Here can be carried out by one or more network infrastructure elements with process, method, program code, the instruction of other places description.

Can on the cellular network with multiple communities, implement here method, program code and the instruction described with other places.Cellular network can be frequency division multiple access (FDMA) network or CDMA (CDMA) network.Cellular network can comprise mobile device, cell site, base station, transponder, antenna, tower etc.Cellular network can be GSM, GPRS, 3G, EVDO, grid or other network type.

Can be on mobile device or implement here method, program code and the instruction described with other places by mobile device.Mobile device can comprise navigator, cell phone, mobile phone, mobile personal digital assistant, laptop computer, palmtop computer, notebook, pager, E-book reader, music player etc.These equipment can also comprise storage medium (such as flash memory, impact damper, RAM, R0M and one or more computing equipment) except other parts.Program code, method and the instruction that can make the computing equipment associated with mobile device to carry out to be stored thereon.Alternatively, mobile device can be configured to cooperate with miscellaneous equipment carry out instruction.Mobile device can with following base station communication, executive routine code is docked and be configured in these base stations with server.Mobile device can be communicated by letter on peer-to-peer network, grid network or other communication network.Program code can be stored on the storage medium associated with server and by the computing equipment being embedded in server and carry out.Base station can comprise computing equipment and storage medium.Storage medium can be stored program code and the instruction that the computing equipment associated with base station carried out.

Can on following machine readable media, store and/or access computer software, program code and/or instruction, this medium can comprise: the data that are kept for calculating reach machine element, equipment and the recording medium at interval sometime; Be called the semiconductor memory of random access memory (RAM); The massage storage that is generally used for storing more lastingly, such as the form (as hard disk, tape, magnetic drum, magnetic card and other type) of CD, magnetic store; Processor register, cache memory, volatile memory, nonvolatile memory; Optical memory (such as CD, DVD); Detachable media, for example, such as flash memory (, USB rod or usb key), floppy disk, tape, paper tape, punch card, independent ram disc, Zip driving, detachable massage storage, off-line etc.; Other computer memory, such as dynamic storage, static memory, read/writable memory device, alterable memory, read-only, random access, sequential access, position addressable, file addressable, content addressable, network attachment storer, storage area network, bar code, magnetic China ink etc.

Method and system described herein can become another state by physics and/or an invisible Xiang Congyi state transformation.Method and system described herein also can become another state from a state transformation by the data of represents physical and/or invisible item.

Can realize above-described method and/or process and step thereof with any combination of the hardware, software or the hardware and software that are suitable for application-specific.Hardware can comprise particular aspects or the parts of multi-purpose computer and/or dedicated computing equipment or concrete computing equipment or concrete computing equipment.Can be in one or more microprocessor, microcontroller, embedded microcontroller, programmable digital signal processor or other programmable device and inside and/or external memory storage implementation procedure.Also can or alternatively can be configured to process embodiment process in the special IC of electronic signal, programmable gate array, programmable logic array or any miscellaneous equipment or device combination.Also can be implemented as by understanding one or more process the computer-executable code that can carry out on machine readable media.

Can use following structured programming language (such as C), Object-Oriented Programming Language (such as C++) or any other senior or rudimentary programming language (comprising assembly language, hardware description language and database programming language and technology) to produce computer-executable code, wherein can store, described in compiling or decipher programming language with in one of the said equipment and processor, the isomery combination of processor architecture or the combination of different hardware and software or can move on any other machine of execution of program instructions.

Therefore, in one aspect in, can in following computer-executable code, embody above-described every kind of method and combination thereof, when this code is carried out on one or more computing equipment, carry out its step.In another aspect, method can be embodied in to be carried out in the system of its step and can be distributed on equipment by many modes, or all functions can be integrated in special, autonomous device or other hardware.In another aspect, can comprise above-described any hardware and/or software for carrying out with the device of the step of above-described procedure correlation.All such arrangements and combination are intended to fall in the scope of present disclosure.

Although disclose the present invention in conjunction with the preferred embodiment that is shown specifically and describes, the various modifications to it and improvement will become easily and understand those skilled in the art.Thereby the spirit and scope of the present invention by be not subject to aforementioned exemplary restriction but should be to understand in the admissible broad sense of law.

Claims (according to the modification of the 19th article of treaty)

1. a system that uses the space in the region that three-dimensional artificial quantizes two-dimensional video image to change, change in this space is that the movement between the first frame of video and the second frame of video causes by described region, described system comprises the computing machine with the non-transient state computer-readable medium of having stored instruction thereon, in the time that this instruction is carried out by the processor of described computing machine, make described processor carry out following steps:

Receive the request of watching from the two-dimensional digital video data feed-in of internet from user;

Receive the feed-in of two-dimensional digital video data from internet;

Applicating geometric surface on multiple area of space based in the frame of described two-dimensional digital video data feed-in at least in part, in simulated environment, build the three-dimensional artificial of described two-dimensional digital video data feed-in, wherein said multiple area of space are to shine upon to define by the coordinate of described two-dimensional digital video data feed-in at least in part;

Area of space in the first frame of video, in described multiple area of space is mapped to the position of described area of space in the second frame of video, wherein said the second frame of video is captive in the first frame time subsequently, and described mapping realizes by carrying out following steps:

Step 1: the mapping point in described two-dimensional video data feed-in based on described area of space at least in part, select the area of space in the first frame of video;

Step 2: by the difference between the geometric jacquard patterning unit surface that quantizes geometric jacquard patterning unit surface that described area of space applies in described the first frame of video and apply in frame of video formerly and frame of video subsequently, the Geometrical change for described area of space in frame of video formerly and frame of video subsequently described in identification; And

Step 3: the difference being quantized is summarized as to three-dimensional mapping matrix;

By performing step one, step 2 and step 3, process iteratively the each frame of video in the multiple frame of video in the feed-in of described two-dimensional digital video, to create multiple three-dimensional mapping matrixes; And also comprise:

The association of the quantity between described multiple three-dimensional mapping matrixes is summarized as to three-dimensional mapping algorithm, wherein said three-dimensional mapping algorithm has defined three-dimensional geometry position data at least in part, and this three-dimensional geometry position data makes can be applied to for the Geometrical change of area of space intrinsic in described multiple frame of video the virtual digit video image not being presented in the feed-in of described two-dimensional digital video data.

2. the system as claimed in claim 1, wherein said virtual digit video image is to be inserted in the area of space of described two-dimensional digital data feed-in and the advertisement of having replaced described area of space, and described two-dimensional digital video image is reconfigured as new virtual digit video feed-in.

3. the system as claimed in claim 1, wherein said virtual digit image is changed at least one additional effect that comprises the element of frame and select from comprise the group of lighting effect, hatching effect and mirror effect.

4. the system as claimed in claim 1, wherein said digital video feed-in receives from live event.

5. the system as claimed in claim 1, wherein said digital video feed-in is to receive the digital video medium from having stored.

6. the system as claimed in claim 1, wherein said area of space comprises the miscellaneous area with unique texture.

7. the system as claimed in claim 1, the position of wherein said area of space is coded in the metadata of described two-dimensional digital video data feed-in.

8. system as claimed in claim 8, wherein for the selection of described area of space also the mapping point based on described area of space be stored in and data facility that described three-dimensional artificial environmental facies are associated in known spatial characteristics between interrelated.

9. system as claimed in claim 8, wherein said known spatial characteristics is advertisement logo.

10. system as claimed in claim 8, wherein said known spatial characteristics is on clothing class commodity.

11. 1 kinds of systems that use three-dimensional mapping algorithm to insert virtual image in the video flowing based on internet, described system comprises the computing machine with the non-transient state computer-readable medium of having stored instruction thereon, in the time that this instruction is carried out by the processor of described computing machine, make described processor carry out following steps:

Receive the request of checking from the two-dimensional digital video data feed-in of internet from user;

Select virtual digit image;

Three-dimensional mapping algorithm is applied to described virtual digit image, wherein said three-dimensional mapping algorithm is reconfigured the area of space substituting in described two-dimensional digital feed-in in multiple frames of described virtual digit image in the feed-in of described two-dimensional digital data, and wherein said three-dimensional mapping algorithm makes it possible to the similar Geometrical change of described virtual digit image applications to presenting in the area of space in the multiple frame of video in the feed-in of described two-dimensional digital video data; And

The numerical data feed-in reconfiguring is sent to user and shows, the wherein said numerical data feed-in reconfiguring is the virtualized numerical data feed-in that comprises the described virtual digit image that has substituted described area of space.

12. systems as claimed in claim 11, wherein said request is accompanied by least one data relevant with described user's characteristic, and for the selection of virtual digit image at least in part based on the correlativity of described data.

13. systems as claimed in claim 12, wherein said area of space comprises miscellaneous area.

14. systems as claimed in claim 12, wherein said virtual digit image is the advertisement logo relevant with at least a portion of described two-dimensional digital video feed-in.

15. systems as claimed in claim 14, wherein said virtual digit image is changed to comprise at least one additional effect of selecting the group from comprising lighting effect, hatching effect and mirror effect.

16. systems as claimed in claim 11, the position of wherein said area of space is coded in the metadata of described two-dimensional digital video data feed-in.

17. systems as claimed in claim 16, also comprise: determine the position of described area of space in the numerical data feed-in reconfiguring that is shown to described user by described metadata.

18. 1 kinds use three-dimensional mapping algorithm virtual image to be inserted into the system of replacing the digital of digital video data of damage with interpolate video data in the feed-in of two-dimensional digital video, described system comprises the computing machine with the non-transient state computer-readable medium of having stored instruction thereon, in the time that this instruction is carried out by the processor of described computing machine, make described processor carry out following steps:

Receive the request of watching from the two-dimensional digital video data feed-in of internet from user;

Receive the feed-in of two-dimensional digital video data from internet, the area of space in the multiple frames in wherein said two-dimensional video data feed-in comprises that the part of the advertisement causing due to the digital of digital video data damaging describes;

Calculate the correlativity of unspoiled digital of digital video data in described area of space and the collection of the digital video image of having stored with image array algorithm;

Correlativity based on calculated at least in part, the digital video image that identification has been stored;

The digital video image of having stored based on identified at least in part, selects virtual digit image;

Three-dimensional mapping algorithm is applied to described virtual digit image, wherein said three-dimensional mapping algorithm makes the area of space in alternative described two-dimensional digital feed-in in multiple frames of described virtual digit image in the feed-in of described two-dimensional digital data and is reconfigured, and wherein said three-dimensional mapping algorithm makes it possible to the similar Geometrical change of described virtual digit image applications to presenting in the area of space in the multiple frame of video in the feed-in of described two-dimensional digital video data; And

The numerical data feed-in reconfiguring is sent to user to show, the wherein said numerical data feed-in reconfiguring is the virtualized numerical data feed-in that comprises the described virtual digit image that has substituted described area of space.

19. systems as claimed in claim 18, wherein said virtual digit image is the full release of described parts of images, and wherein said virtual digit image is at least in part based on creating with the digital of digital video data that the digital video image of having stored is interpolated.

20. systems as claimed in claim 18, the digital of digital video data of wherein said damage is caused by the physical deformation of the object of describing in the feed-in of described two-dimensional digital video data at least partly.

Claims (20)

1. a system that uses the space in the region that three-dimensional artificial quantizes two-dimensional video image to change, change in this space is that the movement between the first frame of video and the second frame of video causes by described region, described system comprises the computing machine with the non-transient state computer-readable medium of having stored instruction thereon, in the time that this instruction is carried out by the processor of described computing machine, make described processor carry out following steps:

Receive the feed-in of two-dimensional digital video data;

Applicating geometric surface on multiple area of space based in the frame of described two-dimensional digital video data feed-in at least in part, in simulated environment, build the three-dimensional artificial of described two-dimensional digital video data feed-in, wherein said multiple area of space are to shine upon to define by the coordinate of described two-dimensional digital video data feed-in at least in part;

One area of space in the first frame of video, in described multiple area of space is mapped to the position of described area of space in the second frame of video, wherein said the second frame of video is captive in the first frame time subsequently, and this mapping realizes by carrying out following steps:

Step 1: the mapping point in described two-dimensional video data feed-in based on described area of space at least in part, select the area of space in described the first frame of video;

Step 2: by quantize the difference between the geometric jacquard patterning unit surface that described area of space applies in described the first frame of video and the geometric jacquard patterning unit surface of applying in described the second frame of video, identify the Geometrical change for described area of space in described the second frame of video; And

Step 3: the difference being quantized is summarized as to three-dimensional mapping matrix;

By performing step one, step 2 and step 3, process iteratively the each frame of video in the multiple frame of video in the feed-in of described two-dimensional digital video, to create multiple three-dimensional mapping matrixes; And

The association of the quantity between described multiple three-dimensional mapping matrixes is summarized as to three-dimensional mapping algorithm, wherein said three-dimensional mapping algorithm has defined three-dimensional geometry position data at least in part, and this three-dimensional geometry position data makes can be applied to for the Geometrical change of area of space intrinsic in described multiple frame of video the virtual digit video image not being presented in the feed-in of described two-dimensional digital video data.

2. the system as claimed in claim 1, wherein said virtual digit video image is to be inserted in the area of space of described two-dimensional digital data feed-in and the advertisement of having replaced described area of space, and described two-dimensional digital video image is reconfigured as new virtual digit video feed-in.

3. the system as claimed in claim 1, wherein said digital video feed-in obtains from infrared camera.

4. the system as claimed in claim 1, wherein said digital video feed-in receives from live event.

5. the system as claimed in claim 1, wherein said digital video feed-in is to receive the digital video medium from having stored.

6. system as claimed in claim 5, the wherein said digital video medium of having stored is DVD.

7. system as claimed in claim 5, wherein said digital video feed-in receives from internet.

8. system as claimed in claim 8, wherein for the selection of described area of space also the mapping point based on described area of space be stored in and data facility that described three-dimensional artificial environmental facies are associated in known spatial characteristics between interrelated.

9. system as claimed in claim 8, wherein said known spatial characteristics is advertisement logo.

10. system as claimed in claim 8, wherein said known spatial characteristics is clothing class commodity.

11. 1 kinds of systems that use three-dimensional mapping algorithm to insert virtual image in the video flowing based on internet, described system comprises the computing machine with the non-transient state computer-readable medium of having stored instruction thereon, in the time that this instruction is carried out by the processor of described computing machine, make described processor carry out following steps:

Receive the request of checking from the two-dimensional digital video data feed-in of internet from user;

Select virtual digit image;

Three-dimensional mapping algorithm is applied to described virtual digit image, wherein said three-dimensional mapping algorithm makes the area of space in alternative described two-dimensional digital feed-in in multiple frames of described virtual digit image in the feed-in of described two-dimensional digital data and is reconfigured, and wherein said three-dimensional mapping algorithm makes it possible to the similar Geometrical change of described virtual digit image applications to presenting in the area of space in the multiple frame of video in the feed-in of described two-dimensional digital video data; And

The numerical data feed-in reconfiguring is sent to user and shows, the wherein said numerical data feed-in reconfiguring is the virtualized numerical data feed-in that comprises the described virtual digit image that has substituted described area of space.

12. systems as claimed in claim 11, wherein said request is accompanied by least one data relevant with described user's characteristic, and for the selection of virtual digit image at least in part based on the correlativity of described data.

13. systems as claimed in claim 12, wherein said virtual digit image is the content of being supported.

14. systems as claimed in claim 12, wherein said virtual digit image is the advertisement logo relevant with at least a portion of described two-dimensional digital video feed-in.

15. systems as claimed in claim 14, that between the 2nd logo wherein identifying based on described advertisement logo and in the feed-in of described two-dimensional digital video at least in part with the correlativity of described advertisement logo, has stored is associated, wherein for the detection of described the 2nd logo at least in part the image based on identifying in the feed-in of described two-dimensional digital video mate with the quantification between the logo being stored in database.

16. systems as claimed in claim 15, the wherein also geometric position based on being associated with the feed-in of described two-dimensional digital video of correlativity.

17. systems as claimed in claim 15, wherein said correlativity is the geometric position based on the client device being sent to being associated with the digital video feed-in reconfiguring also.

18. 1 kinds use three-dimensional mapping algorithm interpolate video data to replace the digital of digital video data of damage and in the feed-in of two-dimensional digital video, insert the system of virtual image, described system comprises the computing machine with the non-transient state computer-readable medium of having stored instruction thereon, in the time that this instruction is carried out by the processor of described computing machine, make described processor carry out following steps:

Receive the feed-in of two-dimensional digital video data, the area of space in the multiple frames in wherein said two-dimensional video data feed-in comprises that the part of the advertisement causing due to the digital of digital video data damaging describes;

Calculate the correlativity of unspoiled digital of digital video data in described area of space and the collection of the digital video image of having stored with image array algorithm;

Correlativity based on calculated at least in part, the digital video image that identification has been stored;

The digital video image of having stored based on identified at least in part, selects virtual digit image;

Three-dimensional mapping algorithm is applied to described virtual digit image, wherein said three-dimensional mapping algorithm makes the area of space in alternative described two-dimensional digital feed-in in multiple frames of described virtual digit image in the feed-in of described two-dimensional digital data and is reconfigured, and wherein said three-dimensional mapping algorithm makes it possible to the similar Geometrical change of described virtual digit image applications to presenting in the area of space in the multiple frame of video in the feed-in of described two-dimensional digital video data; And

The numerical data feed-in reconfiguring is sent to user to show, the wherein said numerical data feed-in reconfiguring is the virtualized numerical data feed-in that comprises the described virtual digit image that has substituted described area of space.

19. systems as claimed in claim 18, wherein said virtual digit image is the full release of described parts of images, and wherein said virtual digit image is at least in part based on creating with the digital of digital video data that the digital video image of having stored is interpolated.

20. systems as claimed in claim 18, the digital of digital video data of wherein said damage is caused by the physical deformation of the object of describing in the feed-in of described two-dimensional digital video data at least partly.

Images