WO2017063055A1 - Video advertising by virtual content placement - Google Patents

Video advertising by virtual content placement Download PDF

Info

Publication number
WO2017063055A1
WO2017063055A1 PCT/BG2015/000033 BG2015000033W WO2017063055A1 WO 2017063055 A1 WO2017063055 A1 WO 2017063055A1 BG 2015000033 W BG2015000033 W BG 2015000033W WO 2017063055 A1 WO2017063055 A1 WO 2017063055A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
marker
advertisement
scene
embedded
Prior art date
Application number
PCT/BG2015/000033
Other languages
French (fr)
Inventor
Ilan TZORYA
Original Assignee
Tzorya Ilan
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tzorya Ilan filed Critical Tzorya Ilan
Priority to PCT/BG2015/000033 priority Critical patent/WO2017063055A1/en
Publication of WO2017063055A1 publication Critical patent/WO2017063055A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/812—Monomedia components thereof involving advertisement data

Definitions

  • the present invention relates to system and method for virtual content placement in videos by replacing a special element existing in the photographed scene with different advertisements.
  • Virtual replacement of the content of a video is a technique used mainly in the advertisement industry.
  • the goal of the advertisers is to keep the viewer's attention focused on the commercial.
  • the best way to achieve that is by embedment of the commercial into the video so that it can't be avoided by the viewer.
  • the advertisements embedded in the video should be suitable for its content and interesting for the viewer regarding the type of video he is watching.
  • the technology should be perfected enough so that the advertisement can appear as a part of the video scene and blend with the whole picture.
  • the virtual content placement must take into account a broad variety of factors such as size and perspective of the camera, illumination, shadows, colors in the video etc.
  • the present technology allows any image file formats to be embedded in the video (JPEG, BMP, GIF, PNG, WEBP), including in different sizes (16:9, 4:3) so the commercials can appear as clear and realistic as possible.
  • the embedment is done by the replacement of a special element (marker) existing in the photographed scene with the selected advertisement.
  • This technology allows the advertisers to place their advertisements in different videos distributed in the Internet via different websites at the lowest cost.
  • the present technology of virtual replacement envisions the use of special elements (markers), which are created before filming the video and placed in the scene as a two- dimensional (2D) objects.
  • Each marker has specific characteristics (size, shape and color) that allow it to be detected by algorithms for video processing.
  • the marker can be a distinctive spot in red color with square or rectangular shape, placed in the background while filming the video.
  • Different sizes or shapes of the marker can be used with regard to the type of advertisements that are appropriate for embedment.
  • the marker should exist in the photographed scene, so in most cases it will visible (partially or entirely) during filming the video.
  • the video processor is a specific software, working with appropriate set of hardware that can guarantee the fastest and highest quality customization of the video. It processes the video scene by scene as an algorithm executes different steps in order to achieve a satisfying result - embedding the advertisement in the video in a clear and realistic way. The most important part of the process is the proper segmentation of the image so that the number of the redundant details can be minimized in order the algorithm that detects the marker to function quickly and accurately.
  • the next step after segmentation of the image is implementing morphological transformations and different filters such as blurring.
  • the noises in the video are reduced and the marker becomes easier to detect.
  • the coordinates of the marker in the picture are precisely determined with different techniques for detecting objects.
  • the aforementioned techniques depend on the specific type of marker used. For example, in the case of a red colored square or rectangular marker, the applicable technology will detect the precise coordinates of the marker by isolation of all the colors except for the red one. This coordinates are saved and can be utilized multiple times for placing different contents within the marker area without converting the video.
  • the final step of the process is placing the selected advertisement within the marker. That is achieved by the addition of a new layer to the video - an "overlay", using HTML5.
  • the overlay is coded independently from the video stream and can be used multiple times for embedment of different advertisements.
  • This layer is transparent and it's only visible part is the advertisement that will be shown at the place where the marker used to be.
  • An important part of this process is making the necessary geometrical calculations so that the advertisement can follow the movements of the camera in the different scenes of the video. Thus, the advertisement blends with the whole picture and does not harm the viewer experience.
  • the present invention envisions the use of a special web-based software as the best way for carrying out the process.
  • the users of this software are divided into two groups - advertisers and publishers.
  • Step 1 Uploading the video into the software. The status of the uploaded video before its processing and customization is "Pending";
  • Step 2 Processing and customization of the video using "the video processor”. This step includes segmentation and morphological transformations;
  • Step 3 Determining and saving the coordinates of the marker used while filming the video;
  • Step 4 Changing the video status from "pending" to “converted” so that it can be utilized for embedment of different advertisements by publishers;
  • the advertisers, as clients, are able to manipulate the whole process, including their revenues from the advertisements embedded into the videos, as follows:
  • Step 1 Uploading different advertisements in the form of images with any file format (JPEG, BMP, GIF, PNG, WEBP) and choosing their size (16:9, 4:3 etc.) or selecting an advertisement from the ones already uploaded on the platform;
  • JPEG, BMP, GIF, PNG, WEBP file format
  • Step 2 Determining the videos into which the elected advertisements can be successfully embedded (taking into consideration their content, the size of the marker etc.);
  • Step 3 Embedding the chosen advertisements into the chosen videos
  • Step 4 Receiving an "embedded code” for each video.
  • the "embedded code” allows the advertiser to publish the video on every website of his choice;
  • Step 5 Determining the desired number of broadcasts of the video with the embedded advertisement;
  • Step 6 Tracing the number of broadcasts and views of the video with the embedded advertisement.
  • the present invention facilitates the work of the publishers (each video is processed and customized only once and can be utilized for embedment of different advertisements) and allows the advertisers to manage the whole process, including the broadcasting of the videos, and to foresee and calculate the interrelation between their costs and revenues.
  • Fig. 1 demonstrates the process of embedding the advertisement into the video
  • Fig. 2 gives detailed view of the steps that the advertiser undertakes to use the method
  • Fig. 3 gives detailed view of the steps that the publisher undertakes to create the video with special marker
  • Fig. 4 demonstrates the interaction between different steps of the process.
  • the publisher's video has a red marker placed inside of it.
  • the advertiser selects the video which he wants his commercial to be placed in.
  • the commercial will be shown on the place of the red marker while the video is playing.
  • the advertiser gets an embeddable code which can be used to reach users all over the web. Every show up changes statistics for number of views and counts impressions.
  • the present invention is applicable in the field of internet advertisement. Its utilization will result in achievement of the ultimate advertising goal- keeping the viewer's attention focused on the commercial without harming his experience while watching the video at a cost determined by the advertisers with regard to the number of broadcasts.

Abstract

Content placement in videos by replacing a special element existing in the photographed scene with different advertisements. A special element (marker) existing in the photographed scene is replaced by an advertisement, embedded in the video. After filming with the marker a special web service customizes the video in order to make possible the replacement of the marker. The advertiser selects the advertisement to be replaced in the video scene which is made by an embedded code received by the advertiser. The advertisement is shown in as an original scene in the video by automatically adding an independently coded transparent "overlayer" to the video.

Description

VIDEO ADVERTISING BY VIRTUAL CONTENT
PLACEMENT DESCRIPTION OF THE INVENTION
I. Technical field
The present invention relates to system and method for virtual content placement in videos by replacing a special element existing in the photographed scene with different advertisements.
II. Background art
Ever since the Internet has enabled people all around the world to communicate with each other, entrepreneurs have tried to use it as a media for broadcasting content suitable for their needs. However, at the moment most of the advertisement models used in these videos are harmful to the viewer experience and thus, irritating for the viewers. For example, the addition of intrusive elements to the video, such as pre/post rolls and banners (used in YouTube for example) is not welcomed by the users. In order to avoid this, virtual replacement of the content of the video was created.
Virtual replacement of the content of a video is a technique used mainly in the advertisement industry. The goal of the advertisers is to keep the viewer's attention focused on the commercial. The best way to achieve that is by embedment of the commercial into the video so that it can't be avoided by the viewer. The advertisements embedded in the video should be suitable for its content and interesting for the viewer regarding the type of video he is watching. The technology should be perfected enough so that the advertisement can appear as a part of the video scene and blend with the whole picture. In order to appear realistic, the virtual content placement must take into account a broad variety of factors such as size and perspective of the camera, illumination, shadows, colors in the video etc.
The present technology allows any image file formats to be embedded in the video (JPEG, BMP, GIF, PNG, WEBP), including in different sizes (16:9, 4:3) so the commercials can appear as clear and realistic as possible. The embedment is done by the replacement of a special element (marker) existing in the photographed scene with the selected advertisement. This technology allows the advertisers to place their advertisements in different videos distributed in the Internet via different websites at the lowest cost. III. Disclosure of the invention
The present technology of virtual replacement envisions the use of special elements (markers), which are created before filming the video and placed in the scene as a two- dimensional (2D) objects. Each marker has specific characteristics (size, shape and color) that allow it to be detected by algorithms for video processing. For example, the marker can be a distinctive spot in red color with square or rectangular shape, placed in the background while filming the video. Different sizes or shapes of the marker can be used with regard to the type of advertisements that are appropriate for embedment. Surely, the marker should exist in the photographed scene, so in most cases it will visible (partially or entirely) during filming the video.
After filming the video with the marker in it, different processes should be executed in order to replace it with an advertisement. Firstly, the video is transmitted to "the video processor" for processing and customization. "The video processor" is a specific software, working with appropriate set of hardware that can guarantee the fastest and highest quality customization of the video. It processes the video scene by scene as an algorithm executes different steps in order to achieve a satisfying result - embedding the advertisement in the video in a clear and realistic way. The most important part of the process is the proper segmentation of the image so that the number of the redundant details can be minimized in order the algorithm that detects the marker to function quickly and accurately. The next step after segmentation of the image is implementing morphological transformations and different filters such as blurring. Thus, the noises in the video are reduced and the marker becomes easier to detect. After the image is fully processed the coordinates of the marker in the picture are precisely determined with different techniques for detecting objects. The aforementioned techniques depend on the specific type of marker used. For example, in the case of a red colored square or rectangular marker, the applicable technology will detect the precise coordinates of the marker by isolation of all the colors except for the red one. This coordinates are saved and can be utilized multiple times for placing different contents within the marker area without converting the video.
The final step of the process is placing the selected advertisement within the marker. That is achieved by the addition of a new layer to the video - an "overlay", using HTML5. The overlay is coded independently from the video stream and can be used multiple times for embedment of different advertisements. This layer is transparent and it's only visible part is the advertisement that will be shown at the place where the marker used to be. An important part of this process is making the necessary geometrical calculations so that the advertisement can follow the movements of the camera in the different scenes of the video. Thus, the advertisement blends with the whole picture and does not harm the viewer experience.
IV. Best mode for carrying out the invention
In addition to the innovative system and method for embedding advertisements in the videos, the present invention envisions the use of a special web-based software as the best way for carrying out the process. The users of this software are divided into two groups - advertisers and publishers.
The publishers are responsible for execution of the following steps, thoroughly described in the disclosure of the invention:
- Step 1 : Uploading the video into the software. The status of the uploaded video before its processing and customization is "Pending";
- Step 2: Processing and customization of the video using "the video processor". This step includes segmentation and morphological transformations;
- Step 3: Determining and saving the coordinates of the marker used while filming the video;
- Step 4: Changing the video status from "pending" to "converted" so that it can be utilized for embedment of different advertisements by publishers;
- Step 5: Arranging the videos into lists regarding the specific characteristics of the marker used (for example regarding the size of the marker - 16:9, 4:3 etc.)
The advertisers, as clients, are able to manipulate the whole process, including their revenues from the advertisements embedded into the videos, as follows:
- Step 1 : Uploading different advertisements in the form of images with any file format (JPEG, BMP, GIF, PNG, WEBP) and choosing their size (16:9, 4:3 etc.) or selecting an advertisement from the ones already uploaded on the platform;
- Step 2: Determining the videos into which the elected advertisements can be successfully embedded (taking into consideration their content, the size of the marker etc.);
- Step 3: Embedding the chosen advertisements into the chosen videos;
- Step 4: Receiving an "embedded code" for each video. The "embedded code" allows the advertiser to publish the video on every website of his choice; - Step 5: Determining the desired number of broadcasts of the video with the embedded advertisement;
- Step 6: Tracing the number of broadcasts and views of the video with the embedded advertisement.
Thus, the present invention facilitates the work of the publishers (each video is processed and customized only once and can be utilized for embedment of different advertisements) and allows the advertisers to manage the whole process, including the broadcasting of the videos, and to foresee and calculate the interrelation between their costs and revenues.
V. Brief description of the drawings
The present invention can be understood and appreciated more fully from the following drawings, presented herein:
Fig. 1 demonstrates the process of embedding the advertisement into the video
Fig. 2 gives detailed view of the steps that the advertiser undertakes to use the method
Fig. 3 gives detailed view of the steps that the publisher undertakes to create the video with special marker
Fig. 4 demonstrates the interaction between different steps of the process. The publisher's video has a red marker placed inside of it. The advertiser selects the video which he wants his commercial to be placed in. The commercial will be shown on the place of the red marker while the video is playing. When the video and the commercial are put together, the advertiser gets an embeddable code which can be used to reach users all over the web. Every show up changes statistics for number of views and counts impressions.
VI. Industrial applicability
The present invention is applicable in the field of internet advertisement. Its utilization will result in achievement of the ultimate advertising goal- keeping the viewer's attention focused on the commercial without harming his experience while watching the video at a cost determined by the advertisers with regard to the number of broadcasts.

Claims

CLAIMS Regarding the description of the invention and the innovative steps in it, we would like to obtain protection for the following features:
1. Method and technology for recognizing a marker in a video by its specific size and shape and determining its specific coordinates;
2. Technology for placing suitable for the size and the shape of the marker advertisements within the marker by automatically adding an independently coded transparent "overlayer" to the video;
3. Software product that allows the advertisers to manipulate the process of embedment alone by using already converted videos;
4. Technology for automatically producing a unique "embedded code" for each video with embedded advertisement after its finalization, which allows the advertiser to publish the video on every website of his choice;
5. Specific software that allows the advertisers to determine the desired number of broadcasts and trace it.
PCT/BG2015/000033 2015-10-13 2015-10-13 Video advertising by virtual content placement WO2017063055A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/BG2015/000033 WO2017063055A1 (en) 2015-10-13 2015-10-13 Video advertising by virtual content placement

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/BG2015/000033 WO2017063055A1 (en) 2015-10-13 2015-10-13 Video advertising by virtual content placement

Publications (1)

Publication Number Publication Date
WO2017063055A1 true WO2017063055A1 (en) 2017-04-20

Family

ID=54979345

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/BG2015/000033 WO2017063055A1 (en) 2015-10-13 2015-10-13 Video advertising by virtual content placement

Country Status (1)

Country Link
WO (1) WO2017063055A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108288249A (en) * 2018-01-25 2018-07-17 北京览科技有限公司 A kind of method and apparatus for replacing the object in video
CN110035320A (en) * 2019-03-19 2019-07-19 星河视效文化传播(北京)有限公司 The advertisement load rendering method and device of video
CN110521212A (en) * 2017-04-27 2019-11-29 西安诺瓦星云科技股份有限公司 Video record and processing system and method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010047297A1 (en) * 2000-02-16 2001-11-29 Albert Wen Advertisement brokering with remote ad generation system and method in a distributed computer network
US20050137958A1 (en) * 2003-12-23 2005-06-23 Thomas Huber Advertising methods for advertising time slots and embedded objects
US20080320512A1 (en) * 2007-06-22 2008-12-25 Inskin Media Ltd. Systems and methods for providing interactive advertisements through media player skin
US20150139545A1 (en) * 2013-11-15 2015-05-21 Samsung Electronics Co., Ltd. Method and system to detect objects in multimedia using non-textural information within segmented region

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010047297A1 (en) * 2000-02-16 2001-11-29 Albert Wen Advertisement brokering with remote ad generation system and method in a distributed computer network
US20050137958A1 (en) * 2003-12-23 2005-06-23 Thomas Huber Advertising methods for advertising time slots and embedded objects
US20080320512A1 (en) * 2007-06-22 2008-12-25 Inskin Media Ltd. Systems and methods for providing interactive advertisements through media player skin
US20150139545A1 (en) * 2013-11-15 2015-05-21 Samsung Electronics Co., Ltd. Method and system to detect objects in multimedia using non-textural information within segmented region

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110521212A (en) * 2017-04-27 2019-11-29 西安诺瓦星云科技股份有限公司 Video record and processing system and method
CN108288249A (en) * 2018-01-25 2018-07-17 北京览科技有限公司 A kind of method and apparatus for replacing the object in video
CN110035320A (en) * 2019-03-19 2019-07-19 星河视效文化传播(北京)有限公司 The advertisement load rendering method and device of video
CN110035320B (en) * 2019-03-19 2021-06-22 星河视效科技(北京)有限公司 Video advertisement loading rendering method and device

Similar Documents

Publication Publication Date Title
US11019283B2 (en) Augmenting detected regions in image or video data
US11482192B2 (en) Automated object selection and placement for augmented reality
CN106792100B (en) Video bullet screen display method and device
US8860803B2 (en) Dynamic replacement of cinematic stage props in program content
US9038100B2 (en) Dynamic insertion of cinematic stage props in program content
US10032192B2 (en) Automatic localization of advertisements
US8929720B2 (en) Apparatus and method for identifying insertion zones in video material and for inserting additional material into the insertion zones
CN103686254B (en) The method, apparatus and system of automatic localization for advertisement
EP2523192B1 (en) Dynamic replacement of cinematic stage props in program content
JP2004304794A (en) Method for displaying movie
CN106060578A (en) Producing video data
JP7447077B2 (en) Method and system for dynamic image content replacement in video streams
US9349053B2 (en) Method and system of identifying non-distinctive images/objects in a digital video and tracking such images/objects using temporal and spatial queues
CN111357295B (en) Method and system for fusing user-specific content into video production
CN104811744A (en) Information putting method and system
KR20190075177A (en) Context-based augmented ad
CN1728781A (en) Method and apparatus for insertion of additional content into video
US20130301918A1 (en) System, platform, application and method for automated video foreground and/or background replacement
CN112312195B (en) Method and device for implanting multimedia information into video, computer equipment and storage medium
CN105847718A (en) Scene recognition-based live video bullet screen display method and display device thereof
CN110300316A (en) Method, apparatus, electronic equipment and the storage medium of pushed information are implanted into video
WO2017063055A1 (en) Video advertising by virtual content placement
CN110663044A (en) Method and apparatus for providing product placement
CN111970556A (en) Method and device for processing black edge of video picture
US11436788B2 (en) File generation apparatus, image generation apparatus, file generation method, and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15813687

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 24.07.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 15813687

Country of ref document: EP

Kind code of ref document: A1