US9137542B2 - Audio encoding of control signals for displays - Google Patents

Audio encoding of control signals for displays Download PDF

Info

Publication number
US9137542B2
US9137542B2 US13/948,382 US201313948382A US9137542B2 US 9137542 B2 US9137542 B2 US 9137542B2 US 201313948382 A US201313948382 A US 201313948382A US 9137542 B2 US9137542 B2 US 9137542B2
Authority
US
United States
Prior art keywords
pixels
video content
audio
display
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US13/948,382
Other versions
US20150029395A1 (en
Inventor
Brian T. Weber
Benjamin K. Stein
Patrick M. Campbell
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
3M Innovative Properties Co
Original Assignee
3M Innovative Properties Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 3M Innovative Properties Co filed Critical 3M Innovative Properties Co
Priority to US13/948,382 priority Critical patent/US9137542B2/en
Assigned to 3M INNOVATIVE PROPERTIES COMPANY reassignment 3M INNOVATIVE PROPERTIES COMPANY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: STEIN, BENJAMIN K., WEBER, BRIAN T., CAMPBELL, PATRICK M.
Publication of US20150029395A1 publication Critical patent/US20150029395A1/en
Application granted granted Critical
Publication of US9137542B2 publication Critical patent/US9137542B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • G—PHYSICS
    • G02—OPTICS
    • G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour 
    • G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour  based on liquid crystals, e.g. single liquid crystal display cells
    • G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
    • G02F1/1333—Constructional arrangements; Manufacturing methods
    • G02F1/1334—Constructional arrangements; Manufacturing methods based on polymer dispersed liquid crystals, e.g. microencapsulated liquid crystals
    • H01L27/3232—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/454—Content or additional data filtering, e.g. blocking advertisements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/633—Control signals issued by server directed to the network components or client
    • H04N21/6332—Control signals issued by server directed to the network components or client directed to client
    • H04N21/6336—Control signals issued by server directed to the network components or client directed to client directed to decoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10K—ORGANIC ELECTRIC SOLID-STATE DEVICES
    • H10K59/00—Integrated devices, or assemblies of multiple devices, comprising at least one organic light-emitting element covered by group H10K50/00
    • H10K59/50—OLEDs integrated with light modulating elements, e.g. with electrochromic elements, photochromic elements or liquid crystal elements

Definitions

  • a switchable transparent display screen is useful for attracting consumer attention and providing information to customers. While in its transparent state, it allows customers to see through the screen and view products behind it.
  • One such type of screen uses Polymer Dispersed Liquid Crystal (PDLC), which is a mixture of liquid crystal in a cured polymer network and is switchable between light transmitting and light scattering states.
  • PDLC displays can be divided into pixels, drawing more attention by displaying projected video content on light scattering pixels while allowing customers to view the product through light transmitting pixels.
  • the pixels must be synchronized with video content such that the video content is projected onto light scattering pixels for display while the other pixels can be set to a clear state. As the video content changes, the pixels need to be reset so that the video content continues to be projected onto the light scattering pixels for display.
  • a system for synchronizing projected video content with a transparent display includes a projector for projecting video content having associated audio content and a transparent display for receiving and displaying the projected video content.
  • the transparent display has pixels capable of switching between a clear state to make portions of the display transparent and a hazy state to display the projected video.
  • a decoder receives and decodes the audio content in order to control the switching of the pixels in the display with the projected video content such that the video content is projected onto pixels in the hazy state.
  • a method for synchronizing projected video content with a transparent display comprises projecting video content having associated audio content to a transparent display and displaying the projected video content on the transparent display.
  • the method also includes decoding the audio content in order to control the switching of the pixels in the display between clear and hazy states such that the projected video content is projected onto pixels in the hazy state.
  • FIG. 1 is a block diagram of a system for audio encoding of data to control a transparent display
  • FIG. 2 is a block diagram illustrating use of audio encoding of data to synchronize video projected onto a transparent display with switching of the display;
  • FIG. 3 is a flow chart of a method for audio encoding of data to control a transparent display
  • FIG. 4 is a diagram illustrating use of audio encoded data to control a transparent display.
  • Embodiments of the present invention include a method of encoding a control signal using audio tones.
  • This signal can be sine or square waves with the frequency of the waves determining the data set being sent.
  • the frequency can be in the ultrasonic range to send data faster and free the audio line for traditional use of providing audio with video.
  • This signal can also be a series of DTMF (dual-tone multi-frequency) tones. Each tone, or series of tones, can represent a different set of data. Using stereo audio allows for more data to be transmitted or for error correction to be performed.
  • the control signal can be used to encode pixel data in segmented transparent displays.
  • FIG. 1 is a block diagram of a system 10 for audio encoding of data.
  • System 10 includes a decoder 12 for decoding audio signals to provide a synchronization signal for a segmented transparent display.
  • Decoder 12 includes a processor 20 , or controller or circuitry, for decoding signals.
  • a memory 21 can store software instructions for execution by processor 20 .
  • the audio signal can be square waves with the frequency of the waves determining the active pixels.
  • the audio signal can also be a sine wave.
  • Pixel information can be encoded in sine waves using several methods. Encoding can be done using a single frequency for each pixel arrangement. It can also be encoded using DTMF tones. Each DTMF tone, or series of tones, can represent one pixel state.
  • a series of tones can play at the beginning of a video and contain data for synchronized pixel switching for the duration of the video, enabling sound to be played with the corresponding video.
  • a sine or square wave 14 is provided to a comparator 16 , which generates a corresponding digital square wave 18 .
  • Processor 20 received digital square wave 18 and decodes it to produce a pixel data output signal 26 .
  • processor 20 receives DTMF tones 24 and decodes the tones to generate pixel data output signal 26 .
  • FIG. 2 is a block diagram illustrating synchronizing a transparent display with video using audio encoding of data.
  • a projector 30 projects content 31 for display on a transparent display 32 such as a PDLC display.
  • a video and audio source 34 provides the video content with associated audio content to projector 30 for projection onto transparent display 32 .
  • the audio content from video and audio source 34 is decoded to provide decoded audio 36 , corresponding with pixel data output 26 , which is used to synchronize transparent display 32 with the video content projected upon it.
  • video content includes still images as well as moving images.
  • PDLC displays have pixels that can be switched to transmit light in a clear state, or scatter light in a hazy state.
  • the pixels In the clear state, the pixels are sufficiently transparent to permit a viewer to see through those pixels of the display.
  • In the hazy state, the pixels In the hazy state, the pixels are sufficiently opaque for a viewer to see the video content projected upon those pixels of the display.
  • the term “pixel” includes any particular portion or segment of the display.
  • the display may have one or more pixels.
  • the pixels of the PDLC display must match the video content so that the video content is projected onto pixels having the hazy state.
  • the encoded pixel data is recorded on the audio track of the video in video and audio source 34 .
  • the encoded data will be played as an audio track, and decoded audio 36 is used to control switching of pixels in transparent display 32 such that the projected video is displayed on pixels in the hazy state.
  • decoded audio 36 is also used to set the pixels not receiving the projected video to the clear state.
  • FIG. 3 is a flow chart of a method 40 for audio encoding of data.
  • Method 40 can be implemented in software, for example, for execution by processor 20 in system 10 .
  • the system waits for audio input (step 42 ), which the system receives from the audio content in video and audio source 34 .
  • the system counts the number of rising edges of the signal over a short period of time (step 44 ). As the frequency increases, the counts increase accordingly.
  • Each count is correlated to a specific pixel pattern (step 46 ). Based upon the correlated counts, a digital high signal is output to switch a particular pixel on in transparent display 32 , and a digital low signal is output to switch a particular pixel off in transparent display 32 (step 48 ).
  • the method repeats to continue decoding audio signals for synchronizing the projected video content from video and audio source 34 with the switching of pixels in transparent display 32 .
  • Table 1 illustrates correlating pixel counts with pixel patterns and the on and off states for the pixels in each pattern.
  • This correlation can be stored in memory, such as memory 21 , for retrieving the corresponding pixel patterns to synchronize the display with video content.
  • the particular pixel patterns can specify the (x, y) positions of the pixels to turn on as represented by pixels(x, y) and the (x, y) positions of the pixels to turn off as represented by pixels(x′, y′).
  • the pixel patterns can change, as determined by the counts, to continue to display the projected video onto pixels in the off (hazy) state.
  • FIG. 4 is a diagram illustrating use of audio encoded data to control switching of pixels in a transparent display.
  • a transparent display 50 is has pixels in a background portion 52 and a ring portion 54 both set to a hazy state to display video content, while pixels in ring portion 53 and center portion 56 are set to a clear state.
  • pixels in background portion 52 are still set to the hazy state and pixels in 53 are still set to a clear state, but pixels in ring portion 54 are now set to a clear state while pixels in center portion 56 are set to a hazy state to display video content in center portion 56 instead of ring portion 54 .
  • the configurations of pixels in clear and hazy states in the example of FIG. 4 can be stored as pixel patterns as illustrated in Table 1 and corresponding with particular counts.
  • Table 2 includes an example of BASIC code for implementing method 40 .
  • the code in Table 2 can be stored in a memory associated with decoder 12 , such as memory 21 , for execution by processor 20 .

Abstract

Synchronizing video content projected onto a transparent display with switching of pixels in the display. The transparent display has pixels capable of switching between a clear state to make portions of the display transparent and a hazy state to display the projected video. A decoder receives and decodes audio content associated with the video content in order to control the switching of the pixels in the display such that the video content is projected onto pixels in the hazy state.

Description

BACKGROUND
A switchable transparent display screen is useful for attracting consumer attention and providing information to customers. While in its transparent state, it allows customers to see through the screen and view products behind it. One such type of screen uses Polymer Dispersed Liquid Crystal (PDLC), which is a mixture of liquid crystal in a cured polymer network and is switchable between light transmitting and light scattering states. PDLC displays can be divided into pixels, drawing more attention by displaying projected video content on light scattering pixels while allowing customers to view the product through light transmitting pixels. For a multi-pixel PDLC display to be functional, the pixels must be synchronized with video content such that the video content is projected onto light scattering pixels for display while the other pixels can be set to a clear state. As the video content changes, the pixels need to be reset so that the video content continues to be projected onto the light scattering pixels for display.
SUMMARY
A system for synchronizing projected video content with a transparent display, consistent with the present invention, includes a projector for projecting video content having associated audio content and a transparent display for receiving and displaying the projected video content. The transparent display has pixels capable of switching between a clear state to make portions of the display transparent and a hazy state to display the projected video. A decoder receives and decodes the audio content in order to control the switching of the pixels in the display with the projected video content such that the video content is projected onto pixels in the hazy state.
A method for synchronizing projected video content with a transparent display, consistent with the present invention, comprises projecting video content having associated audio content to a transparent display and displaying the projected video content on the transparent display. The method also includes decoding the audio content in order to control the switching of the pixels in the display between clear and hazy states such that the projected video content is projected onto pixels in the hazy state.
BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawings are incorporated in and constitute a part of this specification and, together with the description, explain the advantages and principles of the invention. In the drawings,
FIG. 1 is a block diagram of a system for audio encoding of data to control a transparent display;
FIG. 2 is a block diagram illustrating use of audio encoding of data to synchronize video projected onto a transparent display with switching of the display;
FIG. 3 is a flow chart of a method for audio encoding of data to control a transparent display; and
FIG. 4 is a diagram illustrating use of audio encoded data to control a transparent display.
 DETAILED DESCRIPTION
Embodiments of the present invention include a method of encoding a control signal using audio tones. This signal can be sine or square waves with the frequency of the waves determining the data set being sent. The frequency can be in the ultrasonic range to send data faster and free the audio line for traditional use of providing audio with video. This signal can also be a series of DTMF (dual-tone multi-frequency) tones. Each tone, or series of tones, can represent a different set of data. Using stereo audio allows for more data to be transmitted or for error correction to be performed. The control signal can be used to encode pixel data in segmented transparent displays.
An example of a transparent display is described in U.S. patent application Ser. No. 13/675,121, entitled “Switchable Transparent Display,” and filed Nov. 13, 2012, which is incorporated herein by reference as if fully set forth.
FIG. 1 is a block diagram of a system 10 for audio encoding of data. System 10 includes a decoder 12 for decoding audio signals to provide a synchronization signal for a segmented transparent display. Decoder 12 includes a processor 20, or controller or circuitry, for decoding signals. A memory 21 can store software instructions for execution by processor 20. The audio signal can be square waves with the frequency of the waves determining the active pixels. The audio signal can also be a sine wave. Pixel information can be encoded in sine waves using several methods. Encoding can be done using a single frequency for each pixel arrangement. It can also be encoded using DTMF tones. Each DTMF tone, or series of tones, can represent one pixel state. Additionally, a series of tones can play at the beginning of a video and contain data for synchronized pixel switching for the duration of the video, enabling sound to be played with the corresponding video. A sine or square wave 14 is provided to a comparator 16, which generates a corresponding digital square wave 18.
Processor 20 received digital square wave 18 and decodes it to produce a pixel data output signal 26. Alternatively or in addition, processor 20 receives DTMF tones 24 and decodes the tones to generate pixel data output signal 26.
FIG. 2 is a block diagram illustrating synchronizing a transparent display with video using audio encoding of data. A projector 30 projects content 31 for display on a transparent display 32 such as a PDLC display. A video and audio source 34 provides the video content with associated audio content to projector 30 for projection onto transparent display 32. The audio content from video and audio source 34 is decoded to provide decoded audio 36, corresponding with pixel data output 26, which is used to synchronize transparent display 32 with the video content projected upon it. As used herein, “video content” includes still images as well as moving images.
PDLC displays have pixels that can be switched to transmit light in a clear state, or scatter light in a hazy state. In the clear state, the pixels are sufficiently transparent to permit a viewer to see through those pixels of the display. In the hazy state, the pixels are sufficiently opaque for a viewer to see the video content projected upon those pixels of the display. The term “pixel” includes any particular portion or segment of the display. The display may have one or more pixels.
The pixels of the PDLC display must match the video content so that the video content is projected onto pixels having the hazy state. When creating video content, the encoded pixel data is recorded on the audio track of the video in video and audio source 34. When the video is played back with the video content projected onto transparent display 32, the encoded data will be played as an audio track, and decoded audio 36 is used to control switching of pixels in transparent display 32 such that the projected video is displayed on pixels in the hazy state. Preferably, decoded audio 36 is also used to set the pixels not receiving the projected video to the clear state.
FIG. 3 is a flow chart of a method 40 for audio encoding of data. Method 40 can be implemented in software, for example, for execution by processor 20 in system 10. In method 40, the system waits for audio input (step 42), which the system receives from the audio content in video and audio source 34. When receiving audio input, the system counts the number of rising edges of the signal over a short period of time (step 44). As the frequency increases, the counts increase accordingly. Each count is correlated to a specific pixel pattern (step 46). Based upon the correlated counts, a digital high signal is output to switch a particular pixel on in transparent display 32, and a digital low signal is output to switch a particular pixel off in transparent display 32 (step 48). The method repeats to continue decoding audio signals for synchronizing the projected video content from video and audio source 34 with the switching of pixels in transparent display 32.
Table 1 illustrates correlating pixel counts with pixel patterns and the on and off states for the pixels in each pattern. This correlation can be stored in memory, such as memory 21, for retrieving the corresponding pixel patterns to synchronize the display with video content. In the pixel states, the particular pixel patterns can specify the (x, y) positions of the pixels to turn on as represented by pixels(x, y) and the (x, y) positions of the pixels to turn off as represented by pixels(x′, y′). As the projected video is displayed on the transparent display, the pixel patterns can change, as determined by the counts, to continue to display the projected video onto pixels in the off (hazy) state.
TABLE 1
Count Pixel Pattern Pixel States
Count 1 Pixel Pattern 1 Pattern 1 pixels(x, y) - on;
Pattern 1 pixels(x′, y′) - off
Count 2 Pixel Pattern 2 Pattern 2 pixels(x, y) - on;
Pattern 2 pixels(x′, y′) - off
. . . . . . . . .
Count N Pixel Pattern N Pattern N pixels(x, y) - on;
Pattern N pixels(x′, y′) - off
FIG. 4 is a diagram illustrating use of audio encoded data to control switching of pixels in a transparent display. A transparent display 50 is has pixels in a background portion 52 and a ring portion 54 both set to a hazy state to display video content, while pixels in ring portion 53 and center portion 56 are set to a clear state. As the video changes, pixels in background portion 52 are still set to the hazy state and pixels in 53 are still set to a clear state, but pixels in ring portion 54 are now set to a clear state while pixels in center portion 56 are set to a hazy state to display video content in center portion 56 instead of ring portion 54. The configurations of pixels in clear and hazy states in the example of FIG. 4 can be stored as pixel patterns as illustrated in Table 1 and corresponding with particular counts.
Table 2 includes an example of BASIC code for implementing method 40. For example, the code in Table 2 can be stored in a memory associated with decoder 12, such as memory 21, for execution by processor 20.
TABLE 2
‘----------------------------------------------------------------------------
‘I/O Definitions
‘----------------------------------------------------------------------------
INPUT 15
OUTPUT 10
OUTPUT 11
OUTPUT 12
OUTPUT 13
OUTPUT 8
‘----------------------------------------------------------------------------
‘Constant and Variable Definitions
‘----------------------------------------------------------------------------
Reps VAR Word
freq VAR Word
‘----------------------------------------------------------------------------
‘Program
‘----------------------------------------------------------------------------
Main:
 Pattern1:   ‘Determines PDLC Pattern (1=on (clear) 0=off (hazy))
 OUT10 = 0
 OUT11 = 1
 OUT12 = 1
 OUT13 = 1
 GOTO Cycle1   ‘After pixel pattern is set, jumps to “Cycle1”
 Pattern2:
 OUT10 = 0
 OUT11 = 0
 OUT12 = 0
 OUT13 = 0
 GOTO Cycle1
 Pattern3:
 OUT10 = 1
 OUT11 = 1
 OUT12 = 0
 OUT13 = 0
 GOTO Cycle1
 Pattern4:
 OUT10 = 1
 OUT11 = 1
 OUT12 = 1
 OUT13 = 1
 GOTO Cycle1
 Cyclel:
 FOR Reps = 1 TO 10000   ‘Begin Cycle (10000 is arbitrary)
 COUNT 15, 8, freq   ‘Determines the freq of the sound signal, also sets the freq of
the waveform
 IF freq < 4 THEN   ‘If there is no sound signal, go to the next loop
  GOTO Cycle2
 ENDIF
 NEXT     ‘If there is a sound signal, repeat loop
 GOTO Cycle1
 Cycle2:
 FOR Reps = 1 TO 10000
 COUNT 15, 8, freq
 IF freq > 4 THEN   ‘If there is a sound signal, go to the next loop
  GOTO Cycle3
 ENDIF     ‘If there is no sound signal, repeat loop
 NEXT
 GOTO Cycle2
 Cycle3:
 FOR Reps = 1 TO 10000
 COUNT 15, 8, freq
 ELSEIF freq > 28 THEN ‘Determine the frequency of sound input, go to
corresponding pattern
  GOTO Pattern1
 ELSEIF freq > 20 THEN
  GOTO Pattern2
 ELSEIF freq > 12 THEN
  GOTO Pattern3
 ELSEIF freq > 4 THEN
  GOTO Pattern4
 ENDIF
 GOTO Cycle2
 NEXT
GOTO Main

Claims (20)

The invention claimed is:
1. A system for synchronizing projected video content with a transparent display, comprising:
a projector configured to receive video content and project the video content, wherein the video content has an associated audio content;
a transparent display for receiving the projected video content and having one or more pixels capable of switching between a clear state and a hazy state; and
a decoder for controlling the switching of the one or more pixels in the display between the clear and hazy states,
wherein the decoder receives the audio content and decodes the audio content in order to synchronize the switching of the one or more pixels with the projected video content on the display such that the projected video content is projected onto one or more pixels in the hazy state.
2. The system of claim 1, wherein the decoder decodes audio tones in the audio content.
3. The system of claim 2, wherein the decoder determines a count from the audio tones, and the count corresponds with a particular pixel pattern on the display.
4. The system of claim 2, wherein the audio tones comprise a digital square wave.
5. The system of claim 2, wherein the audio tones comprise dual-tone multi-frequency tones.
6. The system of claim 2, wherein the decoded audio tones are within an ultrasonic range of the audio content.
7. The system of claim 1, wherein the transparent display comprises a polymer dispersed liquid crystal display.
8. The system of claim 1, wherein the transparent display comprises a plurality of pixels, and wherein the decoder synchronizes the plurality of pixels such that the pixels not receiving the projected video content are in the clear state.
9. The system of claim 1, wherein the decoded audio content corresponds with a stored pixel pattern for displaying the projected video content.
10. A method for synchronizing projected video content with a transparent display, comprising:
projecting video content to a transparent display, wherein the video content has an associated audio content;
displaying the projected video content on the transparent display, wherein the transparent display has one or more pixels capable of switching between a clear state and a hazy state; and
decoding the audio content in order to control the switching of the one or more pixels in the display between the clear and hazy states, comprising synchronizing the switching of the one or more pixels with the projected video content on the display such that the projected video content is projected onto one or more pixels in the hazy state.
11. The method of claim 10, wherein the decoding step comprises decoding audio tones in the audio content.
12. The method of claim 11 wherein the decoding step comprises determining a count from the audio tones, wherein the count corresponds with a particular pixel pattern on the display.
13. The method of claim 11, wherein the decoding step comprises decoding a digital square wave.
14. The method of claim 11, wherein the decoding step comprises decoding dual-tone multi-frequency tones.
15. The method of claim 11, wherein the decoding step comprises decoding audio tones within an ultrasonic range of the audio content.
16. The method of claim 10, wherein the displaying step comprises displaying the projected video content on a polymer dispersed liquid crystal display.
17. The method of claim 10, wherein the transparent display comprises a plurality of pixels, and wherein the decoding step comprises synchronizing the plurality of pixels such that the pixels not receiving the projected video content are in the clear state.
18. The method of claim 10, wherein the decoding step comprises retrieving a stored pixel pattern for displaying the projected video content.
19. A system for synchronizing projected video content with a transparent display, comprising:
a projector configured to receive video content and project the video content, wherein the video content has an associated audio content;
a transparent display for receiving the projected video content and having pixels capable of switching between a clear state and a hazy state; and
a decoder for controlling the switching of the pixels in the display between the clear and hazy states,
wherein the decoder receives the audio content and decodes the audio content in order to select a particular pixel pattern for the transparent display such that the pixels receiving the projected video content are in the hazy state and the pixels not receiving the projected video content are in the clear state.
20. The system of claim 19, wherein the decoder selects the particular pixel pattern by determining a frequency count within the audio content.
US13/948,382 2013-07-23 2013-07-23 Audio encoding of control signals for displays Expired - Fee Related US9137542B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/948,382 US9137542B2 (en) 2013-07-23 2013-07-23 Audio encoding of control signals for displays

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US13/948,382 US9137542B2 (en) 2013-07-23 2013-07-23 Audio encoding of control signals for displays

Publications (2)

Publication Number Publication Date
US20150029395A1 US20150029395A1 (en) 2015-01-29
US9137542B2 true US9137542B2 (en) 2015-09-15

Family

ID=52390210

Family Applications (1)

Application Number Title Priority Date Filing Date
US13/948,382 Expired - Fee Related US9137542B2 (en) 2013-07-23 2013-07-23 Audio encoding of control signals for displays

Country Status (1)

Country Link
US (1) US9137542B2 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113316013B (en) * 2021-05-31 2022-04-26 烽火通信科技股份有限公司 Video screen projection method and system

Citations (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3576364A (en) 1969-05-20 1971-04-27 Rca Corp Color advertising display employing liquid crystal
US3718712A (en) 1971-03-01 1973-02-27 Minnesota Mining & Mfg Pressure-sensitive adhesives based on cyclic terpene urethane resin
GB1380714A (en) 1970-11-17 1975-01-15 Vogel P S Television image modulator
GB2066992A (en) 1979-12-31 1981-07-15 Electronic Roomfinders Inland Information displays
DE4215868A1 (en) 1992-05-14 1993-11-18 Interpane Entw & Beratungsges Mfg. micro-encapsulated liq. crystal system - having electrically switchable optical transmission
US5516455A (en) 1993-05-03 1996-05-14 Loctite Corporation Polymer dispersed liquid crystals in radiation curable electron-rich alkene-thiol polymer mixtures
WO2002039475A2 (en) 2000-11-07 2002-05-16 Citala Ltd. Electrically addressable matrix structure
US6671008B1 (en) 1991-11-27 2003-12-30 Reveo, Inc. Electro-optical glazing structures having scattering and transparent modes of operation and methods and apparatus for making the same
US6996532B2 (en) 2000-12-07 2006-02-07 Hewlett-Packard Development Company, L.P. Method and apparatus for accessing a content site with a sound sequence
US7005394B1 (en) 1998-07-10 2006-02-28 3M Innovative Properties Company Tackified thermoplastic-epoxy pressure sensitive adhesives
US7009665B2 (en) 1995-10-30 2006-03-07 Le Li Electro-optical glazing structures having scattering and transparent modes of operation and methods and apparatus for making the same
US20060087585A1 (en) * 2004-10-26 2006-04-27 Samsung Electronics Co., Ltd. Apparatus and method for processing an image signal in a digital broadcast receiver
US20060182401A1 (en) 2004-10-14 2006-08-17 Optimer Photonics, Inc. Liquid crystal materials and electrooptic devices with a liquid crystal-containing cladding
US20060216523A1 (en) 2003-08-19 2006-09-28 Shunsuke Takaki Pressure-sensitive adhesive tape and pressure-sensitive adhesive composition for medical adhesive tape
US20070082969A1 (en) 2003-10-27 2007-04-12 Ranjit Malik Poly (alkylene oxide) polymer-based pressure sensitive adhesive and tapes formed therefrom
JP2007095472A (en) 2005-09-28 2007-04-12 Clarion Co Ltd Illumination device, control method, and control program
US7259730B2 (en) 2001-06-12 2007-08-21 Vlyte Innovations, Ltd. Window, a method for displaying a character on a window, and a visual display panel
US7336271B2 (en) 2002-09-03 2008-02-26 Optrex Corporation Image display system
US20090213110A1 (en) * 2004-06-25 2009-08-27 Shuhei Kato Image mixing apparatus and pixel mixer
US20090219253A1 (en) 2008-02-29 2009-09-03 Microsoft Corporation Interactive Surface Computer with Switchable Diffuser
WO2009150579A2 (en) 2008-06-11 2009-12-17 Koninklijke Philips Electronics N. V. Rear projection system and rear projection screen
US20100060826A1 (en) 2006-04-13 2010-03-11 Universite De Mons Hainaut Pdlc films
US20100066928A1 (en) 2008-09-15 2010-03-18 Gojo Industries, Inc. System for selectively revealing indicia
US20100294679A1 (en) 2009-05-25 2010-11-25 Philip Morris Usa Inc. Merchandising unit with switchable glass panel
US20100309390A1 (en) * 2009-06-03 2010-12-09 Honeywood Technologies, Llc Multimedia projection management
US7862898B2 (en) 2005-09-08 2011-01-04 3M Innovative Properties Company Adhesive composition and articles made therefrom
US7892649B2 (en) 2005-09-08 2011-02-22 3M Innovative Properties Company Microstructured adhesive article and articles made therefrom
KR20110030410A (en) 2009-09-17 2011-03-23 한화폴리드리머 주식회사 Smart window device and manufacturing method thereof
US20110069242A1 (en) * 2008-03-28 2011-03-24 Sanyo Electric Co., Ltd. Projection desplay apparatus
US20110080553A1 (en) 2008-03-14 2011-04-07 Gang Sun Electrically controlled medium for modulating light
EP2362384A1 (en) 2010-02-26 2011-08-31 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Watermark generator, watermark decoder, method for providing a watermark signal, method for providing binary message data in dependence on a watermarked signal and a computer program using improved synchronization concept
US8042949B2 (en) 2008-05-02 2011-10-25 Microsoft Corporation Projection of images onto tangible user interfaces
US20120203560A1 (en) 2011-02-04 2012-08-09 Jens Kristian Poulsen Systems and methods for encoding control messages in an audio bitstream
US8442264B2 (en) 1995-07-27 2013-05-14 Digimarc Corporation Control signals in streaming audio or video indicating a watermark
WO2013173070A1 (en) 2012-05-18 2013-11-21 3M Innovative Properties Company Corona patterning of overcoated nanowire transparent conducting coatings
US20140132909A1 (en) * 2012-11-13 2014-05-15 3M Innovative Properties Company Switchable transparent display

Patent Citations (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3576364A (en) 1969-05-20 1971-04-27 Rca Corp Color advertising display employing liquid crystal
GB1380714A (en) 1970-11-17 1975-01-15 Vogel P S Television image modulator
US3718712A (en) 1971-03-01 1973-02-27 Minnesota Mining & Mfg Pressure-sensitive adhesives based on cyclic terpene urethane resin
GB2066992A (en) 1979-12-31 1981-07-15 Electronic Roomfinders Inland Information displays
US6671008B1 (en) 1991-11-27 2003-12-30 Reveo, Inc. Electro-optical glazing structures having scattering and transparent modes of operation and methods and apparatus for making the same
DE4215868A1 (en) 1992-05-14 1993-11-18 Interpane Entw & Beratungsges Mfg. micro-encapsulated liq. crystal system - having electrically switchable optical transmission
US5516455A (en) 1993-05-03 1996-05-14 Loctite Corporation Polymer dispersed liquid crystals in radiation curable electron-rich alkene-thiol polymer mixtures
US8442264B2 (en) 1995-07-27 2013-05-14 Digimarc Corporation Control signals in streaming audio or video indicating a watermark
US7009665B2 (en) 1995-10-30 2006-03-07 Le Li Electro-optical glazing structures having scattering and transparent modes of operation and methods and apparatus for making the same
US7005394B1 (en) 1998-07-10 2006-02-28 3M Innovative Properties Company Tackified thermoplastic-epoxy pressure sensitive adhesives
WO2002039475A2 (en) 2000-11-07 2002-05-16 Citala Ltd. Electrically addressable matrix structure
US6996532B2 (en) 2000-12-07 2006-02-07 Hewlett-Packard Development Company, L.P. Method and apparatus for accessing a content site with a sound sequence
US7259730B2 (en) 2001-06-12 2007-08-21 Vlyte Innovations, Ltd. Window, a method for displaying a character on a window, and a visual display panel
US7336271B2 (en) 2002-09-03 2008-02-26 Optrex Corporation Image display system
US20060216523A1 (en) 2003-08-19 2006-09-28 Shunsuke Takaki Pressure-sensitive adhesive tape and pressure-sensitive adhesive composition for medical adhesive tape
US20070082969A1 (en) 2003-10-27 2007-04-12 Ranjit Malik Poly (alkylene oxide) polymer-based pressure sensitive adhesive and tapes formed therefrom
US20090213110A1 (en) * 2004-06-25 2009-08-27 Shuhei Kato Image mixing apparatus and pixel mixer
US20060182401A1 (en) 2004-10-14 2006-08-17 Optimer Photonics, Inc. Liquid crystal materials and electrooptic devices with a liquid crystal-containing cladding
US20060087585A1 (en) * 2004-10-26 2006-04-27 Samsung Electronics Co., Ltd. Apparatus and method for processing an image signal in a digital broadcast receiver
US7862898B2 (en) 2005-09-08 2011-01-04 3M Innovative Properties Company Adhesive composition and articles made therefrom
US7892649B2 (en) 2005-09-08 2011-02-22 3M Innovative Properties Company Microstructured adhesive article and articles made therefrom
JP2007095472A (en) 2005-09-28 2007-04-12 Clarion Co Ltd Illumination device, control method, and control program
US20100060826A1 (en) 2006-04-13 2010-03-11 Universite De Mons Hainaut Pdlc films
US20090219253A1 (en) 2008-02-29 2009-09-03 Microsoft Corporation Interactive Surface Computer with Switchable Diffuser
US20110080553A1 (en) 2008-03-14 2011-04-07 Gang Sun Electrically controlled medium for modulating light
US20110069242A1 (en) * 2008-03-28 2011-03-24 Sanyo Electric Co., Ltd. Projection desplay apparatus
US8042949B2 (en) 2008-05-02 2011-10-25 Microsoft Corporation Projection of images onto tangible user interfaces
WO2009150579A2 (en) 2008-06-11 2009-12-17 Koninklijke Philips Electronics N. V. Rear projection system and rear projection screen
US20100066928A1 (en) 2008-09-15 2010-03-18 Gojo Industries, Inc. System for selectively revealing indicia
US20100294679A1 (en) 2009-05-25 2010-11-25 Philip Morris Usa Inc. Merchandising unit with switchable glass panel
US20100309390A1 (en) * 2009-06-03 2010-12-09 Honeywood Technologies, Llc Multimedia projection management
KR20110030410A (en) 2009-09-17 2011-03-23 한화폴리드리머 주식회사 Smart window device and manufacturing method thereof
EP2362384A1 (en) 2010-02-26 2011-08-31 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Watermark generator, watermark decoder, method for providing a watermark signal, method for providing binary message data in dependence on a watermarked signal and a computer program using improved synchronization concept
US20120203560A1 (en) 2011-02-04 2012-08-09 Jens Kristian Poulsen Systems and methods for encoding control messages in an audio bitstream
WO2013173070A1 (en) 2012-05-18 2013-11-21 3M Innovative Properties Company Corona patterning of overcoated nanowire transparent conducting coatings
US20140132909A1 (en) * 2012-11-13 2014-05-15 3M Innovative Properties Company Switchable transparent display

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
Fuh, "Studies of Polymer-Stabilized Cholesteric Texture Films", Display Technologies III, Proceedings. Of SPIE, Jun. 30, 2000, vol. 4079, pp. 184-190.
Li, "Multifunctional window glazing", SPIE Newsroom, Mar. 19, 2008, 2 pages.
Mauer, Cholesteric Reflectors with a Color Pattern, Paper 26.1, 1994 SID International Symposium, Digest of Technical Papers, vol. XXV, May 1994, pp. 399-402.
Roberts, U.S. Appl. No. 13/675,130, entitled "Optical Stack Including Light Extraction Layer and Polymer Dispersed Liquid Crystal Layer", filed on Nov. 13, 2012.
Satoh, "80.2: 60-inch Highly Transparent See-through Active Matrix Display without Polarizers", SID Symposium Digest of Technical Papers, May 2010, vol. 41, No. 1, pp. 1192-1195.
Wardhana, U.S. Appl. No. 13/675,121, entitled "Switchable Transparent Display," filed Nov. 13, 2012.
Weber, U.S. Appl. No. 13/948,371, entitled "Addressable Switchable Transparent Display," filed Jul. 23, 2013.

Also Published As

Publication number Publication date
US20150029395A1 (en) 2015-01-29

Similar Documents

Publication Publication Date Title
CN105120325B (en) A kind of information transferring method and system
TWI620162B (en) Display method and display system for video wall
CN102473394B (en) Liquid crystal display device
CN108495152B (en) Video live broadcast method and device, electronic equipment and medium
KR101075122B1 (en) Apparatus for synchronizing of special effect and 4d projecting ststem
US20110090324A1 (en) System and method of displaying three dimensional images using crystal sweep with freeze tag
KR101971792B1 (en) Method and device for playing video
US20100194857A1 (en) Method of stereoscopic 3d viewing using wireless or multiple protocol capable shutter glasses
GB2526805A (en) Methods, apparatuses and computer programs for adapting content
KR100902013B1 (en) Tiled-display system and synchronization method in the system
US20130187832A1 (en) Display apparatus and method for controlling the same
WO2018121012A1 (en) Method and apparatus for controlling synchronization output of digital matrix, and electronic device
KR101970358B1 (en) Central server and performance system including central server
CN106658134A (en) Time synchronization method for ambient light television and ambient light television
US20180367768A1 (en) Projection system, projector, and method for controlling projection system
EP3640933A1 (en) Display system, video processing device, pixel shift display device, video processing method, display method, and program
CN110012336A (en) Picture configuration method, terminal and the device at interface is broadcast live
CN110134487A (en) Dynamic skin change method, readable storage medium storing program for executing and the computer equipment at interface is broadcast live
CN113467741A (en) Screen transmission method, display device and screen transmission system thereof
US9137542B2 (en) Audio encoding of control signals for displays
CN109963185B (en) Video data sending method, video display method, device, system and equipment
CN110166733B (en) Pre-monitoring method and device, output box, server and splicing system
CN103888808A (en) Video display method, display device, auxiliary device and system
CN106484355A (en) A kind of one screen multimode display methods of LED screen and system
JP2018085671A (en) Digital signage system

Legal Events

Date Code Title Description
AS Assignment

Owner name: 3M INNOVATIVE PROPERTIES COMPANY, MINNESOTA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WEBER, BRIAN T.;STEIN, BENJAMIN K.;CAMPBELL, PATRICK M.;SIGNING DATES FROM 20131105 TO 20131107;REEL/FRAME:031637/0192

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20230915