US20110157326A1

US20110157326A1 - Multi-path and multi-source 3d content storage, retrieval, and delivery

Info

Publication number: US20110157326A1
Application number: US12/982,330
Authority: US
Inventors: Jeyhan Karaoguz; James D. Bennett
Original assignee: Broadcom Corp
Current assignee: Avago Technologies International Sales Pte Ltd
Priority date: 2009-12-31
Filing date: 2010-12-30
Publication date: 2011-06-30
Also published as: US20110157168A1; US8767050B2; EP2346021B1; US8922545B2; US9654767B2; TW201142357A; US8988506B2; US20110157257A1; US20110157330A1; US20110157170A1; US20110157167A1; US20110157327A1; US20110157339A1; US20110161843A1; US20110164111A1; TWI467234B; US20110157336A1; US20110157697A1; US9979954B2; CN102183841B

Abstract

Techniques are described herein for supporting presentation of multi-path and multi-source viewing content. For example, portions of three-dimensional viewing content may be received via respective pathways from respective sources. A visual presentation of the three-dimensional viewing content may be caused based on the portions. In another example, instances of viewing content may be received via respective pathways from respective sources. Configurations of respective regions of a screen may be directed to support display of the respective instances.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of U.S. Provisional Application No. 61/291,818, filed on Dec. 31, 2009, which is incorporated by reference herein in its entirety.
This application also claims the benefit of U.S. Provisional Application No. 61/303,119, filed on Feb. 10, 2010, which is incorporated by reference herein in its entirety.
This application is also related to the following U.S. patent applications, each of which also claims the benefit of U.S. Provisional Patent Application Nos. 61/291,818 and 61/303,119 and each of which is incorporated by reference herein:

- U.S. patent application Ser. No. 12/774,225, filed on May 5, 2010, and entitled “Controlling a Pixel Array to Support an Adaptable Light Manipulator”;
- U.S. patent application Ser. No. 12/774,307, filed on May 5, 2010, and entitled “Display with Elastic Light Manipulator”;
- U.S. patent application Ser. No. 12/845,409, filed on Jul. 28, 2010, and entitled “Display With Adaptable Parallax Barrier”;
- U.S. patent application Ser. No. 12/845,440, filed on Jul. 28, 2010, and entitled “Adaptable Parallax Barrier Supporting Mixed 2D and Stereoscopic 3D Display Regions”;
- U.S. patent application Ser. No. 12/845,461, filed on Jul. 28, 2010, and entitled “Display Supporting Multiple Simultaneous 3D Views”;
- U.S. patent application Ser. No. ______ (Attorney Docket No. A05.01210000), filed on even date herewith and entitled “Backlighting Array Supporting Adaptable Parallax Barrier”;
- U.S. patent application Ser. No. ______ (Attorney Docket No. A05.01240000), filed on even date herewith and entitled “Coordinated Driving of Adaptable Light Manipulator, Backlighting and Pixel Array in Support of Adaptable 2D and 3D Displays”; and
- U.S. patent application Ser. No. ______ (Attorney Docket No. A05.01330000), filed on even date herewith and entitled “Video Compression Supporting Selective Delivery of 2D, Stereoscopic 3D and Multi-View 3D Content”.

BACKGROUND OF THE INVENTION

1. Field of the Invention
The present invention relates to techniques for supporting presentation of multi-path and multi-source viewing content.
2. Background Art
Images may be generated for display in various forms. For instance, television (TV) is a widely used telecommunication medium for transmitting and displaying images in monochromatic (“black and white”) or color form. Conventionally, images are provided in analog form and are displayed by display devices in two dimensions. More recently, images are being provided in digital form for display in two dimensions on display devices having improved resolution (e.g., “high definition” or “HD”). Even more recently, images capable of being displayed in three dimensions are being generated.
Conventional displays may use a variety of techniques to achieve three-dimensional (3D) image viewing functionality. For example, various types of glasses have been developed that may be worn by users to view three-dimensional images displayed by a conventional display. Examples of such glasses include glasses that utilize color filters or polarized filters. In each case, the lenses of the glasses pass two-dimensional (2D) images of differing perspective to the user's left and right eyes. The images are combined in the visual center of the brain of the user to be perceived as a three-dimensional image. In another example, synchronized left eye, right eye liquid crystal display (LCD) shutter glasses may be used with conventional two-dimensional image displays to create a three-dimensional viewing illusion. In still another example, LCD display glasses are being used to display three-dimensional images to a user. The lenses of the LCD display glasses include corresponding displays that provide images of differing perspective to the user's eyes, to be perceived by the user as three-dimensional.
Problems exist with such techniques for viewing three-dimensional images. For instance, persons that use such displays and systems to view three-dimensional images may suffer from headaches, eyestrain, and/or nausea after long exposure. Furthermore, some content, such as two-dimensional text, may be more difficult to read and interpret when displayed three-dimensionally. To address these problems, some manufacturers have created display devices that may be toggled between three-dimensional viewing and two-dimensional viewing. A display device of this type may be switched to a three-dimensional mode for viewing of three-dimensional images, and may be switched to a two-dimensional mode for viewing of two-dimensional images (and/or to provide a respite from the viewing of three-dimensional images).
A parallax barrier is another example of a device that enables images to be displayed in three-dimensions. A parallax barrier includes a layer of material with a series of precision slits. The parallax barrier is placed proximal to a display so that each of a user's eyes sees a different set of pixels to create a sense of depth through parallax. A disadvantage of parallax barriers is that the viewer must be positioned in a well-defined location in order to experience the three-dimensional effect. If the viewer moves his/her eyes away from this “sweet spot,” image flipping and/or exacerbation of the eyestrain, headaches and nausea that may be associated with prolonged three-dimensional image viewing may result. Conventional three-dimensional displays that utilize parallax barriers are also constrained in that the displays must be entirely in a two-dimensional image mode or a three-dimensional image mode at any time.
Some conventional devices are capable of receiving portions of 2D content from different sources to be presented on a single screen. Other conventional devices are capable of receiving media guide text and program channels of media content wherein a remote control is used to produce guide text overlaying the media content on a single 2D screen. Similarly, a conventional browser may receive 2D graphic and textual content from many sources (e.g., different servers) and construct a single display within a single window. Yet other conventional devices are capable of receiving full 3D2 content from a single source. For example, such full 3D2 content may be downloaded from a server or retrieved from a removable or fixed storage. The single piece of 3D2 content can have a first portion that is destined for the left eye of a viewer and a second portion that is destined for the right eye of the viewer. These portions represent perspectives (a.k.a. camera views) of a common video event.

BRIEF SUMMARY OF THE INVENTION

Methods, systems, and apparatuses are described for supporting presentation of multi-path and multi-source viewing content as shown in and/or described herein in connection with at least one of the figures, as set forth more completely in the claims.

BRIEF DESCRIPTION OF THE DRAWINGS/FIGURES

The accompanying drawings, which are incorporated herein and form a part of the specification, illustrate the present invention and, together with the description, further serve to explain the principles of the invention and to enable a person skilled in the pertinent art to make and use the invention.

FIG. 1A is a block diagram of an exemplary system that supports presentation of portions of 3D content that are received from respective sources in accordance with an embodiment.

FIG. 1B is a block diagram of an exemplary system that supports presentation of multiple instances of content from respective sources in accordance with an embodiment.

FIG. 1C is a block diagram of an exemplary display system in accordance with an embodiment that utilizes an adaptable parallax barrier to support multiple viewing configurations.

FIG. 2 illustrates an exemplary arrangement of an adaptable parallax barrier in accordance with an embodiment that supports a particular three-dimensional viewing configuration.

FIG. 3 illustrates an exemplary arrangement of an adaptable parallax barrier in accordance with an alternate embodiment that supports a particular three-dimensional viewing configuration.

FIG. 4 illustrates an exemplary arrangement of an adaptable parallax barrier in accordance with an embodiment that supports a viewing configuration that mixes two-dimensional and three-dimensional viewing regions.

FIG. 5 illustrates an exemplary arrangement of an adaptable parallax barrier in accordance with an embodiment in which different orientations of transparent and opaque slits are used to simultaneously support different viewer orientations.

FIG. 6 depicts a flowchart of an exemplary method for controlling a pixel array to support a same viewing configuration as an adaptable light manipulator in accordance with an embodiment.

FIG. 7 depicts a flowchart of an alternate exemplary method for controlling a pixel array to support a same viewing configuration as an adaptable light manipulator in accordance with an embodiment.

FIG. 8 illustrates a portion of a pixel array to which image pixels have been mapped to support a two-dimensional viewing configuration of an adaptable light manipulator in accordance with an embodiment.

FIG. 9 illustrates how image pixels are mapped to the portion of the pixel array shown in FIG. 8 to support a first three-dimensional viewing configuration of an adaptable light manipulator in accordance with an embodiment.

FIG. 10 illustrates how image pixels are mapped to the portion of the pixel array shown in FIGS. 8 and 9 to support a second three-dimensional viewing configuration of an adaptable light manipulator in accordance with an embodiment.

FIG. 11 is a block diagram of an exemplary display system that utilizes an adaptable parallax barrier and a light generator to support multiple viewing configurations in accordance with an embodiment.

FIG. 12 provides an exploded view of an exemplary display system that utilizes a controllable backlight array to provide regional luminosity control in accordance with an embodiment.

FIG. 13 is a block diagram of an exemplary display system that includes a pixel array disposed between a light generator and an adaptable parallax barrier in accordance with an embodiment.

FIG. 14 provides an exploded view of an exemplary display system that implements a regional brightness control scheme based on pixel intensity in accordance with an embodiment.

FIG. 15 illustrates a front perspective view of an exemplary display panel of a display system in accordance with an embodiment.

FIG. 16 illustrates two exemplary configurations of an adaptable light manipulator that includes a parallax barrier and a brightness regulation overlay in accordance with an embodiment.

FIG. 17 shows a perspective view of an exemplary adaptable lenticular lens that may be used in a displays system in accordance with an embodiment.

FIG. 18 shows a side view of the adaptable lenticular lens of FIG. 17 in accordance with an embodiment.

FIG. 19 is a block diagram of an exemplary display system that includes multiple light manipulator layers in accordance with an embodiment.

FIG. 20 is a block diagram of an exemplary display system that includes multiple light manipulator layers in accordance with an alternate embodiment.

FIGS. 21 and 22 are block diagrams of exemplary systems that support presentation of three-dimensional viewing content based on portions thereof that are received from respective sources in accordance with embodiments.

FIGS. 23-29 depict flowcharts of methods for supporting presentation of three-dimensional viewing content based on portions thereof that are received from respective sources in accordance with embodiments.

FIG. 30 is a block diagram of an exemplary system that directs configurations of respective regions of a screen assembly to support display of respective instances of content in accordance with an embodiment.

FIG. 31 depicts a flowchart of a method for directing configurations of respective regions of a screen assembly for supporting display of respective instances of content in accordance with embodiments.

FIG. 32 is a block diagram of an exemplary practical implementation of an adaptable two-dimensional/three-dimensional display system in accordance with an embodiment.

The present invention will now be described with reference to the accompanying drawings. In the drawings, like reference numbers indicate identical or functionally similar elements. Additionally, the left-most digit(s) of a reference number identifies the drawing in which the reference number first appears.

DETAILED DESCRIPTION OF THE INVENTION

I. Introduction

The present specification discloses one or more embodiments that incorporate the features of the invention. The disclosed embodiment(s) merely exemplify the invention. The scope of the invention is not limited to the disclosed embodiment(s). The invention is defined by the claims appended hereto.
References in the specification to “one embodiment,” “an embodiment,” “an example embodiment,” etc., indicate that the embodiment described may include a particular feature, structure, or characteristic, but every embodiment may not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is submitted that it is within the knowledge of one skilled in the art to effect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described.
Furthermore, it should be understood that spatial descriptions (e.g., “above,” “below,” “up,” “left,” “right,” “down,” “top,” “bottom,” “vertical,” “horizontal,” etc.) used herein are for purposes of illustration only, and that practical implementations of the structures described herein can be spatially arranged in any orientation or manner.
Embodiments described herein provide systems and methods for supporting presentation of multi-path and multi-source viewing content. For instance, the viewing content may include multiple portions that originate from respective sources and that are received via respective paths. Each of the portions may include two-dimensional (2D) content or three-dimensional (3D) content. Two-dimensional (2D) content is content that is configured to be perceived as one or more two-dimensional images. For instance, the two-dimensional content may represent a single perspective of a video event. Three-dimensional (3D) content is content that is configured to be perceived as one or more three-dimensional images. For example, the three-dimensional content may represent multiple perspectives of a video event.
The viewing content may be displayed to a user among any number (e.g., 1, 2, 3, etc.) of regions of a screen, such as a fixed 2D screen, a fixed 3D screen, or an adaptable 3D screen. With respect to an adaptable 3D screen, the viewing content may be displayed among the regions by driving an adaptable light manipulator and/or a pixel array in a coordinated fashion. Some exemplary techniques for driving an adaptable light manipulator and/or a pixel array in a coordinated fashion are described in commonly-owned co-pending U.S. patent application Ser. No. ______, filed on even date herewith and entitled “Coordinated Driving of Adaptable Light Manipulator, Backlighting and Pixel Array in Support of Adaptable 2D and 3D Displays,” the entirety of which is incorporated by reference herein.
The adaptable light manipulator may comprise, for example, an adaptable lenticular lens such as that described in commonly-owned, co-pending U.S. patent application Ser. No. 12/774,307, filed on May 5, 2010, and entitled “Display with Elastic Light Manipulator,” the entirety of which is incorporated by reference herein, or an adaptable parallax barrier such as that described in commonly-owned co-pending U.S. patent application Ser. No. 12/845,440, filed on Jul. 28, 2010, and entitled “Adaptable Parallax Barrier Supporting Mixed 2D and Stereoscopic 3D Display Regions,” the entirety of which is incorporated by reference herein. As described in those applications, the adaptable light manipulator can be dynamically modified in order to accommodate, for example, a changing viewer sweet spot or switching between two-dimensional images and three-dimensional images. As further described in commonly-owned, co-pending U.S. patent application Ser. No. 12/774,225, filed on May 5, 2010 and entitled “Controlling a Pixel Array to Support an Adaptable Light Manipulator,” the entirety of which is incorporated by reference herein, the manner in which images are rendered to pixels of a pixel array used in conjunction with such an adaptable light manipulator may be coordinated with the state of the adaptable light manipulator to support a variety of viewing configurations.
Moreover, an adaptable light manipulator, a pixel array and a non-uniform light generator may be driven in a coordinated fashion. As described in the aforementioned, incorporated U.S. patent application Ser. No. 12/845,440, in a case of where the adaptable light manipulator is an adaptable parallax barrier, simultaneous presentation of two-dimensional and three-dimensional content (and/or various instances of three-dimensional content representing differing numbers of perspectives) via different regions of the same display is also enabled. This feature may be supported by a non-uniform light generator (such as a backlighting array) as described in commonly-owned, co-pending U.S. patent application Ser. No. ______, filed on even date herewith and entitled “Backlighting Array Supporting Adaptable Parallax Barrier”, the entirety of which is incorporated by reference herein.

II. Exemplary Display Systems that Support Multiple Viewing Configurations

FIG. 1A is a block diagram of an exemplary system 140 that supports presentation of portions of 3D content that are received from respective sources in accordance with an embodiment. As shown in FIG. 1A, system 140 includes a media node 160, external sources 194A-194N, and external device(s) 196. Each of the external device(s) 196 includes a fixed 2D screen 167, a fixed 3D screen 169, or an adaptable light manipulating 2D/3Dx screen 171. Each fixed 2D screen 167 has a fixed two-dimensional configuration. A two-dimensional configuration is used to display a 2D representation of video content. Each fixed 3D screen 169 has a fixed three-dimensional configuration. A three-dimensional configuration is used to display a 3D representation of video content. A three-dimensional configuration may support presentation of any two or more viewpoints (a.k.a. perspectives), two of which may be combined to provide a three-dimensional viewing experience. For instance, a three-dimensional configuration that includes x viewpoints is said to be a 3Dx configuration, where x is a positive integer greater than or equal to two.
Each fixed 2D screen 167, fixed 3D screen 169, and adaptable light manipulating 2D/3Dx screen 171 is capable of supporting presentation of 3D portions 161A-161N of 3D content in respective regions of a screen surface. Regions of each screen 167, 169, and 171 are configured to support presentation of the respective 3D portions 161A-161N in the respective regions of the screen surface. The configurations of the various regions of an adaptable light manipulating 2D/3Dx screen 171 may be different or the same. Some examples of an adaptable light manipulating 2D/3Dx screen are described in detail below with reference to FIGS. 1C and 2-20.
External sources 194A-194N are configured to provide the respective 3D portions 161A-161N of the 3D content to media node 160. External sources 194A-194N are also configured to provide respective offer contents 163A-163N to media node 160. Each of the offer contents 163A-163N includes an offer that relates to at least one 3D portion of the 3D content. For example, first external source 194A may provide a first 3D portion 161A to media node 160. First external source 194A may also provide first offer content 163A to media node 160 that relates to an Nth 3D portion 161N. If the offer from first external source 194A is accepted by a user, Nth external source 194N may provide the Nth 3D portion 161N to media node 160. Nth external source 194N may also provide Nth offer content 163N to media node 160 that relates to another 3D portion that may be provided by another of the external sources 194A-194N, and so on.
In another example, first external source 194A may provide the first 3D portion 161A to media node 160. Upon determining that the first 3D portion 161A is provided to media node 160, Nth external source 194N may provide Nth offer content 163N to media node 160 that relates to the Nth 3D portion 161N. If the offer from Nth external source 194N is accepted by the user, Nth external source 194N may provide the Nth 3D portion 161N to media node 160. Upon determining that the Nth 3D portion 161N is provided to media node 160, another of the external sources 194A-194N may provide its offer content to media node 160 that relates to a respective 3D portion of the 3D content, and so on.
External sources 194A-194N include circuitry 165A-165N for managing accounts, billing, licenses, and transactions pertaining to the 3D portions 161A-161N. For example, if first external source 194A provides first 3D portion 161A to media node 160, circuitry 165A may indicate that the first 3D portion 161A has been provided to media node 160 in an account of the user of media node 160. Circuitry 165A may perform operations to bill the user for provision of the first 3D portion 161A, verify that the user is within a group that is authorized (e.g., licensed) to receive the first 3D portion, etc.
Media node 160 includes processing circuitry 162, storage 176, a screen assembly 178, media source interface(s) circuitry 180, and screen interface(s) circuitry 192. Media source interface(s) circuitry 180 receives the 3D portions 161A-161N of the 3D content from the respective external sources 194A-194N for processing by processing circuitry 162. Storage 176 queues the 3D portions 161A-161N as needed so that the portions 161A-161N may be synchronized for presentation. Storage 176 may include one or more internal sources that provide respective portions of the 3D content. For instance, an internal source may include fixed or removable media storage from which one or more of the 3D portions 161A-161N may be retrieved. Screen assembly 178 is configured to present the 3D content (e.g., simultaneously present the 3D portions 161A-161N) once the 3D portions 161A-161N are synchronized. Screen assembly 178 may be a fixed 2D screen assembly, a fixed 3D screen assembly, or an adaptable light manipulating 2D/3Dx screen assembly.
Processing circuitry 162 includes circuitry 164, 166, 168, 170, 172, and 174 and 3D portion(s) adjustments circuitry 182. Circuitry 164 selects the first 3D portion 161A of the 3D content from first external source 194A. Circuitry 166 interacts with a second source (e.g., second external source 194B) to locate a second portion and offer based on the first 3D portion 161A. Circuitry 168 supports billing and account management regarding the various 3D portions 161A-161N. For instance, circuitry 168 may communicate with any one or more of external sources 194A-194N to facilitate proper billing and account updates regarding the respective 3D portions 161A-161N.
Circuitry 170 supports operations pertaining to acceptance or rejection of each offer that is received by media node 160. For instance, circuitry 170 may inform external sources 194A-194N whether offers that are received therefrom are accepted or rejected. Circuitry 172 initiates delivery of the second 3D portion from the second source in response to location of the second 3D portion by circuitry 166. Circuitry 174 manages delivery of the 3D portions 161A-161N. For instance, circuitry 174 may communicate with circuitry 172 to authorize initiation of delivery of the second portion by circuitry 172. Circuitry 174 also supports queuing of the 3D portions 161A-161N. For example, circuitry 174 may determine an amount of storage 176 to be allocated for queuing of the 3D portions 161A-161N. In accordance with this example, circuitry 174 may monitor an amount of storage 176 that is utilized to determine the amount of storage 176 to be allocated.
3D portion(s) adjustments circuitry 182 performs operations on the 3D portions 161A-161N to facilitate presentation of the 3D content. 3D portion(s) adjustments circuitry 182 includes circuitry 184, 186, 188, and 190. Circuitry 184 is configured to decode and/or decrypt the 3D portions 161A-161N that are received from respective external sources 194A-194N, so that processing may be performed on the 3D portions 161A-161N. For instance, such processing may be performed by circuitry 186, 188, and/or 190, which are described below. Circuitry 184 is also configured to encrypt and/or encode the 3D content, including the 3D portions 161A-161N, before the 3D content is delivered to external device(s) 196.
Circuitry 186 synchronizes frames of the 3D portions 161A-161N. For example, circuitry 186 may apply time offsets to one or more of the portions 161A-161N and/or adjust the frame rates of one or more of the 3D portions 161A-161N in order to facilitate synchronization of the 3D portions 161A-161N. In accordance with this example, circuitry 186 may increase the frames rates of one or more of the 3D portions 161A-161N, decrease the frame rates of one or more of the 3D portions 161A-161N, increase the frame rates of some of the 3D portions 161A-161N while decreasing the frame rates of others of the 3D portions 161A-161N, etc.
Circuitry 188 is configured to integrate the 3D portions 161A-161N into a single stream or file. Circuitry 190 is configured to resize the regions that are associated with the respective 3D portions 161A-161N based on any of a variety reasons, including but not limited to bandwidth limitations, user input, etc. Circuitry 190 may reduce the size of region(s) that are associated with one or more (e.g., all) of the 3D portions 161A-161N, increase the size of region(s) that are associated with one or more (e.g., all) of the 3D portions 161A-161N, or reduce the size of some regions which correspond to a first subset of the 3D portions 161A-161N while increasing the size of other regions which correspond to a second subset of the 3D portions 161A-161N. Circuitry 190 may reduce the resolution of one or more of the 3D portions 161A-161N, increase the resolution of one or more of the 3D portions 161A-161N, remove overlapping content from one or more of the 3D portions 161A-161N, crop one or more of the 3D portions 161A-161N (e.g., to fit a screen characteristic such as 3:4, 9:16, or windowing), etc. For instance, circuitry 190 may perform such operations based on resizing of the corresponding regions.
Screen interface(s) circuitry 192 provides the 3D content, including the 3D portions 161A-161N, to external device(s) 196 for presentation. Screen interface(s) circuitry 192 may provide the 3D portions 161A-161N in any suitable number of streams. For instance, screen interface(s) circuitry 192 may provide the 3D portions 161A-161N in respective streams or in a single combined stream to external device(s) 196.
For purposes of illustration, assume that a first portion comprising a desired video presentation is selected from an internal or external “first” source. This first portion may yield the presentation in 2D, for example, or 3D2. Either in response to a user's further search or “add” request (perhaps via a keypad or external remote control not shown, and at any time before or during the presentation of the first portion) or automatically based on the initial selection of the first portion, processing circuitry 160 assists or carries out location of a second portion of content related to the first portion. The internal or external location of the second portion is at a different source than that of the first portion.
An automatically identified second portion could be (but doesn't have to be) offered for possible rejection by the viewer. If accepted or if settings do not require the viewer's confirmation, processing work may be performed. For example, the second source portion may or may not have many differing characteristics from that of the first portion. Processing circuitry 160 may need to operate on at least one if not both of the portions to eliminate the differences. Processing circuitry 160 may synchronize, as well. For example, the first portion may be one-third of the way into the presentation, and the second portion may need an offset and synchronization. The output of processing circuitry 160 may be two independent files or streams or one combined stream. Such output may need to feed one or more fixed 2D, fixed 3D, and adaptive light manipulating internal or external screen assemblies. Processing circuitry 160 needs to make all of these things happen when needed, or provide support therefor. Other functionality of processing circuitry 160 can be appreciated with reference to the labels in the FIG. 1A, including payment processing, licensing, etc.
FIG. 1B is a block diagram of an exemplary system 150 that supports presentation of multiple instances of content from respective sources in accordance with an embodiment. As shown in FIG. 1B, system 150 includes a media node 101, external sources 131A-131N, and external device(s) 133. Each of the external device(s) 133 includes at least one adaptable light manipulating 2D/3Dx assembly. Each of the adaptable light manipulating 2D/3Dx assemblies is configured to receive media streams/files outputs with integrated or separate screen configuration commands (a.k.a. control signals). The screen commands specify how the regions of each adaptable light manipulating 2D/3Dx assembly is to be configured to support the presentation of the multiple instances of content. Some embodiments that include such adaptable light manipulating 2D/3Dx assemblies are discussed below with reference to FIGS. 1C and 2-20.
External sources 131A-131N are configured to provide respective contents 135A-135N to media node 101. The contents 135A-135N may be fully independent and unrelated, or fully or partially related. External sources 131A-131N are also configured to provide respective offer contents 137A-137N to media node 101. Each of the offer contents 137A-137N includes an offer that relates to at least one of the contents 135A-135N. For example, first external source 131A may provide first content 135A to media node 101. First external source 131A may also provide first offer content 137A to media node 101 that relates to Nth content 135N. If the offer from first external source 131A is accepted by a user, Nth external source 131N may provide the Nth content 135N to media node 101. Nth external source 131N may also provide Nth offer content 137N to media node 101 that relates to other content that may be provided by another of the external sources 131A-131N, and so on.
In another example, first external source 131A may provide the first content 135A to media node 101. Upon determining that the first content 135A is provided to media node 101, Nth external source 131N may provide Nth offer content 137N to media node 101 that relates to the Nth content 135N. If the offer from Nth external source 131N is accepted by the user, Nth external source 131N may provide the Nth content 135N to media node 101. Upon determining that the Nth content 135N is provided to media node 101, another of the external sources 131A-131N may provide its offer content to media node 101 that relates to other content, and so on.
External sources 131A-131N include circuitry 139A-139N for managing accounts, billing, licenses, and transactions pertaining to the contents 135A-135N. For example, if first external source 131A provides first content 135A to media node 101, circuitry 139A may indicate that the first content 135A has been provided to media node 101 in an account of the user of media node 101. Circuitry 139A may perform operations to bill the user for provision of the first content 135A, verify that the user is within a group that is authorized (e.g., licensed) to receive the first content, etc.
Media node 101 includes processing circuitry 103, storage 115, at least one adaptable light manipulating 2D/3Dx screen assembly 117, media source interface(s) circuitry 119, and screen interface(s) circuitry 129. Media source interface(s) circuitry 119 receives the contents 135A-135N from the respective external sources 131A-131N for processing by processing circuitry 103. Storage 115 queues the contents 135A-135N as needed so that the contents 135A-135N may be synchronized for presentation. Storage 115 may include one or more internal sources, each of which is capable of providing respective content. For instance, an internal source may include fixed or removable media storage from which one or more of the contents 135A-135N may be retrieved. The at least one screen assembly 117 is configured to simultaneously present the contents 135A-135N once the contents 135A-135N are synchronized.
Processing circuitry 103 includes circuitry 105, 107, 109, 111, and 113 and content adjustments circuitry 121. Circuitry 105 provides software application (e.g., browser) based support for selection of the various contents 135A-135N. For instance, circuitry 105 may generate a graphical interface for enabling the viewer to select one or more of the contents 135A-135N for presentation. Circuitry 107 supports billing and account management regarding the various contents 135A-135N. For instance, circuitry 107 may communicate with any one or more of external sources 131A-131N to facilitate proper billing and account updates regarding the respective contents 135A-135N.
Circuitry 109 provides viewer interface support for enabling the viewer to accept or reject each offer that is received by media node 101. For instance, circuitry 109 may inform external sources 131A-131N whether offers that are received therefrom are accepted or rejected. Circuitry 111 manages delivery of the contents 135A-135N. For instance, circuitry 111 may delay delivery of the various contents 135A-135N until the contents 135A-135N are synchronized. Circuitry 111 also supports queuing of the contents 135A-135N. For example, circuitry 111 may determine an amount of storage 115 to be allocated for queuing of the contents 135A-135N. In accordance with this example, circuitry 111 may monitor an amount of storage 115 that is utilized to determine the amount of storage 115 to be allocated.
Circuitry 113 supports full and regional (re)configuration of adaptable light manipulating 2D/3Dx screen assemblies. For instance, circuitry 113 may provide screen (re)configuration commands for configuring an entire adaptable light manipulating 2D/3Dx screen assembly or one or more regions thereof based on any of a factors, including but not limited to bandwidth limitations, user input, etc. In one example, such screen (re)configuration commands may be integrated into the one or more streams/files that are delivered toward the screen assembly. In another example, such screen (re)configuration commands may be sent externally from the aforementioned one or more streams/files via separate command signaling using the same communication pathway or a separate pathway that is independent from the pathway that is used for delivering the one or more streams/files.
Content adjustments circuitry 121 performs operations on the contents 135A-135N to facilitate presentation thereof. Content adjustments circuitry 121 includes circuitry 123, 125, and 127. Circuitry 123 is configured to decode and/or decrypt the contents 135A-135N that are received from respective external sources 131A-131N, so that processing may be performed on the contents 135A-135N. For instance, such processing may be performed by circuitry 125 and/or 127, which are described below. Circuitry 123 is also configured to encrypt and/or encode the contents 135A-135N before delivery thereof to external device(s) 196.
Circuitry 125 supports outputting multiple streams or files or an integrated stream or file. For example, circuitry 125 may synchronize frames of the contents 135A-135N by applying time offsets to one or more of the contents 135A-135N and/or by adjusting the frame rates of one or more of the contents 135A-135N. In accordance with this example, circuitry 125 may increase the frames rates of one or more of the contents 135A-135N, decrease the frame rates of one or more of the contents 135A-135N, increase the frame rates of some of the contents 135A-135N while decreasing the frame rates of others of the contents 135A-135N, etc.
Circuitry 127 is configured to resize the regions that are associated with the contents 135A-135N based on any of a variety reasons, including but not limited to bandwidth limitations, user input, etc. Circuitry 127 may reduce the size of region(s) that are associated with one or more of the contents 135A-135N, increase the size of region(s) that are associated with one or more of the contents 135A-135N, or reduce the size of some regions which correspond to a first subset of the contents 135A-135N while increasing the size of other regions which correspond to a second subset of the contents 135A-135N. Circuitry 190 may reduce the resolution of one or more of the contents 135A-135N, increase the resolution of one or more of the contents 135A-135N, remove overlapping content from one or more of the contents 135A-135N, change (e.g., increase or decrease) a frame rate that is associated with one or more of the contents 135A-135N, crop one or more of the contents 135A-135N, etc. For instance, circuitry 127 may perform such operations based on resizing of the corresponding regions.
Screen interface(s) circuitry 129 provides the various contents 135A-135N to external device(s) 133 for presentation. Screen interface(s) circuitry 129 may provide the contents 135A-135N in any suitable number of streams. For instance, screen interface(s) circuitry 129 may provide the contents 135A-135N in respective streams or in a single combined stream to external device(s) 133. Screen interface(s) circuitry 129 provides the screen configuration commands that specify how the regions of each adaptable light manipulating 2D/3Dx assembly of the external device(s) 133 is to be configured to support the presentation of the multiple instances of content. The screen configuration commands may be integrated among the contents 135A-135N or separate from the contents 135A-135N.
Although the circuitry and functionality illustrated with respect to FIGS. 1A and 1B may fall within one device housing (as illustrated), it may also be distributed across or fully contained within many of such media nodes. As such, the one or more media nodes may operate independently or in concert to carry out the various aspects of the illustrated functionality. A media node can be any node in the entire end-to-end pathway, including even at one of the media sources (which might receive other content (e.g., the second content) from another media source), within the screen assembly device, within a network node, in any premises device supporting a screen device such as a set top box, a removable media (e.g., DVD, CD or Blu-Ray) player, gateway, access point, television, etc.
The remainder of this section describes some exemplary display systems that include display elements, such as an adaptable light manipulator, a non-uniform light generator, and a pixel array, to enable multiple two-dimensional (2D) and three-dimensional (3D) viewing configurations. A two-dimensional configuration is used to display a 2D representation of video content. A three-dimensional configuration is used to display a 3D representation of video content. A three-dimensional configuration may include any two or more viewpoints (a.k.a. perspectives), two of which may be combined to provide a three-dimensional viewing experience. For instance, a three-dimensional configuration that includes n viewpoints is said to be a 3Dn configuration, where n is a positive integer greater than or equal to two. The configurations that are used to display the different video contents or portions thereof may be different or the same. Moreover, different video contents may be fully unrelated or at least partially related. For example, first content may be at least partially related to second content if the second content is 2D or 3D content and the first content includes movie text (e.g., closed caption text) that relates to the 2D or 3D content.
A. Example Display Systems Using Adaptable Parallax Barriers
FIG. 1C is a block diagram of an exemplary display system 100 that utilizes an adaptable parallax barrier to support multiple viewing configurations in accordance with an embodiment. As shown in FIG. 1C, display system 100 includes driver circuitry 102 and a screen 104, wherein screen 104 include a pixel array 122 and an adaptable parallax barrier 124. As further shown in FIG. 1C, driver circuitry 104 includes pixel array driver circuitry 112 and adaptable parallax barrier driver circuitry 114.
Pixel array 122 comprises a two-dimensional array of pixels (e.g., arranged as a grid or other distribution). Pixel array 122 is a self-illuminating or light-generating pixel array such that the pixels of pixel array 122 each emit light included in light 132. Each pixel may be a separately addressable light source (e.g., a pixel of a plasma display, an LCD display, an LED display such as an OLED display, or of other type of display). Each pixel of pixel array 122 may be individually controllable to vary color and intensity. In an embodiment, each pixel of pixel array 122 may include a plurality of sub-pixels that correspond to separate color channels, such as a trio of red, green, and blue sub-pixels included in each pixel.
Adaptable parallax barrier 124 is positioned proximate to a surface of pixel array 122. Barrier element array 142 is a layer of adaptable parallax barrier 124 that includes a plurality of barrier elements or blocking regions arranged in an array. Each barrier element of the array is configured to be selectively opaque or transparent. Combinations of barrier elements may be configured to be selectively opaque or transparent to enable various effects. For example, the states of the barrier elements of barrier element array 142 may be configured such that light 132 emanating from pixel array 122 is filtered to produce filtered light 134, wherein filtered light 134 includes one or more two-dimensional and/or three-dimensional images that may be viewed by users 136 in a viewing space 106.
Depending upon the implementation, each barrier element may have a round, square, or rectangular shape, and barrier element array 142 may have any number of rows of barrier elements that extend a vertical length of barrier element array 142. In another embodiment, each barrier element may have a “band” shape that extends a vertical length of barrier element array 142, such that barrier element array 142 includes a single horizontal row of barrier elements. Each barrier element may include one or more of such bands, and different regions of barrier element array 142 may include barrier elements that include different numbers of such bands.
It is noted that in some embodiments, barrier elements may be capable of being completely transparent or opaque, and in other embodiments, barrier elements may not be capable of being fully transparent or opaque. For instance, such barrier elements may be capable of being 95% transparent when considered to be “transparent” and may be capable of being 5% transparent when considered to be “opaque.” “Transparent” and “opaque” as used herein are intended to encompass barrier elements being substantially transparent (e.g., greater than 75% transparent, including completely transparent) and substantially opaque (e.g., less than 25% transparent, including completely opaque), respectively.
Driver circuitry 102 receives control signals 108 from control circuitry (not shown in FIG. 1C). For example, control signals 108 may be received via a pathway from processing circuitry, such as processing circuitry 162 of FIG. 1A or processing circuitry 103 of FIG. 1B. The control signals 108 cause driver circuitry 102 to place screen 104 in a selected one of a plurality of different viewing configurations. In particular, based on control signals 108, adaptable parallax barrier driver circuitry 114 transmits drive signals 154 that cause barrier element array 142 to be placed in a state that supports the selected viewing configuration. The selected viewing configuration may be a particular two-dimensional viewing configuration, a particular three-dimensional viewing configuration, or a viewing configuration that supports the display of different types of two-dimensional and/or three-dimensional content in corresponding display regions.
For example, FIG. 2 shows an exemplary arrangement of an adaptable parallax barrier 200 that supports a particular three-dimensional viewing configuration. Adaptable parallax barrier 200 is an example of adaptable parallax barrier 124 of FIG. 1C. As shown in FIG. 2, adaptable parallax barrier 200 includes a barrier element array 202, which includes a plurality of barrier elements 204 arranged in a two-dimensional array. Furthermore, as shown in FIG. 2, barrier element array 202 includes a plurality of parallel strips of barrier elements 204 that are selected to be non-blocking to form a plurality of parallel non-blocking strips (or “slits”) 206 a-206 g. As shown in FIG. 2, parallel non-blocking strips 206 a-206 g (non-blocking slits) are alternated with parallel blocking strips 208 a-208 g of barrier elements 204 that are selected to be blocking. In the example of FIG. 2, non-blocking strips 206 a-206 g and blocking strips 208 a-208 g each have a width (along the x-dimension) of two barrier elements 204, and have lengths that extend along the entire y-dimension (twenty barrier elements 204) of barrier element array 202, although in other embodiments, may have alternative dimensions. Non-blocking strips 206 a-206 g and blocking strips 208 a-208 g form a parallax barrier configuration for adaptable parallax barrier 200. The spacing (and number) of parallel non-blocking strips 206 in barrier element array 202 may be selectable by choosing any number and combination of particular strips of barrier elements 204 in barrier element array 202 to be non-blocking, to be alternated with blocking strips 208, as desired. For example, the spacing (and number) of parallel non-blocking strips 206 in barrier element array 202 may be selected based on control signals that are received via a pathway from processing circuitry, such as processing circuitry 162 of FIG. 1A or processing circuitry 103 of FIG. 1B. It will be recognized that hundreds, thousands, or even larger numbers of non-blocking strips 206 and blocking strips 208 may be present in adaptable parallax barrier 200.
FIG. 3 shows an alternative example of an adaptable parallax barrier 300 that has also been configured to support a particular three-dimensional viewing configuration. Similarly to adaptable parallax barrier 200 of FIG. 2, adaptable parallax barrier 300 includes a barrier element array 302, which includes a plurality of barrier elements 304 arranged in a two-dimensional array (28×1 array). Barrier elements 304 have widths (along the x-dimension) similar to the widths of barrier elements 204 in FIG. 2, but have lengths that extend along the entire vertical length (y-dimension) of barrier element array 302. As shown in FIG. 3, barrier element array 302 includes parallel non-blocking strips 306 a-306 g alternated with parallel blocking strips 308 a-308 g. In the example of FIG. 3, parallel non-blocking strips 306 a-306 g and parallel blocking strips 308 a-308 g each have a width (along the x-dimension) of two barrier elements 304, and have lengths that extend along the entire y-dimension (one barrier element 304) of barrier element array 302. Adaptable parallax barrier 300 may be configured in accordance with control signals that are received via a pathway from processing circuitry, such as processing circuitry 162 of FIG. 1A or processing circuitry 103 of FIG. 1B, for example.
Each of adaptable parallax barriers 200 and 300, configured in the manner shown in FIGS. 2 and 3 respectively, filter light produced by a pixel array to form one or more three-dimensional views in a viewing space, thus supporting a three-dimensional viewing configuration. To achieve a two-dimensional viewing configuration, all of the barrier elements of either adaptable parallax barrier 200 or 300 can simply be placed in a non-blocking state. Additional details concerning how the adaptable parallax barriers operate to support such three-dimensional viewing may be found, for example, in the aforementioned, incorporated U.S. patent application Ser. No. 12/845,440, filed on Jul. 28, 2010, and entitled “Adaptable Parallax Barrier Supporting Mixed 2D and Stereoscopic 3D Display Regions.”
In the adaptable parallax barrier configurations shown in FIGS. 2 and 3, the entirety of the barrier element array is filled with parallel non-blocking strips to support three-dimensional viewing. In further embodiments, one or more regions of an adaptable parallax barrier may be filled with parallel non-blocking strips to deliver three-dimensional images, and one or more other regions of the adaptable parallax barrier may be rendered transparent to deliver two-dimensional images. Thus, a viewing configuration that mixes two-dimensional and three-dimensional viewing regions may be supported.
For instance, FIG. 4 shows an exemplary arrangement of an adaptable parallax barrier 400 that supports a viewing configuration that mixes two-dimensional and three-dimensional viewing regions according to example embodiments. The arrangement of adaptable parallax barrier 400 may be based on control signals that are received via a pathway from processing circuitry, such as processing circuitry 162 of FIG. 1A or processing circuitry 103 of FIG. 1B, for example. Adaptable parallax barrier 400 is similar to adaptable parallax barrier 200 of FIG. 2, having barrier element array 202 including a plurality of barrier elements 204 arranged in a two-dimensional array. In FIG. 4, a first region 402 of barrier element array 202 includes a plurality of parallel non-blocking strips alternated with parallel blocking strips that together fill first region 402. A second region 404 of barrier element array 202 is surrounded by first region 402. Second region 404 is a rectangular shaped region of barrier element array 202 that includes a two-dimensional array of barrier elements 204 that are non-blocking. Thus, in FIG. 4, barrier element array 202 is configured to enable a three-dimensional image to be generated by pixels of a pixel array that are adjacent to barrier elements of first region 402, and to enable a two-dimensional image to be generated by pixels of the pixel array that are adjacent to barrier elements inside of second region 404. Note that alternatively, first region 402 may include all non-blocking barrier elements 202 to pass a two-dimensional image, and second region 404 may include parallel non-blocking strips alternated with parallel blocking strips to pass a three-dimensional image. In further embodiments, adaptable parallax barrier 400 may have additional numbers, sizes, and arrangements of regions configured to pass different combinations of two-dimensional images and three-dimensional images.
In still further embodiments, different regions of an adaptable parallax barrier that have parallel non-blocking strips may have the parallel non-blocking strips oriented at different angles to deliver three-dimensional images to viewers that are oriented differently. Thus, a viewing configuration that mixes three-dimensional viewing regions having different viewing orientations may be supported.
For example, FIG. 5 shows an exemplary arrangement of an adaptable parallax barrier 500 in which transparent slits have different orientations, according to an example embodiment. The arrangement of adaptable parallax barrier 500 may be based on control signals that are received via a pathway from processing circuitry, such as processing circuitry 162 of FIG. 1A or processing circuitry 103 of FIG. 1B, for example. Adaptable parallax barrier 500 is similar to adaptable parallax barrier 200 of FIG. 2, having barrier element array 202 including a plurality of barrier elements 204 arranged in a two-dimensional array. A first region 510 (e.g., a bottom half) of barrier element array 202 includes a first plurality of parallel strips of barrier elements 204 that are selected to be non-blocking to form a first plurality of parallel non-blocking strips 502 a-502 e (each having a width of two barrier elements 204). As shown in FIG. 5, parallel non-blocking strips 502 a-502 e are alternated with parallel blocking strips 504 a-504 f of barrier elements 204 (each having a width of three barrier elements 204). Parallel non-blocking strips 502 a-502 e are oriented in a first direction (e.g., along a vertical axis).
Furthermore, as shown in FIG. 5, a second region 512 (e.g., a top half) of barrier element array 202 includes a second plurality of parallel strips of barrier elements 204 that are selected to be non-blocking to form a second plurality of parallel non-blocking strips 506 a-506 d (each having a width of one barrier element 204). As shown in FIG. 5, parallel non-blocking strips 506 a-506 d are alternated with parallel blocking strips 508 a-508 c of barrier elements 204 (each having a width of two barrier elements 204). Parallel non-blocking strips 506 a-506 d are oriented in a second direction (e.g., along a horizontal axis).
As such, in FIG. 5, first and second pluralities of parallel non-blocking strips 502 a-502 e and 506 a-506 d are present in barrier element array 202 that are oriented perpendicularly to each other. The region of barrier element array 202 that includes first plurality of parallel non-blocking strips 502 a-502 e may be configured to deliver a three-dimensional image in a viewing space to be viewable by a user whose body is oriented vertically (e.g., sitting upright or standing up). The region of barrier element array 202 that includes second plurality of parallel non-blocking strips 506 a-506 d may be configured to deliver a three-dimensional image in a viewing space to be viewable by a user whose body is oriented horizontally (e.g., laying down). In this manner, users who are oriented differently relative to each other can still each be provided with a corresponding three-dimensional image that accommodates their position.
The foregoing adaptable parallax barriers and arrangements thereof have been described herein by way of example only. Additional adaptable parallax barriers and arrangements thereof may be used to support additional viewing configurations. For example, additional adaptable parallax barrier implementations and arrangements thereof are described in the aforementioned, incorporated U.S. patent application Ser. No. 12/845,440 filed on Jul. 28, 2010, and entitled “Adaptable Parallax Barrier Supporting Mixed 2D and Stereoscopic 3D Display Regions,” and in commonly-owned, co-pending U.S. patent application Ser. No. 12/845,461, filed on Jul. 28, 2010, and entitled “Display Supporting Multiple Simultaneous 3D Views,” the entirety of which is incorporated by reference herein.
Returning now to the description of display system 100 of FIG. 1C, since a configuration of adaptable parallax barrier 124 can be dynamically modified to support a particular viewing configuration, pixel array 122 must also be controlled to support the same viewing configuration. In particular, the rendering of pixels of an image (also referred to herein as “image pixels”) among the pixels of pixel array 122 (also referred to herein as “display pixels”) must be handled in a manner that is consistent with a current configuration of adaptable parallax barrier 124. This may entail, for example, changing a number of display pixels that represents each image pixel (i.e., changing the resolution of a displayed image) and/or changing which display pixels or groups thereof correspond to the respective image pixels (i.e., changing the locations at which the image pixels are displayed), in response to modification of a configuration of adaptable parallax barrier 124. Such changes may be implemented by a controller (not shown in FIG. 1C) via delivery of appropriate control signals 108 to pixel array driver circuitry 112.
For example, in one embodiment, when a configuration of adaptable parallax barrier 124 supports a first viewing configuration responsive to control signals 108, pixel array driver circuitry 204 sends drive signals 152 in conformance with control signals 108 such that the rendering of images to pixel array 122 occurs in a manner that also supports the first viewing configuration. Furthermore, when the configuration of adaptable parallax barrier 124 is modified to support a second viewing configuration responsive to control signals 108, pixel array driver circuitry 204 sends drive signals 152 in conformance with the control signals 108 such that the rendering of images to pixel array 122 occurs in a manner that also supports the second viewing configuration.
FIG. 6 depicts a flowchart 600 of an exemplary method for controlling a pixel array to support the same viewing configuration as an adaptable light manipulator (such as adaptable parallax barrier 124) in accordance with an embodiment. As shown in FIG. 6, the method of flowchart 600 begins at step 602. During step 602, a configuration of an adaptable light manipulator, such as adaptable parallax barrier 124, is modified. At step 604, a number of display pixels in a pixel array, such as pixel array 122, that represents each image pixel of a plurality of image pixels is changed in response to modifying the configuration of the adaptable light manipulator.
FIGS. 8 and 9 provide a simple illustration of an exemplary application of the method of flowchart 600. As shown in FIG. 8, a portion of a pixel array 800 includes a 16×16 array of display pixels. An example display pixel is shown as display pixel 802. In one embodiment, each display pixel comprises a trio of red, green, and blue sub-pixels as discussed above. A first image comprising a 4×4 array of image pixels (each shown depicting the letter “A” to indicate that each is included in the same image) is mapped to the display pixels such that 4 display pixels are used to present each image pixel. An example of an image pixel is shown as image pixel 804. In FIG. 8, the first image is intended to represent an image that is viewed when an adaptable light manipulator disposed proximate to the pixel array is configured to support a two-dimensional viewing configuration.
FIG. 9 is intended to represent the same portion of pixel array 800 after the configuration of the adaptable light manipulator has been changed to support a three-dimensional viewing configuration. The three-dimensional viewing configuration requires the combined display of a first image and a second image across the same portion of pixel array 800. This means that the first image must be represented with only half the display pixels. To achieve this, the pixel array is controlled such that 2 rather than 4 display pixels are used to present each image pixel of the first image (each still shown depicting the letter “A”). This corresponds to a decreased viewing resolution of the first image. The other half of the display pixels are now used to present each image pixel of a second image (each shown depicting the letter “B”). The image pixels associated with the different images are aligned with the adaptable light manipulator to achieve a desired three-dimensional viewing effect.
FIG. 7 depicts a flowchart 700 of another exemplary method for controlling a pixel array to support the same viewing configuration as an adaptable light manipulator (such as adaptable parallax barrier 124) in accordance with an embodiment. As shown in FIG. 7, the method of flowchart 700 begins at step 702. During step 702, a plurality of image pixels is mapped to a plurality of respective first subsets of display pixels in a pixel array, such as pixel array 122. At step 704, a configuration of an adaptable light manipulator that is positioned proximate to the pixel array is changed. For example, in an embodiment in which the adaptable light manipulator includes adaptable parallax barrier 124, a slit pattern, orientation, or the like, of adaptable parallax barrier 124 may be changed. At step 706, a mapping of the plurality of image pixels is changed from the plurality of respective first subsets of the display pixels to a plurality of respective second subsets of the display pixels in the pixel array to compensate for changing the configuration of the adaptable light manipulator.
FIGS. 9 and 10 provide a simple illustration of an exemplary application of the method of flowchart 700. As shown in FIG. 9, a portion of a pixel array 800 is used to simultaneously display a first image comprising image pixels shown depicting the letter “A” and a second image comprising image pixels shown depicting the letter “B.” As noted above, this display format is utilized to support a three-dimensional viewing configuration corresponding to a particular arrangement of an adaptable light manipulator disposed proximate to the pixel array. FIG. 10 is intended to represent the same portion of pixel array 800 after the configuration of the adaptable light manipulator has been changed to support a modified three-dimensional viewing configuration (e.g., in response to a changed location of a viewer or some other factor). The modified three-dimensional viewing configuration requires the display location of the first image and the second image to be shifted, as shown in FIG. 10. Thus, for example, rather than rendering image pixel 904 to the bottom-most two display pixels in the far-left column of array portion 800, the same image pixel 904 is now rendered to the bottom-most two display pixels in the second column from the left of array portion 800.
Numerous other methods may be used to control the rendering of image pixels to display pixels in support of a desired two-dimensional and/or three-dimensional viewing configuration implemented by an adaptable parallax barrier or other adaptable light manipulator. Additional details concerning such control of a pixel array may be found in the aforementioned, incorporated U.S. patent application Ser. No. 12/774,225, filed on May 5, 2010, and entitled “Controlling a Pixel Array to Support an Adaptable Light Manipulator.”
FIG. 11 shows a block diagram of an exemplary display system 1100, which is another example of a display system that utilizes an adaptable parallax barrier to support multiple viewing configurations. As shown in FIG. 11, display system 1100 includes driver circuitry 1102 and a screen 1104, wherein screen 1104 include a light generator 1122, an adaptable parallax barrier 1124 and a pixel array 1126. As further shown in FIG. 11, driver circuitry 1102 includes light generator driver circuitry 1112, adaptable parallax barrier driver circuitry 1114 and pixel array driver circuitry 1116.
Light generator 1122 emits light 1132. Adaptable parallax barrier 1124 is positioned proximate to light generator 1122. Barrier element array 1144 is a layer of adaptable parallax barrier 1124 that includes a plurality of barrier elements or blocking regions arranged in an array. Each barrier element of the array is configured to be selectively opaque or transparent. Barrier element array 1144 filters light 1132 received from light generator 1122 to generate filtered light 1134. Filtered light 1134 is configured to enable a two-dimensional image or a three-dimensional image (e.g., formed by a pair of two-dimensional images in filtered light 1134) to be formed based on images subsequently imposed on filtered light 1134 by pixel array 1126.
Pixel array 1126 includes a two-dimensional array of pixels (e.g., arranged in a grid or other distribution) like pixel array 122 of FIG. 1C. However, pixel array 1126 is not self-illuminating, and instead is a light filter that imposes images (e.g., in the form of color, grayscale, etc.) on filtered light 1134 from adaptable parallax barrier 1124 to generate filtered light 1136 to include one or more images. Each pixel of pixel array 1126 may be a separately addressable filter (e.g., a pixel of a plasma display, an LCD display, an LED display, or of other type of display). Each pixel of pixel array 1126 may be individually controllable to vary the color imposed on the corresponding light passing through, and/or to vary the intensity of the passed light in filtered light 1136. In an embodiment, each pixel of pixel array 1126 may include a plurality of sub-pixels that correspond to separate color channels, such as a trio of red, green, and blue sub-pixels included in each pixel.
Driver circuitry 1102 receives control signals 1108 from control circuitry (not shown in FIG. 11). For example, control signals 1108 may be received via a pathway from processing circuitry, such as processing circuitry 162 of FIG. 1A or processing circuitry 103 of FIG. 1B. The control signals 1108 cause driver circuitry 1102 to place screen 1104 in a selected one of a plurality of different viewing configurations. In particular, based on control signals 1108, adaptable parallax barrier driver circuitry 1114 transmits drive signals 1154 that cause barrier element array 1144 to be placed in a state that supports the selected viewing configuration. Likewise, based on control signals 1108, pixel array driver circuitry 1116 transmits drive signals 1156 to cause pixels of one or more images (also referred to herein as “image pixels”) to be rendered among the pixels of pixel array 1126 (also referred to herein as “display pixels”) in a manner that is consistent with a current configuration of adaptable parallax barrier 1124. The selected viewing configuration may be a particular two-dimensional viewing configuration, a particular three-dimensional viewing configuration, or a viewing configuration that supports the display of different types of two-dimensional and/or three-dimensional content in different display regions.
As discussed in the aforementioned, incorporated U.S. patent application Ser. No. ______, filed on even date herewith and entitled “Backlighting Array Supporting Adaptable Parallax Barrier,” conventional LCD displays typically include a backlight and a display panel that includes an array of LCD pixels. The backlight is designed to produce a sheet of light of uniform luminosity for illuminating the LCD pixels. When simultaneously displaying two-dimensional, three-dimensional and multi-view three-dimensional regions using an adaptable parallax barrier such as that described in the aforementioned, incorporated U.S. patent application Ser. No. 12/845,440, filed on Jul. 28, 2010, and entitled “Adaptable Parallax Barrier Supporting Mixed 2D and Stereoscopic 3D Display Regions,” the use of a conventional backlight will result in a disparity in perceived brightness between the different simultaneously-displayed regions. This is because the number of visible pixels per unit area associated with a two-dimensional region will generally exceed the number of visible pixels per unit area associated with a particular three-dimensional or multi-view three-dimensional region (in which the pixels must be partitioned among different eyes/views).
To address this issue, light generator 1122 includes a backlight array 1142 which is a two-dimensional array of light sources. Such light sources may be arranged, for example, in a rectangular grid. Each light source in backlight array 1142 is individually addressable and controllable to select an amount of light emitted thereby. A single light source may comprise one or more light-emitting elements depending upon the implementation. In one embodiment, each light source in backlight array 1142 comprises a single light-emitting diode (LED) although this example is not intended to be limiting.
The amount of light emitted by the individual light sources that make up backlight array 1142 can selectively controlled by drive signals 1152 generated by light generator driver circuitry 1112 so that the brightness associated with each of a plurality of display regions of screen 1104 can also be controlled. This enables display system 1100 to provide a desired brightness level for each display region automatically and/or in response to user input. For example, backlight array 1142 can be controlled such that a uniform level of brightness is achieved across different simultaneously-displayed display regions, even though the number of perceptible pixels per unit area varies from display region to display region. As another example, backlight array 1142 can be controlled such that the level of brightness associated with a particular display region is increased or reduced without impacting (or without substantially impacting) the brightness of other simultaneously-displayed display regions.
To help illustrate this, FIG. 12 provides an exploded view of an exemplary display system 1200 that implements a controllable backlight array as described immediately above. Display system 1200 comprises one implementation of display system 1100. As shown in FIG. 12, display system 1200 includes a light generator 1202 that includes a backlight array 1212, an adaptable parallax barrier 1204 that includes a barrier element array 1222 and a display panel 1206 that includes a pixel array 1232. These elements may be aligned with and positioned proximate to each other to create an integrated display screen.
In accordance with the example configuration shown in FIG. 12, a first portion 1234 of pixel array 1232 and a first portion 1224 of barrier element array 1222 have been manipulated to create a first display region that displays multi-view three-dimensional content, a second portion 1236 of pixel array 1232 and a second portion 1226 of barrier element array 1222 have been manipulated to create a second display region that displays a three-dimensional image, and a third portion of 1238 of pixel array 1232 and a third portion 1228 of barrier element array 1222 have been manipulated to create a third display region that displays a two-dimensional image. To independently control the brightness of each of the first, second and third display regions, the amount of light emitted by light sources included within a first portion 1214, a second portion 1216 and a third portion 1218 of backlight array 1212 can respectively be controlled. For example, the light sources within first portion 1214 may be controlled to provide greater luminosity than the light sources within second portion 1216 and third portion 1218 as the number of perceivable pixels per unit area will be smallest in the first display region with which first portion 1214 is aligned. In further accordance with this example, the light sources within second portion 1216 may be controlled to provide greater luminosity than the light sources within third portion 1218 since the number of perceivable pixels per unit area will be smaller in the second display region with which second portion 1216 is aligned than the third display region with which third portion 1218 is aligned. Of course, if uniform luminosity is not desired across the various display regions then other control schemes may be used.
Of course, the arrangement shown in FIG. 12 provides only a single teaching example. It should be noted that a display system in accordance with an embodiment can dynamically manipulate pixel array 1232 and barrier element array 1222 in a coordinated fashion to dynamically and simultaneously create any number of display regions of different sizes and in different locations, wherein each of the created display regions can display one of two-dimensional, three-dimensional or multi-view three-dimensional content. To accommodate this, backlight array 1212 can also be dynamically manipulated in a coordinated fashion with pixel array 1232 and barrier element array 1222 to ensure that each display region is perceived at a desired level of brightness.
In the arrangement shown in FIG. 12, there is a one-to-one correspondence between each light source in backlight array 1212 and every display pixel in pixel array 1232. However, this need not be the case to achieve regional brightness control. For example, in certain embodiments, the number of light sources provided in backlight array 1212 is less than the number of pixels provided in pixel array 1232. For instance, in one embodiment, a single light source may be provided in backlight array 1212 for every N pixels provided in pixel array 1232, wherein N is an integer greater than 1. In an embodiment in which the number of light sources in backlight array 1212 is less than the number of pixels in pixel array 1232, each light source may be arranged so that it provides backlighting for a particular group of pixels in pixel array 1232, although this is only an example. In alternate embodiments, the number of light sources provided in backlight array 1212 is greater than the number of pixels provided in pixel array 1232.
Also, in the examples described above, light sources in backlight array 1212 are described as being individually controllable. However, in alternate embodiments, light sources in backlight array 1212 may only be controllable in groups. This may facilitate a reduction in the complexity of the control infrastructure associated with backlight array 1212. In still further embodiments, light sources in backlight array 1212 may be controllable both individually and in groups. It will be recognized that light generator 1202, adaptable parallax barrier 1204, and display panel 1206 may be controlled based on control signals that are received via a pathway from processing circuitry, such as processing circuitry 162 of FIG. 1A or processing circuitry 103 of FIG. 1B.
It is also noted that although FIGS. 11 and 12 show display system configurations in which a barrier element array of an adaptable parallax barrier is disposed between a backlight array of individually addressable and controllable light sources and a pixel array, in alternate implementations the pixel array may be disposed between the backlight array and the barrier element array. Such an alternate implementation is shown in FIG. 13. In particular, FIG. 13 is a block diagram of an exemplary display system 1300 that includes a pixel array 1324 disposed between a light generator 1322 that includes a backlight array 1342 and an adaptable parallax barrier 1326 that includes a barrier element array 1344 to support the generation of two-dimensional and/or three-dimensional images perceivable in a viewing space 1306. In such alternate implementations, selective control of the luminosity of groups or individual ones of the light sources in backlight array 1342 may also be used to vary the backlighting luminosity associated with different display regions created by the interaction of backlight array 1342, pixel array 1324 and barrier element array 1344. For example, light generator 1322. pixel array 1324, and/or adaptable parallax barrier 1326 may be controlled based on control signals that are received via a pathway from processing circuitry, such as processing circuitry 162 of FIG. 1A or processing circuitry 103 of FIG. 1B.
Other example display system implementations that utilize a backlight array of independently-controllable light sources are described in the aforementioned, incorporated U.S. patent application Ser. No. ______, filed on even date herewith and entitled “Backlighting Array Supporting Adaptable Parallax Barrier.” That application also describes other approaches for controlling the brightness of different simultaneously-displayed display regions of a display system. Some of these approaches will be described below.
For example, to achieve independent region-by-region brightness control in a display system that includes a conventional backlight panel designed to produce a sheet of light of uniform luminosity, the amount of light passed by the individual pixels that make up a pixel array can be selectively controlled so that the brightness associated with each of a plurality of display regions can also be controlled. To help illustrate this, FIG. 14 provides an exploded view of an exemplary display system 1400 that implements a regional brightness control scheme based on pixel intensity as described immediately above. The regional brightness control scheme may be implemented based on control signals that are received via a pathway from processing circuitry, such as processing circuitry 162 of FIG. 1A or processing circuitry 103 of FIG. 1B, for example. As shown in FIG. 14, display system 1400 includes a display panel 1402 and an adaptable parallax barrier 1404. Display system 1400 also includes a backlight panel, although this element is not shown in FIG. 14. These elements may be aligned with and positioned proximate to each other to create an integrated display screen.
As further shown in FIG. 14, display panel 1402 includes a pixel array 1412. Each of the pixels in a first portion 1414 of pixel array 1412 is individually controlled by pixel array driver circuitry to pass a selected amount of light produced by a backlight panel (not shown in FIG. 14), thereby producing display-generated light representative of a single two-dimensional image. Each of the pixels in a second portion 1416 of pixel array 1412 is individually controlled by the pixel array driver circuitry to pass a selected amount of light produced by the backlight panel, thereby producing display-generated light representative of two two-dimensional images that, when combined by the brain of a viewer positioned in an appropriate location relative to display system 1400, will be perceived as a single three-dimensional image.
Adaptable parallax barrier 1404 includes barrier element array 1422 that includes a first portion 1424 and a second portion 1426. Barrier element array 1422 is aligned with pixel array 1414 such that first portion 1424 of blocking region array 1422 overlays first portion 1414 of pixel array 1412 and second portion 1426 of blocking region array 1422 overlays second portion 1416 of pixel array 1412. Adaptable parallax barrier driver circuitry causes all the barrier elements within first portion 1424 of barrier element array 1422 to be transparent. Thus, the two-dimensional image generated by the pixels of first portion 1414 of pixel array 1412 will simply be passed through to a viewer in a viewing space in front of display system 1400. Furthermore, the adaptable parallax barrier driver circuitry manipulates the barrier elements within second portion 1426 of blocking region array 1422 to form a plurality of parallel transparent strips alternated with parallel opaque strips, thereby creating a parallax effect that enables the two two-dimensional images generated by the pixels of second portion 1416 of pixel array 1412 to be perceived as a three-dimensional image by a viewer in the viewing space in front of display system 1400.
Assume that a viewer is positioned such that he/she can perceive both the two-dimensional image passed by first portion 1424 of barrier element array 1422 and the three-dimensional image formed through parallax by second portion 1426 of barrier element 1422. As discussed above, the pixels per unit area perceived by this viewer with respect to the two-dimensional image will be greater than the pixels per unit area perceived by this viewer with respect to the three-dimensional image. Thus, the two-dimensional image will appear brighter to the viewer than the three dimensional image when backlighting of constant luminosity is provided behind pixel array 1412.
To address this issue, drive signals may be transmitted to display panel 1402 that selectively cause the pixels included in first portion 1414 of pixel array 1412 to pass less light from the backlight panel (i.e., become less intense), thereby reducing the brightness of the two-dimensional image produced from the pixels in first portion 1414 of pixel array 1412. Alternatively or additionally, drive signals may be transmitted to display panel 1402 that selectively cause the pixels included in second portion 1416 of pixel array 1412 to pass more light from the backlight panel (i.e., become more intense), thereby increasing the brightness of the three-dimensional image produced from the pixels in second portion 1416 of pixel array 1412. By controlling the intensity of the pixels in portions 1414 and 1416 of pixel array 1412 in this manner, the brightness of the two-dimensional image produced from the pixels in first portion 1414 of pixel array 1412 and the brightness of the three-dimensional image produced from the pixels in second portion 1416 of pixel array 1412 can be kept consistent. Additionally, by providing independent control over the intensity of the pixels in portions 1414 and 1416 of pixel array 1412, independent control over the brightness of the two-dimensional and three-dimensional images generated therefrom can also be achieved.
Of course, the arrangement shown in FIG. 14 provides only a single teaching example. It should be noted that a display system in accordance with an embodiment can dynamically manipulate pixel array 1412 and blocking element array 1422 in a coordinated fashion to dynamically and simultaneously create any number of display regions of different sizes and in different locations, wherein each of the created display regions can display one of two-dimensional, three-dimensional or multi-view three-dimensional content. To accommodate this, the intensity of the pixels in pixel array 1412 can also be dynamically manipulated in a coordinated fashion to ensure that each display region is perceived at a desired level of brightness.
In one embodiment, a regional brightness control scheme combines the use of a backlight array of independently-controllable light sources as previously described with regional pixel intensity control. The advantages of such a control scheme will now be described with reference to FIG. 15. FIG. 15 illustrates a front perspective view of an exemplary display panel 1500. Display panel 1500 includes a pixel array 1502 that includes a first portion 1504 and a second portion 1506, wherein each of first portion 1504 and second portion 1506 includes a different subset of the pixels in pixel array 1502. It is to be assumed that first portion 1504 of pixel array 1502 is illuminated by backlighting provided by an aligned first portion of a backlight array (not shown in FIG. 15), wherein the backlight array is similar to backlight array 1142 described above in reference to FIG. 11. Second portion 1506 of pixel array 1502 is illuminated by backlighting provided by an aligned second portion of the backlight array. In one example, the amount of light emitted by each light source in the second portion of the backlight array to illuminate second portion 1506 of pixel array 1502 is controlled such that it is greater than the amount of light emitted by each light source in the first portion of the backlight array to illuminate first portion 1504 of pixel array 1502. This control scheme may be applied, for example, to cause a three-dimensional image formed by interaction between the pixels in second portion 1506 of pixel array 1502 and an adaptable parallax barrier to appear to have a uniform brightness level with respect to a two-dimensional image formed by interaction between the pixels in first portion 1504 of pixel array 1504 and the adaptable parallax barrier.
However, the difference in the amount of light emitted by each light source in the first and second portions of the backlight array to illuminate corresponding first and second portions 1504 and 1506 of pixel array 1502 may also give rise to undesired visual artifacts. In particular, the difference may cause pixels in boundary areas immediately outside of second portion 1506 of pixel array 1502 to appear brighter than desired in relation to other pixels in first portion 1504 of pixel array 1502. For example, as shown in FIG. 15, the pixels in boundary area 1512 immediately outside of second portion 1506 of pixel array 1502 may appear brighter than desired in relation to other pixels in first portion 1504 of pixel array 1502. This may be due to the fact that the increased luminosity provided by the light sources in the second portion of the backlight array has “spilled over” to impact the pixels in boundary area 1512, causing those pixels to be brighter than desired. Conversely, the difference may cause pixels in boundary areas immediately inside of second portion 1506 of pixel array 1502 to appear dimmer than desired in relation to other pixels in second portion 1506 of pixel array 1502. For example, as shown in FIG. 15, the pixels in boundary area 1514 immediately inside of second portion 1506 of pixel array 1502 may appear dimmer than desired in relation to other pixels in second portion 1506 of pixel array 1502. This may be due to the fact that the reduced luminosity of the light sources in the first portion of the backlight array has “spilled over” to impact the pixels in boundary area 1514, causing those pixels to be dimmer than desired.
To address this issue, an embodiment may selectively control the amount of light passed by the pixels located in boundary region 1512 or boundary region 1514 to compensate for the undesired visual effects. For example, driver circuitry associated with pixel array 1502 may selectively cause the pixels included in boundary area 1512 of pixel array 1502 to pass less light from the backlight panel (i.e., become less intense), thereby reducing the brightness of the pixels in boundary area 1512, thus compensating for an undesired increase in brightness due to “spill over” from light sources in the second portion of the backlight array. Alternatively or additionally, driver circuitry associated with pixel array 1502 may selectively cause the pixels included in boundary area 1514 of pixel array 1502 to pass more light from the backlight panel (i.e., become more intense), thereby increasing the brightness of the pixels in boundary area 1514, thus compensating for an undesired reduction in brightness due to “spill over” from light sources in the first portion of the backlight array. By controlling the intensity of the pixels in boundary areas 1512 and 1514 in this manner, the undesired visual effects described above that can arise from the use of a backlight array to provide regional brightness control can be mitigated or avoided entirely.
The illustration provided in FIG. 15 provides only one example of undesired visual effects that can arise from the use of a backlight array to provide regional brightness control. Persons skilled in the relevant art(s) will appreciate that many different display regions having many different brightness characteristics can be simultaneously generated by a display system in accordance with embodiments, thereby giving rise to different undesired visual effects relating to the brightness of boundary areas inside and outside of the different display regions. In each case, the intensity of pixels located in such boundaries areas can be selectively increased or reduced to mitigate or avoid such undesired visual effects.
In additional embodiments, a regional brightness control scheme is implemented in a display system that does not include a backlight panel at all, but instead utilizes a display panel comprising an array of organic light emitting diodes (OLEDs) or polymer light emitting diodes (PLEDs) which function as display pixels and also provide their own illumination. Display system 100 described above in reference to FIG. 1C may be representative of such a system, provided that pixel array 122 comprises an array of OLEDs or PLEDs. In accordance with such an implementation, the amount of light emitted by the individual OLED/PLED pixels that make up the OLED/PLED pixel array can be selectively controlled so that the brightness associated with each of a plurality of display regions of display system 100 can also be controlled. This enables display system 100 to provide a desired brightness level for each display region automatically and/or in response to user input. For example, the OLED/PLED pixel array can be controlled such that a uniform level of brightness is achieved across different simultaneously-displayed display regions, even though the number of perceptible pixels per unit area varies from display region to display region. As another example, the OLED/PLED pixel array can be controlled such that the level of brightness associated with a particular display region is increased or reduced without impacting (or without substantially impacting) the brightness of other simultaneously-displayed display regions.
Where OLED/PLED pixel regions such as those described above are adjacent to each other, it is possible that the brightness characteristics of one pixel region can impact the perceived brightness of an adjacent pixel region having different brightness characteristics, creating an undesired visual effect. For example, a first OLED/PLED pixel region having a relatively high level of brightness to support the viewing of multi-view three-dimensional content may be adjacent to a second OLED/PLED pixel region having a relatively low level of brightness to support the viewing of two-dimensional content. In this scenario, light from pixels in a perimeter area of the first OLED/PLED pixel region that are close to the boundary between the two pixel regions may “spill over” into a perimeter area of the second OLED/PLED pixel region. This may cause pixels in the perimeter area of the second OLED/PLED pixel region to appear brighter than desired in relation to other pixels in the second OLED/PLED pixel region. Conversely, pixels in the perimeter area of the first OLED/PLED pixel array may appear dimmer than desired in relation to other pixels in the first OLED/PLED pixel region because of the adjacency to the second OLED/PLED pixel region. To address this issue, it is possible to selectively increase or reduce the brightness of one or more OLED/PLED pixels in either perimeter area to reduce the “spill over” effect arising from the different brightness characteristics between the regions.
In still further embodiments, a regional brightness control scheme is implemented in a display system that includes an adaptable parallax barrier that also supports brightness regulation via an “overlay” approach. Such an approach involves the use of a brightness regulation overlay that is either independent of or integrated with an adaptable parallax barrier. The brightness regulation overlay is used to help achieve the aforementioned goals of maintaining standard brightness across various regional screen configurations and compensating for or minimizing backlighting dispersion.
The brightness regulation overlay comprises an element that allows regional dimming through various tones of “grey” pixels. In one example embodiment, an adaptable parallax barrier and the brightness regulation overlay are implemented as a non-color (i.e., black, white and grayscale) LCD sandwich, although other implementations may be used. The combined adaptable parallax barrier and brightness regulation overlay provide full transparent or opaque states for each pixel, as well as a grayscale alternative that can be used to “balance out” brightness variations caused by the parallax barrier itself.
Control over the individual barrier elements of the parallax barrier and the individual grayscale pixels of the brightness regulation overlay may be provided by using coordinated driver circuitry signaling. Such coordinate signaling may cause the pixels of the adaptable parallax barrier and the brightness regulation overlay (collectively referred to below as the manipulator pixels) to create opaque and transparent barrier elements associated with a particular parallax barrier configuration and a grayscale support there between to allow creation of overlays. The regional brightness control scheme described above with reference to FIG. 15, which may include such coordinated signaling, may be implemented based on control signals that are received via a pathway from processing circuitry, such as processing circuitry 162 of FIG. 1A or processing circuitry 103 of FIG. 1B, for example.
FIG. 16 illustrates two exemplary configurations of an adaptable light manipulator 1600 that includes an adaptable parallax barrier and a brightness regulation overlay implemented as a light manipulating LCD sandwich with manipulator grayscale pixels. The exemplary configurations of adaptable light manipulator 1600 may be based on control signals that are received via a pathway from processing circuitry, such as processing circuitry 162 of FIG. 1A or processing circuitry 103 of FIG. 1B, for example. In FIG. 16, the grayscale pixels map to the display pixels on a one-to-one basis, but that need not be the case.
A first exemplary configuration of adaptable light manipulator 1600 is shown above the section line denoted with reference numeral 1602. In accordance with the first exemplary configuration, a three-dimensional region 1604 is created with fully transparent or fully opaque manipulator pixels that provide parallax barrier functionality and a two-dimensional region 1606 is created having continuous medium gray manipulator pixels. The medium gray manipulator pixels operate to reduce the perceived brightness of two-dimensional region 1606 to better match that of three-dimensional region 1604. It is noted that in other example configurations, two-dimensional region 1606 could instead comprise a three-dimensional region having a number of views that is different than three-dimensional region 1604, thus also requiring brightness regulation.
In the first exemplary configuration, no boundary region compensation is performed. In the second exemplary configuration, which is shown below section line 1602, boundary region compensation is performed. For example, a boundary region 1610 within two-dimensional region 1606 may be “lightened” to a light gray to compensate for any diminution of light that might occur near the boundary with three-dimensional region 1604. In contrast, the grayscale level of an inner portion 1608 of two-dimensional region 1606 is maintained at the same medium gray level as in the portion of two-dimensional region 1606 above section line 1602. As a further example, a first boundary region 1612 and a second boundary region 1614 within three-dimensional region 1604 comprise darker and lighter gray transitional areas, respectively, to account for light dispersion from two-dimensional region 1606. In contrast, an inner portion 1616 of three-dimensional region 1604 includes only fully transparent or fully opaque manipulator pixels consistent with a parallax barrier configuration and no brightness regulation.
In one embodiment, the configuration of adaptable light manipulator 1600 is achieved by first creating a white through various grayscale areas that correspond to the regions and boundary areas to be formed. Once established, the manipulator pixels in these areas that comprise the opaque portions of the parallax barrier are overwritten to turn them black. Of course this two-stage approach is conceptual only and no “overwriting” need be performed.
In certain embodiments, adaptable light manipulator 1600 comprises the only component used in a display system for performing brightness regulation and/or boundary region compensation. In alternate embodiments, the display system further utilizes any one or more of the following aforementioned techniques for performing brightness regulation and/or boundary region compensation: a backlight array with independently-controllable light sources, and/or a pixel array and associated control logic for selectively increasing or decreasing the intensity of display pixels (e.g., either LCD pixels or OLED/PLED pixels). Note that in certain embodiments (such as the one described above in reference to FIG. 16), adaptable light manipulator 1600 is implemented as an integrated adaptable parallax barrier and brightness regulation overlay. However, in alternate embodiments, adaptable light manipulator 1600 is implemented using an adaptable parallax barrier panel and an independent brightness regulation overlay panel.
B. Example Display Systems Using Adaptable Lenticular Lenses
In display systems in accordance with further embodiments, rather than using an adaptable parallax barrier to perform light manipulation in support of multiple viewing configurations, an adaptable lenticular lens may be used. For example, with respect to example display system 100 of FIG. 1C, adaptable parallax barrier 124 may be replaced with an adaptable lenticular lens. Likewise, with respect to example display system 1300 of FIG. 13, adaptable parallax barrier 1326 may be replaced with an adaptable lenticular lens. The configuration of such an adaptable lenticular lens may be based on control signals that are received via a pathway from processing circuitry, such as processing circuitry 162 of FIG. 1A or processing circuitry 103 of FIG. 1B, for example.
FIG. 17 shows a perspective view of an exemplary adaptable lenticular lens 1700 in accordance with an embodiment. As shown in FIG. 17, adaptable lenticular lens 1700 includes a sub-lens array 1702. Sub-lens array 1702 includes a plurality of sub-lenses 1704 arranged in a two-dimensional array (e.g., arranged side-by-side in a row). Each sub-lens 1704 is shown in FIG. 17 as generally cylindrical in shape and having a substantially semi-circular cross-section, but in other embodiments may have other shapes. In FIG. 17, sub-lens array 1702 is shown to include eight sub-lenses for illustrative purposes and is not intended to be limiting. For instance, sub-lens array 1702 may include any number (e.g., hundreds, thousands, etc.) of sub-lenses 1704. FIG. 18 shows a side view of adaptable lenticular lens 1700. In FIG. 18, light may be passed through adaptable lenticular lens 1700 in the direction of dotted arrow 1802 to be diverted. Adaptable lenticular lens 1700 is adaptable in that it can be modified to manipulate light in different ways in order to accommodate different viewing configurations. For example, in one embodiment, adaptable lenticular lens is made from an elastic material and can be stretched or shrunk in one or more directions in response to generated drive signals.
Further description regarding the use of an adaptable lenticular lens to deliver three-dimensional views is provided in the aforementioned, incorporated U.S. patent application Ser. No. 12/774,307, filed on May 5, 2010, and entitled “Display with Elastic Light Manipulator.”
C. Example Display Systems Using Multiple Light Manipulators
Display systems in accordance with further embodiments may include multiple layers of light manipulators. Such display systems may enable multiple three-dimensional images to be displayed in a viewing space. The multiple light manipulating layers may enable spatial separation of the images. For instance, in accordance with one embodiment, a display device that includes multiple light manipulator layers may be configured to display a first three-dimensional image in a first region of a viewing space (e.g., a left-side area), a second three-dimensional image in a second region of the viewing space (e.g., a central area), a third three-dimensional image in a third region of the viewing space (e.g., a right-side area), etc. In fact, a display device that includes multiple light manipulator layers may be configured to display any number of spatially separated three-dimensional images as desired for a particular application (e.g., according to a number and spacing of viewers in the viewing space, etc.).
FIG. 19 is a block diagram of an exemplary display system 1900 that includes multiple light manipulator layers in accordance with an embodiment. As shown in FIG. 19, display system 1900 includes driver circuitry 1902 and a screen 1904, wherein screen 1904 includes a pixel array 1922, a first light manipulator 1924 and a second light manipulator 1926. As shown in FIG. 19, first light manipulator 1924 includes first light manipulator elements 1942 and second light manipulator 1926 includes second light manipulator elements 1944. Furthermore, as shown in FIG. 19, driver circuitry 1902 includes pixel array driver circuitry 1912 and light manipulator driver circuitry 1914.
Light 1932 is received at first light manipulator 1924 from pixel array 1922. Pixel array driver circuitry 1912 may generate drive signals 1952 based on a control signal 1908 received from control circuitry (not shown in FIG. 19) and drive signals 1952 may be received by pixel array 1922 to generate light 1932. For example, control signal 1908 may be received via a pathway from processing circuitry, such as processing circuitry 162 of FIG. 1A or processing circuitry 103 of FIG. 1B. Each pixel of pixel array 1922 may generate light that is received at first light manipulator 1924. In an embodiment, pixel array driver circuitry 1912 may generate drive signals 1952 to cause pixel array 1922 to emit light 1932 containing a plurality of images corresponding to the sets of pixels.
First light manipulator 1924 may be configured to manipulate light 1932 received from pixel array 1922. As shown in FIG. 19, first light manipulator 1924 includes light manipulator elements 1942 configured to perform manipulating (e.g., filtering, diverting, etc.) of light 1932 to generate manipulated light 1934. Light manipulator elements 1942 may optionally be configurable to adjust the manipulating performed by first light manipulator 1924. First light manipulator 1924 may perform filtering in a similar manner as an adaptable parallax barrier described above or in other manner. In another embodiment, first light manipulator 1924 may include a lenticular lens that diverts light 1932 to perform light manipulating, generating manipulated light 1934. In an embodiment, light manipulator driver circuitry 1914 may generate drive signals 1954 based on control signal 1908 received by driver circuitry 1902 to cause light manipulator elements 1942 to manipulate light 1932 as desired.
Manipulated light 1934 is received by second light manipulator 1926 to generate manipulated light 1936 that includes a plurality of three-dimensional images 1962A-1962N formed in a viewing space 1906. It will be recognized that manipulated light 1936 may include any number N of three-dimensional images. As shown in FIG. 19, second light manipulator 1926 includes light manipulator elements 1944 configured to perform manipulating of manipulated light 1934 to generate manipulated light 1936. Light manipulator elements 1944 may optionally be configurable to adjust the manipulating performed by second light manipulator 1926. In an embodiment, light manipulator driver circuitry 1914 may generate drive signals 1956 based on control signal 1908 to cause light manipulator elements 1944 to manipulate manipulated light 1934 to generate manipulated light 1936 including three-dimensional images 1962A-1962N as desired. In embodiments, second light manipulator 1926 may include an adaptable parallax barrier or lenticular lens configured to manipulate manipulated light 1934 to generate manipulated light 1936.
As such, screen 1904 of display system 1900 supports multiple viewers with media content in the form of three-dimensional images or views. Screen 1904 may provide a first three-dimensional view based on first three-dimensional media content to a first viewer, a second three-dimensional view based on second three-dimensional media content to a second viewer, and optionally further three-dimensional views based on further three-dimensional media content to further viewers. First and second light manipulators 1924 and 1926 each cause three-dimensional media content to be presented to a corresponding viewer via a corresponding area of screen 1904, with each viewer being enabled to view corresponding media content without viewing media content directed to other viewers. Furthermore, the areas of screen 1904 that provide the various three-dimensional views of media content overlap each other at least in part. In the embodiment of FIG. 19, the areas may be the same area. As such, multiple three-dimensional views that are each viewable by a corresponding viewer may be delivered by a single screen. Embodiments of display system 1900 may also be configured to generate two-dimensional views, as well as any combination of one or more two-dimensional views simultaneously with one or more three-dimensional views.
FIG. 20 shows a block diagram of an exemplary display system 2000, which is a further example of a display system that includes multiple light manipulator layers. Like display system 1900 of FIG. 19, display system 2000 is configured to display multiple three-dimensional images 2062A-2062N in a viewing space 2006 in a spatially separated manner. As shown in FIG. 20, display system 2000 includes driver circuitry 2002 and a screen 2004, wherein screen 2004 includes a light generator 2022, a first light manipulator 2024, a second light manipulator 2026 and a pixel array 2028. As shown in FIG. 20, light generator 2022 optionally includes a backlight array 2042, first light manipulator 2024 includes first light manipulator elements 2044, and second light manipulator 2026 includes second light manipulator elements 2046. Furthermore, as shown in FIG. 20, driver circuitry 2002 receives control signals 2008 and includes light generator driver circuitry 2012, light manipulator driver circuitry 2014, and pixel array driver circuitry 2016. Control signals 2008 may be received via a pathway from processing circuitry, such as processing circuitry 162 of FIG. 1A or processing circuitry 103 of FIG. 1B, for example. Light generator driver circuitry 2012, light manipulator driver circuitry 2014, and pixel array driver circuitry 2016 may generate drive signals to perform their respective functions based on control signals 2008. As shown in FIG. 20, first and second light manipulators 2024 and 2026 are positioned between light generator 2022 and pixel array 2028. In another embodiment, pixel array 2028 may instead be located between first and second light manipulators 2024 and 2026.

III. Exemplary Techniques for Supporting Presentation of Multi-Path and Multi-Source Viewing Content

This section describes exemplary systems and methods that support presentation of multi-path and multi-source viewing content. For example, FIG. 21 is a block diagram of an exemplary system 2100 that supports presentation of three-dimensional viewing content based on portions thereof that are received from respective sources in accordance with an embodiment. As shown in FIG. 21, system 2100 includes a first source 2102A, a second source 2102B, a media circuitry 2104, and a screen 2106. First source 2102A provides first a view portion 2122A of three-dimensional (3D) viewing content 2134 via a first pathway 2120A. First view portion 2122A represents a first subset of perspective views that are represented by the 3D viewing content 2134. Second source 2102B provides a second view portion 2122B of the 3D viewing content 2134 via a second pathway 2120B. The second view portion 2122B represents a second subset of the perspective views that are represented by the 3D viewing content 2134. Each of the first and second subsets may include any suitable number (1, 2, 3, 4, etc.) of the perspective views that are represented by the 3D viewing content 2134. A number of the perspective views that are included in the first subset and a number of the perspective views that are included in the second subset may be the same or different.
In some embodiments, second source 2102B provides a difference file in lieu of the second view portion 2122B. The difference file defines a difference between the first view portion 2122A and the second view portion 2122B. Although the following discussion refers repeatedly to the second view portion 2122B, it will be recognized that the discussion also applies if second source 2102B provides the difference file in lieu of the second view portion 2122B.
Each of first and second sources 2102A and 2102B may be a remote source or a local source. Examples of a remote source include but are not limited to a broadcast media server or an on-demand media server. Examples of a local source include but are not limited to a disc player (e.g., a DVD player, a CD player, or Blu-Ray disc player), a personal computer (e.g., a desktop computer, a laptop computer, or a tablet computer), a personal media player, or a smart phone.
Each of the first and second pathways 2120A and 2120B may include one or more local device pathways, point-to-point links, and/or pathways in a hybrid fiber coaxial (HFC) network, a wide-area network (e.g., the Internet), a local area network (LAN), another type of network, or a combination thereof. Each of the first and second pathways 2120A and 2120B may support wired, wireless, or both transmission media, including satellite, terrestrial (e.g., fiber optic, copper, twisted pair, coaxial, or the like), radio, microwave, free-space optics, and/or any other form or method of transmission.
Media circuitry 2104 is configured to process the first and second view portions 2122A and 2122B to support presentation of 3D viewing content 2134. Media circuitry 2104 includes first circuitry 2112, second circuitry 2114, third circuitry 2116, and fourth circuitry 2118. First circuitry 2112 receives the first and second view portions 2122A and 2122B. For example, if the first and second view portions 2122A and 2122B are encoded, first circuitry 2112 may decode the first and second view portions 2122A and 2122B for further processing by second circuitry 2114. In accordance with this example, if first circuitry 2112 receives the difference file in lieu of the second view portion 2122B from second source 2102B, first circuitry 2112 may decode the first view portion 2122A and the difference file in accordance with one or more techniques described in commonly-owned co-pending U.S. patent application Ser. No. ______, filed on even date herewith and entitled “Video Compression Supporting Selective Delivery of 2D, Stereoscopic 3D and Multi-View 3D Content,” the entirety of which is incorporated by reference herein.
Second circuitry 2114 generates drive signal(s) 2124 based on the first and second view portions 2122A and 2122B. The drive signal(s) 2124 are intended to control screen 2106 to support a visual presentation of the three-dimensional viewing content 2134. For example, second circuitry 2114 may include pixel array driver circuitry (e.g., pixel array driver circuitry 112, 1116, 1912, or 2016) for controlling a pixel array (e.g., pixel array 122, 1126, 1922, or 2028) in screen 2106. In another example, second circuitry 2114 may include light manipulator driver circuitry (e.g., adaptable parallax barrier driver circuitry 114 or 1114, or light manipulator driver circuitry 1914 or 2014) for controlling one or more light manipulators (e.g., adaptable parallax barrier(s) 124 and/or 1124, and/or light manipulator(s) 1924, 1926, 2024 and/or 2026) in screen 2106. In yet another example, second circuitry 2114 may include light generator driver circuitry (e.g., light generator driver circuitry 1112 or 2012) for controlling a light generator (e.g., light generator 1122 or 2022) in screen 2106.
Second circuitry 2114 may synchronize the first view portion 2122A and the second view portion 2122B. Second circuitry may buffer the first view portion 2122A and/or the second view portion 2122B to perform the synchronization. Such buffering may enable second circuitry 2114 to shift the first view portion 2122A and/or the second view portion 2122B with respect to time to align frames that are included in the second view portion 2122B with corresponding frames that are included in the first view portion 2122A, or vice versa. In accordance with this example, second circuitry 2114 generates the drive signal(s) in response to synchronizing the first and second view portions 2122A and 2122B.
Third circuitry 2116 responds to offers that are provided by offer system 2108. Third circuitry 2116 receives the offers via first circuitry 2112. As shown in FIG. 21, first circuitry 2112 receives an offer 2126 that relates to second view portion 2122B from offer system 2108. First circuitry 2112 forwards the offer 2126 to third circuitry 2116. In an example, third circuitry 2116 may determine whether to accept the offer 2126 based on one or more predetermined criteria. Such criteria may require, for example, that a cost that is specified by the offer 2126 be less than a cost threshold, that the offer 2126 specify one or more perspective views represented by the second view portion 2122B that are included among one or more designated perspective views, etc. In another example, third circuitry 2116 may determine whether to accept the offer 2126 based on input from a viewer. In accordance with this example, third circuitry 2116 may send a request regarding the offer 2126 to the viewer and determine whether to accept the offer 2126 based on the viewer's response to the request.
Third circuitry 2116 is shown in FIG. 21 to provide an acceptance 2128 of the offer 2126 to offer system 2108 for purposes of illustration. Provision of the acceptance 2128 by third circuitry 2116 may trigger any of a variety of events. For example, second source 2102B may provide the second view portion 2122B to first circuitry 2112 in response to third circuitry 2116 providing the acceptance 2128. In another example, offer system 2108 may provide an enabling signal 2132 to first circuitry 2112 that enables media circuitry 2104 to access the second view portion 2122B in response to third circuitry 2116 providing the acceptance 2128. For instance, the enabling signal 2132 may include information, such as a passcode or a decryption key, that first circuitry 2112 may use to obtain access to the second view portion 2122B. In yet another example, third circuitry 2116 may trigger a billing event regarding the second view portion 2122B based at least in part on provision of the acceptance 2128. For instance, the billing event may involve billing the viewer a cost that is specified in the offer 2126.
The discussion above regarding the offer 2132 and the acceptance 2128 is provided for illustrative purposes and is not intended to be limiting. It will be recognized that second source 2102B may provide the second view portion 2122B to first circuitry 2112 regardless whether the offer 2126 and the acceptance 2128 are present. Moreover, first circuitry 2112 may be capable of accessing the second view portion 2122B regardless whether first circuitry 2112 receives the enabling signal 2132.
Fourth circuitry 2108 determines that the first view portion 2122A is received by first circuitry 2112. For instance, fourth circuitry 2108 may receive an indicator from first circuitry 2112 that indicates receipt of the first view portion 2122A. Upon determining that the first view portion 2122A is received, fourth circuitry 2108 delivers an indication 2130 relating to the first view portion 2122A to offer system 2108. The indication 2130 indicates that the first view portion 2122A is received by media circuitry 2104. In an embodiment, first circuitry 2112 receives the offer 2126 from offer system 2108 in response to fourth circuitry 2118 providing the indication 2130 to offer system 2108.
Offer system 2108 provides the offer 2126 relating to the second view portion 2122B to first circuitry 2112. Offer system 2108 may receive the acceptance 2128 from third circuitry 2116 is response to providing the offer 2126. In one embodiment, upon receiving the acceptance 2128, offer system 2108 provides then instruction 2134 to second source 2102B. The instruction 2134 instructs second source 2102B to deliver the second view portion 2122B to media circuitry 2104. Accordingly, second source may not deliver the second view portion 2122B to media circuitry 2104 until receipt of the instruction 2134. In another embodiment, upon receiving the acceptance 2128, offer system 2108 provides the enabling signal 2132 to first circuitry 2112 for enabling media circuitry 2104 to access the second view portion 2122B.
The output of media circuitry 2104 comprises the drive signal(s) 2124. Screen 2106 presents the 3D viewing content 2134 in viewing space 2110 based on the drive signal(s) 2124. As described above, screen 2106 may include a pixel array, one or more light manipulators, and/or a light generator for supporting presentation of the 3D viewing content 2134. Screen 2106 may be any suitable type of screen, including but not limited to an LCD screen, a plasma screen, a light emitting device (LED) screen (e.g., an OLED (organic LED) screen), etc.
It will be recognized that although first circuitry 2112, second circuitry 2114, third circuitry 2116, and fourth circuitry 2118 are labeled as such, the functionality of first circuitry 2112, second circuitry 2114, third circuitry 2116, and fourth circuitry 2118 may be implemented in hardware, software, firmware, or any combination thereof. Moreover, system 2100 may not include one or more of first source 2102A, second source 2102B, screen 2106, offer system 2108, first circuitry 2112, second circuitry 2114, third circuitry 2116, and/or fourth circuitry 2118. Furthermore, system 2100 may include elements in addition to or in lieu of first source 2102A, second source 2102B, screen 2106, offer system 2108, first circuitry 2112, second circuitry 2114, third circuitry 2116, and/or fourth circuitry 2118.
FIG. 22 is a block diagram of another exemplary system 2100 that supports presentation of three-dimensional viewing content based on portions thereof that are received from respective sources in accordance with an embodiment. As shown in FIG. 22, display system 2200 includes a first source 2202A, a second source 2202B, media circuitry 2204, and a screen 2206. First and second sources 2202A and 2202B and screen 2206 operate in like manner to first and second sources 2102A and 2102B and screen 2106, as described above with reference to FIG. 21. For instance, first and second sources 2202A and 2202B provide respective first and second view portions 2222A and 2222B via respective first and second pathways 2220A and 2220B to media circuitry 2104. Screen 2206 presents 3D viewing content 2234 in viewing space 2210 based on drive signal(s) 2224 that are received from media circuitry 2204.
Media circuitry 2204 includes first circuitry 2212, second circuitry 2214, and third circuitry 2216. First and second circuitry 2212 and 2214 operate in like manner to first and second circuitry 2112 and 2114, as described above with reference to FIG. 21. For instance, first circuitry 2212 receives the first and second view portions 2222A and 2222B from first and second sources 2202A and 2202B. Second circuitry 2214 generates the drive signal(s) 2224 based on the first and second view portions 2222A and 2222B.
First circuitry 2212 is shown in FIG. 22 to receive a control signal 2236, a search instruction 2238, and an orientation indication 2240 for illustrative purposes. It will be recognized that first circuitry 2212 need not necessarily receive each of the control signal 2236, the search instruction 2238, and the orientation indication 2240. For instance, first circuitry may receive any one or more of the control signal 2236, the search instruction 2238, and/or the orientation indication 2240.
The control signal 2236 is generated in response to viewer input. For instance, the control signal 2236 may specify one or more portions or perspective views that are identified by the viewer input. First circuitry 2212 may receive the control signal 2236 from a user input interface that is accessible to the viewer. The user input interface may be a remote control device, a traditional computer input device such as a keyboard or mouse, a touch screen, a gamepad or other type of gaming console input device, or one or more sensors including but not limited to video cameras, microphones and motion sensors. In an embodiment, third circuitry 2216 selects the second view portion 2222B based on the control signal 2236. For instance, third circuitry 2216 may review available portions of content to identify the portion(s) that are specified by the control signal 2236 or that represent perspective views that are specified by the control signal 2236. In accordance with this embodiment, third circuitry 2216 may select the second view portion 2222B in response to the second view portion 2222B including the identified portion(s).
The search instruction 2238 is intended to initiate a search for portion(s) of content that may be combined with the first view portion 2222A for presentation of the 3D viewing content 2234. The search instruction 2238 may be generated by a user input interface in response to viewer input, for example. In an embodiment, third circuitry 2216 initiates the search based on the search instruction 2238. In accordance with this embodiment, first circuitry 2212 may receive the second view portion 2222B in response to initiation of the search.
The orientation indication 2240 indicates an orientation of the viewer with respect to screen 2206. For example, the orientation indication 2240 may be received from a device that is worn by the viewer, held by the viewer, sitting in the viewer's lap, in the viewer's pocket, sitting next the viewer, etc. In another example, the orientation indication 2240 may be received in response to a distancing signal that is transmitted toward the viewer by third circuitry 2216. In accordance with this example, third circuitry 2216 may determine an orientation (e.g., location) of the viewer based on a difference between a time at which third circuitry 2216 transmits the distancing signal and a time at which third circuitry receives the orientation indication 2240. For instance, a reflection of the distancing signal from the viewer may be received by third circuitry 2216 as the orientation indication 2240.
In an embodiment, third circuitry 2216 selects the second view portion 2222B based on the orientation of the viewer, as indicated by the orientation indication 2240. As shown in FIG. 22, third circuitry 2216 provides a selection instruction 2242 to second source 2202B. The selection instruction 2242 instructs second source 2202B to provide the second view portion 2222B to media circuitry 2204.
In an example, if the orientation indication 2240 indicates that the orientation of the viewer is toward a left side of screen 2206, third circuitry 2216 may select the second view portion 2222B based on the second view portion 2222B representing perspective views that facilitate a left-oriented viewing experience, such as perspective views 1, 2, and 4 of 3D8 viewing content. In accordance with this example, if the first view portion 2222A represents a single perspective view, such as perspective view 3, the 3D viewing content 2234 may be presented as 3D4 viewing content that represents perspective views 1, 2, 3, and 4.
In another example, if the orientation indication 2240 indicates that the orientation of the viewer is substantially aligned with a center of screen 2206, third circuitry 2216 may select the second view portion 2222B based on the second view portion 2222B representing perspective views that facilitate a center-oriented viewing experience, such as perspective views 4, 6, 8, 10, 12, and 14 of 3D16 viewing content. In accordance with this example, if the first view portion 2222A represents two perspective views, such as perspective views 5 and 9, the 3D viewing content 2234 may be presented as 3D8 viewing content that represents perspective views 4, 5, 6, 8, 9, 10, 12, and 14.
In yet another example, if the orientation indication 2240 indicates that the orientation of the viewer is toward a right side of screen 2206, third circuitry 2216 may select the second view portion 2222 based on the second view portion 2222 representing perspective views that facilitate a right-oriented viewing experience, such as perspective views 9, 11, 13, and 15 of 3D16 viewing content. In accordance with this example, if the first view portion 2222A represents four perspective views (e.g., perspective views 8, 10, 12, and 14), the 3D viewing content 2234 may be presented as 3D8 viewing content that represents perspective views 8, 9, 10, 11, 12, 13, 14, and 15. The examples provided herein are merely teaching examples and are not intended to be limiting.
Presentation of multi-path and multi-source viewing content may be supported in a variety of ways according to embodiments. For instance, FIGS. 23-29 depicts flowcharts 2300, 2400, 2500, 2600, 2700, 2800, and 2900 of exemplary methods for supporting presentation of three-dimensional viewing content based on portions thereof that are received from respective sources in accordance with embodiments. Flowcharts 2300, 2400, 2500, 2600, 2700, 2800, and 2900 may be performed by system 2100 shown in FIG. 21 or system 2200 shown in FIG. 22, for example. However the methods of flowcharts 2300, 2400, 2500, 2600, 2700, 2800, and 2900 are not limited to those embodiments. Further structural and operational embodiments will be apparent to persons skilled in the relevant art(s) based on the discussion regarding flowcharts 2300, 2400, 2500, 2600, 2700, 2800, and 2900.
As shown in FIG. 23, flowchart 2300 begins with step 2302. In step 2302, a first data portion of three-dimensional viewing content is received via a first pathway. The first data portion originates from a first source. The first data portion is associated with a first perspective view. For instance, the first data portion may comprise a two-dimensional portion of the three-dimensional viewing content, though the scope of the embodiments is not limited in this respect. In an exemplary implementation, first circuitry 2112 or 2212 receives first view portion 2122A or 2222A of 3D viewing content 2134 or 2234 via first pathway 2120A or 2220A. First view portion 2122A or 2222A originates from first source 2102A or 2202A.
At step 2304, a second data portion of the three-dimensional viewing content is received via a second pathway. The second data portion originates from a second source. The second data portion is associated with a second perspective view. In an exemplary implementation, first circuitry 2112 or 2212 receives second view portion 2122B or 2222B of 3D viewing content 2134 or 2234 via second pathway 2120B or 2220B. Second view portion 2122B or 2222B originates from second source 2102B or 2202B.
At step 2306, a visual presentation of the three-dimensional viewing content is caused based on both the first data portion and the second data portion. In an exemplary implementation, second circuitry 2114 or 2214 causes a visual presentation of 3D viewing content 2134 or 2234 based on both the first view portion 2122A or 2222A and the second view portion 2122B or 2222B.
In an embodiment, instead of performing step 2304 of flowchart 2300, the steps shown in flowchart 2400 or flowchart 2500 of respective FIG. 24 or 25 may be performed. As shown in FIG. 24, flowchart 2400 begins at step 2402. In step 2402, a search for a second data portion of the three-dimensional viewing content is initiated in response to a search instruction. In an exemplary implementation, third circuitry 2216 initiates a search for second view portion 2222B in response to search instruction 2238.
At step 2404, the second data portion is received via a second pathway in response to initiating the search. The second data portion originates from a second source. The second data portion is associated with a second perspective view. In an exemplary implementation, first circuitry 2212 second view portion 2222B.
As shown in FIG. 25, flowchart 2500 begins at step 2502. In step 2502, an offer relating to a second data portion of the three-dimensional viewing content is received. In an exemplary implementation, first circuitry 2112 receives offer 2126 relating to second view portion 2122B.
At step 2504, acceptance of the offer is carried out. For instance, carrying out the acceptance of the offer may trigger a billing event regarding the second data portion. In an exemplary implementation, third circuitry 2116 carries out acceptance of offer 2126. For instance, Third circuitry 2116 may provide acceptance 2128 to accept offer 2126.
At step 2506, the second data portion is received via a second pathway. The second data portion originates from a second source. The second data portion is associated with a second perspective view. In an exemplary implementation, first circuitry 2112 receives second view portion 2122B via second pathway 2120B.
In an embodiment, instead of performing step 2502 of flowchart 2500, the steps shown in flowchart 2600 of FIG. 26 may be performed. As shown in FIG. 26, flowchart 2600 begins at step 2602. In step 2602, an indication relating to the first data portion is delivered. In an exemplary implementation, fourth circuitry 2118 delivers indication 2130 relating to first view portion 2122A.
At step 2604, an offer relating to a second data portion of the three-dimensional viewing content is received. The offer is based at least in part on the indication. In an exemplary implementation, first circuitry 2112 receives offer 2126 relating to second view portion 2122B.
Flowchart 2300 of FIG. 3 may further include the step shown in flowchart 2700 of FIG. 27 or the step shown in flowchart 2800 of FIG. 28. As shown in FIG. 27, flowchart 2700 includes step 2702. At step 2702, the second data portion is selected based on an orientation of a viewer with respect to a screen assembly that supports the visual presentation of the three-dimensional viewing content. In an exemplary implementation, third circuitry 2216 selects second view portion 2222B based on an orientation of a viewer with respect to screen 2206, which supports visual presentation of 3D viewing content 2234.
As shown in FIG. 28, flowchart 2800 includes step 2802. At step 2802, the second data portion is selected based on viewer input. In an exemplary implementation, third circuitry 2216 selects second view portion 2222B based on control signal 2236, which is generated in response to viewer input.
FIG. 29 depicts an exemplary implementation of the method of flowchart 2300 in accordance with an embodiment. As shown in FIG. 29, flowchart 2900 begins at step 2902. In step 2902, a first data portion of three-dimensional viewing content that comprises a two-dimensional portion is received via a first pathway. The first data portion is associated with a single first perspective view. The first data portion originates from a storage that is local to a device that causes a visual presentation of the three-dimensional viewing content. In an exemplary implementation, first circuitry 2112 or 2212 receives first view portion 2122A or 2222A via a first pathway 2120A or 2220A. In accordance with this implementation, first view portion 2122A or 2222A comprises a two-dimensional portion and is associated with a single first perspective view. Further in accordance with this implementation, first view portion 2122A or 2222A originates from first source 2102A or 2202A, which may be local to a device that includes media circuitry 2104 or 2204, for example.
At step 2904, a second data portion of the three-dimensional viewing content is received via a second pathway. The second data portion is associated with at least one second perspective view. The second data portion originates from a second source. In an exemplary implementation, first circuitry 2112 or 2212 receives second view portion 2122B or 2222B via a second pathway 2120B or 2220B. In accordance with this implementation, second view portion 2122B or 2222B is associated with at least one second perspective view. Further in accordance with this implementation, second view portion 2122B or 2222B originates from second source 2102B or 2202B. For instance, second source 2102B or 2202B may be local or remote to the device that includes media circuitry 2104 or 2204.
At step 2906, the visual presentation of the three-dimensional viewing content is caused based on both the first data portion and the second data portion. The three-dimensional viewing content represents at least two perspective views. In an exemplary implementation, second circuitry 2114 or 2214 causes a visual presentation of 3D viewing content 2134 or 2234 based on both the first view portion 2122A or 2222A and the second view portion 2122B or 2222B. In accordance with this exemplary implementation, 3D viewing content 2134 or 2234 represents at least two perspective views.
FIG. 30 is a block diagram of an exemplary system 3000 that directs configurations of respective regions of a screen assembly to support display of respective instances of content in accordance with an embodiment. As shown in FIG. 30, system 3000 includes first source 3002A, second source 3002B, media system 3004, and screen 3006. First source 3002A provides a first content instance 3022A via a first pathway 3020A. Second source 3002B provides a second content instance 3022B via a second pathway 3020B. Each of the first and second content instances 3022A and 3022B may represent any suitable number of perspective views. A number of perspective views represented by the first content instance 3022A and a number of perspective views represented by the second content instance 3022B may be the same or different.
First source 3002A and/or second source 3002B may include multiple sources. For example, portions of the first content instance 3022A may be provided by respective sources that are included in first source 3002A. Each portion of the first content instance 3022A may represent a respective subset of the perspective views that are represented by the first content instance 3022A. In another example, portions of the second content instance 3022B may be provided by respective sources that are included in second source 3002B. Each portion of the second content instance 3022B may represent a respective subset of the perspective views that are represented by the second content instance 3022B.
Media circuitry 3004 includes first circuitry 3012 and second circuitry 3014. First circuitry 3012 receives the first and second content instances 3022A and 3022B. For example, if the first and second content instances 3022A and 3022B are encoded, first circuitry 3012 may decode the first and second content instances 3022A and 3022B for further processing by second circuitry 3014.
Second circuitry 3014 generates first drive signal(s) 3024A to direct a first configuration of a first region 3044A of screen 3006. The first configuration supports display of the first content instance 3022A. Second circuitry 3014 further generates second drive signal(s) 3024B to direct a second configuration of a second region 3044B of screen 3006. The second configuration supports display of the second content instance 3022B. The second configuration is different from the first configuration.
For example, second circuitry 3014 may include pixel array driver circuitry (e.g., pixel array driver circuitry 112, 1116, 1912, or 2016) for generating pixel array drive signals (e.g., drive signals 152, 1156, or 1952). In another example, second circuitry 3014 may include light manipulator driver circuitry (e.g., adaptable parallax barrier driver circuitry 114 or 1114, or light manipulator driver circuitry 1914 or 2014) for generating light manipulator drive signals (e.g., drive signals 154, 1154, 1954, and/or 1956). In yet another example, second circuitry 3014 may include light generator driver circuitry (e.g., light generator driver circuitry 1112 or 2012) for generating light generator drive signals (e.g., drive signals 1152). Any of the aforementioned drive signals may be included among the first and second drive signal(s) 3024A and 3024B.
Screen 3006 includes first region 3044A and second region 3044B. The first and second regions 3044A and 3044B may include respective portions of a pixel array (e.g., pixel array 122, 1126, 1922, or 2028), respective portions of one or more light manipulators (e.g., adaptable parallax barrier(s) 124 and/or 1124, and/or light manipulator(s) 1924, 1926, 2024 and/or 2026), and/or respective portions of a light generator (e.g., light generator 1122 or 2022). For instance, the first drive signal(s) 3024A may be configured to control configurations of the portions of the pixel array, light manipulator(s), and/or light generator that are included in first region 3044A. The second drive signal(s) 3024B may be configured to control configurations of the portions of the pixel array, light manipulator(s), and/or light generator that are included in second region 3044B.
FIG. 31 depicts a flowchart 3100 of a method for directing configurations of respective regions of a screen assembly for supporting display of respective instances of content in accordance with embodiments. As shown in FIG. 31, flowchart 3100 begins at step 3102. In step 3102, first viewing content that originates from a first source is received via a first pathway. In an exemplary implementation, first circuitry 3012 receives first content instance 3022A via first pathway 3020A. In accordance with this implementation, the first content instance 3022A originates from first source 3002A.
At step 3104, second viewing content that originates from a second source is received via a second pathway. In an exemplary implementation, first circuitry 3012 receives second content instance 3022B via second pathway 3020B. In accordance with this implementation, the second content instance 3022B originates from second source 3002B.
In an embodiment, the first pathway comprises a local pathway, and the second pathway comprises a remote pathway. A local pathway is a pathway from a local source. A remote pathway is a pathway from a remote source. Examples of a remote source include but are not limited to a broadcast media server or an on-demand media server. Examples of a local source include but are not limited to a disc player (e.g., a DVD player, a CD player, or Blu-Ray disc player), a personal computer (e.g., a desktop computer, a laptop computer, or a tablet computer), a personal media player, or a smart phone.
In another embodiment, the first viewing content is two-dimensional content, and the second viewing content is three-dimensional content. In accordance with this embodiment, the first viewing content represents a single perspective view. In further accordance with this embodiment, the second viewing content represents multiple views, any two of which may be combined for perception as three-dimensional image(s).
In yet another embodiment, the first viewing content is first three-dimensional content, and the second viewing content is second three-dimensional content. The first three-dimensional content may represent a first number of perspectives, and the second three-dimensional content may represent a second number of perspectives. The first number may be different from or the same as the first number.
The second viewing content may be related to the first viewing content or unrelated to the first viewing content. If the first viewing content and the second viewing content correspond to a common video event, the first viewing content and the second viewing content are said to be related. Otherwise, the first viewing content and the second viewing content are said to be unrelated.
At step 3106, a first configuration of a first region of a screen assembly is directed. The first configuration supports display of the first viewing content. In an exemplary implementation, second circuitry 3014 directs a first configuration of first region 3044A of screen 3006. In accordance with this implementation, the first configuration of first region 3044A supports display of first content instance 3022A.
At step 3108, a second configuration of a second region of the screen assembly is directed. The second configuration supports display of the second viewing content. The second configuration is different from the first configuration. In an exemplary implementation, second circuitry 3014 directs a second configuration of second region 3044B of screen 3006 that is different from the first configuration of first region 3044A. In accordance with this implementation, the second configuration of second region 3044B supports display of second content instance 3022B.
FIG. 32 is a block diagram of an example practical implementation of a display system 3200 in accordance with an embodiment. As shown in FIG. 32, display system 3200 generally comprises control circuitry 3202, driver circuitry 3204 and a screen 3206.
As shown in FIG. 32, control circuitry 3202 includes a processing unit 3214, which may comprise one or more general-purpose or special-purpose processors or one or more processing cores. Processing unit 3214 is connected to a communication infrastructure 3212, such as a communication bus. Control circuitry 3202 may also include a primary or main memory (not shown in FIG. 32), such as random access memory (RAM), that is connected to communication infrastructure 3212. The main memory may have control logic stored thereon for execution by processing unit 3214 as well as data stored thereon that may be input to or output by processing unit 3214 during execution of such control logic.
Control circuitry 3202 may also include one or more secondary storage devices (not shown in FIG. 32) that are connected to communication infrastructure 3212, including but not limited to a hard disk drive, a removable storage drive (such as an optical disk drive, a floppy disk drive, a magnetic tape drive, or the like), or an interface for communicating with a removable storage unit such as an interface for communicating with a memory card, memory stick or the like. Each of these secondary storage devices provide an additional means for storing control logic for execution by processing unit 3214 as well as data that may be input to or output by processing unit 3214 during execution of such control logic.
Control circuitry 3202 further includes a user input interface 3218, a viewer tracking unit 3216, and a media interface 3220. User input interface 3218 is intended to generally represent any type of interface that may be used to receive user input, including but not limited to a remote control device, a traditional computer input device such as a keyboard or mouse, a touch screen, a gamepad or other type of gaming console input device, or one or more sensors including but not limited to video cameras, microphones and motion sensors.
Viewer tracking unit 3216 is intended to generally represent any type of functionality for determining or estimating a location of one or more viewers of display system 3200 and/or a head orientation of one or more viewers of display system 3200. Viewer tracking unit may perform such functions using different types of sensors (e.g., cameras, motion sensors, microphones or the like) or by using tracking systems such as those that wirelessly track an object (e.g., headset, remote control, or the like) currently being held or worn by a viewer.
Media interface 3220 is intended to represent any type of interface that is capable of receiving media content such as video content or image content. In certain implementations, media interface 3220 may comprise an interface for receiving media content from a remote source such as a broadcast media server, an on-demand media server, or the like. In such implementations, media interface 3220 may comprise, for example and without limitation, a wired or wireless internet or intranet connection, a satellite interface, a fiber interface, a coaxial cable interface, or a fiber-coaxial cable interface. Media interface 3220 may also comprise an interface for receiving media content from a local source such as a DVD or Blu-Ray disc player, a personal computer, a personal media player, smart phone, or the like. Media interface 3220 may be capable of retrieving video content from multiple sources.
Control circuitry 3202 further includes a communication interface 3222. Communication interface 3222 enables control circuitry 3202 to send control signals via a communication medium 3252 to another communication interface 3230 within driver circuitry 3204, thereby enabling control circuitry 3202 to control the operation of driver circuitry 3204. Communication medium 3252 may comprise any kind of wired or wireless communication medium suitable for transmitting such control signals.
As shown in FIG. 32, driver circuitry 3204 includes the aforementioned communication interface 3230 as well as pixel array driver circuitry 3232 and adaptable light manipulator driver circuitry 3234. Driver circuitry also optionally includes light generator driver circuitry 3236. Each of these driver circuitry elements is configured to receive control signals from control circuitry 3202 (via the link between communication interface 3222 and communication interface 3230) and, responsive thereto, to send selected drive signals to a corresponding hardware element within screen 3206, the drive signals causing the corresponding hardware element to operate in a particular manner. In particular, pixel array driver circuitry 3232 is configured to send selected drive signals to a pixel array 3242 within screen 3206, adaptable light manipulator driver circuitry 3234 is configured to send selected drive signals to an adaptable light manipulator 3244 within screen elements 3206, and optional light generator driver circuitry 3236 is configured to send selected drive signals to an optional light generator 3246 within screen 3206.
In one example mode of operation, processing unit 3214 operates pursuant to control logic to receive video content via media interface 3220 and to generate control signals necessary to cause driver circuitry 3204 to render such video content to screen 3206 in accordance with a selected viewing configuration. The control logic that is executed by processing unit 3214 may be retrieved, for example, from a primary memory or a secondary storage device connected to processing unit 3214 via communication infrastructure 3212 as discussed above. The control logic may also be retrieved from some other local or remote source. Where the control logic is stored on a computer readable medium, that computer readable medium may be referred to herein as a computer program product.
Among other features, driver circuitry 3204 may be controlled in a manner previously described to send coordinated drive signals necessary for simultaneously displaying two-dimensional images, three-dimensional images and multi-view three-dimensional content via different display regions of the screen. The manner in which pixel array 3242, adaptable light manipulator 3244 (e.g., an adaptable parallax barrier), and light generator 3246 may be manipulated in a coordinated fashion to perform this function was described previously herein. Note that in accordance with certain implementations (e.g., implementations in which pixel array comprises an OLED/PLED pixel array), screen 3206 need not include light generator 3246.
In one embodiment, at least part of the function of generating control signals necessary to cause pixel array 3242, adaptable light manipulator 3244 and light generator 3246 to render video content to screen 3206 in accordance with a selected viewing configuration is performed by drive signal processing circuitry 3238 which is integrated within driver circuitry 3204. Such circuitry may operate, for example, in conjunction with and/or under the control of processing unit 3214 to generate the necessary control signals.
In certain implementations, control circuitry 3202, driver circuitry 3204 and screen elements 3206 are all included within a single housing. For example and without limitation, all these elements may exist within a television, a laptop computer, a tablet computer, or a telephone. In accordance with such an implementation, the link 3252 formed between communication interfaces 3222 and 3230 may be replaced by a direct connection between driver circuitry 3204 and communication infrastructure 3212. In an alternate implementation, control circuitry 3202 is disposed within a first housing, such as set top box or personal computer, and driver circuitry 3204 and screen 3206 are disposed within a second housing, such as a television or computer monitor. The set top box may be any type of set top box including but not limited to fiber, Internet, cable, satellite, or terrestrial digital.

IV. Conclusion

While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example only, and not limitation. It will be apparent to persons skilled in the relevant art that various changes in form and detail can be made therein without departing from the spirit and scope of the invention. Thus, the breadth and scope of the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.

Claims

1. A method used with three-dimensional viewing content, the three-dimensional viewing content having both a first data portion associated with a first perspective view and a second data portion associated with a second perspective view, the method comprising:

receiving the first data portion that originates from a first source via a first pathway;

receiving the second data portion that originates from a second source via a second pathway; and

causing a visual presentation of the three-dimensional viewing content based on both the first data portion and the second data portion.

2. The method of claim 1, further comprising:

receiving an offer relating to the second data portion; and

carrying out acceptance of the offer;

wherein receiving the second data portion comprises:

receiving the second data portion in response to carrying out the acceptance of the offer.

3. The method of claim 2, further comprising:

delivering an indication relating to the first data portion;

wherein the offer is based at least in part on the indication.

4. The method of claim 2, wherein carrying out the acceptance of the offer triggers a billing event regarding the second data portion.

5. The method of claim 1, wherein the first data portion comprising a two-dimensional portion of the three-dimensional viewing content.

6. The method of claim 5, wherein receiving the first data portion comprises:

receiving the first data portion that represents a single perspective view from a storage that is local to a device that causes the visual presentation of the three-dimensional viewing content;

wherein receiving the second data portion comprises:

receiving the second data portion that represents at least one other perspective view; and

wherein causing the visual presentation comprises:

causing the visual presentation of the three-dimensional viewing content that represents at least two perspective views.

7. The method of claim 1, further comprising:

selecting the second data portion based on an orientation of a viewer with respect to a screen assembly that supports the visual presentation of the three-dimensional viewing content.

8. The method of claim 1, further comprising:

selecting the second data portion based on viewer input.

9. The method of claim 1, further comprising:

initiating a search for the second data in response to a search instruction;

wherein receiving the second data portion comprises:

receiving the second data portion in response to initiating the search.

10. A method used to display first viewing content and second viewing content on a screen assembly, the method comprising:

receiving the first viewing content that originates from a first source via a first pathway;

receiving the second viewing content that originates from a second source via a second pathway;

directing a first configuration of a first region of the screen assembly, the first configuration supporting display of the first viewing content; and

directing a second configuration of a second region of the screen assembly, the second configuration supporting display of the second viewing content, and the second configuration being different from the first configuration.

11. The method of claim 10, wherein the first pathway comprises a local pathway and the second pathway comprises a remote pathway.

12. The method of claim 10, wherein the second viewing content is unrelated to the first viewing content.

13. The method of claim 10, wherein the first viewing content is two-dimensional content; and

wherein the second viewing content is three-dimensional content.

14. The method of claim 10, wherein the first viewing content is first three-dimensional content that represents a first number of perspectives; and

wherein the second viewing content is second three-dimensional content that represents a second number of perspectives, the second number being different from the first number.

15. Media circuitry that supports three-dimensional viewing content, the three-dimensional viewing content having both a first view portion associated with a first perspective view and a second view portion associated with a second perspective view, the media circuitry comprising:

first circuitry that receives both the first view portion that originates from a first source via a first pathway, and the second view portion that originates from a second source via a second pathway; and

second circuitry that causes a visual presentation of the three-dimensional viewing content based on both the first view portion and the second view portion.

16. The media circuitry of claim 15, wherein the first circuitry receives an offer relating to the second view portion; and

wherein the media circuitry further comprises:

third circuitry that carries out acceptance of the offer.

17. The media circuitry of claim 16, further comprising:

fourth circuitry that delivers an indication relating to the first view portion;

wherein the offer is based on the indication.

18. The media circuitry of claim 16, wherein the third circuitry triggers a billing event regarding the second view portion based at least in part on acceptance of the offer.

19. The media circuitry of claim 15, wherein the first view portion represents a single perspective view of the three-dimensional viewing content.

20. The media circuitry of claim 19, wherein the first circuitry receives the first view portion from a storage that is local to a device that includes the media circuitry; and

wherein the three-dimensional viewing content represents at least two perspective views.

21. The media circuitry of claim 15, further comprising:

third circuitry that selects the second view portion based on an orientation of a viewer with respect to a screen assembly on which the second circuitry causes the visual presentation of the three-dimensional viewing content.

22. The media circuitry of claim 15, wherein the first circuitry receives a control signal that is generated in response to viewer input; and

wherein the media circuitry further comprises:

third circuitry that selects the second view portion based on the control signal.

23. The media circuitry of claim 15, further comprising:

third circuitry that initiates a search for the second data in response to a search instruction;

wherein the first circuitry receives the second data portion in response to initiation of the search.

24. A media system that supports display of first content and second content on a screen assembly, the media system comprising:

first circuitry that receives both the first content that originates from a first source via a first pathway, and the second content that originates from a second source via a second pathway;

second circuitry that directs a first configuration of a first region of the screen assembly, the first configuration supporting display of the first content; and

the second circuitry directs a second configuration of a second region of the screen assembly, the second configuration supporting display of the second content, and the second configuration being different from the first configuration.

25. The media system of claim 24, wherein the first pathway comprises a local pathway and the second pathway comprises a remote pathway.

26. The media system of claim 24, wherein the second viewing content is unrelated to the first viewing content.

27. The media system of claim 24, wherein the first viewing content is two-dimensional content; and

wherein the second viewing content is three-dimensional content.

28. The media system of claim 24, wherein the first viewing content is first three-dimensional content that represents a first number of perspectives; and