|Veröffentlichungsdatum||5. Dez. 2000|
|Eingetragen||11. Aug. 1997|
|Prioritätsdatum||11. Aug. 1997|
|Veröffentlichungsnummer||08909710, 909710, US 6157351 A, US 6157351A, US-A-6157351, US6157351 A, US6157351A|
|Ursprünglich Bevollmächtigter||I-O Display Systems, Llc|
|Zitat exportieren||BiBTeX, EndNote, RefMan|
|Patentzitate (9), Referenziert von (15), Klassifizierungen (22), Juristische Ereignisse (16)|
|Externe Links: USPTO, USPTO-Zuordnung, Espacenet|
The present invention relates to computer systems and more particularly to the display of three dimensional images utilizing a personal computer system.
In general an individual uses both eyes to view objects or images. Due to the separation of our eyes, each eye views the world from a slightly different vantage point. The two views are combined by the human brain to allow one to perceive depth or three dimensions.
Computer displays or movie screens have no depth. Thus when viewing a computer display or movie screen both of an individual's eyes see the same image and there is no depth perception, that is, the individual does not perceive three dimensions in the image being viewed.
The art of presenting different images to the right and left eye of a viewer so that the viewer perceives a three dimensional image is well developed. Different images can be presented to each eye of a viewer using special eye glasses. One early system utilized polarized glasses, the lenses of which pass vertical polarized light to one eye and horizontally polarized light to the other eye. When a viewer is wearing such glasses, if correctly polarized images are projected, the viewer can perceive (i.e. see) a three dimensional image.
Other known systems utilize eye glasses which have lenses that can be electronically opened and closed. The lenses are alternatively opened and closed and appropriate images are alternatively projected on a screen or display in time sequence synchronized with the opening and closing of the lenses.
There are two type of systems that utilize such glasses. The first type of system displays images in what is often called "page flip mode". In page flip mode, right and left eye images are alternatively displayed. The right eye lens is opened to see one set of images and the left eye lens is opened to see the other set of images. The second type of system is generally referred to as an "interlaced" system". Interlaced systems display different images using the even and odd lines of the display. That is, a first image is displayed using the even numbered lines on the display and then a second image is displayed using the odd numbered lines on the display. The right eye shutter is opened for one image and the left eye shutter is opened for the second image.
Many computer systems are utilized for a variety of functions, programs and operations. It is desirable to have a system which can display three dimensional images and which can at other times be used for other purposes which involve display of conventional two dimensional images. Even with systems which are exclusively used for games, it is desirable to be able to use the system for both normal images and for three dimensional images.
The present invention provides a system which can automatically display either regular two dimensional images or three dimensional images. The system includes, a processor which executes a program, a display, eye glasses which have electronically controllable lenses, and a detector unit connected between the processing unit and the display. Prior to displaying a three dimensional image, the processor sends a signal to the display which represents a particular bar code. The bar code indicates if the following three dimensional images will be displayed in page flip mode or in an interlaced mode. The detector unit detects the bar code and activates the special glasses so that the lenses in the glasses are alternatively opened and closed as frames are displayed. At the end of the three dimensional presentation, the processor sends another bar code to the display. The detector detects this bar code and the systems resumes normal two dimensional operation with both lenses in the glasses being open at all times.
A further feature of the present invention is that it can be used to display a three dimensional "widow" on a screen which has normal two dimensional data. The three dimensional window is surrounded by a border which is detected by the detector unit and only the data within this border or window is displayed in three dimensional page flip or interlaced mode.
FIG. 1 is an overall drawing showing the major components in the system.
FIG. 2 diagramatically shows the system components through which the data stream passes.
FIG. 3 is a block diagram of the detector unit.
FIG. 4 shows a display with a window of three dimensional data.
The main components of the system as shown in FIG. 1 include a conventional computer display 10, a special adapter 20, a conventional personal computer processing unit 30, an infra red signal transmitter 40 and a pair of eye glasses 50. The eye glasses 50 include lenses which can be electronically opened and closed. Signals which control operation of the lenses are transmitted to glasses 50 via an infra red signal link that includes transmitter 40 and receiver 55.
The system shown can display both two dimensional images on display 10 in a conventional manner and three dimensional images. When a program in processor 30 desires to initiate three dimensional operation, it first sends an image containing a special bar code to display 10. The special bar code is detected by unit 20 and three dimensional operation begins.
The system uses seven distinct bar codes. The seven bar codes are herein designed A to G and they have the following meaning:
Bar code A: start "Page Flip" three dimensional mode.
Bar Code B start "Pseudo Interlaced" three dimensional mode.
Bar Code C stop three dimensional operation and resume normal operation.
Bar Code D to G used to define the beginning and end of lines in a three dimensional widow in an otherwise two dimensional image (defined below).
Eye glasses 50 have two liquid crystal (LC) lenses which can be rendered opaque or transparent by electrical signals from unit 20. The two lenses in eye glasses 50 can be controlled independently. In three dimensional operation the lenses are alternatively opened and closed. That is, when the right eye is open the left eye is closed and vice versa. Eye glasses with liquid crystal lenses controllable via and IR link are known in the art.
The system can operate in either page-flip or interlaced mode. In page flip mode the images for the left and right eyes are alternatively displayed on the display 10. The left eye lens is opened for one frame of data on display 10 and then the right eye lens is opened for one frame of data on display 10.
In interlaced mode, the right eye image is displayed using the even lines on the display and the left eye image is displayed using the odd lines on the display. The right eye lens is opened with the right eye image is being displayed and the left eye lens is opened when the left eye image is being displayed. In interlaced mode, the processor transmits frames of data to unit 20 which have both the left and right eye images. As frames are received by detector 20, detector 20 first blocks the even lines in one frame and then it blocks the odd lines in the next frame, thereby creating the left and right eye images on display 10. While the type of operation describe above can be referred to as interlaced operation, it is more accurately described a "pseudo interlaced" since the display is not operating in a true interlaced mode. A truly interlaced display first actually receives from the processor an images for the even rows of the display and then it receives an image for the odd rows of the display. With the present invention the processor sends all lines in each frame and unit 20 blocks the even rows for one image and then the odd rows for a second image.
FIG. 2 shows the data flow in the system. Game or other software 201 generates images. These images go to a video API (application programming interface), and then to video drivers 203B which drive a video adapter 203C. The video adapter sends images to detector box 20 which in turn sends images to display 10. The game or other software 201 generates images for the right and left eyes which when combined create a three dimensional image. The technique for generating such right and left eye images is well known and it can utilize multiple cameras which take pictures of the same object or it can involve highly complex mathematical operations. With respect to the present invention the creation of the right and left eye images can follow the teaching in the prior art.
The images created by program 201 are supplied or sent to a standard software three dimensional API (application program interface) such as the three dimensional program interface provided by Microsoft entitled Direct 3D. The three dimensional API provides an input to system software which in turn supplies signals to video drivers 203B. The video drivers 203B interface with and drive the actual video adapter hardware 203 in the computer. These Video API 203A, the video drivers 203B and the video adapter 203C are conventional commercially available units. For example the Windows operating system marketed by Microsoft corporation has an API for three dimensional images and video drivers for most of the popular video adapter cards.
The mode of operation where a three dimensional image is presented in a window in an otherwise two dimensional screen is illustrated in FIG. 4. As shown in FIG. 4, the main part of the screen 401 is a conventional two dimensional image. The window 402 displays a three dimensional image. It should be understood that the window 402 can be any size and it can be located anywhere on the screen.
At the border 403 of the three dimensional window 402, each line has a bar code which tells the detector box 20 that the glasses need be opened and closed to display the image inside the window in three dimensions. Since only the image inside the window is a three dimensional image, the opening and closing of the lenses on the glasses 50 has a minimal impact on what the viewer sees in the remaining portions of the screen.
The details of the unit 20 are shown in FIG. 3. This unit can be described as a detector and control unit. This unit detects the bar codes which the computer sends to the display and in response to the detection of codes it initiates and stops the operation of the three dimensional mode. Unit 20 receives the RGB (red green blue) signal and the vertical and horizontal sync signals from the computer 30, it appropriately modifies the RGB signals and it supplies the modified RGB signal and the horizontal and vertical sync signals to display 10. The paths of the RGB and horizontal and vertical sync signals through unit 20 are shown by the dark wide lines in FIG. 3. Unit 20 also sends signals to eye glasses 50 which open and close the lenses in these glasses.
As shown in FIG. 3, unit 20 includes seven registers 301A, to 301G which store the bit patterns that form the bar codes A to G. A comparator 305 examines the stream of bits in the RGB signals and it compares them to the bits in registers 301A to 301G. When a match is detected one of the output lines from the comparator 305 is activated. The codes cause activation of the following lines as follows:
Code A: activates "Page Flip Mode" line. The entire screen is placed in page flip mode until a stop signal received.
Code B: activates "Pseudo Interlaced Mode" line. The entire screen is placed in pseudo interlaced mode until a stop signal is received.
Code C: deactivates both "Page Flip Mode" and "Pseudo Interlaced Mode" lines.
Code D: sent to unit 302 to activate page flip mode in a window. That is, 3D line begins in a window at the point this code is received.
Code E: sent to unit 302 to stop page flip mode in a window. That is, a 3D line in a window using page flip mode ends at the point this code is received.
Code F: sent to unit 302 to activate pseudo interlaced mode in a window. That is, a 3D line in a window begins at the point where this code is received.
Code G: sent to unit 302 to stop pseudo interlaced mode in a window. That is, a 3D line in a window using pseudo interlaced mode ends at the point where this code is received.
When the page flip mode signal or 3D Off signal is activated the unit 306 passes the RGB signals to the display 10 through OR unit 308. When the Pseudo Interlaced Mode signal is active, unit 314 deletes alternate lines from alternate frames (as explained later this also occurs in a portion of a frame when there is an pseudo interlaced 3D window). When the Pseudo Interlaced Mode line is active (as a result of comparator 305 detecting a code B), unit 314 first detects a vertical sync signal and it then alternately passes and blocks lines as it receives each horizontal sync signal. This can be done by a flip flop which is triggered by the horizontal sync signal and the output of which controls a gate which blocks or passes the RGB signals. Circuit 306 passes the entire RGB signal when the system is operating in Page Flip Mode or when the 3D operation is not active. Stated differently, circuit 306 passes the entire RGB signal except when the system is operating in pseudo interlaced mode. When the system is operating in pseudo interlaced mode the RGB signals are passed to OR circuit 308 through unit 314 which deletes alternate lines from either the entire screen or from a window.
When the page flip mode or pseudo interlaced modes are in operation unit 318 which controls the lenses of the eyeglasses through unit IR transmit unit 40 is activated through OR circuitry 312. When active, unit 318 alternately opens (makes transparent) the right and left lenses for alternate frames of data. Signals from control unit 318 in unit 20 are transmitted to glasses 50 via IR transmit and receive units 40 and 55. IR transmit and receive units 40 and 55 are conventional.
The 3D window control unit 302 receives a signal when any one of the control codes D to G is detected by comparator 305. These control codes indicate to unit 302 when and where 3D operation in a window begins and ends. When the location of a 3D window moves, the position of these codes in the data stream naturally shifts.
When unit 302 receives a signal indicating that there is a 3D window, a signal is sent to unit 318 indicating that the right and left lenses should be opened for alternate frames. When unit 302 receives code F from comparator 305, a signal is sent to unit 314 indicating that alternative lines need be deleted from a window. It is noted that codes F and G appear at the border of a three dimensional image, hence they indicate where the deletion of alternate lines should begin and end.
In a situation where a 3D window is operating in page flip mode, the entire RGB signal is passed to the display and unit 302 merely needs send a signal to unit 318 to open and closes the eye glass lenses for alternate frames. The images which alternate in the window in order to create the 3D affect are generated in a conventional manner by the system software as previously described.
The actual series of bits which form each bar code can be choosen in an arbitrary manner. The length of the series of bits which form each code should be at least one byte long.
While the invention has been shown and described with respect to a preferred embodiment thereof, it should be understood that various changes in form and detail can be made without departing from the spirit and scope of the invention. The scope of applicant's invention is defined by the appended claims and equivalents thereto.
|US4875034 *||8. Febr. 1988||17. Okt. 1989||Brokenshire Daniel A||Stereoscopic graphics display system with multiple windows for displaying multiple images|
|US5181133 *||15. Mai 1991||19. Jan. 1993||Stereographics Corporation||Drive method for twisted nematic liquid crystal shutters for stereoscopic and other applications|
|US5281957 *||10. Juli 1991||25. Jan. 1994||Schoolman Scientific Corp.||Portable computer and head mounted display|
|US5446834 *||6. Dez. 1994||29. Aug. 1995||Sun Microsystems, Inc.||Method and apparatus for high resolution virtual reality systems using head tracked display|
|US5523886 *||4. Jan. 1994||4. Juni 1996||Sega Of America, Inc.||Stereoscopic/monoscopic video display system|
|US5572250 *||20. Okt. 1994||5. Nov. 1996||Stereographics Corporation||Universal electronic stereoscopic display|
|US5691737 *||14. Sept. 1994||25. Nov. 1997||Sony Corporation||System for explaining an exhibit using spectacle-type displays|
|US5745164 *||17. Jan. 1997||28. Apr. 1998||Reveo, Inc.||System and method for electro-optically producing and displaying spectrally-multiplexed images of three-dimensional imagery for use in stereoscopic viewing thereof|
|US6088052 *||7. Jan. 1998||11. Juli 2000||Recherches Point Lab Inc.||3D stereoscopic video display system|
|Zitiert von Patent||Eingetragen||Veröffentlichungsdatum||Antragsteller||Titel|
|US7817166 *||12. Okt. 2006||19. Okt. 2010||Apple Inc.||Stereo windowing system with translucent window support|
|US8089506||22. Juni 2006||3. Jan. 2012||Brother Kogyo Kabushiki Kaisha||Image display apparatus and signal processing apparatus|
|US8675044||23. Dez. 2008||18. März 2014||Wistron Corporation||Method for playing images according to a data comparison result and image playback system thereof|
|US9261710 *||20. Dez. 2010||16. Febr. 2016||Intel Corporation||2D quality enhancer in polarized 3D systems for 2D-3D co-existence|
|US20040100489 *||26. Nov. 2002||27. Mai 2004||Canon Kabushiki Kaisha||Automatic 3-D web content generation|
|US20060238613 *||22. Juni 2006||26. Okt. 2006||Brother Kogyo Kabushiki Kaisha||Image display apparatus and signal processing apparatus|
|US20080088644 *||12. Okt. 2006||17. Apr. 2008||Apple Computer, Inc.||Stereo windowing system with translucent window support|
|US20100066819 *||23. Dez. 2008||18. März 2010||Yi-Ju Yu||Method for playing images according to a data comparison result and image playback system thereof|
|US20110157311 *||1. Apr. 2010||30. Juni 2011||Industrial Technology Research Institute||Method and System for Rendering Multi-View Image|
|US20110216065 *||18. Mai 2011||8. Sept. 2011||Industrial Technology Research Institute||Method and System for Rendering Multi-View Image|
|US20110285821 *||18. Mai 2011||24. Nov. 2011||Kabushiki Kaisha Toshiba||Information processing apparatus and video content playback method|
|US20120002279 *||20. Dez. 2010||5. Jan. 2012||Jain Sunil K||2d quality enhancer in polarized 3d systems for 2d-3d co-existence|
|EP1705929A1 *||21. Dez. 2004||27. Sept. 2006||Brother Kogyo Kabushiki Kaisha||Image display device and signal processing device|
|EP1705929A4 *||21. Dez. 2004||4. Apr. 2007||Brother Ind Ltd||Image display device and signal processing device|
|EP2347596A1 *||4. Sept. 2009||27. Juli 2011||3dswitch S.r.l.||System for encoding and decoding stereoscopic images|
|US-Klassifikation||345/7, 348/43, 348/E13.04, 348/53, 348/E13.059, 348/E13.044, 348/51, 345/419, 382/285, 348/E13.022, 348/42|
|Unternehmensklassifikation||G09G2310/0224, H04N13/0438, H04N13/0285, H04N13/0456, G09G3/003, H04N13/0497|
|Europäische Klassifikation||H04N13/04G7, H04N13/04Y, H04N13/04N, G09G3/00B4|
|11. Aug. 1997||AS||Assignment|
Owner name: H3D ENTERTAINMENT INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:OLSON, PETER;REEL/FRAME:008756/0666
Effective date: 19970804
|29. Okt. 1997||AS||Assignment|
Owner name: ASSET DEPLOYMENT, INC., AS AGENT, TEXAS
Free format text: ASSIGNMENT AND SECURITY AGREEMENT;ASSIGNOR:H3D ENTERTAINMENT, INC.;REEL/FRAME:008776/0556
Effective date: 19971023
Owner name: ASSET DEPLOYMENT, INC., AS AGENT, TEXAS
Free format text: SECURITY INTEREST;ASSIGNOR:H3D ENTERTAINMENT, INC.;REEL/FRAME:008776/0556
Effective date: 19971023
|8. Nov. 1999||AS||Assignment|
Owner name: I-O DISPLAY SYSTEMS, LLC, CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:H3D ENTERTAINMENT, INC.;REEL/FRAME:010368/0236
Effective date: 19991020
|26. März 2002||AS||Assignment|
Owner name: TDV TECHNOLOGY CORPORATION, NEW YORK
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:I-O DISPLAY SYSTEMS LLC;REEL/FRAME:012754/0465
Effective date: 20020313
|12. Nov. 2002||AS||Assignment|
Owner name: 3D WORLD CORP., NEW YORK
Free format text: CHANGE OF NAME;ASSIGNOR:TDV TECHNOLOGIES CORP.;REEL/FRAME:013240/0026
Effective date: 20020603
|21. Jan. 2003||AS||Assignment|
Owner name: X3D TECHNOLOGIES CORP., NEW YORK
Free format text: CHANGE OF NAME;ASSIGNOR:3D WORLD CORP.;REEL/FRAME:013372/0655
Effective date: 20020628
|18. Mai 2004||FPAY||Fee payment|
Year of fee payment: 4
|11. Okt. 2006||AS||Assignment|
Owner name: NEWSIGHT GMBH, GERMANY
Free format text: CHANGE OF NAME;ASSIGNOR:X3D TECHNOLOGIES GMBH;REEL/FRAME:018375/0149
Effective date: 20050901
|20. Okt. 2006||AS||Assignment|
Owner name: PRENTICE CAPITAL MANAGEMENT, LP, NEW YORK
Free format text: SECURITY AGREEMENT;ASSIGNOR:NEWSIGHT CORPORATION;REEL/FRAME:018407/0859
Effective date: 20060926
Owner name: NEWSIGHT CORPORATION, NEW YORK
Free format text: CHANGE OF NAME;ASSIGNOR:X3D TECHNOLOGIES CORP.;REEL/FRAME:018407/0882
Effective date: 20050909
|9. Jan. 2008||AS||Assignment|
Owner name: PRENTICE CAPITAL MANAGEMENT, LP, NEW YORK
Free format text: SECURITY AGREEMENT;ASSIGNOR:NEWSIGHT CORPORATION;REEL/FRAME:020339/0259
Effective date: 20071220
|4. Juni 2008||FPAY||Fee payment|
Year of fee payment: 8
|30. Apr. 2009||AS||Assignment|
Owner name: VIA ONE VISION HOLDINGS, S.A.R.L., LUXEMBOURG
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NEWSIGHT CORPORATION AND NEWSIGHT GMBH;REEL/FRAME:022610/0827
Effective date: 20090422
|31. Okt. 2011||AS||Assignment|
Owner name: PHOENIX 3D, INC., NEW YORK
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:VIA ONE GLOBAL SA;VIA ONE VISION HOLDINGS SARL;REEL/FRAME:027268/0310
Effective date: 20101220
|16. Juli 2012||REMI||Maintenance fee reminder mailed|
|5. Dez. 2012||LAPS||Lapse for failure to pay maintenance fees|
|22. Jan. 2013||FP||Expired due to failure to pay maintenance fee|
Effective date: 20121205