Classifications

• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
  • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
  • G09G3/003—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to produce spatial visual effects
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/388—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
  • H04N13/395—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume with depth sampling, i.e. the volume being constructed from a stack or sequence of 2D image planes
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
  • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
  • G09G3/002—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/346—Image reproducers using prisms or semi-transparent mirrors

Definitions

• the present invention relates to image display systems, especially useful for computer displays and videoconferencing. More particularly, the present invention involves improved imaging systems, capable of providing multiplane images from video or other sources that present data that is valuable when alternately perceptible by a viewer. The present invention also has the capacity to provide, simultaneously or alternately, multiple images such as for multiple users of a computer system.
• Image that is the lowest bandwidth required for an autostereoscopic 3-D picture, would be 750 MHz. This corresponds to about 125 of today's conventional TV channels.
• the experience of 3-D is created in the presence of four conditions.
• the first condition consists of what are collectively called 2-D cues. These cues mainly consist of objects getting smaller, higher, closer together, dimmer, less distinct, less contrasty and less colored as they get further away, as well of course as the fact that foreground objects block the view of background objects. These cues are recorded and reproduced in the course of standard 2-D image recording.
• the second condition is parallax.
• Parallax occurs when a change of position of the viewer produces a different view in which background objects previously hidden by foreground objects become visible
• Conventional 3-D stereo techniques lack an ability to convey parallax, but although parallax is not absolutely essential for a viewer to experience 3-D, its presence adds a great deal of realism to 3-D imaging
• the third condition is lateral binocular disparity This means that the lateral binocular disparity
• the fourth condition is depth disparity, in which at least two objects in the scene are not in focus to the eye at the same time.
• accommodation or re-focusing of the eye is required when moved from one such object to the other
• This phenomenon present in real life, is not reproduced with conventional 3-D imaging techniques
• This phenomenon is very important because, as the brain acts to refocus the eyes from one depth to the other, it experiences the perception of true depth
• this condition is very important because, as the brain acts to refocus the eyes from one depth to the other, it experiences the perception of true depth
• this condition is very important because, as the brain acts to refocus the eyes from one depth to the other, it experiences the perception of true depth
• Lack of the depth disparity phenomenon leads to eye strain and headaches after extended periods of viewing in current 3-D imaging systems, because of the conflict between accommodation and convergence
• these four conditions correlate to one another when viewing a 3-D image so as to provide the same relationships found when viewing a real
• Autostereoscopy directs the corresponding images to the eye without the use of any optical device near the person Instead, optics are located near the images, restnc ting the angle of view of each image so that each eye still sees only one of the two images This has been done with lenses, prisms, and light-blocking barriers, for instance Since the angle of view for each image can be made very narrow, many images can be taken from many angles and viewed one at a time as one moves one's head This provides an aspect of 3-D perception, called motion parallax, not available from stereoscopy With motion parallax, one can look around foreground objects to see previously hidden background objecl s The images displayed using stereoscopy and autostereoscopy, however, are all in one plane, so the constant refocusing and perception of a mix of sharp and blurry images — which the inventor has found to be so important to the real 3-D experience — is absent Due to this lack of variable accommodation cues, stereoscopy and autostereoscopy present another difference from
• the present display system employs an apparatus that presents two or more images in positions such that each of the images is spatially separated from each of the other images along a co-axial ne-of-sight for a viewer (1 e co-aligned)
• the embodiments described herein provide (at least) a foreground image and a background image which are co-aligned, and employ at least one optical element that acts as a beamcombiner
• the beamcombiner is optionally a reflective element such as a semi-silvered mirror or a refractive element such as a Fresnel beamsplitter (herein called a Fresnel beamcombiner because of the way it is used) or the Fresnel semi-prism disclosed hereinbelow
• the foreground image and the background image are optionally generated to display a foreground image plane that is imperceptible or at least transparent except where there are objects in the foreground image plane This quality of transparency allows objects on a background image plane to be seen when the are not obscured by such foreground objects
• the images are preferably related in a manner such that objects in the background image are not perceptible through objects on the foreground image plane that are supposed to be opaque (by which the inventor means non-transmissive in the wavelength
• the present invention provides an image display system comprising a first image source, a second image source, and a beamcombiner, wherein these elements are arranged so as to present to a viewer a foreground image from one of the image sources, and a background image from the other of the image sources, the background image being presented at a greater distance from the viewer than the foreground image
• the viewer perceives the foreground image and the background image as part of a scene having depth
• the foreground image and background image are co-aligned to the line of sight of a viewer
• the first and second image sources are portions of a composite image source (e.g a television screen or monitor)
• a display system also includes a reflective element disposed to reflect the image of the second image source to the beamcombiner
• a housing which is adapted to be fastened to a conventional television set or monitor and which contains the optical elements of the present invention, the housing providing an aperture through which a viewer observes the display.
• a system desirably comprises a housing and a beamcombiner within the housing, wherein the housing has a viewing aperture, a first image aperture, and a second image aperture; wherein the first image aperture is adapted to a first image source; wherein the second image aperture is adapted to a second image source; wherein the first image aperture, the second image aperture, and the beamcombiner are so disposed as to present to a viewer through the viewing aperture a foreground image from one of the image sources, and a background image from the other of the image sources, the background image being presented at a greater distance from the viewer than the foreground image.
• Techniques disclosed herein include controlling relative brightness of the two images, using a approach to dim out portions of the background image that are occluded by the foreground image.
• a mask is desirably interposed between the background image source and beamcombiner at a position that is the same distance from the beamcombiner as the foreground image source, so that the mask displays a silhouette of foreground objects that appear coincident with the foreground image source, acting to mask portions of the background image from the viewer.
• the mask may be a light valve, e.g. an LCD.
• a lens may be interposed between the first image source and the viewer so as to present at least one of the foreground image and the background image as a real image.
• the lens may be a Fresnel lens or a lenserF lens as described hereinbelow
• Some embodiments employ the optics of a conventional a projector, e.g. a slide or movie projector, to produce the effects of the present invention.
• a mirror is placed far enough out from the projector exit lens to divert portions of the projector's output to different projection screens.
• a portion of the beam is reflected to a projection screen.
• Another portion of the beam is caused to fall on a second projection screen, which may be disposed at a right angle from the first projection screen.
• a lens is used to re-focus one of the portions, since the screens are at different distances from the projector.
• Each portion reflects from its screen to a beamcombiner whereby the portions are aligned.
• One portion is transmitted while the other portion is reflected in the same direction.
• Another aspect of the present invention is a method for displaying images to a viewer by simultaneously presenting to both eyes of a viewer a first image that is generally planar, simultaneously presenting to both eyes of a viewer a second image that is generally planar and is co-aligned with the first image along an axis that is in the general direction of the viewer but at a perceptibly different distance from the viewer than the first image, wherein the image that is at a distance closer to the viewer depicts objects in the foreground of the displayed images and the other of the images depicts objects in the background of the scene.
• a viewer observing the images perceives the depicted objects as part of a scene having real depth.
• the method desirably applies to moving images.
• the method may be one wherein the first image and second image are presented alternatingly to a viewer with a cycle that is within the time frame of persistence of vision; or the first image and the second image may both be presented to the viewer simultaneously.
• the first image and second image are each presented from an image source derived from a portion of the same television screen.
• the displayed images are real images of first and second image sources. In others the displayed images are virtual images of first and second image sources. In yet others, the first image is a real image of a first image source and the second image is a virtual image of a second image source.
• the first image is a real image of a first image source and the second image is a second image source being viewed directly.
• the first image is a virtual image of a first image source and the second image is a second image source being viewed directly.
• the present display system employs an apparatus that presents two or more images in positions such that each of the images is spatially separated from each of the other images along a co-axial line-of-sight for a viewer (e.g. co-aligned).
• a viewer looking at the resulting display sees data which has value when viewed simultaneously.
• Software and hardware of the present invention produce image data which has value when viewed simultaneously.
• Such embodiments include the presentation of images on one plane while simultaneously allowing the alternate perception of other images on another plane.
• each source image is divided into at least two image signals. These separate image signals produce separate images on different portions of a single image display device, which are then optically combined to form a composite image scene or other display, or are used to synchronously generate a plurality of images, each on a separate display device, which arc then optically combined to form the images.
• source images are divided into at least two images, at least one foreground image and at least one background image.
• Some techniques for dividing source images are known and have been mentioned herein, while others are part of the present invention and have been disclosed herein.
• the computer or other device writing to the display device must be configured to write the foreground image to a first designated area of the display device and to write the background image to a second designated area of the display device.
• the foreground image may be written to the top half of the CRT and the background image may be written to the bottom half of the CRT by supplying the pixel data for the foreground image during the first half of each display frame and supplying the pixel data for the background image during the second half of each display frame.
• the present invention contemplates employing during viewing optical expansion of at least one of the images to recreate the aspect ratio of the original image.
• optical expansion techniques it is advantageous to display the image compressed in the direction which is to be expanded, e.g., vertically. Such compression allows optical expansion without resulting in an image stretched in that direction.
• Resolution enhancement steps may be performed on image data if the image is to be optically expanded to restore aspect ratio. Pixel and line interpolating methods may be employed for this purpose.
• Some versions of the image display apparatus of the present invention employ relatively inexpensive lenses, preferably annular lenses disclosed herein, that nevertheless avoid or minimize the objectionable characteristics of scatter, flare, chromatic aberration and spherical distortion that otherwise result from the use of lenses m such display systems
• the improvement to optical elements having rises and faces (ones that are stepped, e g a Fresnel lens) disclosed herein employs a light-absorptive element adjacent the vertical rises so that the amount of light passing through or reflected from the rises is minimized
• the present invention provides an improved optical element having ⁇ se portions and face portions, wherein light transmitting through or reflected from the rise portions is substantially prevented from being seen by an observer viewing an image formed by light passing through the annular lens More particularly, the rise portions are coated with an opaque light-absorbent material
• the improved optical element may be a refractive optical element, in which event the rise portions are substantially opaque and the face portions are substantially transparent It may also have an anti-reflective coating It may, for example, be a Fresnel lens or a Fresnel semi-lens or a lenserF lens, as disclosed hereinbelow
• the improved optical element may be a reflective element, such as an annular mirror
• Such methods comprise the steps of producing an optical element having rise portions and face portions, and imparting a light-absorbent coating to the rise portions
• the optical element may have a series of annular grooves, or the grooves may be linear
• the element may be refractive, in which event an antireflective coating may also be applied, or the element may be reflective
• the light-absorbent coating may be imparted to the rises by applying light-absorbing material to the element and selectively cleaning it so as to leave a coat of light-absorbing material adhering to the rise portions but not to the face portions
• Adherence may be enhanced by roughening the ⁇ se portions in advance, such as by scratching, scoring or abrading
• Positive or negative photoresist may be used in the process in various ways
• a coating of positive photoresist may be applied to the optical element so as to coat all faces and rises, then illuminating the photoresist so that the rises are not illuminated, so that exposed photoresist is only on the faces
• the element is then developed to remove the photoresist from the rises, and opaque material that is capable of adhering to the rises is then applied to the element.
• the photoresist is then removed from the faces by developing to dissolve away exposed resist together with any of the opaque material remaining on it
• a coating of negative photoresist may be similarly applied to the optical element, then illuminating the photoresist so that the faces are not illuminated, with exposed photoresist being only on the rises
• the element is then developed to remove the photoresist from the rises, and opaque material that is capable of adhering to the rises is then applied to the element
• the photoresist is then removed from the faces by developing to dissolve away exposed resist together with any of the opaque material remaining on it
• the photoresist itself may be dark colored or dyed and left on the rises
• Negative photoresist may be made to coat the rises selectively by exposing the rises but not the faces to light and then developing the optical element to remove unexposed photoresist
• dark positive photoresist may be made to coat the rises selectively by exposing the faces but not the rises to light and then developing the optical element to remove exposed photoresist
• the present invention also contemplates use of a sandwich of optical elements to provide a compact and lightweight adapter that can be placed in front of a television screen or monitor
• the sandwich comprises a Fresnel semi-lens of the present invention which is aligned with a Fresnel beam combining element
• the Fresnel beam combining element is preferably a commercially available Fresnel beamcombiner or a Fresnel semi-prism of the present invention.
• a holographic optical element may be constructed (using known techniques) with the equivalent functionality of the two or three subelements of the Fresnel sandwich described herein to accomplish the same tasks
• An embodiment of the present invention is a "narrow-profile" single image source display system This embodiment uses numerous smaller mirrors which decreases the distance the optical elements protrude from the image source
• the display is sphl into numerous foreground and background areas Each top portion is the foreground portion, and each bottom is the background portion
• Each set of portions is co-aligned
• the resulting output is striped because no light passes directly from any background portion
• An optional lenticular expansion array is used to expand each image set stripe so gaps or blank stripes are not presented to the user
• a further aspect of the invention disclosed herein is a multiplayer video game adapter
• Such an embodiment allows two or more players to share a single monitor and yet have mutually independent and "secret" 3-D views of a computer screen or the like
• Such a multi-player image display system would comprise two or more of the 3-D image display systems of this invention, wherein each image source (having a foreground and a background image) is a portion of an overall image source, e g a single monitor, and would further comprise means for reflecting each of the foreground and background images respectively from a specified one of the image sources to a specified one of the players
• An additional aspect of the multiplayer video adapter of the present invention is that a simplified version, presenting multiple 2-D images, may also be produced
• FIG 1 is a perspective view of a 3-D imaging device of this invention (Each of the 3- D imaging devices depicted herein is an embodiment of the present invention )
• Fig 2 is a cross-section view of the embodiment represented in Fig 1
• Fig 3 is a view of a foreground image which consists of a person
• Fig 4 is a view of a background image which consists of a house
• Fig 5 is a "head-on" view of the foreground image of Fig 3 and the background image of Fig 4 displayed by a 3-D imaging device of this invention
• Fig 6 is a perspective view of the foreground image of Fig 3 and the background image of Fig 4 displayed by a 3-D imaging device of the invention
• Fig 7 is a view of a foreground image which consists of white circles on a black surround
• Fig 8 is a view of a background image, which consists of white squares on a hatched background
• Fig 9 is a "head-on" view of the foreground image of Fig 7 and the background image of Fig 8 displayed by a 3-D imaging device of the invention
• Fig 10 is a perspective view of foreground image of Fig 7 and background image of
• Fig 11 is a head-on, wireframe view of foreground objects of Fig 7 and the background objects of Fig 8
• Fig 12 is a view of a foreground image which consists of two people
• Fig 13 is a view of a background image which consists of a house and a shrub
• Fig 14 is a perspective view of the foreground image of Fig 12 and the background image of Fig 13
• Fig 15 is a "head-on" view of the foreground image of Fig 12 and the background image of Fig 13
• Fig 16 is a view of a foreground image of two people
• Fig 17 is a view of the foreground image in Fig 16 which exaggerates the perspective cues in accordance with the invention
• Fig 18 is a view of a foreground image and a background image
• Fig 19 is a side view of foreground image and background image wherein the background image is larger than the foreground image
• Fig 20 is a side view of foreground image and background image wherein the background image is tilted with its top away from the viewer
• Fig 21 shows a foreground image which consists of a "smiley face" on a black surround
• Fig 22 shows a background image which consists of two square objects on a hashed surround
• Fig 23 shows 3-D output as viewed head-on, or how a unified image might look if presented on a 2-D imaging device
• Fig 24 shows the objects of foreground image of Fig 21 as a wireframe from a head-on perspective as they would occlude the background image of Fig 22 when displayed on a 3-D imaging device
• Fig 25 shows a head-on perspective of the output of a light valve or LCD as it occludes the background image of Fig 22
• Fig 26 is a cross-section view of an embodiment showing the placement of an LCD or silhouette so its output properly masks the background behind foreground objects
• Fig 27 is a cross-section view of a 3-D imaging device which utilizes portions of a single image source to create foreground and background images
• Fig 27A is a cross-section view of the embodiment of Fig 27 which shows the housing in alternate positions
• Fig 28 is a cross-section view of a 3-D imaging device of this invention illustrating potential problems with a user having a direct line-of-sight to the image source
• Fig 29 is a cross-section view of a 3-D imaging device of the invention which avoids the line-of-sight problem presented in some other embodiments
• Fig 30 is a cross-section view of a 3-D imaging device of the invention which has secondary optics to further change the path of light to a viewer
• Fig 31 is a perspective view of an image source, a Fresnel lens, and the real image of the image source
• Fig 32 is a side view of an image source, a Fresnel lens, the real image of the image source, and the angle of view in which the real image is perceived
• Fig 32A is a perspective view of a faceted Fresnel lens
• Fig 32B is a plan view of the faceted Fresnel lens in Fig 32A
• Fig 33 is a cross-section view of a 3-D imaging system which uses a Fresnel lens
• Fig 34 is a plan view of a 3-D imaging system of the present invention which uses a
• Fig 34A is a plan view of a 3-D imaging system of the present invention
• Fig. 34B is a plan view of a 3-D imaging system of the present invention.
• Fig. 34C is a plan view of a 3-D imaging system of the present invention.
• Fig. 35A is an elevation view of a Fresnel lens.
• Fig. 35B is a cross-section view of a Fresnel lens taken at line 35B-35B.
• Fig. 36 is a cross-section view of a "lenserF" lens (LenserF is Fresnel backwards).
• Fig. 37 is a cross-section view of a Fresnel lens.
• Fig. 38 is a cross-section view of a portion of a Fresnel lens schematically illustrating light passing through the rise portion of the lens.
• Fig. 39 is a cross-section view of a portion of a Fresnel lens which has a scored rise and shows light reflecting and scattering from the scored rise.
• Fig. 40 is a cross-section view of a portion of a Fresnel lens which has an opaque coating on the rise, reducing scatter and flare.
• Fig. 41 is a plan view of an annular lens of the present invention which is coated with photoresist and is partially covered with a light shield.
• Fig. 42 is a cross-sectional elevation view of the annular lens of Fig. 41, taken along the line 48-48.
• Fig. 43 is a cross-section view of a sheet of plastic lens material having opaque pre-printed rings thereon, preparatory to being formed into an annular lens of the present invention.
• Fig. 44 is a cross-section view of a step in the formation of an annular lens of the present invention by a press or mold, forming a lens with opaque rises from the sheet of plastic material shown in Fig. 43.
• Fig. 45 is a cross-section view of a portion of an annular lens, and a wave plate, schematically illustrating the passage of beams of polarized light therethrough.
• Fig. 46 is a cross-section view of a portion of an annular lens coated with anti-reflective (AR) coating, schematically illustrating the effect of AR coating on a beam of light.
• AR anti-reflective
• Fig. 46A is a plan view of an optical element of the present invention.
• Fig. 46B is a perspective view of two optical elements of the present invention.
• Fig. 46C is a plan view of an optical element of the present invention.
• Fig. 46D is a perspective view of two optical elements of the present invention.
• Fig. 47 is a view of an image source.
• Fig. 47A is a plan view of a 3-D imaging system of this invention.
• Fig. 48 is a perspective view of the 3-D imaging system of Fig. 47.
• Fig. 49 is a plan view of an imaging system which functions as a multiplayer adapter.
• Fig. 49A is a perspective view of the imaging system of Fig. 49.
• Fig 50 is a view of an image source of the present invention
• Fig 51 is a plan view of a multiplayer 3-D imaging system of this invention
• Fig 52 is a perspective view of the embodiment in Fig 51
• Fig 53 is a plan view of another embodiment of the multiplayer 3-D imaging system of this invention.
• Fig 54 is a perspective view of the embodiment in Fig 53
• Fig 55 is a plan view of yet another embodiment of the multiplayer 3-D imaging system of this invention.
• Fig 56 is a perspective view of the embodiment in Fig 55
• Fig 56A is a plan view of yet another embodiment of the multiplayer 3-D imaging system of this invention
• Fig 56B is a perspective view of the embodiment in Fig 56A
• Fig 57 is a plan view of another multiplayer 3-D imaging system of this invention.
• Fig 58 is a plan view of another multiplayer 3-D imaging system of this invention
• Fig 59 is a plan view of another multiplayer 3-D imaging system of this invention
• Fig 60 is a plan view of another multiplayer 3-D imaging system of this invention
• Fig 61 is a plan view of another multiplayer 3-D imaging system of this invention
• Fig 62 is a plan view of another multiplayer 3-D imaging system of this invention
• Fig 63 is a plan view of another multiplayer imaging system of this invention
• Fig 64 is a plan view of another multiplayer imaging system of this invenl ion
• Fig 65 is a perspective view of another multiplayer imaging system of this invention.
• Fig 66 is a plan view of the multiplayer imaging system of Fig 65
• Fig 67 is a view of an image source
• Fig 68 is a plan view of another multiplayer imaging system of this invention
• Fig 69 is a perspective view of the multiplayer imaging system in Fig 68
• Fig 70 is a view of an image source
• Fig 71 is a plan view of another multiplayer imaging system of this invention
• Fig 72 is a perspective view of another multiplayer imaging system of this invention
• Fig 73 is a plan view of the multiplayer imaging system of Fig 72
• Fig 74 is a view of an image source
• Fig 75 is a plan view of an imaging system of this invention
• Fig 76 is a perspective view of the imaging system of Fig 75
• Fig 77 is a plan view of an imaging system of this invention
• Fig 78 is a perspective view of the imaging system of Fig 77
• Fig 79 is a perspective view of the image source and a conventional mirror
• Fig 79A is a perspective view of the image source and a conventional mirror
• Fig 80 is a plan view of another multiplayer imaging system of this invention
• Fig 81 is a perspective view the multiplayer imaging system of this invention
• Fig 82 is a plan view of another multiplayer imaging system of this invention
• Fig 83 is a perspective view the multiplayer imaging system of this invention
• Fig 84 is a plan view of another multiplayer imaging system of this invention
• Fig 84A is a diagrammatic view of a display system of this invention
• Fig 85 is an elevation view of a monitor enlarger imaging system of this invention
• Fig 86 is an elevation view of a monitor enlarger imaging system of this invention
• Fig 87 is an elevation view of an image display system of this invention
• Fig 88 is a plan view of the image display system of Fig 87
• Fig 89 is a side view of an image display system of the present invention
• Fig 90 is a side view of an image display system of the present invention
• Fig 91 is a side view of an image display system of the present invention
• Fig 92 is a side view of an image display system of the present invention
• Fig 93A is a side view of an image display system of the present invention
• Fig 93B is a perspective view of an image display system of the present invention
• Fig 93C is a perspective view of an image display system of the present invention
• Fig 93D is a perspective view of an image display system of the present invention with semi-circular screens
• Fig 93E is a perspective view of an image display system of the present invention with complete projection lenses
• Fig 94A is a plan view of an image display system of the present invention
• Fig 94B is a plan view of an image display system of the present invention
• Fig 95A is a perspective view of an image display system of the present invention
• Fig 95B is a perspective view of an image display system of the present invention
• Fig 96 shows a foreground image for display in accordance with the present invention
• Fig 97 shows a background image for display in accordance with the present invention
• Fig 98 shows, from a "head-on" perspective, an elevation view of the foreground image of Fig 96 and the background image of Fig 97
• Fig 99 shows, from a "head-on" perspective, an elevation view of the foreground image of Fig 96 and the background image of Fig 97 as perceived by a viewer who is focussing on the foreground image
• Fig 100 shows, from a "head-on" perspective, an elevation view of the foreground image of Fig 96 and the background image of Fig 97 as perceived by a viewer who is focussing on the background image
• Fig 101 shows, from a "head-on" perspective, an elevation view of a foreground image and a background image in which a pointer points to an item of the foreground image
• Fig 102 shows, from a "head-on” perspective, an elevation view of an image source for the embodiment of Fig 101 that includes both a foreground image and a background image
• Fig 103 shows, from a "head-on” perspective, an elevation view of a foreground image and a background image
• Fig 104 shows, from a "head-on" perspective, an elevation view of an image source for the embodiment of Fig 103 that includes both a foreground image and a background image
• Fig 105A shows the display of a first image comprising a portion of a "coded" message
• Fig 105B shows the display of a second image comprising a portion of a "c oded" message
• Fig 105C shows the combined display of the first and second coded images revealing the message
• the present invention provides what may be termed real-depth imaging, since there are real differences in depth between images of objects in a scene
• different objects at different depths in a scene are presented in different planes in space, one behind the other
• the object areas of each plane are perceived as opaque, and the non-object areas are clear to allow observation of the images in more distant planes
• a foreground image is formed on a first plane and a background image is formed on a plane located more distantly from the observer.
• the images are generally co-axial from the vantage point of the observer.
• the foreground image presents selected objects on a black surround. This black area appears as a blank or transparent space through which the background image is seen.
• Figs. 1 and 2 show an embodiment of the present invention.
• Fig. 1 is a perspective view thereof.
• Fig. 2 shows a cross-sectional view of the housing 1-001.
• the housing 1-001 has a front face 1-002, a left face 1-003, a top face 1-004, a rear face 1-005, and a bottom face 1-006.
• the housing 1-001 has on its front face 1-002 a viewing aperture 1-012 through which a viewer 1-200 (diagrammatically represented as a stylized eye, although it is to be understood that both eyes of the viewer are typically open) can perceive a 3-D scene.
• the housing 1-001 has on its rear face 1-005 a foreground aperture 1-014.
• the housing 1-001 has on its bottom face 1-006 a background aperture 1-016.
• an optical element 1-035 Disposed within the housing 1-001 is an optical element 1-035, such as a partially reflective (e.g. semi-silvered) mirror.
• the foreground aperture 1-014 is positioned to permit light from a foreground image source 1-040 (e.g. a TV monitor) to pass into the housing.
• a foreground image 1-050 is shown on the foreground image source 1-040.
• the foreground image 1-050 is seen directly by the viewer (i.e. without reflection) through the partially reflective optical element 1-035.
• the background aperture 1-016 is positioned to permit light from a background image source 1-080 (e.g. another TV monitor) to pass into the housing.
• a virtual background image 1-090 appears displaced behind the foreground image 1-050.
• Fig. 1 shows a first light ray 1-100 and a second light ray
• the first light ray 1-100 passes from the foreground image source 1-040 through the foreground aperture 1-014, directly through the partially reflective optical element 1-035, and then through the viewing aperture 1-012 to a viewer 1-200. (Not shown is that some of the light from the foreground image 1-050 is reflected upwards within the housing by the optical element 1-035, since it is semi-reflective.
• the interior of the housing is light-absorbent, e.g. painted black or covered with black velvet, to prevent such stray light from interfering with the intended images.)
• the illustrated second light ray 1-101 passes from the background image source 1-050 through the background aperture 1-016 to the semi-reflective optical element 1-035.
• the second light ray 1-101 is then reflected from the semi-reflective optical element 1-035 through the viewing aperture 1-012 to a viewer 1-200.
• Light (such as is represented by the second light ray 1-101) which comes from the background image source 1-050 is perceived by the viewer 1-200 as coming from the location of the virtual background image 1-090, even though it is in fact coming from the background image source 1-080.
• the distance from the background image source 1-080 to the middle of the optical element 1-035 is the same as the distance from the virtual background image 1-090 to the same point on the optical element 1-035.
• optical element 1-035 acts as a beamcombiner, aligning the foreground image 1-050 and the virtual background image 1-090. Some of the light 1-102 and 1-103 reflected or transmitted is misdirected in this embodiment by optical element 1-035 and is absorbed within the housing 1-004. A viewer 1-200 looking at the foreground image 1-050 and the virtual background image 1-090 will perceive both images as being co-axial along the same line-of-sight, but at different distances from the viewer 1-200. Objects located on foreground image 1-050 are physically closer to the viewer 1-200 than objects on the virtual background image 1-090.
• the foreground image 1-050 and the virtual background image 1-090 are in different locations in space, a viewer 1-200 who bobs her head will notice parallax between the foreground image 1-050 and the virtual background image 1-090.
• the inventor has found that the typical viewer tends to perceive a foreground image and background image formed this way as parts of an overall scene having real depth.
• the foreground image is presented in greater brightness than the background image.
• the blank surround is desirably left clear at printing.
• the surround is desirably blank when the foreground image is a light valve held in place before a background image, or when multiple light valves are held in series to create multiplanar effects.
• the blank surround is desirably black, so as not to interfere with the viewer's perception of the background image.
• Image sources are any source of imagery, such as CRT's, plasma displays, stereographic 3-D images, television monitors, LCD's, transparencies, photographs, illuminated objects, flat or curved front or rear-projection screens on which images are projected, or any portion thereof.
• a scene to be viewed is preferably divided into at least two images, presented on two co-axial planes. Two-dimensional cues, including perspective and background object occlusion, are provided in each plane. A viewer observing the images continually shifts attention from plane to plane, simultaneously changing accommodation and convergence. As in real life, a scene presented by the 3-D display system of the present invention appears to be a mix of sharper and blurrier images and single and doubled images which keep shifting. If the viewer moves or shifts position, both horizontal and vertical parallax are perceived. At all times, in all viewing positions, the two eyes of an observer see different perspective views, creating binocular disparity that further stimulates the brain into perceiving a real-life depth experience.
• Fig. 3 shows an illustrative foreground image 3-050.
• On the foreground image 3-050 is a black surround 3-052 on which there is a foreground object 3-054, a person.
• Fig. 4 is a background image 3-090.
• On the background image there is a background object 3-094, a house.
• Fig, 5 is a "head on" perspective view of the foreground image 3-050 and the background image 3-090.
• the foreground object 3-054 partially occludes the background object 3-094.
• Fig. 6 is a different perspective view of the foreground image 3-050 and the background image 3-090. In Fig. 6, the foreground object 3-054 partially occludes a different portion of the background object 3-094 than it does in Fig. 5.
• the foreground image 3-050 and the background image 3-090 appear in different planes.
• the foreground image 3-050 has a foreground object 3-054 or multiple foreground objects on a black surround 3-052.
• the black surround acts as a transparent space through which the background image 3-094 can be seen.
• the foreground object 3-054 will appear solid if it is of sufficient brightness with regard to the background image 3-090 and any background object 3-094.
• the background object 3-094 is higher up in the frame, smaller, and less contrasty than the foreground object 3-054.
• the foreground image source brighter (I e by increasing the brightness of the foreground image)
• the beamcombiner e g reflector or refractor
• Another method to minimize bleedthrough involves dimming the background immediately behind the foreground objects
• this sort of "flying spot" shadow is desirable, whereas in others it would be distracting to the presentation
• the shadow is preferably tapered so it is darkest in its center and lightens toward the edges so no hard boundary is created
• Figs 7 through 11 illustrate a potential problem with image bleed-through
• Fig 7 is a foreground image 7-050
• Fig 8 is a background image 7-090
• Fig 9 shows a "head on" perspective view of the co-aligned foreground image 7-050 and the background image 7-090
• first foreground object 7-054 partially occludes the striped surround 7-092 and also partially occludes the first background object 7-094
• Fig 10 is a view from a slightly different perspective of the foreground image 7-050 and background image 7-090 Note that, in comparison with Fig 9, different portions of the striped surround 7-092 are occluded by the first for
• Fig 11 illustrates a potential problem area 11-116 that may arise when foreground image 7-050 and background image 7-090 are viewed from a "head-on" perspective
• Light from the first background object 7-094 may bleed through the first foreground object 7-054, giving the first foreground object 7-054 a ghostly or insubstantial appearance, damaging the perception of a 3-D scene.
• the inventor found that when the foreground image 2-050 is brighter than the virtual background image 2-090, it helps to eliminate this ghostly or bleed-through problem.
• the foreground image 2-050 can be made brighter than the background image 2-090 in various ways. One way is through selection of a reflective element 2-035 which reflects less of the light from the background image 2-090. Another method is to ensure that the foreground image source 2-040 is at least twice as bright as the background image source 2-080. Other methods as known in the art can be used to control the relative brightness of the final images.
• Figs. 12 through 15 show a different foreground image 12-050 and background image
• Fig. 12 is a foreground image 12-050. On it are a first foreground object 12-054 and a second foreground object 12-055.
• Fig. 13 is a background image 12-090. On it are a first background object 12-094 and a second background object 12-095.
• Fig. 14 is a slightly “off-line” perspective view of the foreground image 12-050 and the background image 12-090.
• Fig. 15 is a "head on" perspective view of the foreground image 12-050 and the background image 12-090.
• first foreground object 12-054 partially occludes second foreground object 12-055.
• the second foreground object 12-055 is higher in the frame, smaller, etc. than the first foreground object 12-054. Similar effects happen in the background image 12-090. In addition to what is shown in the drawing, it can be made to have less contrast.
• Fig. 16 shows foreground image 12-050.
• Fig. 17 shows a modified foreground image 17-050, on which are a first foreground object
• Fig. 18 shows a foreground image 18-050 and a background image 18-090.
• Fig. 19 shows the foreground image 18-050 and the background image 18-090 as seen by a viewer 19-200.
• the foreground image 18-050 is smaller than the background image 18-090, the images will appear properly proportioned when looked at by a viewer 19-200 since the background image 18-090 is farther away from the viewer than the foreground image 18-050.
• the background image 18-090 can be made larger by using a larger background image source. Alternatively, intervening magnifying optics are employed to expand the background image 18-090.
• Fig. 20 shows a viewer 20-200, a foreground image 20-050 and a background image 20-090.
• a sensation of continuous depth can be enhanced by tilting either the foreground image 20-050, the background image 20-090, or both, away from the viewer.
• the objects are actually farther away from the viewer than objects which are lower in the frame, contributing to a perception of a continuous depth scene.
• a third "floor-plane" image is optionally created with another image source, such as a CRT, being placed along the "floor" between the foreground image and the background image.
• stereographic and other "3-D" imaging techniques of the prior art as images for display systems and methods of the present invention can also greatly enhance the perception of 3-D.
• Another method for solving the bleedthrough problem involves the use of a light valve.
• the light valve is placed between the background image source and any beamcombiner used to make the images co-axial.
• the light valve is placed the same distance from the beamcombiner as is the foreground image source.
• the light valve is a binary liquid crystal display (LCD) which is made black wherever foreground objects exist and is transparent otherwise. In this manner, no stray light passes from the background through the foreground object.
• LCD binary liquid crystal display
• There is parallax between the foreground image and the background image which is tracked by the parallax between the light valve and the background image. A user who moves her head will see appropriate background around foreground objects, but not through them.
• Such an embodiment of this invention will assist in making many sorts of foreground images appear to be very substantial. Take the example of a foreground object in which blackness is a feature. If any light from the background bleeds through the area that is supposed to be black, that object will appear ghostly and insubstantial. For example, where a foreground object is a person wearing a black tie and the background image is a roaring fire, seeing the fire through the tie would be an undesired effect.
• Fig. 21 is a foreground image 21-050.
• Fig. 21 has a black surround 21-052 on which is a foreground object 21-054.
• Foreground object 21-054 has a first eye 21-055 and a second eye 21-056.
• the first eye 21-055 and the second eye 21-056 are black areas where blackness is a feature of that area.
• the first eye 21-055 and the second eye 21-056 are meant to be opaque, in contrast with the black surround 21-052 which is black so as to allow perception of a background image.
• Fig. 22 is background image 21-090.
• Background image 21-090 has a striped surround 21-092, and a first background object 21-094 and a second background object 21-095.
• Fig. 23 is a "head-on" perspective view of the foreground image 21-050 and the background image 21-090, which have been co-aligned using a device of the present invention.
• Fig. 24 is also a "head-on" perspective view of the co-aligned foreground image 21-050 and the background image 21-090, with the foreground image 21-050 rendered as a transparent wireframe so as to define a problem area 24-114.
• a problem area 24-114 results when a viewer has line-of-sight through a black object which is supposed to be opaque to a portion of the background image which is light colored.
• light from background object 21-094 is in line with the first eye 21-055. Unimpeded, this light would give the first eye 21-055 a ghostly appearance.
• the first eye 21-055 would appear transparent, not black.
• Increasing the brightness of the foreground image 21-050 does not solve this type of bleed-through problem, as multiplying the brightness of black (namely, zero) by a factor results in zero, and thus still black.
• One potential solution is to dim the portion of the background image 21-090 that is behind foreground objects like first eye 21-055. Depending on the position of the viewer 2-200, different portions of the background image 21-090 are behind foreground objects.
• Parallax makes areas like problem area 24-114 a moving target.
• a dimmed "head-on” problem area 24-114 is perceived by a viewer 2-200 looking around a foreground object 22-052 to the background 23-090.
• Using "flying spot” technology on the background 23-090 to solve the "head-on” problem areas is potentially damaging to realistic parallax.
• a solution to the "flying spot” or masking problem is to employ an element which stops the background image 23-090 from interfering with the foreground image 22-050: a light valve 25-115 (or, in the case of a still picture, a silhouette will do) that is opaque wherever there are foreground objects. Using a light valve in this fashion will allow foreground objects which have blackness as a feature to occlude background objects.
• Fig. 25 depicts a silhouette that could be used to mask the problem area 24-114 discussed in connection with Figs. 21 through 25.
• Fig. 26 shows one embodiment of the present invention that uses such a light valve.
• a light valve 26-115 Disposed within the housing 26-001 is a light valve 26-115.
• a reflective element 26-035 Disposed within the housing 26-001 is a reflective element 26-035, such as a partially reflective mirror.
• a foreground image source 26-040 Disposed near the foreground aperture 26-014 is a foreground image source 26-040.
• 26-050 is shown on the foreground image source 26-040. Near the background aperture 26-016 is a background image source 26-080. A virtual background image 26-090 appears, displaced behind the foreground image 26-050.
• the light valve 26-115 is placed between the reflective element 26-035 and the background image source 26-080.
• the light valve is placed at the same distance from the reflective element 26-035 as the foreground image 26-050 on the foreground image source 26-040 (as indicated with arrows 26-100). In this manner, a virtual light valve is created which is coincident with the foreground image 26-050.
• the first eye 21-055 would be perceived as black, while retaining its ability to occlude the background image 21-090.
• the black surround 21-052 would remain transparent so the background image 21-090 can be viewed around foreground object 21-054.
• a signal which is sufficiently sophisticated to drive the light valve of this embodiment may be readily provided as a byproduct of the computer-generation process.
• the inventor means that it is capable of dealing with the particular combination of foreground image and background image being presented so as to provide realistic object occlusion.
• a black tie i.e., object where blackness is a feature
• a donut that is oriented so the viewer has line-of-sight to the background (i.e., object where blackness is meant to be a transparency).
• Most of the embodiments of the present invention preferably contain one or more optical elements in a housing.
• the housing contains one or more image sources, or alternatively it may be provided with one or more apertures through which light from an external image source passes.
• the housing is optionally designed to contain at least one image source while having an aperture for receiving light from at least one other image source.
• the housing preferably has an interior of light-absorbent material so any stray light which hits it is not reflected inappropriately (i.e. to the viewer directly or indirectly).
• the housing preferably has a viewing aperture, through which the viewer perceives the images.
• the viewing aperture is preferably smaller than the image source, e.g. when a larger viewing aperture would impermissibly allow a viewer to have a potentially detracting direct line-of-sight to a background image source.
• the housing is optionally designed so it can be easily placed on or near an image source and easily removed from being near an image source.
• some embodiments for television sets and computer monitors are equipped with hinges or Velcro fastening tape so they can be flipped from being in front of the monitor to a storage position on top of the monitor.
• the housing is optionally designed so an image source can easily be removed from being near it.
• a housing is potentially collapsible, to facilitate storage or portage of the unit.
• An adapter which uses a still picture as a background image, for example, can be made so the still picture is easily removed from the adapter.
• an embodiment which is used as a demonstration unit or a portable advertising unit is preferably provided with a holding element which allows an image source such as standard LCD projector to be mounted on or in the housing.
• the housing is often proportioned to the image source. Housings have been made for very small embodiments (image source having a diagonal measured in a fraction of an inch) and very large embodiments (image source having a diagonal of a few yards). Use in hand-held viewers, personal televisions mounted in head-gear, conventional television and computer monitors, projection units, and billboard size advertising displays are some of the contemplated embodiments of this invention illustrating part of the range of sizes contemplated for this invention.
• Some embodiments of the display adapter invention use a single unified image source as the original source of at least the foreground image and the background image. For example, some embodiments use a single standard television or computer monitor as an image source. One portion of the screen is used for the foreground image and another portion is used to provide a background image. In some embodiments a mirror is used as a means to reflect light from the background image source to a co-aligning, or beamcombining, element.
• a magnifying reflective optic such as a spherical mirror or Fresnel mirror
• a minifying reflective optic is optionally employed where a smaller image is desired.
• the background image is optionally reflected by a mirror to the beamcombining element.
• a lens sandwich assembly is provided, which acts to co-align the images without any additional reflective optics being necessary to reflect light from the background image source.
• a halved television screen is either “landscape” if cut horizontally or “portrait” if cut vertically.
• a 2: 1 image compression can be used in conjunction with optics designed to uncompress the image.
• optics would include cylindrical optical elements to uncompress an image in a single direction. Cylindrical mirrors or cylindrical
• Fresnel lenses are relatively cheap to manufacture, and they can be used in pairs where uniform expansion of an entire image is desired.
• a larger background image source is called for so it will appear properly proportioned to the foreground image source.
• the background image if not made larger, can appear too small for its foreground image since the background image is actually farther away from the viewer than the foreground image as discussed hereinabove.
• Single Image Source for 3-D By using a single image source for providing both the foreground image and the background image, a real-depth experience is optionally provided at moderate cost to the user, avoiding the expense of multiple image sources such as when each additional image source is a computer monitor or a television set. In one such method, an image source, such as a television or computer monitor screen, is split in portions.
• One portion is used to generate each plane.
• one portion of the screen is used to generate a foreground image
• another portion is used to generate a background image.
• the background image is often reflected ninety degrees through the use of a mirror.
• foreground image and background image are optionally co-aligned as elsewhere taught in this document (i.e. through an element such as a beamcombiner).
• the inventor was surprised at the pronounced 3-D effect created through the use of the present invention, especially on foreground and background images generated from a single image source.
• images which are farther from a viewer such as a background image
• images which are closer to a viewer such as a foreground image
• a larger portion of the image source may be used for the background image to compensate.
• magnification is used to enlarge the background image as taught elsewhere herein
• Fig 27 shows an embodiment of the present invention
• Housing 27-001 has a front face 27-002, a top face 27-004, a rear face 27-005, and an optional panhandle 27-006 which facilitates mounting
• Panhandle 27-006 has a panhandle bottom face 27-007 and panhandle corner 27-008
• On the front face 27-002 is a viewing aperture 27-012
• 27-005 is an image source aperture 27-014 adapted to cooperate with an image source 27-030, such as a CRT or television monitor
• an image source 27-030 such as a CRT or television monitor
• a reflective element 27-035, such as a partially reflective mirror, that acts as a beamcombiner Part of the image source 27-030 is used as a foreground image source 27-040
• a foreground image 27-050 is on the foreground image source 27-040
• Another part of the image source 27-030 is used as a background image source 27-080
• a virtual background image 27-090 appears displaced behind the foreground image 27-050
• Light path 27-100 shows the path from the background image source 27-080 to the virtual background image 27-090
• a conventional mirror 27-135 is disposed within the housing 27-001 to reflect light from the background image source 27-080 to the reflective element 27-035 which reflects light to a viewer 27-200
• reflective element 27-035 acts as a beamcombiner to present the co-aligned foreground image 27-050 and the background image 27-090 to a viewer 27-200
• the foreground image source 27-040 and the background image source 27-080 are just different parts of the same image source 27-030
• This embodiment is potentially smaller, cheaper, and easier to use than embodiments which use more than one image source as the sources of the foreground image and the background image
• the housing 27-001 may contain all sources of imagery, whether a single image source or multiple image sources In this embodiment, however, the housing 27-001 is optionally attached, permanently or temporarily, to the image source 27-030
• straps of fastening tape such as Velcro
• Velcro straps, hinges, a brace or other known fastening devices or schemes are optionally used to dispose the housing 27-001 near the image source 27-030
• the housing 27-001 is preferably collapsible
• Embodiments of the present invention may vary widely in size, as noted elsewhere in this document
• the embodiment of Fig 27 are optionally made to fit a handheld gaming device or a large projection television
• the use of hinges at panhandle corner 27-008 or Velcro straps on optional panhandle 27-006 can allow the housing 27-001 to be flipped up onto the monitor
• Fig. 28 shows another single-image-source embodiment of the present invention.
• the embodiment has a housing 28-001.
• Housing 28-001 has a front face which has a viewing aperture 28-012.
• the housing 28-001 has on its rear face 28-005 an image source aperture 28-014.
• Disposed near the image source aperture 28-014 is an image source 28-030, such as a
• a reflective element 28-035, such as a partially reflective mirror Disposed within the housing 28-001 is a reflective element 28-035, such as a partially reflective mirror.
• Part of the image source 28-030 is used as a foreground image source 28-040.
• a foreground image 28-050 is on the foreground image source 28-040.
• Another part of the image source 28-030 is used as a background image source 28-080.
• a virtual background image 28-090 appears displaced behind the foreground image 28-050.
• Light path 28-100 is shown.
• Light path 28-101 is shown.
• a conventional mirror 28-135 is disposed within the housing 28-001 to reflect light from the background image source 28-080 to the reflective element 28-035 which reflects light to a viewer 28-200.
• reflective element 28-035 acts as a beamcombiner to present the co-aligned foreground image 28-050 and the background image 28-090 to a viewer 28-200.
• Light path 28-100 shows a proper line-of-sight from a viewer 2-200 to the foreground image source 28-040 (and thus to the foreground image 28-050, which is on its surface).
• Light path 28-101 shows a potential problem with this embodiment.
• a viewer 28-200 has line of the sight to the background image source 28-080 through viewing aperture 28-012. It is preferable that the user not have line-of-sight to the background image source 28-080 because it is distracting to the perception of 3-D a viewer 28-200 should perceive when looking at the co-aligned background image 28-090 and foreground image 28-050.
• One way to avoid this problem is to make the viewing aperture 28-012 smaller, to reduce the viewpoints from which a viewer 28-200 has a line-of-sight to the background image source 28-090.
• FIG. 29 Another way to avoid the problem of line-of-sight to the background image area is shown in Fig. 29.
• the embodiment shown in Fig. 29 has a housing 29-001.
• Housing 29-001 has a top face 29-004 which has a viewing aperture 29-012.
• the housing 29-001 has on its rear face 29-005 an image source aperture 29-014.
• an image source 29-030 Disposed near the image aperture 29-014 is an image source 29-030, such as a CRT or television monitor.
• a reflective element 29-035, such as a partially reflective mirror Disposed within the housing 29-001 is a reflective element 29-035, such as a partially reflective mirror.
• Part of the image source 29-030 is used as a foreground image source 29-040.
• a virtual foreground image 29-050 is created by reflective element 29-035.
• Another part of the image source 29-030 is used as a background image source 29-080.
• a virtual background image 29-090 appears displaced behind the virtual foreground image 29-050.
• a conventional mirror 29-135 is disposed within the housing 29-001 to reflect light from the background image source 29-080 to the reflective element 29-035 which transmits light to a viewer 29-200.
• reflective element 29-035 acts as a beamcombiner to present the co-aligned virtual foreground image 29-050 and the virtual background image 29-090 to a viewer 29-200.
• Light path 29-100 and light path 29-101 show a proper line-of-sight from a viewer 2-200 to the virtual foreground image source 29-050 and the virtual background image source 29-090.
• the images are directed at a ninety degree angle to the face of the image source.
• the image source 29-030 is placed "face up" so the viewing aperture 29-012 is oriented to the viewer 29-200.
• the monitor is turned ninety degrees to its left, and the adapter directs its output to its right. Changing the orientation of the image source, as with a television set or computer monitor, can be inconvenient and therefore undesirable (e.g. from a thermal management standpoint).
• Fig. 30 shows the embodiment shown in Fig. 29.
• a secondary reflective optic 29-400 such as a plane mirror, is used to direct the images to a viewer 29-200 seated in front of a conventionally oriented monitor or CRT.
• Splitting a single image source can create problems with the aspect ratio of the image. For example, splitting a television screen horizontally yields a very wide "landscape” or “letterbox” aspect ratio, while splitting it vertically yields a "portrait” aspect ratio.
• additional optics such as a cylindrical lens
• secondary reflective optic 29-400 is optionally a cylindrical expansion mirror. The cylindrical expansion mirror is designed to uncompress the image in one direction.
• the co-aligned foreground image 29-050 and background image 2-090 are redirected and expanded for a viewer 29-200.
• Anamorphic curvature of the mirror can provide virtually any size image with any desired aspect ratio.
• FIG. 31 there is shown an image source 31-030, a real image 31-050, a viewer 31-200, and a Fresnel lens 31-300.
• Fig. 32 there is an image source 31-030, a real image 31-050, an arrow 31-100, a viewer 31-200, and a Fresnel lens 31-300.
• Any lens (whether Fresnel or conventional), if properly placed in relation to an image source, can create a real image for a controlled angle of view.
• Image source 31-030 is re-imaged by Fresnel lens 31-300.
• This real image 31-300 is visible to a viewer 31-200 who is within a controlled angle of view indicated by arrow 31-100.
• the size of the real image and the controlled angle of view can be altered by moving the image source, varying the focal length of the lens and relative position, etc.
• a real image is an image in front of the optical element that reimages it, unlike a virtual image which appears to be behind the optic. For example, an image in a mirror appears behind the glass. A real image reimaged by a lens appears to float in space in front of the lens.
• Fresnel lenses are preferred for most embodiments of the present invention that produce real images because they are relatively light and easy to manufacture. Unlike many lens types, they are optionally glued together in a sandwich, to correct for spherical aberration or chromatic aberration. For example, two or more different materials can be used in the elements of the sandwich (or any of the other optical elements disclosed herein) to correct for chromatic aberration. Those of ordinary skill in the art recognize that as other lenses become more economical, then other lenses may become preferred.
• Fig 32 is a single-image-source adapter of the present invention, such as depicted in Figs. 27 and 29.
• Figs. 32A and 32B depict a Fresnel lens 32A-300, which has additional facets 32A- 301.
• Fig. 32A is a perspective view
• Fig. 32B is a plan view. Facets 32A-301 help extend the controlled angle of view created by a Fresnel lens 32A-300 to nearly one hundred eighty degrees.
• the sheet forming the Fresnel lens 32A-300 is curved into a cylinder.
• housing 33-001 has a front face 33-002, a top face 33-004, and a rear face 33-005.
• the housing 33-001 has on its front face 33-002 a viewing aperture 33-012.
• the housing 33-001 has on its rear face 33-005 an image source aperture 33-014.
• an image source 33-030 Disposed near the image source aperture 33-014 is an image source 33-030, such as a CRT or television monitor. Disposed within the housing 33-001 is a reflective element
• a conventional mirror 33-135 is disposed within the housing 33-001 to reflect light from the background image source 33-080 to the reflective element 33-035 which reflects light to a viewer 33-200.
• Fresnel lens 33-300 is disposed between the reflective element 33-035 and the viewer 33-200.
• reflective element 33-035 acts as a beamcombiner to present the co-aligned foreground image 33-050 and the background image 33-090 to a viewer 33-200.
• the light from the background image source 33-080 is reimaged into real background image 33-090.
• the light from the foreground image source 33-040 is reimaged into the real foreground image 33-050.
• the viewer 33-200 sees the real foreground image 33-050 and the real background image 33-090 hanging in space in front of all optical elements.
• the viewer 33-200 is often startled, expecting to find a plane of glass from which the real foreground image 33-050 and the real background image 33-090 are reflected.
• the viewer 33-200 can place her finger on or through the foreground image 33-050 if desired, and still see the rest of the scene.
• inventions of the present invention may also utilize a lens, preferably a Fresnel lens, to generate at least one real image.
• a lens preferably a Fresnel lens
• Fig. 34 is another embodiment of the present invention which utilizes a Fresnel lens to generate a real image. Depicted in Fig. 34 are reflective means (such as a beamsplitter)
• foreground image source 34-040 real foreground image 34-051, real foreground image 34-052, background image source 34-080, a first viewer 34-202, a second viewer 34- 202, and a Fresnel lens 34-300.
• This embodiment uses a real foreground image 34-051 and/or 34-052.
• a viewer 34- 201 sees the real foreground image 34-051 and has a direct line of sight to the background image source 34-080.
• a viewer 34-202 sees the real foreground image 34-052 and sees the virtual image of the background image source 34-052.
• Real image 34-051 is reflected by reflective means 34-035, and real image 34-052 is transmitted by reflective means 34-035.
• a housing is optionally used which allows viewing from the position of viewer 24- 201, viewer 24-202 or preferably both.
• An embodiment which allows viewing in such positions turns Fig. 2's "misdirected" light 1-102 and 1-103 into a potentially desirable feature of the invention.
• reflective element 34-035 acts as a beamcombiner to present the co-aligned real foreground image and the background image to a viewer.
• the light from the foreground image source 34-040 is reimaged into the real foreground image
• the main difference between the embodiments of Fig. 33 and of Fig. 34 is the placement of the Fresnel lens 33-300.
• the Fresnel lens 33-300 is disposed between the foreground image source 33-040 and the reflective element 33-035.
• the foreground image is a real image.
• the background image is a virtual image or a direct line of sight to the background image.
• Fig. 41 shows a single image source 3-D adapter as in Fig. 28.
• the Fresnel lens With the addition of the Fresnel lens, a viewer sees a real foreground image and a real background image.
• the optics are optionally placed that the real images appear to float in space in front of the housing and all accompanying optics. When first presented with a real image, the viewer often expects it to be a projection on some type of screen. For many embodiments, the viewer can actually place his or her hand in plane with the image, much to their surprise.
• the use of real images can greatly contribute to the perception of depth in the scene.
• the Fresnel lens may alternately be placed so as to "float" only the foreground image or only the background image. Multiple Fresnel lenses are optionally placed to refocus light in a shorter optical path, for example.
• a more compact embodiment of the present invention uses a single projector (of any standard type as known in the art) as the source of foreground and background images.
• a single projector of any standard type as known in the art
• One portion of the image projected by the beam from the projector lens is the foreground, while another portion is the background.
• This more compact embodiment of the present invention uses a mirror that is placed far enough out from the projector exit lens to divert portions of the projector's output to different projection screens. It is important that the mirror be placed far enough out from the projector than that certain short distance, so the image is actually split rather than dimmed. For a typical projector the inventor has found that the mirror should be at least twelve inches and preferably about 18 inches from the projector exit lens face.
• a portion of the beam is reflected to a projection screen.
• Another portion of the beam is reflected to a second projection screen, disposed at a ninety-degree angle from the first projection screen.
• a lens is used to re-focus one of the portions, since the screens are at different distances from the projector.
• Each portion reflects from its screen to a beamcombiner whereby the portions are aligned.
• One portion is transmitted while the other portion is reflected in the same direction.
• light ray 34A-101 leaves projector 34A-030 and reflects from a reflective element 34A-135 (preferably a plane mirror)
• a reflective element 34A-135 preferably a plane mirror
• reflective element 34A-136 preferably a plane mirror
• Light ray 34A-101 hits projection screen 34A-040, reflects back to a reflective element 34A-035, which acts as a beamcombiner, from which light ray 34A-101 reflects to a secondary reflective optic 34A-400, preferably a plane mirror, from which it is reimaged by a first Fresnel (or lenserF) lens 34A- 301 and a second Fresnel (or lenserF) lens 34A-302
• a real foreground image 34A-050 appears in space well outside the housing 34A-001
• Light ray 34A-102 is reflected by reflective element 34A-136, preferably a mirror, at a point when light ray 34A-102 is far enough from the projector that it contains only light that will comprise the background image
• Light ray 34A-102 then hits the background projection screen 34A-080, from which it reflects through the reflective element 34A-035 Co-aligned with the light ray 34A-101 reflected from 34A-035, light ray 34A-102 is reflected and reimaged as a real background image 34A-090 outside the housing 34A-101 Varying the distances and arrangements of this embodiment in light of the rest of this document is a part of the invention
• One of light ray 34A-101 or 34A-102 is focussed by a lens 34A-031 since foreground projection screen 34A-040 and background projection screen 34A-080 are at different distances from the projector 34A-030 If light ray 34A-102 is focussed, a negative lens is used Preferably light ray 34A-102 is focussed instead, so more plentiful positive lenses may be used
• Figure 34B is a plan view of an image display system of the present invention
• Foreground projector 34B-030 projects onto curved projection screen 34B-040
• Fig 34C is a plan view of an image display system of the present invention similar to the one shown in Fig 34B
• mirror 34C-300 is an off-axis Fresnel mirror
• mirror 34C-301 is a Fresnel mirror
• An image source placed at approximately 2F (twice the focal length) on one side of a lens causes a real image to form in space at approximately 2F on the other side of the lens.
• Fresnel Lens In accordance with the present invention, an improved Fresnel lens is preferably employed.
• a Fresnel lens is an optical element resembling a plano-convex or plano-concave lens that is cut into narrow rings and flattened out.
• Fresnel lenses can be large glass structures as in lighthouses, floodlights or traffic signals, or thin molded plastic plates with fine steps.
• Fresnel lenses are commonly made from plastic, thus allowing them to be mass-produced inexpensively and quickly from a metal master.
• the metal master is typically made by rotating a copper or other material blank with a computer-manipulated cutting tool of diamond or other hard material. The master is then used to cast, emboss, compression mold or injection mold plastic replicas.
• Conventional Fresnel lenses are formed with a series of annular rings and are therefore relatively thin, and relatively light. In contrast, conventional plano-convex and plano-concave lenses are thick, heavy, and expensive.
• Fresnel lenses have poor resolving power when compared to conventional lenses because of the shape of the surface of each annulus.
• Each annulus of a Fresnel lens when viewed in cross-section, has a vertical surface (a rise) and a lens-function surface (a face).
• Annular lenses such as Fresnel lenses, also suffer from flare or scatter of light as some of the light passes through and reflects off of the rise instead of through the lens face. To improve the optical performance of annular lenses, the amount of such light scattered by the rises should be reduced to a minimum.
• the "lenserF” is another type of annular lens.
• the lenserF provides a lens which has as one side a series of spaced ring-shaped planar, or annular, faces, which together approximate the planar surface of a normal plano-convex or plano-concave lens. The annular faces are separated by rises.
• a lenserF is thin, but, unlike a Fresnel, it is not flat. It retains the curved shape and depth of the plano-convex or plano-concave lens, and provides much better resolving power than a corresponding Fresnel lens that approximates the same curve.
• the effect of such a curvature is to create a cavity in which additional lenses (lenserFs or others) can be placed.
• Compounding or cascading of lenses can take place in a much smaller volume, allowing lenses to be closer together than with conventional lenses (allowing greater magnification, chromatic aberration correction, lower F number, etc.).
• Compound plastic lenses are capable of being made to minimize chromatic aberration.
• annular lenses including Fresnel and lenserF lenses, disclosed herein comprises means for decreasing the amount of light scattered from the rises of the lens.
• a number of techniques are disclosed herein which are optionally used alone, or in combination with scratching or abrading the rises, to reduce the light reflecting from the rises.
• Coating the rises of the lens with an opaque absorptive material Generally, an opaque material such as ink is made to adhere to the rise, while leaving other portions of the lens free of opaque material.
• the rise portion of the lens is preferably scratched, abraded or scored during manufacture to promote better adherence of opaque material to the rise portion.
• the rise is desirably scratched, abraded or scored during manufacture to facilitate adherence.
• Opaque material such as ink may thereafter be applied to an annular lens or other optical element by dipping, spraying or other conventional means, then subjecting it to a brief wash, with or without wiping by rubber or other material with appropriate grooves.
• Such a technique results in a coat of ink adhering to the scratched rise and leaves the smooth lens faces uncoated.
• the application of opaque material to selected areas of an annular lens is optionally achieved by the use of a photoresist.
• the photoresist is then used to protect the coated regions of the lens from the opaque material.
• This embodiment of the invention is optionally implemented by applying a coating of positive photoresist to the entire lens.
• Positive photoresist generally softens or depolymerizes upon exposure to light.
• a light shield with an appropriate opening e.g. wedge-shaped
• the lens is rotated to provide successive exposure of the lens faces around the entire 360 degrees. By this process the faces, but not the rises, are exposed to light.
• a resist developer is then used to rinse away the photoresist from the rises, while leaving the exposed photoresist on the face portions.
• the entire lens can then be coated with opaque material that is capable of adhering to the lens rises but that is prevented from adhering to the lens faces because of the presence of the photoresist thereon.
• the photoresist is then removed from the lens faces by further rinsing with developer to dissolve away the exposed resist together with the opaque material coating it.
• Negative photoresist generally hardens or polymerizes upon exposure to light.
• the lens is dipped or sprayed in photoresist and then exposed to a properly masked light. In this method, however the light exposure is arranged to strike the resist only on the rises. A developer will rinse away the exposed negative photoresist from the rises. Coating of the lens with opaque material is then performed as disclosed above.
• Yet another embodiment of the invention involves using a photoresist that is black or other dark color, dyed black or dark, or is otherwise opaque once the process is finished. With proper exposure and development, e.g. as described above, the rises are left coated with the black resist, while the faces are left uncoated.
• pre-printed opaque rings or striations are positioned on material such as flat plastic such that when the lens or other optical element is pressed, stamped, embossed or molded, the rise portions of the completed lens will be made up of the opaque pre-printed rings.
• a transparent element having pre-printed thereon opaque lines or circles is positioned with respect to the rises of an existing stepped optical element such that the opaque markings intercept a substantial portion of the light which passes through, or which reflects off of, the rises.
• the opaque markings may be on the reverse side of the substrate from which the optical element is constructed.
• emulsion coated on both faces of the lens are scanned by laser or exposed to an annular pattern to become dark on rises while being clear on faces after standard photographic development.
• grooves are formed in the lens surface when the lens is made. Then ink is put on and "doctor bladed” off, leaving ink in the grooves. Drying of the ink can be done by air, UV, heat, etc.
• Another embodiment of the invention involves applying an antireflective coating to virtually all surfaces of the lens to reduce reflection of any light from the face.
• This embodiment of the invention effects its result in a manner similar to the way in which an AR coating on a television tube eliminates the reflections from room lights.
• an AR coating applied to the Fresnel lens also coats the rises, thus reducing the reflection of light that impinges on or reflects from the rises.
• Yet a further embodiment of the invention includes an AR coating on virtually all surfaces of an annular lens and an opaque coating on the rises. This embodiment combines a reduction of light reflected from the rise and an absorption of light that would otherwise pass outwardly through the rise, to further reduce light passing through or reflecting from the rise portions.
• scattering from the rises of the lens is reduced by using an image source that produces circularly polarized light.
• an image source is optionally an LCD in conjunction with an appropriate polarizer, or it is optionally another source of light that has been circularly polarized.
• only light which passes through the lens face directly without being reflected from the rise will be transmitted by a circular analyzer.
• Fig. 35A shows a plan view of a Fresnel lens 35-300 of the prior art.
• Fig. 35B is a cross-sectional view of a Fresnel lens 35-300, taken at line 35B-35B. Shown is a rise portion
• Figs. 36 and 37 show a cross section of a planoconcave lenserF 36-300, which has rise portion 36-310 and a face portion 36-315.
• Fig. 37 shows a cross section of a planoconvex lenserF 37-300.
• Fig. 38 are shown details of a Fresnel lens 38-300 in cross-sectional view. Light ray 38-100 is shown. Rise portion 38-310 and face portion 38-315 are depicted.
• Light ray 38-100 passes through rise portion 38-310. Light ray 38-100 then reflects from face portion 38-315, contributing to scatter or flare.
• Fig. 39 shows details of a Fresnel lens 39-300 in cross-sectional view. Light rays 39-101, 39-102, and 39-103 are shown. Also shown is scored rise 39-310. Fig. 39 schematically illustrates additional scatter or flare arising from light ray 39-101 being reflected from a scratched rise 39-310 of a prior art Fresnel lens. Light ray 39-102 is shown to produce additional scatter or flare as it passes through the scored rise 39-310 and is refracted. Light ray 39-102 is shown to contribute additional scatter and flare Light ray 39-103 contributes to scatter and flare.
• Fig. 40 shows light rays 40-100, 40-101, 40-102, and 40-103.
• Fig. 40 also shows details of a Fresnel lens 40-300 in cross-sectional view. Also shown are each opaque rise portion 40-320. Light rays 40-100, 40-101, 40-102, and 40-103 are each shown to be absorbed upon hitting the rise portion 40-320.
• an opaque material such as ink or other coating material is made to adhere to the rise, while leaving other portions of the lens free of opaque material.
• the rise of the lens is preferably scratched, abraded or scored during manufacture to promote better adherence of material to the rise.
• Opaque material is optionally applied to a lens by dipping or spraying the lens with a coating such as ink, then subjecting the lens to a brief wash. Such a technique results in a coat of ink adhering to the scratched rise and leaves each smooth lens face uncoated.
• Fig. 41 shows another way to provide such opacity using photoresist on a Fresnel lens 41-300.
• a light shield 41-328 with a wedge-shaped opening 41-329 is shown.
• Fig. 42 is a cross sectional view of Fig. 41 taken along line 42. Light ray 41-100 and 41-101 are shown.
• Unexposed photoresist 41-322 is shown.
• Exposed photoresist 41-324 is shown.
• light shield 41-328 is also shown.
• the application of opaque material to each rise of the lens is optionally achieved by the use of a photoresist.
• This embodiment of the invention is optionally implemented by applying a coating of positive photoresist to the entire lens 41-300.
• a light shield 41-328 with a wedge-shaped opening 41-329 is then placed over the lens 41-300, so that when the lens is exposed to light as from light ray 41- 100 from the proper angle, each face 41-310 is not exposed to light.
• the lens 41-300 is rotated to provide successive exposure of each lens face 41-315 around the entire 360 degrees. By this process each face 41-315, but not any rise 41-310, is exposed to light.
• a resist developer is then used to rinse away the photoresist from each rise 41-310, while leaving the exposed photoresist on each face 41-315.
• the entire lens 41-300 can then be coated with opaque material that is capable of adhering to the lens 41-300 but that is prevented from adhering to the lens faces because of the presence of the photoresist thereon.
• the photoresist is then removed from each face 44-315 by further rinsing with developer to dissolve away the exposed resist 41-324 together with the opaque material coating it This process leaves each rise 41-310 coated with opaque material and every face 41-315 clear
• Yet another embodiment of the invention that uses a negative photoresist is as follows As in the method described above, the lens 41-300 is dipped or sprayed in photoresist and then exposed to a properly masked light In this method, however, the light exposure is arranged to strike the resist only on each rise 41-310 A developer will rinse away the exposed negative photoresist from each rise 41-310 Coating of the lens 41-300 with opaque material is performed as disclosed above The resist is developed away each face 41-315 Yet another embodiment of the invention involves using a photoresist that is dyed dark With proper exposure and development, each rise 41-310 is left coated with the black resist, while each face 41-315 is left uncoated
• Fig 43 in another embodiment of the invention there are opaque pre-printed rings 43-340 positioned on lens material 43-342
• the opaque pre-printed rings 43-340 are positioned such that when a lens 44-300 is pressed, stamped, embossed or molded, each rise 44-310 of the completed lens 44-300 will be made up of the opaque pre-p ⁇ nted rings 44-340
• Fig 45 shows an embodiment involving circularly polarized light
• Light ray 45-100, light ray 45-101, and light ray reference point 45-102 are shown Also shown are the Fresnel lens 45-300, each rise portion 45-310, each face portion 45-315, and a quarter wave plate 45-350
• Scattering from each rise 45-310 of the lens 45-300 is reduced by providing an image source that produces circularly polarized light Such light is optionally provided by the output from an LCD or is optionally other light that has been circularly polarized
• a quarter wave plate 51-350 is provided so that light ray 45-100 which passes through the face will be properly transmitted by quarter wave plate 45-350
• light ray 45-101 reflects from the rise 45-310 at light reference point 45-102, its polarization will change and it will not pass through the quarter wave plate 45-350
• FIG. 46 another embodiment of the invention involves applying an anti-reflective (AR) coating to the lens 46-300 to reduce reflection of any light from any face
• AR anti-reflective
• This embodiment of the invention effects its result in a manner similar to the way in which an AR coating on a television tube eliminates the reflections from room lights
• an AR coating 46-355 applied to the Fresnel lens also coats each rise 46-310, thus reducing the reflection of light 46-100 that passes through the lens 46-300 and which light 46-101 then cannot reflect from any rise 46-310
• Yet a further embodiment of the invention uses an AR coating 46-355 together with an opaque coating This embodiment combines a reduction of light reflected from any rise 46-310 and an absorption of light to further reduce light passing through or reflecting from any rise 46-310.
• Another embodiment of the single-image-source 3-D display adapter invention uses a special "sandwich" of optical elements, some of which have been invented for this purpose. It has the advantage of light weight when the elements are annular or Fresnel-type elements are typically formed from plastic sheets and are relatively simple and inexpensive to fabricate.
• the three sandwich elements in combination create a pair of co-axial displaced images: a foreground image on the image source, and a virtual background image which appears behind the foreground image.
• the Fresnel cylinder lens is optionally used to regain image size and restore aspect ratio.
• the following description provides details for an illustrative embodiment for use with a standard 17-inch screen, but of course this invention is readily adapted for use on monitors or television sets of other sizes using calculations known to those in the art.
• the lens element "sandwich" of the present invention is placed parallel to the screen. In the embodiment being described, it is spaced about eight inches (8") from the front of the screen.
• the lens element sandwich is optionally placed in a collapsible housing, attached to the monitor with L-brackets, mounted to a base, or secured by other means known in the art.
• the lens element sandwich comprises a Fresnel semi-lens and a Fresnel beamcombining element.
• it also includes a Fresnel cylinder lens if it is desired to modify the aspect ratio of the displayed image, e.g. where it is desired to double the height of the images displayed on the image source.
• the first element of the lens element sandwich is a novel optical element that is hereby disclosed, which the inventor calls a Fresnel semi-lens 46A-700. It is designed to permit the viewer to view a foreground image at the position of the image source (the face of the television tube) and a virtual background image which appears four inches behind the foreground image. It consists of alternating sets of segments, one set 46A-701 of segments being part of a Fresnel lens and the other set 46A-702 of segments being parallel to the baseline of the sheet (flat). The segments are preferably in the form of narrow horizontal stripes but may take other shapes if desired.
• the segments that are part of a Fresnel lens have a focal length of twenty - four inches. Light which passes through the Fresnel semi-lens faces will thus be reimaged as a virtual image four inches behind the image source, magnified 1.5 times.
• the Fresnel semi-lens is a generally sheetlike optical element that is grooved on one side, having circular grooves that form rises and faces.
• the faces approximate the curvature of a regular optical lens.
• only a portion of the area of the optical element approximates the curvature of a convex (or for other purposes, a concave) optical lens) while the rest of the area of the Fresnel semi-lens is parallel to the baseline (i.e. flat) and thus permits light along the axis to pass through unrefracted.
• the Fresnel semi-lens is constructed to cooperate with the Fresnel beam combining element to produce the desired overall effect.
• the Fresnel beamcombining element can be in one of two forms: a Fresnel beamcombiner 46B-800 or a Fresnel semi-prism 46D-800.
• the function of this element is to bring the foreground image and the background image into alignment, as discussed hereinabove in connection with other embodiments of the overall invention.
• Either form of the Fresnel beamcombining element is sufficiently fine (as measured, for example, in grooves on the order of a millimeter or less) to be unresolvable by the human eye. This characteristic is also desirable for the Fresnel semi-lens.
• the specifics of how and where the Fresnel beamcombining element brings the image into alignment are somewhat different from those of the previously described embodiments utilizing reflective optics and merit further discussion.
• Fresnel beamcombiner 46B-800 the inventor means a generally sheetlike optical element, preferably of plastic such as acrylic, that is grooved on one side. Unlike a Fresnel lens, where the grooves are circular and form rises and faces, a Fresnel beamcombiner 46B-
• each such triangle on the left side form a first set of facets that tend to act in unison on light from a particular source, and the faces of each such triangle on the right side form a second set of facets that similarly tend to act in unison.
• Commercial products that can be so employed are available from Fresnel Optics, Inc., Henrietta, NY, in the PR 700 series of catalog numbers (identified as beamsplitters, since a beam going in the opposite direction from the combined beam produced by the present invention is split into two directions).
• the Fresnel beam combining element is a Fresnel beamcombiner
• a viewer sees light from the light source through each of the two sets of facets.
• Light from the top half of the monitor coming through one set 46B-801 of facets of the Fresnel beamcombiner is bent toward the viewer.
• light from the bottom half of the monitor coming through the other set 46B-802 of facets of the Fresnel beamcombiner 46B-800 is correspondingly bent in the opposite direction and also directed towards the viewer.
• the angle between the input beams in this embodiment is approximately thirty-five degrees.
• Light from the top half of the image source and light from its bottom half are thus co-aligned: from the viewer's vantage point the foreground image from the top half of the monitor is superimposed on the background image, from the bottom half of the monitor, in line with the center of the image source.
• the Fresnel beam combining element is a novel optical element that is hereby disclosed, which the inventor calls a Fresnel semi-prism.
• the inventor needs first to discuss conventional Fresnel prisms.
• Conventional Fresnel prisms are available from Fresnel Optics, Inc. in the
• a Fresnel prism is also a generally sheetlike optical element that is grooved on one side. Its faces consist of straight lines that are all sloped the same angle to the baseline of the sheet. Its rises approximate the vertical, as in a Fresnel lens, but they are linear rather than circular.
• a Fresnel prism differs from a Fresnel beamcombiner in that its cross section shows repeating right triangles, rather than isosceles triangles.
• a Fresnel prism refracts light from a source much as a regular right-triangular prism does. If one looks at a scene and then at the same scene through a Fresnel prism, the scene appears to be offset from its actual position. When the lines of the Fresnel prism are oriented horizontally, the apparent offset is vertical.
• a Fresnel semi-prism is a kind of Fresnel beam combining element that presents to the viewer, in one co-axial orientation, light beams deriving from images in two different locations, e.g. on two different areas of a television screen. It does this by refracting light beams originating from one location and by passing directly without refraction light beams originating from the other location.
• light from the bottom half of the image source passes through a prism portion of the Fresnel semi-prism and is refracted so it is co-aligned with light from the top half of the image source.
• Light from the top half of the source passes through the non-prism or flat portion of Fresnel semi-prism, and its direction is unchanged.
• the foreground image and background image are co-axially aligned from the vantage point of the viewer.
• the Fresnel semi-lens acts on light coming from the bottom half of the display (such as a CRT) to create a virtual image that is behind the face of the display (i.e. the face of the CRT)
• the viewer perceives a real-depth experience as described hereinabove
• a third, optional, element of the sandwich of optical elements of the present embodiment is a Fresnel cylinder lens, such as those from Fresnel Optics, Inc. in the catalog number series CY 500. In the embodiment being described, it desirably has a focal length of about sixteen inches.
• the images on the screen are each pre-compressed 2:1 in the vertical
• the Fresnel cylinder lens acts to expand the picture to compensate for 2 1 vertical compression as discussed hereinabove, restoring aspect ratio and image size This element is not necessary if restoration of aspect ratio is not desired. If it is not used, then the images are not pre-compressed in the vertical dimension
• the Fresnel beam combining element needs to be carefully aligned with the Fresnel semi-lens element, these two elements are preferably embossed or molded on opposite sides of the same plastic substrate The flat faces on the Fresnel semi-prism and the flat areas of the Fresnel semi-lens are aligned so that the light from the top half of the screen is not re-imaged for the viewer by the Fresnel lens segments.
• the Fresnel lens segments of the Fresnel semi-lens are aligned with the optically refractive elements of the Fresnel beam combining element If the Fresnel beamcombiner is used as the Fresnel beam combining element, the bottom half of each prism sub-element is lined up with a clear segment of the Fresnel semi-lens. Using either embodiment, light from the bottom half of the screen which passes through the Fresnel lens segments of the Fresnel semi-lens is reimaged as a virtual image about four inches behind the image source
• a holographic optical element may be constructed (using known techniques) with the equivalent functionality of the two or three subelements of the Fresnel sandwich described herein to accomplish the same tasks Multiplayer 3-D Adapter
• a further embodiment of the invention disclosed herein is a multiplayer 3-D adapter
• the output of an image source (such as a television monitor or other standard CRT) is segmented
• the screen is divided into multiple foreground sections and multiple background sections
• One set of foreground and background images is routed to each player (or viewer) preferably in a manner which does not allow any other player to see another player's view
• a computer screen is split vertically.
• the right-hand portion of the screen is the first player image source
• the left-hand portion is the second player image source.
• the right-hand portion is further subdivided into a foreground image section and a background image section as discussed hereinabove
• the foreground image and the background image are co-ahgned using reflective elements such as a beamcombiner
• Additional optics are optionally used to re-direct and magnify the 3-D scene so that it is not visible from the second player's seating position The same is done for the second player's image source
• Another embodiment splits the image source horizontally
• the top of the image source is used as a first player section, and the bottom of the image source is used as a second player section
• the upper left corner is used as the first player's background source, and the upper right is used as the first player's foreground source
• a conventional mirror is used to reflect the background source to a reflective element which is used to co-align foreground and background images
• Secondary optics such as a conventional mirror, are optionally added to redirect the output to a seating position in front of the image source
• a Fresnel lens or other reimaging optics
• the lower right corner is used as the second player's background source
• the lower left corner is used as the second player's foreground source
• the images are co-ahgned and preferably redirected so that the first player can not see the
• the secondary optics are preferably arranged so that all players sit in front of the monitor or so that the players may surround the monitor in various seating configurations
• a multiplayer adapter (whether or not 3-D) allows inexpensive home systems (like Sega Genesis, Nintendo or personal computers) to let people play multiplayer games that are preferably all of these, simultaneous, secret, multiperspective, multiplayer, non-networked
• current games will be examined that are missing at least one from that group of attributes.
• Some car racing games are multiperspective, and even split the monitor screen to provide each driver with his own view These games lack the secret element because a player can simply look at the other player's portion of the screen In the car racing game, that is largely unimportant, but in other games where stealth is a part of the action for example, secrecy is paramount
• Multiperspective is missing from a number of the "fight" games on the market (Virtua Fighter, Mortal Kombat). The contestants are shown battling it out in a ring from a shared perspective.
• Multiplayer games like Doom, Heretic and Descent are currently played over networks: more than one machine and some connective means is required to play the game. For example they use a port-to-port connection, modem connection, local-area or wide-area network (LAN or WAN) connection, dial-up service (such as DWANGO) or the Internet. At the very least, a second image source is often used (i.e. a second monitor in some video arcade games).
• Kali software (World Wide Web http://www.kali.com) allows people to play games over the Internet as if players were on the same local area network.
• TheLadder (World Wide Web http://www.kali.com) allows people to play games over the Internet as if players were on the same local area network.
• TheLadder (World Wide Web http://www.kali.com) allows people to play games over the Internet as if players were on the same local area network.
• TheLadder World Wide Web http://www.kali.com
• the addition of the connective means makes it much more expensive and inconvenient to play games where a secret, multiperspective is important.
• the multiplayer adapter of the present invention solves all of those problems: on it one can play games that are simultaneous, secret, multiperspective, multiplayer, and yet non-networked.
• Doom is a "first person” game, that is, the player's view is what his character sees as he runs around in a maze, killing things. So if the first player sneaks up from behind the second player, the first player will see the second player, who may remain unaware of the first player's presence.
• surprise is one of the fun parts.
• Fig. 47 shows an image source 47-030.
• Fig. 47A shows a plan view of a multiplayer 3-D imaging system.
• Fig. 48 shows a perspective view of a multiplayer 3-D imaging system.
• First reflective element 47-035 a second reflective element 47-036.
• the multiplayer adapter segments an image source into multiple foreground image sources and multiple bac kground image sources
• This embodiment segments the image source 47-030 into a first foreground image source 47-040 and a first background image source 47 080
• First background image source 47-080 is reflected from a first conventional mirror 47-135 to the first reflective element 47-035
• Light from the foreground image source is reflected from the first reflective element 47-035
• first reflective element 47-035 acts as a beamcombiner
• the co-ahgned images are optionally further reflected and magnified as desired by first spherical mirror 47-400
• This embodiment also segments the image source 47-030 into a second foreground image source 47-040 and a second background image source 47-080 Second background image source 47-080 is reflected from a second conventional mirror 47-136 to the second reflective element 47-035 Light from the foreground image source is reflected from the second reflective element 47-035
• second reflective element 47-035 acts as a beamcombiner
• the co-ahgned images are optionally further reflected and magnified as desired by second spherical mirror 47-400
• Fig 49 is a plan view of the multiplayer adapter shown in Figs 47 and 48
• Fig 49A is a perspective view of the same embodiment
• Optional housing 47-001 is provided with an opaque front face 47-002
• Light ray 47-106 emits from the first background image source 47-080, is reflected by conventional mirror 47-135 to the reflective element 47-035 from which it is reflected to the front of the monitor
• light ray 47-107 is transmitted by the reflective element and is visible to the a viewer sitting in front of the monitor Similar problems occur with regard to the other player area
• the opaque face 47-002 is provided to stop a viewer from having a direct hne-of-sight 47-100 with either foreground image source
• Fig 50 is a view of a segmented image source
• Fig 51 is a plan view of a multiplayer imaging system
• Fig 52 is a perspective view of a multiplayer imaging system
• Figs 50 through 52 there is an image source 50-030
• reflective elements which act as beamcombmers Depicted are a first reflective element 50-035, a second reflective element 50-036, a third reflective element 50-037, and a fourth reflective element 50-038
• Image source is divided to provide a first foreground image source 50-041, a second foreground image source 50-042, a third foreground image source 50-043, a fourth foreground image source 50-044, as well as a first background image source 50-081, a second background image source 50-082, a third background image source 50-083, and a fourth background image source 50-084
• conventional mirrors used to help co-align foreground image and background image, namely a first conventional mirror 50-135, a second conventional mirror 50-136, a third conventional mirror 50-137,
• First light ray 50-101 is from the co-ahgned images from first foreground image source 50-041 and the first background image source 50-081 and is directed to viewer 50-201
• Second light ray 50-102 is from the co-ahgned images from second foreground image source 50-042 and the second background image source 50-082 and is directed to viewer 50-202
• Third light ray 50-103 is from the co-ahgned images from third foreground image source 50-043 and the third background image source 50-083 and is directed to viewer 50-203
• Fourth light ray 50-104 is from the co-aligned images from fourth foreground image source 50-044 and the fourth background image source 50-084 and is directed to viewer 50-204
• Figs 53 and 54 depict additional light rays 50-105, 50-106, 50-107 and 50-108 which represent light which is also combined by the various reflective elements For example, viewer 50-204 may see any of these light rays and therefore may see any of the viewpoints of the other players It is prefer
• Figs 55 and 56 depict another embodiment of a four-player adapter
• image source 55-030 There is reflective elements 55-035, which act as beamcombmers
• Image source 55-030 is divided to provide foreground image sources 55-040, as well as background image sources 55-080
• light rays 55-100 Also depicted are conventional mirrors 55-135 used to help co-align foreground image sources 55-040 and background image sources 55-080 Viewers 55-200 are shown
• Secondary reflective optics 55-400 are provided In this embodiment, all of the light rays 55-100 are directed to the front of the image source 55-030 allowing all viewers 55-200 to sit in front of the television or computer screen
• Figs 56A and 56B depict another embodiment of a four-player adapter wherein all images are directed to the front of the image source.
• Image source 56-030 There is a housing 56-001 and an image source 56-030. There are reflective elements 56-035 and 56-036 which act as beamcombmers. Image source 56-030 is divided to provide four 3-D views indicated by light rays 56-101, 56-102, 56-103, and 56-104. Also depicted is a conventional mirror 56-135 used to help co-align foreground image and background image sets. Fresnel lens 56-300 and secondary reflective optics 56-400 are provided.
• Light ray 56-102 and 56-103 are prevented from transmitting through reflective element 56-035 by housing 56-101.
• Light ray 56-101 and 56-104 are reflected from reflective element 56-036 through Fresnel lens 56-300 (which preferably expands and reimages) to the front of the image source 56-030.
• Secondary reflective optics 56-400 (such as a Fresnel mirror, spherical mirror, cylindrical mirror appropriate to restore aspect ratio, expand or magnify the image, create a real image, etc. as described in this document) are preferably present.
• Figs. 57 through 59 are plan views of the single image source multiplayer adapter embodiment shown in Fig. 47.
• secondary optic 47-401 has been re-oriented to direct one player's output to a position behind the image source.
• a housing is optionally provided which blocks light from reflective element 47-036 while providing a viewing aperture so that light from reflective element 47-035 may be seen from the front of image source 47-030.
• Figs. 60 through 62 are plan views of the embodiments shown in Figs. 57 through 59.
• a Fresnel lens 47-300 has been added to the drawings. It is worth mentioning, that the various adapters as depicted are capable of utilizing a Fresnel lens (or any other economically and optically feasible lens known to one of ordinary skill in the art) to 'float" or create real images of any or all image planes involved as taught herein.
• the multiplayer adapter desirably provides 3-D real depth in accordance with the present invention.
• simplified versions provide 2-D images to multiple players, within the scope of the present invention.
• Fig. 63 shows an embodiment of a single image source multiplayer adapter. Depicted are image source 63-030, light ray 63-101, light ray 63-102, conventional mirror 63-135, a first viewer 63-201, a second viewer 63-202, optional secondary reflective optic 63-401 and optional secondary reflective optic 63-402
• the image source is divided into multiple portions a first player portion and a second player portion
• Light ray 63-101 from a first portion of the screen is reflected from a conventional mirror 63-135 to a first viewer 63-201 (directly or after interaction with optional secondary reflective optic 63-401)
• Light ray 63-102 is directed to another viewer
• the display on image source 63-030 is optionally compressed 2 1 along one axis to allow an optional secondary reflective optic to recover the original aspect ratio, albeit at the cost of resolution
• Fig 64 shows another embodiment of the single-image-source multiplayer adapter of Fig 63
• An additional piece, called a view splitter 63-010 has been attached between each conventional mirror 63-135
• Optional secondary reflective optic 63-401 has been reversed to redirect light ray 63-101 to a different location
• An optional view splitter is used to block one player from seeing the other player's screen
• the angle of view may be controlled using a view splitter 63-010 or through the use of a Fresnel lens or other means of creating a real image (as taught hereinabove) with a controlled angle of view
• Proper placement of a Fresnel lens along the path of light ray 63-101 can be used to make sure that second viewer 63-202 is outside the controlled angle of view
• Figs 65 and 66 show an even simpler multiplayer adapter Depicted are the image source 65-030, first player portion 65-040, second player portion 65-042, light ray 65-101, light ray 65-102, optional Fre
• Figs 67 through 69 show a non 3-D multiplayer adapter Figs 67 and 68 are perspective views, and Fig 69 is a plan view
• the figures show image source 67-030, first player portion 67-041, second player portion 67-042, third player portion 67-043, fourth player portion 67-043, first light ray 67-101, second light ray 67-102, third light ray 67-103, fourth light ray 67-104, conventional mirror 67-135, second player conventional mirror
• First light ray 67-101 is seen by first viewer 67-201.
• Second light ray 67-102 is reflected from second conventional mirror to second viewer 67-202.
• Third light ray 67-103 is reflected from third conventional mirror to secondary reflective optic 67-400 to a third viewer 67-204.
• Fourth light ray 67-104 is reflected from fourth conventional mirror to fourth viewer
• a Fresnel lens or other optic for creating a real image, an enlarged image or an image with a changed aspect ratio
• Figs. 70 and 71 show another four-player adapter variant.
• the figures show an image source 70-030, a first player portion 70-041, a second player portion 70-042, a third player portion 70-043, a fourth player portion 70-044, first light ray 70-101, second light ray 70-102, third light ray 70-103, fourth light ray 70-104, first conventional mirror 70- 135, second conventional mirror 70-136, third conventional mirror 70-137, fourth conventional mirror 70-138, first viewer 70-201, second viewer 70-202, third viewer 70-203, fourth viewer 70-204, reference point 70-300, second reference point 70-301, first secondary reflective optic 70-401, second secondary reflective optic 70-402, third secondary reflective optic 70-403, fourth secondary reflective optic 70-404.
• each player portion is half as tall and half as wide as the original image source.
• the appropriate action, if any, to take with additional secondary optics is uniform magnification. As discussed elsewhere, this may done through the us of cylindrical lenses, cylindrical Fresnel lenses, Fresnel lenses, spherical mirrors, or any of the cylindrical expansion elements used in tandem (one to expand the image in the vertical, the other to expand it in the horizontal).
• This embodiment illustrates the potential placement of spherical mirrors because the spherical mirrors must be a good deal larger than that which they will magnify.
• secondary reflective mirror 70-404 could be placed directly under 70-403 making a more compact system. However, given the size of the spherical mirrors contemplated in these Figures, the offset is necessary.
• Figs. 72 and 73 depict another embodiment of a four-player adapter.
• Image source player portion 72-040, conventional mirror 72-135, light ray 72-100, viewers 72-200, optional reference point 72-300, and optional secondary reflective optic 72-040 are shown
• light ray 72-100 is reflected to the appropriate viewer
• Embodiments which direct all output to the front accommodate themselves well to consumer set-up of their homes televisions and computers are often backed to walls
• Reference point 72-300 shows possible locations for placement of Fresnel lenses (or other optical elements for creating a real image with a controlled angle of view) to provide additional "security" to those using this adapter
• Figs 74 through 84 depict a multiplayer adapter Shown in the figures are a first view splitter 74-010, a second view splitter 74-011, the image source 74-030, first player portion 74-041, second player portion 74-042, third player portion 74-043, fourth player portion 74-044, light ray 74-101, 74-102, 74-103, 74-104, a conventional mirror 74-135,
• an image source 74-030 such as a television monitor, is placed
• a view splitter 74-010 is used to create two different views, one on each side of the view splitter 74-010 In this fashion, one person can see his own portion of the videogame in privacy, as previously discussed
• a second view splitter 74-011 is preferably slotted or otherwise detachable from first view splitter 74-010 When the second splitter is in place, this embodiment may be used as a four-player adapter Each viewer sits in her own quadrant looking at her respective screen area
• FIG. 79 through 81 A conventional mirror 74-135 is angled so as to reflect the first player portion 74-041 to make it easier to view Viewers may sit comfortably back from the image source, rather than gazing down on the monitor face itself This improvement may alternatively be used with the two-player version of this embodiment However, in that instance either larger conventional mirrors are necessary, or it may be necessary to be able to change the orientation thereof to present an integrated image to both players
• Figs 82 and 83 show the addition of Fresnel lens 74-300 (or other element that will re-image each light ray into a real image)
• Fig 84 shows that addition of secondary reflective optics 74-400 can be used to redirect, reimage, and/or magnify the image
• Fig 84A shows a display system of the present invention
• An image source 84A-030 is placed "face-up" and its output 84A-101 directed to secondary reflective optics 84A-401, such as a spherical mirror Spherical mirrors are relatively cheap to make, and can be used to uniformly expand images, but must be made larger than the image that they will expand to reduce spherical aberrations
• Figs 85 and 86 show a monitor enlarger of the present invention Image source 85- 030, light ray 85-100, first mirror 85-401, and second mirror 85-402 are depicted Referring now to Fig 85, light ray 85-100 leaves image source 85-030 Light ray 85-100 is reflected from first mirror 85-401 to second mirror 85-402 which expand the image as desired, preferably uniformly Referring now to Fig 86, the position of second mirror 85-402 may be changed to reflect light ray 85-100 to the rear of the monitor
• Figs 86 and 87 show another embodiment of the monitor enlarger of the present invention Depicted are an image source 87-030, a first beamsplitter 87-035, a second beamsplitter 87-036, and a first mirror 87-135 Light ray 87-101, 87-102, 87-103, and 87- 104, first viewer 87-201, second viewer 87-202, third viewer 87-203, fourth viewer 87-204, a beamsphttmg mirror 87-401, and a second mirror 87-402, are also shown
• First mirror 87-135 is preferably a cylindrical expansion mirror designed to expand the image in one dimension
• Light ray 87-101 is reflected from the first mirror 87-135 to the beamsphttmg mirror 87-401 and further reflected
• beamsphttmg mirror 87-401 is also a cylindrical expansion mirror disposed to expand the image in its other dimension
• Light ray 87-101 passes to first beamsplitter 87-035, from whence light ray 87-101 continues to a first viewer 87-201, and light ray 87-102 continues to a second viewer 87-202
• Second mirror 87-402 is also preferably a cylindrical expansion mirror disposed to expand the image in the other direction from first mirror 87-135
• Light ray 103 passes through second beamsplitter 87-036 to a third viewer
• Light ray 87-104 is a reflected portion of the image which reaches a fourth viewer 87-200 This adapter allows a single image source to direct output to the four directions
• the distance of the top and bottom images from the viewer are different, therefore the magnifications are not the same
• the bottom image often becomes magnified more than the top image, for example
• the screen is divided so that the one image is bigger than the other image and the images are the same size after they pass through the optical system
• This technology can be used for a movie adapter
• the use of a single cylindrical expansion mirror can help recapture the original dimensions of a movie and display a full sized image without the black cut-outs from letterbox
• An embodiment of the present invention is a "narrow-profile" single image source display system. This embodiment uses numerous smaller mirrors which decreases the distance the optical elements protrude from the image source. These "narrow-profile" embodiments potentially reduces the apparent distance between the planes, unless some of the methods discussed below are employed to increase the distance between foreground and background planes. Different embodiments split the screen into greater or smaller numbers of segments than depicted.
• Figs. 89 to 92 show embodiments of a narrow profile image display system in which the display is split into numerous foreground and background areas. Each top portion is the foreground portion, and each bottom is the background portion. Each set of portions is co- aligned as described hereinabove in the document. The resulting output is striped because no light passes directly from any background portion.
• An optional lenticular expansion array is used to expand each image set stripe so gaps or blank stripes are not presented to the user.
• light 89-101 from each foreground portion 80-040 passes through a reflective element 89-035, such as a beamcombiner, and then through an optional expansion element 89-400 such as a lenticular array.
• Light 89-102 from the background is reflected from a mirror 89-135 (optionally an expanding mirror) and further reflected from reflective element 89-035, and then through an optional expansion element 89-400.
• the optional expansion element 89-400 the reflection of light 89-102 from the mirror 89-135 would leave dark gaps or stripes.
• An optional expansion element 89-400 is placed to magnify the light images passing through it by 2. This doubling eliminates any gaps in the image created by the use of interlaced conventional mirrors. With a 20" television set or monitor, a 10-12" depth between the planes facilitates the preferred perception of depth. The cylindrical mirrors are set up so that they create a virtual image 10" behind a 20" screen, allowing a very large separation of the planes used for the foreground and background images.
• a curved reflective element 90-035 such as a beamsplitter or partially reflective mirror, is used in front of each foreground image area 90-040.
• This displacement has the advantage of placing the virtual background image even farther behind the foreground image.
• each segment would be .167" and the mirror would therefore have a radius of curvature of .25"
• a conventional cylindrical mirror 91-135 is used to reflect the background image to a partially reflective cylindrical mirror 91-035 which co-aligns the its foreground/background portion set.
• a partially reflective cylindrical mirror 91-035 which co-aligns the its foreground/background portion set.
• plastic cylinders molded in a frame, then cut and slightly offset could serve as the lens array in this embodiment. This would be very inexpensive to make, for reasonable image quality.
• a second optional expansion element 92-401 (such as a series of lenticular lens elements) is used to expand each of the background image area segments.
• the expanded image is reflected to the foreground mirror.
• Different embodiments split the screen into greater or smaller numbers of segments than depicted.
• this "narrow profile" 3-D image display system may be used as an image source in any of the other image display systems and methods of this invention.
• the display output may be reimaged through the use of a properly placed Fresnel lens (or its reimaging equivalent).
• the display output may be used in combination with other 3-D techniques of this invention in a meta-display system to provide multiple image planes.
• the background image source 34-080 is optionally replaced with a "narrow profile" embodiment as one of many methods to generate multiple image planes. Time Multiplexing
• Time multiplexing has been used to present alternate left- and right-eye stereoscopic views to an observer.
• viewers must wear special glasses which alternately expose the left and right eyes in synchrony with a display so that each eye sees only the proper perspective view.
• Such a system has all the drawbacks of stereoscopic imaging discussed above, plus it requires twice the normal frame rate to avoid perception of an "alternating eye flicker" which generates eyestrain and headaches in many users.
• the invention disclosed herein permits a single image source, such as a TV or computer monitor, to be used to produce foreground and background images.
• a single image source such as a TV or computer monitor
• One way to do this with time multiplexing is by sending the foreground and the background images alternately to the image source.
• double the frame rate to eliminate flicker
• the standard frame rate is nevertheless less objectionable than many other 3-D techniques since both eyes perceive each image simultaneously, one behind the other.
• the two images can be displayed in their proper locations in space in any of various of ways.
• the shaft is marked optically or with an electrical contact so that one rotational position generates a signal to a synchronizing circuit, or the shaft may be driven by a motor responsive to a synchronizing pulse that is part of the decoded TV signal.
• a projector When a projector is used to create the image, it may be synchronized with the rotating shaft, to provide the nearer and then the farther image in alternating succession. These could be successive frames on a reel of cinematic film, for example.
• the system is synchronized to ensure that first substantially all the pixels of a particular frame are displayed during the time that the screens (or the lens) are positioned to display the near image, and then that the pixels of substantially the entire far image are displayed during the time that the screens (or the lens) are positioned to display the far image.
• the shaft is spun at 30 revolutions per second, to provide 30 near images and 30 far images per second. If a system having a different refresh rate is used, the rotational speed is synchronized correspondingly.
• Time multiplexing is another way to get "double duty" from an image source. Instead of sacrificing resolution (as may be done in some of the single-image-source splitting embodiments), full frame foreground and background images are displayed on an image source in alternating sequence.
• Figs. 93A-93E show an image source 100-030, a first image projection screen 100-040, a second image projection screen 100-080, a projector 100-300, a lens 100-310, and a rotating member 100-350.
• a first image projection screen 100-040 and a second image projection screen 100-080 are attached to a rotating member 100-350.
• Rotating member 100-350 is disposed so it alternately presents first projection screen 100-040 and second image projection screen 100-080 to projector lens 310.
• Figs. 93A through 93E are elevational views of this embodiment.
• the second image projection screen receives a second image from projector lens 100-310.
• the first image screen 100-040 receives a first image from projector lens 100-310 once the rotating member 100-350 has rotated half a turn.
• the projection system shown in Figs. 93A though 93C consists of two screens 100-040 and 100-080 mounted one hundred eighty degrees apart on a common rotating member 100-350, each screen at a different distance from the projector lens 100-310. As an example, as shown in Figs.
• a single projector 100-300 is used, having a lens 100-310 which has a large enough depth of focus to be in focus on either of the two planes. (Alternatively, two projectors could be used, one in focus on each plane.)
• the projection screens 100-040, 100-080 are front-projection screens, wherein the viewer is located in the vicinity of the projector 300. In that instance, the foreground image appears on the first screen 100-040, and the background image appears on the second screen 100-080.
• the projection screens 100-040, 100-080 are translucent rear-projection screens, wherein the viewer is located opposite from the projector 300. In that case, the foreground image appears on the second screen 100-040 and the background image appears on the first screen 100-080.
• screens 100-040, 100-080 are illustrated diagrammatically by rectangles in Figs. 93B and 93C, they may desirably be shaped otherwise, e.g. in the form of semicircles as shown in Fig. 93D.
• FIG. 93E Another embodiment, shown in Fig. 93E, uses a pair of complete projection lenses 100-310, 100-311 in front of the projector on a rotating member 100-350, synchronized to the changing position of a pair of projection screens (not shown).
• a projection lens may be provided that changes focus by the insertion and extraction of a lens element having a position that is synchronized to the changing position of a pair of projection screens.
• FIGs. 94A and 94B Another time multiplexing embodiment is shown in Figs. 94A and 94B. Depicted are an image source 101-030, a pair of mirrors 101-040 and 101-041, light rays 101-101 and 101- 102, a viewer 101-200, and a rotating shaft 101-350.
• the image source 101-030 is preferably a single TV monitor. The images are viewed in a spinning mirror arrangement.
• This embodiment comprises a pair of mirrors 101-040 and 101-041, mounted one hundred eighty degrees apart, on a single rotating shaft 101-350.
• the mirrors 101-040 and 101-041 alternately rotate into position to present to the viewer 101-200 a virtual image of the monitor 101-030, the viewer 101-200 sees with both eyes, alternatingly a more distant image (when the system is in the position shown in Fig. 94A) and then a closer image (see Fig. 94B) followed by the next version of the more distant image (see again Fig. 94A).
• the two alternating light paths from the monitor to the viewer are shown by dashed lines 101-101 and 101-102.
• Figs. 95A and 95B show a perspective view of another embodiment.
• Figs. 95A and 95B depicted are a large lens 102-300, stationary projection screen 102-030, a projector 102-031, real image 102-050, and a viewer 102-200.
• a large lens 102-300 such as a Fresnel lens, cut to form a semi-circle, is made to rotate in front of a stationary projection screen 102-030.
• the viewer 102-200 sees the projection screen successively through the lens (as shown in Fig. 95B) and then directly (as in Fig. 95A).
• the screen 102-030 is made to appear closer to the viewer (and larger), in the form of a real image 102-050. This is a foreground image.
• the screen 102-030 appears at its actual distance (and smaller), see Fig.
• the lens 102-300 position is synchronized to the images that are projected onto the screen by projector 102-031.
• the screen may be a front-projection screen positioned so that the projector beam does not go through the lens. However it is preferably a rear-projection screen, as shown.
• the "proportioned” orientation requires placing the TV monitor on its side Proportion is preserved, but the user is required to turn the TV set on its side That may be inconvenient in some instances, for example, where the TV is used for both game playing and traditional TV viewing
• the major advantage of the "proportioned" orientation is that the foreground and background sections have proportions that more closely approximate that of a full screen
• the video signal can be produced generically and viewed by some viewers using customary 2-D television screens and by others using apparatus of the present invention, with minimal information regarding depth being required to get full 3-D effect from the adapter, as previously discussed
• all problems with aspect ratio caused by the splitting of the screen can be cured through the use of elements that expand an image along a desired line
• foreground image and background image are created to be of different sizes
• Real Image Monitor Embodiments of the present invention preferably provide 3-D real depth in accordance with the present invention
• a simplified version provides a real image of an image source within the scope of the present invention
• One embodiment of the present invention that forms real images uses a Fresnel lens (or other means of generating a real image as known in the art and/or discussed herein) and a mirror in a housing
• the housing has holes or apertures a rear aperture that sits more or less flush with the image source (for example, the face of a CRT) and a second aperture through which the real image is viewed
• the image is reflected from the mirror (which is angled appropriately, desirably at a 45-degree angle) and through the Fresnel lens, which focuses the light into a real image
• This real image appears to float in space
• an advantage of the present invention is that the user is further from the computer monitor and its associated hazards
• the indirect viewing system of the present invention has certain advantages over other prior art viewing systems in that a angle of view is controllable and there is a great reduction in glare Both features would be useful, for example, m an office setting or at an automated teller machine, where privacy is important and where glare is potentially distracting Recording
• a number of techniques may be employed in imaging processing methods for processing source images comprising live or pre-recorded images to be displayed using the display techniques of the present invention. These techniques and methods vary in accordance with whether the source image is a live image or is an already recorded and stored image to be displayed according to the display methods of the present invention.
• the image processing methods of the present invention process a source image to view using the display techniques of the present invention.
• These display techniques utilize at least two separate images, usually including a foreground image and a background image, separately displayed on at least two separate optically aligned planes or volumes.
• the source image is either a live scene characterized by a continuous three-dimensional space defined between a forwardmost foreground object and a rearmost background object or a pre recorded two-dimensional image displayable on a single plane and containing the same human visual depth perception cues contained within a photograph.
• Each source image is divided into at least two image signals. These separate image signals produce separate images on different portions of a single image display device which are then optically combined to form a composite image scene or other display, or are used to synchronously generate a plurality of images each on a separate display device which are then optically combined to form the composite image scene or other display.
• a first camera is directed at one or more foreground objects in a scene to be captured.
• the function of the first camera is to capture the foreground of the scene.
• a second camera is positioned behind or above the foreground subject matter and is also directed at the scene to be captured.
• the function of the second camera is to capture the background of the scene.
• Numerous configurations for the relative positioning of the two cameras may be employed. For example, both cameras can be located in the same plane, one being vertically positioned at chest height and the second being vertically positioned about ten feet or so higher than the first camera and aimed downward.
• the first and second cameras would be equipped with different focal length lenses, the focal length of the lens on the first camera being selected to focus on objects in the foreground and the lens for the second camera being selected to focus on objects in the background of the scene.
• the depth of field of the first camera may be selected to focus on a range of objects in a Z depth corresponding to the depth of foreground composition and the depth of field of the second camera may be selected to focus on a range of objects in a Z depth corresponding to the depth of background composition.
• Other numbers of cameras may be employed.
• This technique is also useful for processing prerecorded images in, for example, two- dimensional movie subject matter.
• a focus threshold is selected and everything greater than the focus threshold is considered to belong in the foreground image and everything less than the focus threshold is considered to be in the background image.
• Another multicamera technique which is contemplated for use in processing images for display according to the present invention is to employ two or three cameras horizontally displaced from one another, e.g., one to capture the scene from the left, one to capture the scene from the center, and one to capture the scene from the right .
• the different angles of view allow a composite full view of all background objects behind the one or more foreground objects in the image.
• Yet another multicamera technique comprises two horizontally-displaced cameras arranged in parallel fields of view at the same Z location.
• the two images generated by the two cameras are compared and matching objects from each image can be recognized using known computer matching techniques. Matching objects are recognized and the distance from the image of each object to the edges of the frame in each of the two images are calculated to determine depth. At infinity, all objects overlap, but as objects get closer to the cameras, the corresponding images become separated by greater distances.
• the cameras are aimed at a common point such as the center of the furthest background object. All objects at that point will be aligned and closer objects will become separated.
• This technique also works when the cameras are vertically displaced. Vertical camera displacement may be advantageous when dealing with scenes which are horizontally cluttered.
• Computer processing of the image signals may then be performed to selectively eliminate background objects or areas using techniques such as have been employed in colorization of motion pictures (in which the computer tracks a selected object or area from frame to frame) to create the foreground image frame Where real-time processing is not an issue, foreground objects can alternately be selected by hand
• the same techniques can be used to produce a background image devoid of foreground objects
• a single-camera technique for identifying foreground and background objects employs two lenses which are focussed on the same scene through a single aperture by way of a beamsplitter One lens is focussed on the foreground and the other is focussed on the background and each lens focusses an image on its own image detector.
• known techniques which discard out-of-focus components, foreground and background objects can be identified and eliminated from each of the foreground and background images as required.
• Known fill techniques may be used to reconstruct background areas occluded by foreground objects
• the computer may select foreground objects on the fly.
• One technique for facilitating this separation is to employ a camera whose sole purpose is to capture foreground objects This camera is set for a narrow depth of field, and standard techniques may be employed to select ln-focus objects from the scene foreground
• Another technique which may be usefully employed to select foreground images "on-the fly" is to analyze the spatial frequency of the various portions of the image Spatial frequency will be highest for in-focus objects.
• a spatial frequency threshold is selected and groups of pixels having a spatial frequency above threshold are determined to belong to foreground objects.
• contrast detection Another technique which can be employed to discriminate between foreground and background objects is contrast detection. Highest contrast areas are generally found foreground objects. Techniques such as MTF filtering look for the highest difference between dark and light areas of an image. Because objects m the foreground of an image generally move more quickly than objects in the background, frame-to-frame motion detection could also be employed to discriminate between foreground objects and background objects. Another useful technique which may be employed to distinguish between foreground and background objects is color saturation which decreases as objects recede into the background. Other useful techniques include brightness detection, based on the assumption that closer objects are usually brighter. Optical subtraction may be employed with these techniques to eliminate portions of the image that are the same in successive frames, resulting m an image of foreground objects.
• ranging techniques may be employed during capture of live images. For example, a coherent or incoherent projected grid may be superimposed on the scene in a way in which it will not show up in the recording of the image.
• Examples of such grid projection techniques include infrared or ultraviolet projection and scanning or strobing at a frequency or speed that will not be recorded with the image.
• a detector may be gated to the grid flash (with the camera gated oppositely to the flash). The grid may be detected and its focus analyzed. Threshold conditions may be used to determine if an object is in the foreground. If the imaged grid pattern is scanned in synchronization with a scene scanning camera, the Z coordinate can be approximated for each element in the scene and can be stored with the pixel to use to separate foreground and background. This technique may be performed on a per camera basis where multiple cameras are employed.
• each grid line and grid square is proportional to the projected distance from the source to the object.
• the grid lines each become distorted as a function of the Z position of each point on the three dimensional surface.
• the computer can employ known techniques to analyze a two dimensional scan of the projected grid lines to determine the Z coordinate of each point on the surface.
• Another scanning technique applicable to the present invention is to scan the scene with a laser beam and detect the reflection from objects in the scene.
• the reflected spot size is proportional to the distance traveled by the reflected beam due to the limited depth of focus of the lens.
• Another laser technique employs a scanned laser beam that is pulsed for short periods of time.
• the laser is configured to have a coherence length within which all foreground objects reside.
• the beam is reflected from an object in the scene, the reflected beam is received and recombined with a reference beam from the same laser, and an interference pattern will develop only for objects which reside within the coherence length.
• a detector is used to detect the presence of the interference pattern. This technique identifies objects in the foreground.
• each pixel in the scene can be identified as coming from a foreground object or a background object by storing an additional bit with the pixel
• Known object-detection techniques such as analyzing pixels to find boundaries (large changes) which define the edges of an object, can be utilized to store Z-coordinate information for entire objects rather than for each individual pixel, reducing the amount of
• the grid generation and laser scanning techniques disclosed herein may be augmented by employing two or more spaced apart grid generators or scanning laser beams to avoid the problem of foreground objects blocking the grid or laser beam from reaching objects or areas
• source images are divided into at least two images, at least one foreground image and at least one background image
• Techniques for dividing source images are known and have been mentioned herein
• the computer or other device writing to the display device must be configured to write the foreground image to a first designated area of the display device and to write the background image to a second designated area of the display device
• the foreground image may be written to the top half of the CRT and the background image may be written to the bottom half of the CRT by supplying the pixel data for the foreground image during the first half of each display frame and supplying the pixel data for the background image during the second half of each display frame
• Implementation of such a display scheme is trivial for CRT and other display devices, involving only providing the correct data at the correct time
• the plurality of divided images are formed on a single display device, such as a CRT display, it may be desirable to employ optical expansion during viewing of at least one of the images to recreate the aspect ratio of the original image
• optical expansion techniques it is advantageous to display the image compressed in the direction which is to be expanded, e g , vertically
• Such compression according to the present invention allows optical expansion without resulting in a stretched image in that direction.
• Image compression techniques are well known in the art and have been embodied in software.
• resolution enhancement steps may be performed on image data if the image is to be optically expanded to restore aspect ratio.
• Numerous known pixel and line interpolating methods may be employed for this purpose.
• Computer display systems have improved in their ability to allow the simultaneous display of different forms or kinds of data that has value when perceived in quick succession as the viewer switches attention from one to another image.
• a character-based display system such as the display on a personal computer running the MS-DOS operating system, generally shows the user only one application at a time. Improved resolution of displays and the development of graphical user interfaces allow users to view more than one application at a time. Typically, each application runs in its own portion of the screen, often called a "window.”
• the Apple Macintosh Operating System (“OS)
• OS Microsoft Windows 95
• Some systems support monitors displaying different information.
• the Macintosh OS supports two monitors, allowing the user to drag items from one monitor to another, greatly increasing the available working space on this combined virtual desktop. None of these advances, however, provide the user with the advantages of the disclosed invention.
• the disclosed invention takes advantage of the image presentation and co-alignment techniques elsewhere disclosed herein.
• a relatively simple form of the present invention employs an image source, such as a traditional computer monitor, which includes at least two portions. Each of the portions is displayed in an image plane, using methods described herein.
• the top half of the monitor displays the foreground image
• the bottom half of the monitor displays the background image.
• the background is optically combined with the foreground (e.g. reflected from a conventional mirror to a beamcombiner which optionally co-aligns the images from the foreground and the background).
• the co-aligned foreground and background don't present to the viewer a three-dimensional scene, but instead optionally present data simultaneously which is valuable when perceptible alternately as the viewer shifts attention from one plane to another.
• Each image plane may display one or more windows that contain information or images.
• any or all of the image planes may contain stereoscopic image information.
• the stereoscopic information may be for any technology that directs different images to the right and the left eye, e.g. (1) presenting the images in different colors, while the viewer wears glasses having a different colored filter for each eye, or (2) presenting the images for left and right eye sequentially, while the viewer wears glasses that alternatingly present the image to each eye, or alternatively (3) using lenticular lenses to direct different portions of the image to each eye.
• the foreground image plane contains spreadsheet data, and changes thereto are instantly reflected in a linked chart which is on the background image plane.
• a teleconference participant window (or other source of video such as a television tuner) appears on the background image plane, while pertinent data for the conversation appears in the foreground image plane.
• a programmer writes code on the foreground image plane while watching the application running on the background image plane.
• the designer of a World Wide Web page sees a web page form on the background image plane as html code is being typed onto the foreground image plane.
• a stock analyst works with figures on the foreground image and is alerted when a major indicator changes from green to red on the background image screen.
• a nurse views a patient's chart in the foreground image while the patient's current vital statistics appear on the background image.
• the background image plane there may be action on the background image plane.
• the principal subject of the viewer's attention is on the foreground, it is contemplated that other embodiments would have the user's principal attention on another image plane.
• a user focusses on one plane but remains peripherally aware of changes on the other plane. If the change on the other plane is a gross or attention-getting change (i.e. the color change in the stock analyst example above) the user can decide to shift focus from one plane to the other plane.
• the other plane is still in the user's vision, and the user remains peripherally aware of changes on that plane, more so than if the images are adjacent to one another but in the same plane.
• Fig. 96 shows an example of a foreground image 103- 050 that may be displayed with the present invention.
• a black surround 103-052 (shown in white for purposes of reproduction) contains spreadsheet data 103-054.
• Fig. 97 shows the background image 103-090, which contains a dynamically updated chart 103-092 and the moving image of a videoconference participant 103-094.
• Fig. 98 is a head-on view of a display in accordance with the present invention wherein the foreground image 103-050 and the background image 103-090 are seen at two depths but in co-alignment with the viewer's line of sight.
• the spreadsheet data 103-054 is optionally white, yellow, green or another color which contrasts well with the black surround 103-052.
• the chart 103-092 and the videoconference participant 103-094 preferably are visible through the spreadsheet data 103- 054.
• a viewer who looks at one plane remains peripherally aware of the other plane(s) and able to respond to perceived changes.
• the viewer who focusses on the foreground image still sees the background image.
• the viewer who focusses on the background image still sees the foreground image. Whichever image captures the attention of the viewer, the viewer can still perceive important changes on the other plane.
• Figs. 99 and 100 roughly illustrate what a viewer perceives.
• the foreground image 103-050 is actually at a different distance from a viewer's eyes than the background image 103-090. Therefore only one image plane is in focus at any particular time. This phenomenon is due to the narrow depth of field of the eyes. This is true of monocular viewers as well as binocular viewers.
• Fig. 99 if the eye focusses on the spreadsheet data 103-054, the videoconference participant 103-094 is out of focus and will appear blurred. For a binocular viewer, it will also appear doubled.
• Fig. 100 if the videoconference participant 103-094 is in focus, the spreadsheet data appears blurred and doubled.
• a preferred embodiment of the present invention involves placing a single-image- source adapter (shown in Fig 27) on a standard computer monitor displaying program data
• a user running standard Macintosh OS, Microsoft Windows o ⁇ other equivalent programs and operating systems can experience the benefits of the present invention
• a simulated videoconference or TV broadcast (a window displaying a movie using the AVI file format) was in the lower right portion of the screen It was easy to direct attention to the foreground spreadsheet data or the movie without distraction
• the placement of the elements was similar to their placement m Figs 101 through 104 the Excel spreadsheet was displayed on the top half of the screen, and the Excel chart and the AVI movie window on the bottom portion of the screen
• the user moved the mouse to cause the mouse pointer to move up and down on the screen from window to window so that the mouse pointer moved from one plane to the other, it seemed a natural and comfortable maneuver for one familiar with the use of a computer mouse
• Fig 101 shows a mouse pointer 108-800 on the foreground image 108-050, pointing at the spreadsheet data 108-054
• Fig 102 shows an image source 108-030 displaying the foreground image 103-050 and the background image 108-090
• the user moves the mouse pointer 108-800 down the foreground image 108-050 and onto the top of the background image 108-090
• the mouse pointer 108-800 is easily moved to the videoconference participant 108-094 to activate sound or access a pop-up menu of information associated with that participant It was easy for the user to tell which plane the mouse pointer was on This is because the mouse pointer, like the rest of the image as shown in Figs 99 and 100, is in focus on only one plane or the other It is desirable to implement a pointer which is additionally capable
• Cascading arranges all active windows so that they largely overlap, but with some portion of each window showing Cascading is similar to how a card player "fans" cards so only a portion of each card is showing Tiling divides available desktop space between all non- minimized windows
• One skilled in the art in hght of this specification, is enabled to write software and provide hardware solutions which switch the relative position of planes, allowing the user to control the order/position in which planes appear
• the user is optionally enabled to move individual applications from plane to plane, allowing each plane to be its own customizable desktop Developers will recognize that software may be written to provide the user with the ability to dim or brighten selected planes through software controls as desired
• the plane containing the "active" window is automatically made brighter by software or hardware elements
• the plane containing the "active” window is automatically made to move to the foreground, and other planes “bumped” farther back by software or hardware elements
• Any mouse pointer, plane or image controls are preferably linked to a dedicated keyboard key (I e the start menu key in Windows 95), hot key (I e alt-tab in Microsoft Windows 3 1) or other method commonly used for short-cuts (as in the features accessible through a secondary-mouse-button click in Windows 95), in a menu or dialog box as known in the art
• a pull-down menu can be used or the controls are provided through additional add-in software that is used to manage the passing of applications and their windows from one plane of the image display system to another plane of the image display system
• the multiplane display of the present invention is potentially implemented as a feature of the operating system Currently, many operating systems (MacOS, Windows 95) and application programs (the MS-DOS application Windows 3 1) allow for control over the appearance of the desktop, as well as individual program windows.
• the display of the present invention optionally provides an intermediate construct "plane” management, in which the conventional "desktop” is modified to become a volume in which there are many planar images. The planes are managed using tools as discussed elsewhere in this disclosure.
• Such software manages multiple desktops that are all co-aligned.
• the multiple desktops are managed using metamanagement tools as discussed elsewhere in this application.
• the choice between the "plane” concept, the “desktop” concept, or a combination thereof is one that someone skilled in the art of programming would make once the display of the present invention is understood.
• the software which may be used with the display technology of the present invention may be implemented in semiconductor chips or other dedicated hardware, as is commonly known in that art.
• the multi-plane display of the present invention may take advantage of any of the features taught elsewhere in this disclosure: the use of two or more image sources (as most broadly defined herein) or the presentation of data in more than two planes, the use of Fresnel and other lenses to create a real image of one or more planes, etc.
• a "3-D window" or image section of the display of the present invention as taught herein may be used in conjunction with 2-D planar display areas.
• two monitors as image sources (shown in Fig. 34)
• a first computer's monitor or even a television set is optionally used as one plane and a second computer's monitor used as a second plane.
• the potential sacrifices in aspect ratio and/or brightness of single-image-source embodiments may be avoided, although at potentially greater hardware cost.
• the cost of running a second monitor or computer is economically feasible.
• software and/or hardware may be optionally included using known techniques to perform image compression, such as 2:1 in the vertical, so that the planes can be re- expanded optically to present a full-sized display from a single image source, such as a CRT.
• Output for the present invention may constitute a secret messaging system similar in style to "secret decoder" rings and suitable for children's games.
• a portion of a message appears on one plane, while different portions of the message appear on other planes. If the portions are co-aligned on an image display of the present invention, the information in the message may be perceived; otherwise it remains a mystery.
• the foreground image 112-040 and the background image 112-080 are each a part of a single message. When viewed from the proper angle, i.e. a head-on perspective of the two co-aligned images, the message may be read.
• Fig. 105C shows a head-on perspective view of the foreground image 112-040 and the background image 112-080, showing the "secret" message.
• the information may be split up differently.
• one plane may contain all vertical members of all the characters in the message, while the other plane contains the rest of the character information.
• the output is pixellated, with some parts of the image on one plane and others on another plane. This pixellation is optionally random or purposefully deceiving (e.g. presenting a misleading image or message as part of the encoding process).
• the additive nature of colors in the display plays a role.
• the colors that result from the co-aligning of the foreground and background portions may convey a message to the user. Unless the images are co-aligned properly, the message remains a mystery.
• the message to be communicated is to appear in yellow when the images are properly aligned, that yellow may be perceived by a viewer in a few ways.
• One plane may be transparent while the other is yellow, or both planes may be yellow.
• Another way to generate yellow light is to co-align red light on one plane and green light on another plane.
• the "coded” images may present a random wash of color or a particular image to a viewer who does not use the present invention to co-align the images.
• the "decoded” message in yellow is only perceived through the use of an embodiment of the present invention.
• perspective of a scene may be exaggerated to make the scene appear more three dimensional.
• Objects in the background image of the scene may be shrunk relative to foreground objects according to the present invention to exaggerate depth perception.
• Background image objects may be easily shrunk without loss of resolution according to known methods, which may also include the step of expanding foreground objects, shrinking background objects or performing both steps. Exaggerated reduction and elongation of parts of foreground images will make them appear to fill the space between the foreground and background planes.
• the image display techniques of the present invention utilize at least two overlapping images, it is advantageous to control the brightness of the background and foreground images in order to prevent background images from "bleeding through" images of foreground objects.
• Brightness control techniques are employed in accordance with the present invention to prevent background images from bleeding through to the foreground.
• One method according to the present invention is to generate a shadow of a foreground object at a location in the background image corresponding to the location of the object in the foreground image. This method lowers the light level at that point in the background image to minimize background image bleed through.
• the shadow is preferably somewhat larger (e.g., about twice the size in each direction) than the foreground object, and is preferably tapered, i.e., made darkest in its enter and lighter towards its edges to prevent unnaturally abrupt brightness transitions in the background image. In this manner, parallax artifacts between the foreground and background images are minimized. Alternatively, the brightness of the entire background image may be reduced, and/or the brightness of the foreground image increased for the same end. Another brightness control technique which may be employed according to the present invention to prevent background image bleed through is color balancing.
• the display technology of the present invention includes the use of light valves disposed in a conjugate plane of the foreground image located in the background image path to block background light which would otherwise bleed through foreground objects.
• a light valve device such as a binary LCD array permits selective transmission or blocking of regions of the background image by producing silhouettes of foreground objects to block background light from passing through to the viewer with no parallax error.
• shadow images of foreground objects are generated on the light valve elements to create the shadow image of foreground objects.
• This method according to the present invention uses known techniques to create a black pixel on the light valve plane wherever there is a non-zero (or other threshold) pixel value of the foreground image.
• plane-switching techniques include the steps of gradually decreasing the size of the object as it recedes in the Z direction and, at a selected time, moving the image of the object from the foreground image to the background image.
• objects in the background image which are moving in the Z direction towards the viewer may be gradually increased in size and at a selected point are transferred from the background image to the foreground image
• This effect may be implemented on a frame by frame basis using known image processing techniques
• the foreground and background images are temporally synchronized This method may be implemented using known techniques and is especially useful where two independent image sources, such as CRT displays or projectors, are employed
• one or more images are reversed as a consequence of having been reflected from an odd number of mirrors
• this image reversal may be corrected by generating a reversed image so that subsequent reversal of that image by reflection from an odd number of mirrors will result in an unreversed image
• Known techniques such as CRT scanning from right to left, or display pipelining lines of pixel data from right to left, may be employed for this purpose
• the present invention may be embodied in other specific forms without departing from its spirit or essential characteristics
• the described embodiments are to be considered in all respects as illustrative and not restrictive All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope The inventor intends that all patentable subject matter disclosed herein eventually be the subject of patent claims, regardless of whether presented upon the initial filing of the application represented by this document or in a subsequent filing

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Physics & Mathematics (AREA)
• Computer Hardware Design (AREA)
• General Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

Priority Applications (1)

Applications Claiming Priority (6)

Publications (2)

Family

ID=27362150

Family Applications (1)

Country Status (3)

Cited By (12)

Family Cites Families (5)

• 1997
  • 1997-08-15 ID IDP972860A patent/ID19315A/id unknown
  • 1997-08-15 AU AU42317/97A patent/AU4231797A/en not_active Abandoned
  • 1997-08-15 WO PCT/US1997/014502 patent/WO1998010584A2/fr active Application Filing

Also Published As

Similar Documents

Legal Events