WO2018109991A1 - Dispositif d'affichage, miroir électronique, procédé de commande de dispositif d'affichage, programme et support d'informations - Google Patents
Dispositif d'affichage, miroir électronique, procédé de commande de dispositif d'affichage, programme et support d'informations Download PDFInfo
- Publication number
- WO2018109991A1 WO2018109991A1 PCT/JP2017/031455 JP2017031455W WO2018109991A1 WO 2018109991 A1 WO2018109991 A1 WO 2018109991A1 JP 2017031455 W JP2017031455 W JP 2017031455W WO 2018109991 A1 WO2018109991 A1 WO 2018109991A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video
- depth
- occupant
- display screen
- display device
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 30
- 230000000007 visual effect Effects 0.000 claims abstract description 42
- 238000009966 trimming Methods 0.000 claims description 30
- 238000001514 detection method Methods 0.000 claims description 13
- 239000004973 liquid crystal related substance Substances 0.000 claims description 13
- 230000033001 locomotion Effects 0.000 claims description 6
- 239000012788 optical film Substances 0.000 claims description 5
- 230000000694 effects Effects 0.000 abstract description 4
- 230000004888 barrier function Effects 0.000 description 27
- 238000003384 imaging method Methods 0.000 description 26
- 230000008859 change Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 239000010408 film Substances 0.000 description 8
- 230000004048 modification Effects 0.000 description 8
- 238000012986 modification Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 238000009792 diffusion process Methods 0.000 description 4
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000006073 displacement reaction Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000036760 body temperature Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035900 sweating Effects 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/31—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles providing stereoscopic vision
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
- B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
- B60R1/26—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view to the rear of the vehicle
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Definitions
- the present invention relates to a display device for an electronic mirror that displays an image taken by an in-vehicle camera, and an electronic mirror using the display device.
- 3D images have a natural depth. Therefore, it is easy for the driver to intuitively understand the position and speed of the object (viewing target object) reflected on the display screen.
- the viewpoint of the driver is farther in the 3D image displayed on the far side than the display screen when viewed from the driver as compared with the 2D image. Therefore, it is easy for the driver to recognize his / her visual object displayed on the display screen by moving his / her line of sight from the front of the vehicle to the display screen.
- a conventional electronic mirror needs to be equipped with a twin-lens camera in order to display 3D video, the cost is increased.
- the conventional electronic mirror combines two captured images captured by the twin-lens camera by the parallax mapping process, it takes time to display the 3D image on the display screen of the electronic mirror. Since the driver drives the vehicle while watching the 3D video displayed on the display screen, it is a problem that the timing for displaying the 3D video on the display screen is delayed.
- An object of one embodiment of the present invention is to quickly display an image having a sense of depth or popping out.
- a display device is disposed in front of an occupant including a driver of a vehicle, and a visual target included in a photographed image around the photographed vehicle is farther from the occupant than a display screen.
- a setting unit, and a generation unit that generates a first output video including pixel data for left eye and pixel data for right eye according to the depth set by the depth setting unit from the captured video. I have.
- a display device is arranged in front of an occupant including a driver of a vehicle, and the sighted object included in a captured image around the vehicle is displayed on the occupant rather than the display screen.
- a depth of the display screen that allows the object to be recognized to be recognized on the back side or the near side.
- the data of the position shifted by the pixel shift amount corresponding to the depth set by the depth setting unit and the depth set by the depth setting unit in the captured image is the pixel data for the left eye and the pixel data for the right eye
- generating units that generate alternately arranged first output images, and the display screen is inclined in a direction away from the occupant.
- a display device is arranged in front of an occupant including a driver of a vehicle, and the sighted object included in a captured image around the vehicle is displayed on the occupant rather than the display screen.
- a depth of the display screen that allows the object to be recognized to be recognized on the back side or the near side.
- the data of the position shifted by the pixel shift amount corresponding to the depth set by the depth setting unit and the depth set by the depth setting unit in the captured image is the pixel data for the left eye and the pixel data for the right eye
- a generation unit that generates first output video arranged alternately, and the display screen uses a narrow viewing angle liquid crystal that shields light in a direction deviated by a predetermined angle or more from the front of the display screen.
- a liquid crystal display .
- a display device is arranged in front of an occupant including a driver of a vehicle, and the sighted object included in a captured image around the vehicle is displayed on the occupant rather than the display screen.
- a depth of the display screen that allows the object to be recognized to be recognized on the back side or the near side.
- the data of the position shifted by the pixel shift amount corresponding to the depth set by the depth setting unit and the depth set by the depth setting unit in the captured image is the pixel data for the left eye and the pixel data for the right eye
- a generation unit that generates first alternately output video images, and is not visible when the display screen is viewed from the front of the display screen, and when viewed from a direction deviated by a predetermined angle or more from the front.
- the visible image It is displayed on the serial display screen.
- a display device is arranged in front of an occupant including a driver of a vehicle, and the sighted object included in a captured image around the vehicle is displayed on the occupant rather than the display screen.
- a depth of the display screen that allows the object to be recognized to be recognized on the back side or the near side.
- the data of the position shifted by the pixel shift amount corresponding to the depth set by the depth setting unit and the depth set by the depth setting unit in the captured image is the pixel data for the left eye and the pixel data for the right eye
- a generation unit that generates first output video arranged alternately, and an optical film that blocks light in a direction shifted by a predetermined angle or more from the front of the display screen is pasted on the display screen.
- a display device is a display device that is disposed in front of an occupant including a driver of a vehicle and displays a visual target object included in a photographed image around the photographed vehicle.
- a detection unit that detects a position of the occupant's face with respect to the display screen; and a position at which the trimmed image is cut out in the captured video is determined according to the position of the occupant's face with respect to the display screen detected by the detection unit.
- a trimming position determination unit; and a generation unit that generates an output video from the trimmed image cut out from the captured video in accordance with the position determined by the trimming position determination unit.
- the display device control method is arranged in front of an occupant including a driver of a vehicle, and a visual object included in a captured image of the surrounding of the vehicle is displayed on a display screen.
- a control method for a display device that is displayed so as to be recognized on the far side far from the occupant or the near side close to the occupant, from the display screen for recognizing the visible object on the far side or the near side.
- the display device control method is arranged in front of an occupant including a driver of a vehicle, and a visual object included in a captured image of the surrounding of the vehicle is displayed on a display screen.
- a control method for a display device that displays so as to be recognized on the far side away from the occupant or on the near side close to the occupant, the display screen being inclined in a direction away from the occupant,
- the generation step of generating the first output video alternately arranged as the pixel data for the left eye and the pixel data for the right eye includes data at positions shifted by the amount.
- the display device control method is a display device that is disposed in front of an occupant including a driver of a vehicle and displays a visual target object included in a captured image of the surroundings of the vehicle. And detecting the position of the occupant's face relative to the display screen, and trimming the captured video according to the position of the occupant's face relative to the display screen detected in the detection step.
- a trimming position determining step for determining a position to cut out the image; and a generating step for generating an output video from the trimmed image cut out from the captured video in accordance with the position determined in the trimming position determining step.
- FIG. 1 is a block diagram illustrating a configuration of an electronic mirror according to Embodiment 1.
- FIG. It is a figure which shows schematically arrangement
- FIG. It is a figure which shows a part of vehicle inner side provided with the electronic mirror which concerns on Embodiment 1, and is a figure which shows arrangement
- 1 is a diagram illustrating an arrangement of a video display device according to Embodiment 1.
- FIG. (A)-(c) is a figure which shows the depth of the output image
- (A) shows a photographed video
- (b) shows a right-eye video included in an output video trimmed from the photographed video
- (c) shows a left-eye video contained in an output video trimmed from the photographed video.
- (D) shows the output image produced
- 4 is a flowchart showing a flow of video processing executed by the video control device for the electronic mirror according to the first embodiment.
- FIG. 6 is a table showing a correspondence relationship between the depth of an output video and a pixel shift amount in the electronic mirror according to the first and second embodiments. It is a figure which shows arrangement
- FIG. It is a block diagram which shows the structure of the electronic mirror which concerns on Embodiment 2.
- FIG. 10 is a flowchart illustrating a flow of video processing executed by the video control device for an electronic mirror according to the second embodiment.
- (A)-(c) is a figure which shows the range of the output image trimmed (cut out) from each picked-up image, (a) is the range of the reference output image, (b) is a driver
- FIG. (A) (b) is a figure which shows the Example of the viewing angle control in the electronic mirror which concerns on Embodiment 5, (a) shows the Example of the viewing angle control by a directional diffusion film, (b) An example of viewing angle control by a luminance light-shielding film is shown.
- Embodiment 1 Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS.
- FIG. 1 is a block diagram showing the configuration of the electronic mirror 1.
- the electronic mirror 1 includes an imaging unit 11 (imaging unit), a video control device 10, a parallax barrier-compatible video display device 25 (display device) (hereinafter referred to as a video display device 25), and a parallax barrier device.
- an imaging unit 11 imaging unit
- a video control device 10 parallax barrier-compatible video display device 25
- a parallax barrier device display device
- a vehicle information acquisition device 40 an eye tracking camera 50
- driver information acquisition device 52 a driver information acquisition device
- a parallax barrier control device 55 The video control device 10 and the parallax barrier-compatible video display device 25 according to the present embodiment constitute a display device.
- FIG. 2 shows a vehicle to which the electronic mirror 1 according to this embodiment is attached.
- the imaging unit 11 is attached to the rear part of the vehicle so as to face the direction opposite to the traveling direction of the vehicle.
- the imaging unit 11 may be attached so as to face the traveling direction of the vehicle.
- the imaging unit 11 is a monocular camera.
- the imaging unit 11 includes a plurality of monocular cameras, and includes at least three monocular cameras that respectively capture the front rear, left rear, and right rear of the vehicle.
- the imaging unit 11 may further include a monocular camera for a drive recorder that captures the front of the vehicle.
- a monocular camera directed to the rear right side is arranged on the right door of the vehicle.
- This monocular camera captures the right rear side of the vehicle. While the electronic mirror 1 is activated, that is, while the vehicle is running, the imaging unit 11 captures the periphery of the vehicle (in FIG. 2, the rear of the vehicle) and generates captured video data. The captured image includes a visual target that exists around the vehicle. In some cases, the captured image includes a visual target in the vehicle. For example, when the electronic mirror 1 is used as a substitute for a room mirror, the imaging unit 11 includes a monocular camera that captures the interior of the vehicle. The imaging unit 11 outputs the generated captured video to the video control device 10.
- the video control device 10 acquires a captured video from the imaging unit 11 and generates an output video to be output to the video display device 25 from the acquired captured video.
- the output video includes a video corresponding to the right eye of the driver (hereinafter referred to as a video for the right eye) and a video corresponding to the left eye of the driver (hereinafter referred to as a video for the left eye).
- the video control apparatus 10 includes a depth determination unit 12 (depth setting unit) and an output video generation unit 13 (generation unit). Each part of the video control apparatus 10 will be described later.
- the video display device 25 displays the output video generated by the video control device 10 on the display screens 20 and 20 ′.
- the video display device 25 may be a liquid crystal display device, for example.
- the video display device 25 displays on the display screen 20 an output video based on the captured video taken by the imaging unit 11.
- the video display device 25 displays an output video based on a digital video including information such as speed, engine speed, and used gear on the display screen 20 ′.
- FIG. 3 shows a part of the inside of the vehicle shown in FIG. 2, particularly the instrument panel of the driver's seat (cockpit).
- the display screens 20 and 20 ′ of the video display device 25 are arranged in the vicinity of the driver's seat inside the vehicle.
- the display screen 20 of the video display device 25 may be incorporated in a dashboard. Alternatively, it may be arranged in the dashboard and / or on the ceiling of the vehicle (position of the room mirror).
- the video display device 25 displays the output video acquired from the video control device 10 on the display screens 20 and 20 ′ arranged at the positions illustrated in FIG. 3.
- the parallax barrier device 30 is disposed in front of each display screen 20, 20 ′ of the video display device 25.
- the parallax barrier device 30 controls the viewing angle of the output video displayed on the display screens 20 and 20 ′ of the video display device 25 by being controlled by the parallax barrier control device 55.
- the video display device 25 is another image directional liquid crystal display device capable of controlling the viewing angle of the video
- the viewing angle of the output video is controlled by controlling the directivity of the backlight of the video display device 25. May be.
- the electronic mirror 1 may not include the parallax barrier device 30 and the parallax barrier control device 55.
- the vehicle information acquisition device 40 acquires various information indicating the state of the vehicle.
- the information acquired by the vehicle information acquisition device 40 includes, for example, a seat offset amount (corresponding to the seat position), a vehicle speed, and gear information.
- the eye tracking camera 50 tracks the driver's face or eye position.
- the eye tracking camera outputs the detected driver face or eye position information to the driver information acquisition device 52 and the parallax barrier control device 55.
- the driver information acquisition device 52 acquires various information indicating the states of the driver and other passengers.
- the information acquired by the driver information acquisition device 52 includes, for example, information on the driver's face or eye position.
- the driver information acquisition device 52 acquires information on the driver's face or eye position detected by the eye tracking camera 50.
- the driver information acquisition device 52 may include, for example, a biosensor attached to a vehicle seat. In this configuration, the driver information acquisition device 52 acquires information such as the body temperature, sweating, and movement of the occupant seated on the seat from the biometric sensor.
- the parallax barrier control device 55 controls the parallax barrier device 30 based on information on the driver's face or eye position detected by the eye tracking camera 50.
- the video control apparatus 10 includes a depth determination unit 12 and an output video generation unit 13.
- the depth determination unit 12 determines the depth of the output video based on at least one of information indicating the vehicle state acquired by the vehicle information acquisition device 40 and information indicating the driver state acquired by the driver information acquisition device 52. To decide.
- the depth of the output video is a parameter representing the depth of the position of the visual target object in the output video when viewed from the driver (that is, the distance from the display screen 20, 20 'to the visual target object). The depth can be positive or negative or zero.
- the depth determination unit 12 determines the pixel shift amount ⁇ pix between the right-eye pixel data and the left-eye pixel data based on the determined depth of the output video. The depth and the pixel shift amount ⁇ pix will be described later.
- the output video generation unit 13 Based on the pixel shift amount ⁇ pix determined by the depth determination unit 12, the output video generation unit 13 converts pixel data at a position shifted from each other by the pixel shift amount ⁇ pix from one captured video, pixel data for the left eye, and right As the eye pixel data, an output video is generated by alternately arranging the pixel data.
- the output video generated in this way has a sense of depth (when the depth is positive) or a pop-out feeling (when the depth is negative) like a 3D video when viewed through the parallax barrier device 30. Further, the processing time for generating the output video is shortened compared to the processing time for generating the 3D video because the parallax mapping processing is not performed.
- the driver can capture it as a plane image of the distance moved by the depth, and by capturing the image instantly by focusing on that plane, A visual target can be found.
- the viewpoint movement with respect to the front visual field can be reduced depending on the depth, the visual recognition object in the output video can be quickly recognized. Therefore, the driver can make a judgment and act more quickly based on information included in the output video than when viewing a normal 2D video.
- the output video generation unit 13 outputs the generated output video to the video display device 25.
- the output video generation unit 13 may adjust the angle of view or the trimming range of the output video according to which video display device 25 displays the output video.
- the output video generation unit 13 may display an image on the video display device 25 used as a substitute for a room mirror rather than an output video output to another video display device 25 used as a substitute for a door mirror (side mirror).
- An output video having a large corner may be output. This is because the rearview mirror has a role of transmitting a wide range of information behind the vehicle to the driver.
- the output video generation unit 13 is a parallax captured by the twin-lens camera based on the depth (the pop-out amount p and the depth amount d) determined by the depth determination unit 12.
- a 3D image may be generated from two captured images with a general 3D image generation method.
- FIG. 4 shows an example of the arrangement of the video display device 25 (see FIG. 3) arranged in the dashboard.
- the video display device 25 is arranged instead of a mechanical meter such as a speedometer.
- the video display device 25 displays the output video output from the video control device 10 on the display screen 20 ′. Since the entire image display device 25 is smaller than the mechanical meter, the space in the dashboard can be expanded as compared with the conventional case.
- the display screen 20 ′ of the video display device 25 faces the driver. Therefore, when the depth of the output video changes, the viewpoint of the driver who views the output video moves in the traveling direction of the vehicle or in the opposite direction.
- FIGS. 5A to 5C show the display screen 20 of the video display device 25 displaying the output video.
- the viewing angle of the output video is controlled by the parallax barrier device 30 and the parallax barrier control device 55.
- the right eye of the driver sees only the right-eye video composed of the right-eye pixel data included in the output video.
- the driver's left eye sees only the left-eye video composed of pixel data for the right eye included in the output video.
- the driver recognizes as if the visual target is present at the position where the line of sight of the right eye and the line of sight of the left eye shown in FIGS.
- (A) of FIG. 5 shows an output image when the depth is 0, that is, the pixel shift amount ⁇ pix is 0.
- the visual target is on the display screen 20 of the video display device 25 as viewed from the driver. That is, the driver views the output video in the same manner as when the 2D video is displayed on the video display device 25.
- the parallax barrier control device 55 stops or disables the parallax barrier device 30.
- FIG. 5 shows an output image when the depth is negative, that is, the pixel shift amount ⁇ pix is negative, and the visually recognized object appears to jump out of the display screen 20.
- the depth of the output video is represented by the pop-out amount p.
- the depth determination unit 12 may make the depth of the output video smaller than zero.
- FIG. 5 shows an output image when the depth is positive, that is, the pixel shift amount ⁇ pix is positive.
- the depth of the output video is represented by a depth amount d.
- the visual target is located behind the display screen 20 of the video display device 25 as viewed from the driver. In this case, the viewpoint of the driver is farther than the display screen 20 of the video display device 25.
- the depth determination unit 12 may change the depth of the output video based on the vehicle state information acquired from the vehicle information acquisition device 40. For example, when the vehicle is moving at high speed, the driver's viewpoint is usually far from the vehicle. Therefore, the depth determination unit 12 may increase the depth of the output image as the speed of the vehicle increases or as the used gear increases. Further, when the R gear is used, the depth determination unit 12 may make the output depth shallower, that is, reduce the pixel shift amount ⁇ pix than when other gears are used. This makes it easier for the driver to visually recognize the vicinity of the vehicle. Further, the depth determination unit 12 may increase the depth of the output video as the position of the sheet is closer to the display screen 20 of the video display device 25. Thereby, irrespective of the position of the seat, the distance from the driver to the visual recognition object in the output video can be appropriately maintained.
- the depth determination unit 12 may change the depth of the output video based on the driver information acquired from the driver information acquisition device 52. For example, when the driver information acquisition device 52 fails in eye tracking, the depth determination unit 12 may set the depth of the output video to a default value, that is, zero (fail safe). In addition, the driver may be able to manually change the depth of the output video to zero. Thereby, it is possible to prevent the output image from being seen twice by the driver and other occupants.
- the depth of the output video determined by the depth determination unit 12 is constant in the vertical direction (vertical direction) and the horizontal direction (horizontal direction) of the output video.
- the method by which the depth determination unit 12 determines the depth of the output video is not limited to the method described in this embodiment.
- the depth determination unit 12 may change the depth of the output video in the vertical direction (vertical direction) or the horizontal direction (horizontal direction) of the output video (see Embodiment 2).
- the parallax barrier control device 55 stops, that is, invalidates the operation of the parallax barrier device 30.
- the depth determination unit 12 may change the depth of the output video according to the surrounding environment detected by a sensor or the like.
- the depth determination unit 12 may determine the depth of the output video according to the brightness of the environment (for example, backlight or twilight) or the time zone (for example, daytime or night).
- the depth determination unit 12 may determine the depth of the output video according to information included in the output video. For example, the depth determination unit 12 may analyze which of the sky, road, and other vehicles is included in the output video, and may determine the depth of the output video according to the analysis result. In particular, when the output video includes many roads or other vehicles, the depth determination unit 12 may determine the depth of the output video according to the distance from the vehicle to the road or other vehicles.
- the depth determination unit 12 may determine the depth of the output video according to the arrangement of the display screens 20 and 20 ′ of the video display device 25. For example, when the video display device 25 arranged near the driver's face or a part of the face (eyes, nose, etc.) displays the output video, the depth determination unit 12 may increase the depth of the output video. Good.
- the depth determination unit 12 may determine the depth of the output video according to the position of the driver's face or a part of the face (eyes, nose, etc.). For example, when the driver's face moves back and forth, left and right, or up and down (for example, head swing and stretch), the depth determination unit 12 determines the depth of the output video according to the position of the driver after the movement. May be.
- the depth determination unit 12 may determine the depth of the output video according to the driver's action. For example, when the driver performs an operation for moving the vehicle backward (for example, putting an arm on the passenger seat, opening a window or door of the driver seat), the depth determining unit 12 determines the type of the driver's operation. The depth of the output video may be determined.
- Output video generation method A method of generating the output video by the output video generation unit 13 will be described with reference to FIGS. 6A to 6D, FIG. 7, and FIG.
- FIG. 6 shows the imaging
- the captured image shown in FIG. 6A includes a visual recognition object.
- the captured video shown in FIG. 6A has a pixel size of (1920 + ⁇ ) ⁇ 1080, for example.
- ⁇ is equal to the pixel shift amount ⁇ pix.
- FIG. 6B shows the range of the right-eye video included in the output video trimming range.
- FIG. 6C shows the range of the left-eye video included in the output video trimming range.
- the range of the left-eye video is shifted to the left by the pixel shift amount ⁇ pix determined by the depth determination unit 12 from the range of the right-eye video.
- the output video generation unit 13 is (1920 + ⁇ pix) ⁇ 1080 from the left end of the left eye video range shown in FIG. 6C to the right end of the right eye video range shown in FIG. Trim the pixel data of the area. Then, the output video generation unit 13 extracts pixel data at positions shifted by the pixel shift amount ⁇ pix from the trimmed pixel data, and alternately arranges them as pixel data for the left eye and pixel data for the right eye. , Generate output video.
- FIG. 6D shows an output video in which pixel data are alternately arranged.
- the position of the visual target object included in the right-eye image and the position of the same visual object included in the left-eye image are shifted from each other by ⁇ pix. That is, the size of the output video is 1920 ⁇ 1080, similar to the range of the right-eye video and the range of the left-eye video.
- FIG. 7 is a diagram showing numbers assigned to pixels of a captured video acquired by the output video generation unit 13.
- FIG. 8 is a diagram showing an output video generated from the captured video shown in FIG. 7.
- the output video pixel is associated with the corresponding right-eye video pixel number and the corresponding left-eye video pixel. It is the figure which numbered and showed.
- the pixels corresponding to the right-eye image are numbered sequentially from the first in the horizontal direction, and the pixels corresponding to the left-eye image are sequentially numbered from the 51st in the horizontal direction. Waving. That is, in the example shown in FIG. 7, the pixel shift amount ⁇ pix between the right-eye video and the left-eye video is 50 pixels.
- FIG. 7 illustrates only the pixels in the top row of the right-eye video and the left-eye video, the pixels in the other rows of the captured video are the same as the pixels in the top row. By rule, a number is given.
- the output video generation unit 13 includes the odd-numbered pixels (1, 3,%) Of the right-eye video and the even-numbered pixels (2, 4,%) Of the left-eye video. .) Are alternately arranged in the horizontal direction to generate an output video.
- FIG. 8 illustrates only the pixels in the top row of the output video, the pixels in the other rows of the output video are also arranged in the same rule as the pixels in the top row. That is, in this embodiment, the pixel shift amount ⁇ pix in the trimming range does not change in the vertical direction and the horizontal direction of the output video.
- the viewing angle of the output video displayed by the video display device 25 is controlled by the parallax barrier device 30.
- the right eye of the driver sees the right-eye video (video composed of even-numbered pixel data) included in the output video.
- the driver's left eye sees a left-eye image (image composed of odd-numbered pixel data) included in the output image.
- the video for the right eye and the video for the left eye are synthesized in the driver's brain. Therefore, the driver feels as if he is watching only one output image. In addition, since the size of one pixel is very small, the driver hardly recognizes the space between pixels.
- FIG. 9 is a flowchart showing the operation of the video control apparatus 10.
- the video control device 10 acquires a captured video captured by the imaging unit 11 (S2).
- the depth determination unit 12 acquires information indicating the state of the vehicle from the vehicle information acquisition device 40, and acquires information indicating the state of the driver from the driver information acquisition device 52 (S4).
- the depth determination unit 12 determines the depth of the output video based on at least one of information indicating the state of the vehicle and information indicating the state of the driver. Further, a pixel shift amount ⁇ pix corresponding to the determined depth of the output video is determined with reference to a table (see FIG. 10) described later (S6, setting step). The depth determination unit 12 notifies the output video generation unit 13 of information on the determined pixel shift amount ⁇ pix.
- the output video generation unit 13 generates an output video by the above-described method based on the information of the pixel shift amount ⁇ pix determined by the depth determination unit 12 (S8, generation step).
- the output video generation unit 13 outputs the generated output video to the video display device 25.
- the video display device 25 displays the output video received from the output video generation unit 13 on the display screen 20 (S10). Thus, the operation of the video control apparatus 10 is finished.
- FIG. 10 is a table showing a correspondence relationship between the depth (the pop-out amount p and the depth amount d) set in the output video and the pixel shift amount ⁇ pix.
- ⁇ x (unit: mm) is a shift width corresponding to different pixel shift amounts ⁇ pix.
- the pop-out amount p (see FIG. 5B) indicates how much the object to be visually recognized in the output video protrudes forward from the display screen 20, that is, in the direction toward the driver. Represents what looks like.
- the depth amount d (see FIG. 5C) indicates how much the object to be visually recognized in the output video is offset from the display screen 20 in the back direction, that is, the driver's line-of-sight direction. Represents what it looks like.
- the display screen of the video display device may not face the driver.
- the driver sees the display screen of the video display device at an angle, it may be difficult to accurately grasp the sense of depth of the output video.
- the depth of the output video is changed according to the tilt angle of the display screen of the video display device. This makes it easy to accurately grasp the sense of depth of the output video.
- FIG. 11 shows an arrangement of the display screen 20 ′ of the video display device 25 according to the present embodiment.
- the display screen 20 ′ of the video display device 25 according to the present embodiment has an ideal surface facing the driver. It is inclined with respect to it.
- the angle formed between the display screen 20 ′ of the video display device 25 and the ideal plane is ⁇ .
- the upper end of the display screen 20 ′ comes closest to the front and tilts away from the driver as it approaches the lower end of the display screen 20 ′, but the display screen 20 ′ tilts in the opposite direction. It may be. That is, the upper end of the display screen 20 'may be inclined farther from the driver and closer to the driver as it approaches the lower end of the display screen 20'.
- a space (a triangle indicated by a broken line in FIG. 11) is generated between the dashboard and the display screen 20 ′ of the video display device 25.
- This space can be used for arranging electronic devices, HUD (Head-Up-Display), and the like, similarly to the space in the dashboard.
- HUD Head-Up-Display
- the length of the hood that shields sunlight is made shorter than before. can do.
- the depth determination unit 12 of the video control apparatus 10 refers to the table shown in FIG. 10, and shifts the pixel shift amount ⁇ pix ((d in FIG. 6) in the vertical direction (the direction indicated by the arrow of the height h). )) Is gradually changed. Specifically, the depth determination unit 12 determines the pixel shift amount ⁇ pix corresponding to the depth d determined according to the position a of the height h by referring to the table.
- the ideal depth d corresponding to the position a is the distance from the display screen 20 ′ to the ideal plane where the driver wants to recognize the visual target.
- L is the length from the lower end of the display screen 20 ′ of the video display device 25 to the position a measured.
- the pixel shift amount ⁇ pix is determined according to the ideal depth d and position a. Therefore, the visual recognition object in the output video can be seen on the ideal surface for the driver.
- the electronic mirror changes the field angle range of the captured video displayed as the output video according to the position of the driver's face or eyes.
- FIG. 12 is a block diagram showing a configuration of the electronic mirror 2 according to the present embodiment. 12, in addition to the configuration of the video control apparatus 10 described in the first embodiment, the video control apparatus 210 of the electronic mirror 2 according to the present embodiment includes an angle-of-view range determination unit 14 (trimming position determination unit). ). The video control device 210 and the parallax barrier-compatible video display device 25 according to the present embodiment constitute a display device.
- the angle-of-view range determination unit 14 of the electronic mirror 2 acquires information on the driver's face or eye position from the driver information acquisition device 52. Then, the view angle range determination unit 14 determines the view angle range of the output video according to the position of the driver's face or eyes. More specifically, the angle-of-view range determination unit 14 determines a range of pixel data (trimming image range) to be extracted in order to generate an output video from a captured video.
- pixel data trimming image range
- the output video generation unit 13 generates an output video by trimming a part of the captured video according to the angle of view range determined by the angle of view range determination unit 14 ((( a) to (d)).
- FIG. 13 is a flowchart showing the operation of the video control apparatus 210.
- the video control device 210 acquires a captured video captured by the imaging unit 11 (S2).
- the angle-of-view range determination unit 14 acquires information indicating the position of the driver's face or eyes detected by the driver information acquisition device 52 (S32, detection step). Subsequently, the angle-of-view range determination unit 14 determines the trimming range of the output video based on the position of the driver's face or eyes (S34, trimming position determination step). The angle-of-view range determination unit 14 outputs information on the determined trimming range to the output video generation unit 13. When the driver information acquisition device 52 fails in the eye tracking process, the view angle range determination unit 14 may return the view angle of the output video to a preset default value (fail safe).
- the depth determination unit 12 acquires information indicating the state of the vehicle and information indicating the state of the driver (S4). The specific example of the information acquired by the depth determination unit 12 has been described in the first embodiment. Next, the depth determination unit 12 determines the pixel shift amount ⁇ pix as described in the first embodiment (S6).
- the output video generation unit 13 generates an output video based on the trimming range information determined by the angle-of-view range determination unit 14 and the pixel shift amount ⁇ pix determined by the depth determination unit 12. (S8 ').
- the output video generation unit 13 outputs the generated output video to the video display device 25.
- the video display device 25 displays the output video received from the output video generation unit 13 on the display screens 20 and 20 '(see FIG. 3) arranged in the vicinity of the driver's seat (S10).
- the operation of the video control device 210 is completed.
- FIGS. (A) to (c) of FIG. 14 are diagrams showing the field angle range of the output video i3 according to the position of the driver's face or eyes.
- (A) of FIG. 14 shows the field angle range of the output image i3 when the driver's face or eyes are at a predetermined reference position.
- the reference position may be set, for example, to the position of the driver's face or eyes when the driver is seated in an appropriate posture on the vehicle seat.
- FIG. 14 shows the field angle range of the output video i3 when the driver's face or eyes move leftward from the reference position shown in (a) in FIG. In this case, the field angle range of the output video i3 in the captured video moves to the right from the position shown in FIG.
- (C) in FIG. 14 shows the field angle range of the output video i3 when the driver's face or eyes move upward from the reference position shown in (a) in FIG. In this case, the field angle range of the output video i3 in the captured video moves downward from the position shown in FIG.
- the output video when the driver's face or eyes move, the field angle range (trimming position) of the output video displayed by the video display device 25 changes. Therefore, the driver can naturally change the viewing area by moving his / her face or eyes as in the case of looking at the mirror. Furthermore, according to the configuration of the present embodiment, the angle of view of the output video can be changed according to the direction that the driver wants to see without changing the shooting direction of the imaging unit 11, that is, the monocular camera. In the present embodiment, when displaying an output video obtained by shifting pixels from a video captured by the imaging unit 11, that is, a monocular camera, the angle of view range of the output video is changed according to the position of the driver's face or eyes.
- the output video may be a 2D video or a 3D video described in the fourth embodiment later.
- the type of video displayed by the video display device is switched according to at least one of the state of the vehicle and the state of the driver.
- FIG. 15 is a block diagram showing a configuration of the electronic mirror 3 according to the present embodiment.
- the video control device 310 of the electronic mirror 3 further includes a display switching unit 15 as compared with the configuration of the video control device 10 of the electronic mirror 1 according to the first embodiment.
- the electronic mirror 3 further includes a 3D video generation device that generates a normal 3D video.
- the video control apparatus 310 may further include the angle-of-view range determination unit 14 described in the second embodiment.
- the video control device 310 and the parallax barrier-compatible video display device 25 according to the present embodiment constitute a display device.
- the output video generation unit 13 generates an output video by the method described in the first embodiment.
- the output video generation unit 13 outputs the generated output video to the display switching unit 15.
- the display switching unit 15 acquires information indicating the state of the vehicle from the vehicle information acquisition device 40. In addition, the display switching unit 15 acquires information indicating the state of the driver from the driver information acquisition device 52. Then, the display switching unit 15 outputs an image to be output to the image display device 25 according to at least one of the vehicle state and the driver state as an output image (first output image) and a 2D image (second output image). ) And 3D video (third output video).
- the display switching unit 15 also acquires 2D video data.
- the 2D video data may be, for example, video content data recorded on a recording device (not shown).
- the 2D video may be generated from a captured video generated by the imaging unit 11. In this case, the depth is not set in the 2D video like the output video.
- the display switching unit 15 outputs to the video display device 25 is not particularly limited. If a specific example is given, the display switching part 15 may switch the image
- the display switching unit 15 outputs the output video generated by the output video generation unit 13 to the video display device 25.
- the video display device 25 can quickly display an image having a sense of depth or a feeling of popping out.
- the display switching unit 15 causes the video display device 25 to match the captured video (2D video) captured by the imaging unit 11 with the output format of the video display device 25. Output to.
- the display switching unit 15 outputs 2D video other than captured video, such as a television program, a navigation screen, and content, to the video display device 25.
- the parallax barrier control device 55 stops the parallax barrier device 30 of the electronic mirror 3.
- the display switching unit 15 outputs the 3D video generated by the 3D video generation device to the video display device 25.
- the field angle range of the output video is dynamically changed according to the position of the driver's face so that the driver can always see a normal output video.
- the output image seen by the person (passenger) seated in the passenger seat of the vehicle changes between normal state, reverse view, and double image. Therefore, the passenger may feel such a change in the output video uncomfortable.
- the viewing angle of the output video is controlled so that the passenger cannot see the output video. Passengers may not be able to see any video, or any video other than the output video.
- FIG. 16 is a figure which shows one Example of viewing angle control.
- the video display device 25 includes a directional diffusion film that is a kind of optical film.
- the graph shown in FIG. 16A shows the diffusion viewing angle characteristic of the output video in this embodiment.
- the output video is hardly diffused, but as the viewing angle increases, the output video is strongly diffused by the directional diffusion film. Accordingly, a normal output image can be seen by the driver D, while a double image of the right hand output image and the left hand output image can always be seen by the person P sitting in the passenger seat. However, since the double image seen by the person P has no luminance flicker, the discomfort of the person P is reduced.
- FIG. 16B shows the other Example of viewing angle control.
- the video display device 25 includes a viewing angle control film that is a kind of optical film.
- the graph shown in FIG. 16B shows the luminance viewing angle characteristics of the output video in this embodiment.
- the output image is more strongly shielded by the viewing angle control film as the viewing angle ⁇ increases. Accordingly, the driver D can normally see the output video, while the person P sitting in the passenger seat does not see the output video and sees a black screen. Therefore, at the viewing angle of the person P, even if the output video changes, the person P hardly senses such a change in the output video.
- the luminance viewing angle control film may block light at both the positive and negative viewing angles ⁇ , or may block output video that enters the eyes of a person seated in the passenger seat.
- the output image may be shielded by only one of the positive and negative viewing angles ⁇ .
- the video display device 25 may display a so-called bale view.
- a veil view image that is not visible when viewed from the front of the display screen 20 and is visible when viewed from a direction deviated by a predetermined angle or more from the front is displayed on the display screen 20. Cannot see the output video. Therefore, the person seated in the passenger seat does not feel uncomfortable due to the change in the output image.
- the electronic mirror device for a vehicle has been described.
- the control blocks (particularly the video control devices 10, 210, 310) of the electronic mirrors 1, 2, 3 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, It may be realized by software using a CPU (Central Processing Unit).
- a smartphone equipped with a 3D display (video display device 25), an eye tracking camera 50 (driver information acquisition device 52), and a photographing camera (imaging unit 11) is connected to the electronic mirror 1 by a CPU and an application included in the smartphone. , 2 and 3 can be realized.
- the video control apparatus 10 includes a CPU that executes instructions of a program that is software for realizing each function, and a ROM (Read Only Memory) in which the program and various data are recorded so as to be readable by the computer (or CPU).
- a storage device (these are referred to as “recording media”), a RAM (Random Access Memory) for expanding the program, and the like are provided.
- the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it.
- a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used.
- the program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program.
- an arbitrary transmission medium such as a communication network or a broadcast wave
- one embodiment of the present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.
- the display devices (video control devices 10, 210, 310 and the parallax barrier video display device 25) according to the first aspect of the present invention are arranged in front of a passenger including a driver of the vehicle and are photographed around the vehicle.
- a display device for displaying a visual recognition object included in a captured image so as to be recognized on the far side farther from the occupant than the display screen (20, 20 ') or on the near side of the occupant,
- a depth setting unit depth determining unit 12) for setting a depth (amount of protrusion d, a depth amount d) from the display screen for recognizing an object on the back side or the front side, and the depth from the captured image.
- a generation unit (output video generation unit 13) that generates a first output video including pixel data for the left eye and pixel data for the right eye corresponding to the depth set by the height setting unit.
- the depth (depth) is set in the output video, and the pixel data for the left eye and the pixel for the right eye shifted in the pixel arrangement direction by the pixel shift amount corresponding to the set depth.
- An output video containing data is generated.
- the object to be viewed in the output video appears behind the display screen or pops out of the display screen.
- the display device is the display apparatus according to aspect 1, in which the captured image is an image captured by a monocular camera, and the generation unit is set by the depth setting unit in the captured image. Pixel data at a position shifted by a pixel shift amount ( ⁇ pix) corresponding to the depth is alternately arranged as the left-eye pixel data and the right-eye pixel data to generate the first output video. May be.
- an output video having a sense of depth or popping out can be generated from a shot video shot using a monocular camera without requiring a binocular camera as in the prior art.
- the depth setting unit may set the depth based on at least one of the state of the vehicle and the state of the occupant. .
- an appropriate depth can be set in the output video based on at least one of the vehicle state and the occupant state.
- the display device is the display device according to any one of the aspects 1 to 3, wherein the visual object generated from the first output video generated by the generation unit and the captured video is displayed on the display screen.
- the second output image displayed so as to be recognized at the position of the image and the third output image generated from the photographed image and reproducing the binocular parallax of the human are displayed as the state of the vehicle and the occupant.
- a display switching unit (15) that selects an output video to be displayed on the display screen based on at least one of the states may be further provided.
- the display device is the display apparatus according to aspect 3, wherein the state of the vehicle is one of the speed of the vehicle and the position of a seat included in the vehicle, or the state of the occupant is the occupant. It may be either the position of the face relative to the display screen or the binocular parallax of the occupant.
- an appropriate depth can be set in the output video based on any one of the vehicle speed, the seat position, the occupant's face position, and the occupant's binocular parallax.
- the display devices (video control devices 10, 210, and 310 and the parallax barrier video display device 25) according to aspect 6 of the present invention are arranged in front of a passenger including a driver of the vehicle and are photographed around the vehicle.
- a display device for displaying a visual recognition object included in a captured image so as to be recognized on the far side farther from the occupant than the display screen (20, 20 ') or on the near side of the occupant,
- a depth setting unit depth determination unit 12) for setting a depth from the display screen for recognizing an object on the back side or the near side, and the depth set by the depth setting unit in the captured image
- a generation unit (output video generation unit 13) that generates first output video alternately arranged as pixel data for the left eye and pixel data for the right eye, with the data shifted by the pixel shift amount corresponding to With Both the display screen is inclined in a direction away from the occupant.
- the pixel farther from the occupant is set to a shallower depth from the display screen, and the pixel closer to the occupant is set to a deeper depth from the display screen. can do. Therefore, regardless of the pixel position in the tilt direction of the display screen, the output image of the tilted display screen can be shown facing the occupant.
- the depth setting unit sets the depth from the display screen to a pixel farther from the occupant according to the inclination of the display screen. It may be set shallowly.
- the distance from the occupant to the image becomes shorter as the image corresponds to the pixel set with a shallow depth from the display screen. Therefore, when the display screen is tilted, set the pixel farther away from the occupant to a shallower depth from the display screen, and the pixel closer to the occupant to set the depth from the display screen deeper. Can do. Therefore, regardless of the pixel position in the tilt direction of the display screen, the output image of the tilted display screen can be shown facing the occupant.
- the display device (video control device 310 and parallax barrier video display device 25) according to aspect 8 of the present invention is arranged in front of a passenger including a driver of a vehicle and is included in a captured video of the surroundings of the vehicle.
- a display device that displays the object to be recognized on the back side farther from the occupant than the display screen (20, 20 ′) or the near side to the occupant.
- a depth setting unit for setting a depth from the display screen to be recognized on the side or the near side, and a pixel corresponding to the depth set by the depth setting unit in the captured image
- the data at the position shifted by the shift amount includes a generation unit (output video generation unit 13) that generates first output video that is alternately arranged as pixel data for the left eye and pixel data for the right eye.
- the above ⁇ surface is a liquid crystal display device using a narrow viewing angle liquid crystal to block light from the front of the display screen to the predetermined angle or more displacement direction.
- the liquid crystal display device by limiting the field of view of the output video by the liquid crystal display device using the narrow viewing angle liquid crystal, only the left eye pixel is visible to the occupant's left eye, and the occupant's right eye is visible. Only the pixel for the right eye can be seen, so that the occupant (user) who sees the output video displays the object to be viewed in the output video according to the depth set in the output video. It appears behind the screen or appears to jump out of the display screen.
- the display device (video control device 310 and parallax barrier video display device 25) according to aspect 9 of the present invention is disposed in front of the occupant including the driver of the vehicle and is included in the captured video around the vehicle.
- a display device that displays the object to be recognized so as to be recognized on the back side farther from the occupant than the display screen or on the near side near the occupant, and on the back side or the near side.
- a depth setting unit for setting a depth from the display screen to be recognized, and data of a position shifted by a pixel shift amount corresponding to the depth set by the depth setting unit in the captured image is the left eye
- the object to be visually recognized in the output video appears behind the display screen or jumps out of the display screen.
- the display device (video control device 310 and parallax barrier video display device 25) according to aspect 10 of the present invention is disposed in front of an occupant including the driver of the vehicle and is included in the captured video of the surroundings of the vehicle.
- a display device that displays the object to be recognized so as to be recognized on the back side farther from the occupant than the display screen or on the near side near the occupant, and on the back side or the near side.
- a depth setting unit for setting a depth from the display screen to be recognized, and data of a position shifted by a pixel shift amount corresponding to the depth set by the depth setting unit in the captured image is the left eye
- Optical film for blocking light to have been attached
- a passenger viewing the display screen from the front of the display screen can see the visual target in the output video behind the display screen or jump out of the display screen.
- an occupant viewing the display screen from a direction deviated by a predetermined angle or more from the front of the display screen cannot see the output video. Therefore, it is possible to prevent an occupant who views the display screen from a direction deviated by a predetermined angle or more from the front of the display screen from giving unpleasant feeling due to flickering of the luminance of the output video.
- the display device (video control device 210 and parallax barrier video display device 25) according to aspect 11 of the present invention is disposed in front of an occupant including the driver of the vehicle and is included in the captured video of the surroundings of the vehicle.
- a display device that displays a visual recognition target, a detection unit that detects a position of the occupant's face relative to the display screen, and a position detected by the detection unit relative to the display screen of the occupant's face,
- a trimming position determining unit that determines a position to cut out a trimmed image in the captured video; a generation unit that generates an output video from the trimmed image cut out from the captured video according to the position determined by the trimming position determining unit; It has.
- an output image with an appropriate depth can be shown to the occupant according to the position of the occupant's face.
- the trimming position determination unit is configured to capture the image in a direction opposite to the direction of the movement when the occupant's face moves relative to the display screen.
- the position where the trimmed image is cut out in the video may be moved.
- the occupant moves the face with respect to the display screen so as to view the normal mirror, so that the trimmed image displayed as the output video displayed on the display screen is displayed.
- the range can be easily changed.
- An electronic mirror according to aspect 13 of the present invention images the display device according to any one of aspects 1 to 12 above, the front of the vehicle, the front rear, the left rear, or the right rear, and displays the captured image as described above.
- An imaging unit imaging unit 11 that outputs to the apparatus.
- the visual object included in the photographed video around the vehicle that is disposed in front of the occupant including the driver of the vehicle is displayed on the display screen.
- the display device control method is arranged in front of a passenger including a driver of the vehicle, and the object to be viewed included in the photographed video around the vehicle is more than the display screen.
- a generation step of generating the first output video in which the data at the shifted position is alternately arranged as the pixel data for the left eye and the pixel data for the right eye is included.
- the display device control method is a control of a display device that is arranged in front of an occupant including a driver of a vehicle and displays a visual object included in a photographed image around the photographed vehicle.
- Electron mirror 10 1, 2, 3 Electron mirror 10, 210, 310
- Video control device (display device) 11 Imaging unit (monocular camera, imaging unit) 12 Depth determination part (depth setting part) 13 Output video generator (generator) 14 Angle-of-view range determination unit (trimming position determination unit) DESCRIPTION OF SYMBOLS 15 Display switching part 20, 20 'Display screen 25 Parallax barrier corresponding
- Driver information acquisition device detection unit
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Mechanical Engineering (AREA)
- Signal Processing (AREA)
- Controls And Circuits For Display Device (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
La présente invention affiche rapidement une vidéo présentant une sensation de profondeur ou un effet de projection. Une unité de détermination de profondeur (12) détermine une profondeur indiquant la distance vers l'arrière ou vers l'avant pour afficher un objet visuel dans une vidéo de sortie par rapport à des écrans d'affichage (20, 20') dans un dispositif d'affichage vidéo (25), et une unité de génération de vidéo de sortie (13) génère une vidéo de sortie par disposition alternée de pixels qui sont décalés par une quantité de décalage de pixel correspondant à la profondeur déterminée par l'unité de détermination de profondeur (12).
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2016-240769 | 2016-12-12 | ||
JP2016240769 | 2016-12-12 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018109991A1 true WO2018109991A1 (fr) | 2018-06-21 |
Family
ID=62558211
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2017/031455 WO2018109991A1 (fr) | 2016-12-12 | 2017-08-31 | Dispositif d'affichage, miroir électronique, procédé de commande de dispositif d'affichage, programme et support d'informations |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2018109991A1 (fr) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2021062756A (ja) * | 2019-10-15 | 2021-04-22 | 株式会社国際電気通信基礎技術研究所 | 電子ミラー用表示装置 |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2004084559A1 (fr) * | 2003-03-20 | 2004-09-30 | Seijiro Tomita | Affichage video pour vehicule |
JP2007503603A (ja) * | 2003-08-22 | 2007-02-22 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | 表示装置及びそれに用いる視野角制御ユニット |
WO2009011199A1 (fr) * | 2007-07-19 | 2009-01-22 | Sharp Kabushiki Kaisha | Afficheur et élément de contrôle d'angle de vision employé dans celui-ci |
JP2010171608A (ja) * | 2009-01-21 | 2010-08-05 | Nikon Corp | 画像処理装置、プログラム、画像処理方法、記録方法および記録媒体 |
JP2010259017A (ja) * | 2009-04-28 | 2010-11-11 | Nikon Corp | 表示装置、表示方法、および表示プログラム |
JP2011188028A (ja) * | 2010-03-04 | 2011-09-22 | Denso Corp | 車両用周辺監視システム |
WO2012053030A1 (fr) * | 2010-10-19 | 2012-04-26 | 三菱電機株式会社 | Dispositif d'affichage 3d |
JP2013104976A (ja) * | 2011-11-11 | 2013-05-30 | Denso Corp | 車両用表示装置 |
JP2013237320A (ja) * | 2012-05-14 | 2013-11-28 | Toshiba Alpine Automotive Technology Corp | 違和感軽減表示装置およびその表示制御方法 |
-
2017
- 2017-08-31 WO PCT/JP2017/031455 patent/WO2018109991A1/fr active Application Filing
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2004084559A1 (fr) * | 2003-03-20 | 2004-09-30 | Seijiro Tomita | Affichage video pour vehicule |
JP2007503603A (ja) * | 2003-08-22 | 2007-02-22 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | 表示装置及びそれに用いる視野角制御ユニット |
WO2009011199A1 (fr) * | 2007-07-19 | 2009-01-22 | Sharp Kabushiki Kaisha | Afficheur et élément de contrôle d'angle de vision employé dans celui-ci |
JP2010171608A (ja) * | 2009-01-21 | 2010-08-05 | Nikon Corp | 画像処理装置、プログラム、画像処理方法、記録方法および記録媒体 |
JP2010259017A (ja) * | 2009-04-28 | 2010-11-11 | Nikon Corp | 表示装置、表示方法、および表示プログラム |
JP2011188028A (ja) * | 2010-03-04 | 2011-09-22 | Denso Corp | 車両用周辺監視システム |
WO2012053030A1 (fr) * | 2010-10-19 | 2012-04-26 | 三菱電機株式会社 | Dispositif d'affichage 3d |
JP2013104976A (ja) * | 2011-11-11 | 2013-05-30 | Denso Corp | 車両用表示装置 |
JP2013237320A (ja) * | 2012-05-14 | 2013-11-28 | Toshiba Alpine Automotive Technology Corp | 違和感軽減表示装置およびその表示制御方法 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2021062756A (ja) * | 2019-10-15 | 2021-04-22 | 株式会社国際電気通信基礎技術研究所 | 電子ミラー用表示装置 |
JP7398237B2 (ja) | 2019-10-15 | 2023-12-14 | 株式会社国際電気通信基礎技術研究所 | 電子ミラー用表示装置 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4857885B2 (ja) | 表示装置 | |
CN105988220B (zh) | 用于运行车辆用的自动立体观测的视野显示器的方法和控制设备 | |
JP4367212B2 (ja) | 虚像表示装置およびプログラム | |
US10882454B2 (en) | Display system, electronic mirror system, and moving body | |
CN104883554A (zh) | 具有直播视频的虚拟透视仪器群集 | |
JP6857695B2 (ja) | 後方表示装置、後方表示方法、およびプログラム | |
JP2014010418A (ja) | 立体表示装置及び立体表示方法 | |
JPH05139209A (ja) | 視覚情報提供装置 | |
CN111225830B (zh) | 带有调节校正的全显示镜 | |
JP2007052304A (ja) | 映像表示システム | |
JP2018154154A (ja) | 車両の表示システム及び車両の表示システムの制御方法 | |
JP2018203245A (ja) | 表示システム、電子ミラーシステム及び移動体 | |
US20240430379A1 (en) | Image processing apparatus, image processing method, and image processing system | |
JP2019133116A (ja) | 表示システム、移動体、及び、設計方法 | |
JP5117613B1 (ja) | 映像処理装置および映像処理方法ならびに記憶媒体 | |
JP4929768B2 (ja) | 視覚情報呈示装置及び視覚情報呈示方法 | |
JP2019102936A (ja) | 表示装置、電子ミラー、表示装置の制御方法、および表示制御プログラム | |
US20200150916A1 (en) | Multi-panel display system and method for jointly displaying a scene | |
US20190166358A1 (en) | Display device, electronic mirror and method for controlling display device | |
CN115018942A (zh) | 用于车辆的图像显示的方法和设备 | |
JP2020136947A (ja) | 運転支援装置 | |
WO2018109991A1 (fr) | Dispositif d'affichage, miroir électronique, procédé de commande de dispositif d'affichage, programme et support d'informations | |
WO2018101170A1 (fr) | Dispositif d'affichage et miroir électronique | |
JP6697747B2 (ja) | 表示システム、電子ミラーシステム及び移動体 | |
JP7398237B2 (ja) | 電子ミラー用表示装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17880273 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17880273 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: JP |