WO2017033992A1 - Dispositif d'affichage d'image de type visiocasque - Google Patents
Dispositif d'affichage d'image de type visiocasque Download PDFInfo
- Publication number
- WO2017033992A1 WO2017033992A1 PCT/JP2016/074764 JP2016074764W WO2017033992A1 WO 2017033992 A1 WO2017033992 A1 WO 2017033992A1 JP 2016074764 W JP2016074764 W JP 2016074764W WO 2017033992 A1 WO2017033992 A1 WO 2017033992A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- color
- control unit
- light
- image display
- Prior art date
Links
- 230000003287 optical effect Effects 0.000 claims abstract description 55
- 238000001514 detection method Methods 0.000 claims abstract description 24
- 238000004891 communication Methods 0.000 claims abstract description 21
- 238000000034 method Methods 0.000 claims description 28
- 230000009467 reduction Effects 0.000 claims description 3
- 238000005286 illumination Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 18
- 239000003086 colorant Substances 0.000 description 12
- 210000003128 head Anatomy 0.000 description 9
- 230000008859 change Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 6
- 238000004519 manufacturing process Methods 0.000 description 4
- 230000004913 activation Effects 0.000 description 3
- 239000004973 liquid crystal related substance Substances 0.000 description 3
- 230000003247 decreasing effect Effects 0.000 description 2
- 208000013057 hereditary mucoepithelial dysplasia Diseases 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000008034 disappearance Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000010287 polarization Effects 0.000 description 1
- 230000035484 reaction time Effects 0.000 description 1
- 239000011347 resin Substances 0.000 description 1
- 229920005989 resin Polymers 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/02—Viewing or reading apparatus
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/36—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/64—Constructional details of receivers, e.g. cabinets or dust covers
Definitions
- the present invention relates to a head-mounted image display device, and more specifically, includes a control unit that displays an image according to a remaining battery level that allows a user to easily recognize the remaining battery level and extend operating time.
- the present invention relates to a head-mounted image display device.
- HMD head mounted display
- a type of projecting image light based on image data onto the user's eyes while the user recognizes an external image has been proposed.
- Patent Documents 1 and 2 disclose conventional HMDs.
- Patent Document 1 discloses a head-mounted display device including a support block that holds a monocular video display unit in a position close to a user's head.
- This head-mounted display device displays an output image such as data from a personal computer on a viewer unit, which is a display unit, and allows the user's eyes to observe the display screen and the see-through screen of the surrounding external environment together. It is configured.
- Patent Document 2 describes a head-mounted image display device that projects an image displayed on an image display element onto a user's eye through an optical system.
- the image display device includes means for switching a state related to image display according to a state in which the user is observing the display image, so that a high-quality or high-quality image can be observed during gaze observation, while non-gaze observation is performed.
- a configuration is disclosed in which wasteful power consumption is suppressed by displaying an image in a state with low displayability (low resolution, low luminance, low frame rate, or the like).
- the HMDs described in Patent Documents 1 and 2 are all displayed on a small display device that receives image information from a television, video, image information supply device such as a personal computer, and is held in front of the user's eyes. Thus, the user can perform a separate operation while viewing the display screen of the display device.
- the present invention has been made in view of the above-described conventional problems, and an object of the present invention is to respond to the remaining battery level that allows the user to easily recognize the remaining battery level and extend the operating time.
- An object of the present invention is to provide a head-mounted image display device provided with image display control means.
- a head-mounted image display device includes a display optical system that emits image light based on image data, and image light emitted from the display optical system.
- An image display unit comprising an eyepiece optical system that projects onto an eye, and a support unit that supports the display optical system and the eyepiece optical system so as to be disposed along an optical path that passes through free space, and the image display unit
- a control unit having a battery for driving an image, a control unit for controlling the operation of the image display unit, a storage unit for storing various programs and data, and a communication unit for controlling communication with an external device, and the image display A holding member for holding the unit and the control unit on a user's head, wherein the control unit detects the remaining battery level.
- the battery remaining amount detecting unit when detecting that the remaining amount of the battery is equal to or lower than a predetermined first determination level, transmits a first battery remaining amount decrease signal to the control unit;
- the control unit controls the image light emitted from the display optical system to be changed to image light corresponding to a predetermined warning display mode upon receiving the first battery remaining amount decrease signal.
- the display optical system of the image display unit includes a light source that generates irradiation light, and an image display element that receives the irradiation light and converts the light into image light based on the image data, and the light source includes a red light emitting element.
- Each of the colors based on the image data corresponding to the respective colors by the image display element.
- the single color image light of each color that has been sequentially converted is additively mixed by a field sequential method so that the user can visually recognize the color image as one frame, When the battery remaining amount decrease signal is received, the light source and the image display element are controlled, and the color image for one frame is converted into a predetermined one of the monochromatic image lights of the respective colors.
- a first warning display mode for displaying with a single color image light, or a second warning display for converting the color image for one frame into a grayscale image and displaying with a single color image light of a predetermined one of the colors Can change to mode.
- the monochromatic image light corresponding to the first warning display mode corresponds to a light emitting element of a predetermined color among the light emitting elements of each color in a lighting period for each color provided in the period of one frame.
- the monochromatic image light obtained by turning on the illumination light and converting the illuminated irradiation light by the image display element, the control unit of the control unit corresponds to the remaining color provided in the one frame period During the lighting period, the light emitting elements corresponding to the remaining colors can be controlled to be in an off state.
- the monochromatic image light corresponding to the second warning display mode is combined with the image data of each color for the one frame by the control unit of the control unit, and then converted into grayscale image data of a predetermined color of each color.
- the converted irradiation light is emitted by turning on a light emitting element of a predetermined color among the light emitting elements of each color during a corresponding period in a lighting period for each color provided in the period of the one frame.
- the control unit of the control unit corresponds to the remaining color provided in the period of the one frame.
- the light emitting elements corresponding to the remaining colors can be controlled to be in an off state.
- control unit of the control unit When the control unit of the control unit receives the first low battery level signal, the control unit controls the light source and the image display element so that a color image corresponding to one frame for each separated frame is included in each color. A single color image light corresponding to the first or second warning display mode of a predetermined color may be displayed.
- a second battery remaining level decrease signal is output.
- the control unit of the control unit controls the light source and the image display element to enter the first or second warning display mode.
- the corresponding monochromatic image light can be changed to a different preset color and emitted from the display optical system.
- the control unit of the control unit controls the light source and the image display element to display the color screen for one frame for each separated frame in each color. A single color image light corresponding to the first or second warning display mode of a predetermined color may be displayed.
- the image display unit further includes a proximity sensor, and when the user wears the image display unit on the head, a wearing signal is transmitted from the proximity sensor to the control unit of the control unit, and the control unit of the control unit includes: When the mounting signal is received, the battery remaining amount data is acquired from the battery remaining amount detecting unit or the storage unit, and the battery remaining amount detecting unit determines whether the battery remaining amount is equal to or lower than a predetermined first determination level. If the first battery remaining amount reduction signal is received from the battery remaining amount detection unit, the image light emitted from the display optical system corresponds to the predetermined warning display mode. It can be controlled to change to the image light.
- the head-mounted image display device of the present invention since the user can easily recognize the remaining battery level of the head-mounted image display device at a glance, troubles caused by sudden battery exhaustion after the start of use can be prevented. Workability is improved. In addition, since the power required for the screen display after the remaining battery level drops below a predetermined value can be greatly reduced, the operation time can be extended and it is easy to take measures to avoid inconvenience due to the stop of the apparatus.
- FIG. 1 It is the schematic which shows each component in the state with which the user of the head mounted image display apparatus by one Embodiment of this invention was mounted
- the head mounted image display device it is a conceptual diagram showing an example of an image display method when the remaining battery level is low.
- the head-mounted image display device according to the present embodiment it is a conceptual diagram showing another example of an image display method when the remaining battery level is low.
- FIG. 1 is a schematic view showing each component in a state in which a user of a head-mounted image display device according to an embodiment of the present invention is worn.
- the head-mounted image display device 10 includes an image display unit 100 and a control unit 200.
- the image display unit 100 includes a display optical system 20 and an eyepiece optical system 30, and the control unit 200 incorporates a control unit and a battery for controlling the head-mounted image display device 10 in its housing, and the user's temporal region. It is fixedly supported by the part via the holding member 300.
- the holding member 300 includes a rigid structure 320 made of a plastic material or the like and a flexible structure member 310 made of a flexible material.
- the image display unit 100 can adjust the position of the optical axis so that the image light enters the user's eye E through the flexible flexible structure member 310.
- the head-mounted image display device 10 of the present embodiment is not limited to this, and the image display unit 100 is directly coupled to the holding member 300, and the control unit 200 is separated from the image display unit 100 to hold the holding member 300. It can be implemented in various forms such as a configuration in which the other end is connected via a separate connecting member (not shown).
- FIG. 2 is a diagram schematically showing a configuration of a housing that houses the control unit and the image display unit of the head-mounted image display device according to the embodiment of the present invention shown in FIG. ) Is a plan view, and (b) is a front view.
- the control unit 200 has a rectangular parallelepiped-like casing 200a extending forward along the user's head side.
- the control unit 200 includes a camera unit 211 at one end thereof, and the head-mounted image display device 10 is included in the casing 200a.
- a control unit 220 that controls overall functions and operations, a battery 230, a communication unit 240, a storage unit 250, an audio processing unit 260, and an operation input unit 270 are provided.
- a housing portion that is connected to the housing 200a housing the control unit 200 and houses the display optical system 20 of the image display unit 100 constitutes a first housing chamber 20a described later.
- the first storage chamber 20a includes an image display element 24 that includes an image display element that converts image data into image light and an electronic circuit that controls driving of the light source, and is provided on the surface on the user side of the first storage chamber 20a. Is provided with a proximity sensor 25.
- a proximity sensor 25 As the proximity sensor 25, an infrared proximity sensor or other various types of proximity sensors can be used.
- FIG. 3 is a schematic diagram showing the configuration of the image display unit according to the present embodiment shown in FIG. 2, wherein FIG. 3A is a plan view of the image display unit, and FIG. 3B is a front view.
- the image display unit 100 includes a light source 21, a condenser lens 22, and a display optical system 20 including an image display element 23 that displays image data, and image light L emitted from the display optical system 20.
- An eyepiece optical system 30 that leads to the eye E, and a support unit 50 that supports the display optical system 20 and the eyepiece optical system 30 so as to be arranged along an optical path that passes through free space.
- An emission window 60 through which the image light L emitted from the display optical system 20 is transmitted is formed in the first storage chamber 20a, and an incident light through which the image light L from the display optical system 20 is transmitted into the second storage chamber 30a.
- An eyepiece window 90 through which light guided by the window 80 and the eyepiece optical system 30 is transmitted toward the user's eye E is provided.
- a protect plate (not shown) made of a transparent elastic member for protecting the user's eyes may be disposed on the surface of the second storage chamber 30a facing the user's eyes.
- the support unit 50 includes a support member 51 that connects the first storage chamber 20 a that stores the display optical system 20 and the second storage chamber 30 a that stores the eyepiece optical system 30.
- the support member 51 is composed of two support plates (51a, 51b) facing each other in the vertical direction (Z-axis direction), and there is a space between the support plates. Therefore, the user's line of sight is not blocked by the support member 51.
- the support member 51 can be covered with a member such as a transparent resin in order to reinforce both support plates (51a, 51b).
- the support member 51 is formed by two support plates (51a, 51b) facing each other, but is not limited thereto. For example, it can be formed of a single support plate or column. Moreover, you may form a support plate or a support
- the display optical system 20 includes a homogenizing element and a polarizing element for homogenizing light from the light source 21, and image data is converted into image light by an image display element 23 that is driven and controlled by the image display unit 24.
- the light is converted and emitted from the emission window 60.
- the image display element 23 displays an image by modulating incident light according to image data.
- a transmissive liquid crystal display in which pixels serving as regions through which light passes is arranged in a matrix. It is composed of an element (LCD).
- the light source 21 is composed of a set of monochromatic light sources composed of light emitting elements that emit light of each color of R (red), G (green), and B (blue). Diode).
- the light from the light source 21 is condensed through the condenser lens 22 and supplied to the image display element 23.
- the eyepiece optical system 30 is an optical system that guides the image light L emitted from the display optical system 20 to the user's eye E.
- the eyepiece optical system 30 includes a prism 31 and an eyepiece lens 32.
- the prism 31 is a light guide member that functions as means for reflecting the optical path of the image light incident from the display optical system 20 in the direction of the user's eye E.
- the prism 31 has a shape having an incident surface 31a for image light, a reflecting surface 31b, and an exit surface 31c.
- the eyepiece lens 32 has positive power (refractive power) and condenses the image light L on the user's eye E.
- the prism 31 is configured by a single prism or a combination of a plurality of prisms. In the present embodiment, the prism 31 is formed integrally with the eyepiece 32 that is bonded to the incident surface 31a.
- the reflecting surface 31b of the prism 31 is configured by a total reflection surface or a half mirror surface.
- the light emitted from the light source 21 is collected by the condenser lens 22 and enters the transmissive image display element 23, and is modulated by the image display element 23 to become image light L, which is an eyepiece optical system.
- 30 incident windows 80 enter.
- the entrance window 80 corresponds to the entrance surface of the eyepiece 32 joined to the entrance surface 31a of the prism 31 in FIG.
- the image light L enters the prism 31 from the incident surface 31a via the eyepiece lens 32, travels in the prism 31 along the lateral (X) direction, and the optical path is reflected on the reflecting surface 31b. It is bent and travels in the direction of the depth (Y) direction.
- the image light is guided to the user's eye E through the exit surface 31c of the prism 31 (corresponding to the eyepiece window in the present embodiment), and the user observes an enlarged virtual image of the image displayed by the image display element 23. can do.
- the method of converting image data into image light is not limited to the configuration using the above-described transmission type image display element.
- a reflection type liquid crystal display element and a polarization beam splitter (PBS) are used. Can be configured.
- FIG. 4 is a block diagram schematically showing components of the head-mounted image display device according to the present embodiment shown in FIG.
- the control unit of the head-mounted image display apparatus 10 includes a camera unit 211, a control unit 220, a battery 230, a communication unit 240, a storage unit 250, an audio processing unit 260, and an operation input unit. 270 and the like, and controls the image display unit.
- the control unit 220 includes a CPU 221 that controls each component for the general operation of the head-mounted image display device 10, an image processing unit 222 that performs desired image processing on displayed image data, and an input / output unit.
- An input / output control unit 223 that determines the type of data and controls connection switching between the corresponding interface and the component is provided.
- the control unit 220 receives input from the proximity sensor 25, detects attachment / detachment of the apparatus by the user, and controls image output on / off.
- the image processing unit 222 is dedicated to performing data conversion processing of image data captured by the camera unit 211 or image data received via the communication unit 240, and separation or synthesis processing of RGB image data under the control of the CPU 221.
- a processor for example, a DSP
- the image display unit 24 of the image display unit 100 receives these signals and drives and controls the image display element 23 and the light source 21 to emit image light. Details of the image display control will be described later.
- the battery 230 supplies power to each component of the head-mounted image display device 10.
- the output of the battery is monitored by the battery remaining amount detection unit 231.
- the battery remaining amount detection unit 231 controls the battery remaining amount decrease signal.
- the control unit 220 controls to change the image light emitted from the display optical system to the image light corresponding to a predetermined warning display mode upon receiving the battery remaining amount decrease signal. Details of the display mode control due to the remaining battery level will be described later.
- the battery remaining amount detecting unit 231 performs a battery remaining amount detecting operation spontaneously or performs a battery remaining amount detecting operation in accordance with a command from the CPU 221.
- the communication unit 240 controls the control of the control unit 220 to form a communication channel for voice communication with a wired or wirelessly connected external device and a communication channel for transmitting and receiving image data or character data. Do it below.
- the communication unit 240 forms a voice call channel, a character data communication channel such as an e-mail, an image data communication channel, and the like with an external mobile communication system.
- the head-mounted image display device 10 controls to output various information such as communication destination list information to the image display unit 100.
- the head-mounted image display device 10 controls to output various information other than images to the image display unit 100.
- the communication unit 240 includes Bluetooth (registered trademark), WiFi (registered trademark), and the like.
- the storage unit 250 includes a flash memory (flash EEPROM), a RAM (not shown), a program area for storing various application programs necessary for the functional operation of the head-mounted image display device, and data for storing various data. Consists of regions.
- the program area includes an OS (Operating System) for activation of the head-mounted image display device 10 and operation of each of the above-described components, an application program for executing various functions, for example, a call function support
- An application program, a web browser for connecting to an Internet server, an MP3 application program for reproducing audio data, an image output application program for displaying still images, and a moving image compression / reproduction application program are stored.
- the program area of the present embodiment includes an application program related to image display control based on the remaining battery level.
- the data area is an area for storing various data generated by using the head-mounted image display device 10, and stores menu map information, at least one icon corresponding to various functions, or various contents.
- image data captured by the camera unit 211, image data received from the outside, various content information data, and the like are temporarily stored.
- the data area of the present embodiment stores the remaining battery level data detected by the remaining battery level detection unit 231 at the time when the use of the apparatus is ended or temporarily stopped in the nonvolatile memory area, and is used for starting or restarting the apparatus. Accordingly, when the application program related to the image display control based on the battery remaining amount is activated, the stored battery remaining amount data can be transmitted to the control unit 220.
- the audio processing unit 260 outputs the audio data transmitted / received during a call, the audio data included in the received message, the audio data obtained by playing an audio file received from the external storage device, and the like to the earphone 262, and the user's voice or Other audio signals are collected through the microphone 261.
- the operation input unit 270 is configured by a touch switch or the like disposed on the side of the housing 200a of the control unit 200, and inputs for the user to instruct the type of the image output to the image display unit 100, a specific function, and the like. Receive.
- the head-mounted image display device 10 projects image light based on image data or character data received via the communication unit 240 or image data captured by the camera unit 211 to the user's eyes. The user visually recognizes this as a virtual image.
- FIG. 5 is a schematic diagram showing an image display method of the head-mounted image display device according to the embodiment of the present invention. With reference to FIG. 5, the image display by the sequential color method which is the display image generation method according to the present embodiment will be described.
- a single modulator image display element
- three (red, green, and blue) primary color modulation images for each video frame As a sub-frame of each video frame, it is a method of sequentially displaying at high speed so as to create a full-color image in the human visual system. That is, a full-color image is generated by utilizing the relatively slow reaction time of the human eye.
- each frame period When displaying a video frame, each frame period is divided into at least three time periods, and a primary color image is generated during each of these time periods.
- primary color images for one frame are continuously generated at high speed, the user's eyes recognize this as a single full-color image.
- FIG. 5 schematically shows the modulator, that is, the display surface 123 of the image display element 23 at different times of t 0 to t 3 in one video frame.
- light of only one color is irradiated on the display surface of the image display element 23 during each time period within one frame period.
- the time period (t 0 ⁇ t 1) the light source only red light source R in (21 in FIG. 3) is turned, the display sub-frame image corresponding to the red light on the display surface 123 of the image display device 23 Is done.
- the display surface 123 of the image display element is, for example, a display surface of an LCD panel or an LCOS (Liquid crystal on silicon) panel, but is not limited thereto. Therefore, during the first time period (t 0 to t 1 ), the image display element (23 in FIG. 3) generates red image light 114.
- the image display element 23 In the time period (t 1 to t 2 ), only the green light source G of the light source 21 is turned on, and the green light is irradiated onto the display surface 123 on which the subframe image corresponding to the green light of the image display element 23 is displayed. . Thus, the image display element 23 generates the green image light 115 during the second time period (t 1 to t 2 ). Finally, in the time period (t 2 to t 3 ), only the blue light source B of the light source 21 is turned on, and the blue light is irradiated onto the surface 123 on which the sub-frame image corresponding to the blue light of the image display element 23 is displayed. Is done. Thus, the image display element 23 generates the blue image light 116 during the last time period (t 2 to t 3 ).
- the image light of each color corresponding to the red image, the green image, and the blue image that are sub-frame images for each video frame is sequentially emitted, and the full-color display image is visually recognized by the user's eyes.
- the series of image light is generated in the same manner for subsequent images to be displayed and sequentially emitted from the display optical system.
- FIG. 6 is a flowchart showing an example of image display control based on the remaining battery level that is executed while the head-mounted image display device according to the present embodiment is in operation.
- step S100 when the head-mounted image display device is activated (step S100), the control unit 220 instructs the battery remaining amount detection unit 231 to detect the battery remaining amount, and receives the command.
- the detection unit 231 detects the remaining battery level, and acquires remaining battery level data as a detection result.
- the control unit 220 may acquire the remaining battery level data at startup by reading the remaining battery level data stored in the storage unit 250 (step S110).
- the activation of the head-mounted image display apparatus in step S100 is activated by turning on the main power supply of the apparatus, or activation from a standby state based on an input from an infrared proximity sensor included in the apparatus, That is, including restart.
- the battery remaining amount detecting unit 231 compares the battery remaining amount data acquired in step S110 with a predetermined first determination level (reference remaining amount) set in advance (step S120). When it is detected that the remaining battery level is equal to or lower than a predetermined first determination level, the remaining battery level detection unit 231 transmits a first remaining battery level decrease signal to the control unit 220.
- control unit 220 sequentially generates a normal display mode, that is, three-color sub-frame images for the image display unit of the image display unit. Control is performed to display a full-color image (step S130). Thereafter, the control branches to before step S110, and the subsequent steps are repeated.
- the first remaining battery level decrease signal is transmitted from the remaining battery level detection unit 231 to the control unit 220, and the process proceeds to step S140.
- the control unit 220 receives the first remaining battery level lowering signal, and in response to this, sets a display image for the image display unit in advance. It changes to warning display mode, and it controls to produce
- control unit 220 checks whether or not an event for the user to remove the device from the head is generated (step S150). When there is no occurrence of an input event for detaching the device from the head, the control unit 220 controls to branch before step S140 and repeat the subsequent steps.
- control unit 220 stores the remaining battery level data detected by the remaining battery level detection unit 231 at the time of the input event in the nonvolatile memory area (step S160). ).
- the control unit 220 temporarily stops the operation of the head-mounted image display device 10 and branches before step S100 and waits in a standby state or the main power supply by the user. Is turned off to end the operation (step S170).
- FIG. 7 is a conceptual diagram illustrating an example of an image display method when the remaining battery level is reduced in the head-mounted image display device according to the present embodiment.
- a method of generating a display image corresponding to the first warning display mode when the remaining battery level is reduced will be described.
- FIG. 7 schematically shows the modulator, that is, the display surface 123 of the image display element 23 at different times t 0 to t 3 in one video frame corresponding to FIG.
- the first warning display mode of the present embodiment light of only one color is irradiated on the display surface of the display element 23 in one video frame.
- the green light source G of the light source 21 is lit and green light is displayed during the time period (t 1 to t 2 ) within the period (t 0 to t 3 ) of one frame.
- the display surface 123 on which the sub-frame image corresponding to the green light of the element 23 is displayed is irradiated, and the red and blue light sources are not turned on during other time periods.
- the image for one frame is displayed with any one predetermined single color image light (green image light 115 in this example) of each single color image light. It is possible to easily recognize that the remaining amount has decreased, and at the same time, the power required for image display is reduced to approximately one third.
- FIG. 8 is a conceptual diagram showing another example of the image display method when the remaining battery level is reduced in the head-mounted image display device according to the present embodiment.
- a method of generating a display image corresponding to the second warning display mode when the remaining battery level is reduced will be described.
- FIG. 8 schematically shows the modulator, that is, the display surface 123 of the image display element 23 at different times t 0 to t 3 in one video frame corresponding to FIG.
- the images corresponding to the respective colors in one video frame are synthesized, they are converted into a grayscale image of a predetermined one of the colors.
- the image of the color is displayed on the display surface 123 of the image display element 23, and the light of the color is irradiated on the display surface of the image display element 23.
- the green light source G of the light source 21 is turned on during the time period (t 1 to t 2 ) within one frame period (t 0 to t 3 ), and the green light is displayed as an image. Irradiation is performed on the display surface 123 on which the green grayscale image of the element 23 is displayed, and the red and blue light sources are not turned on during other time periods.
- the image of one frame is converted into a single-color grayscale image and displayed with a single color image light (green in this example) of each color. It is possible to easily recognize that the amount has decreased, and at the same time, the power required for image display is reduced.
- FIG. 9 is a conceptual diagram showing another example of a display image generation method corresponding to the first warning display mode when the remaining battery level is low.
- control is performed so that monochromatic image light is emitted for each predetermined spaced frame with respect to the remaining amount of the battery below a predetermined first determination level (reference remaining amount).
- irradiation light of any one of the colors in one video frame is irradiated on the display surface of the display element 23.
- the display surface of the display element 23 For example, during the time period (t 1 to t 2 ) within the period of one frame (t 0 to t 3 ), only the green light source G of the light source 21 is turned on, and the green light corresponds to when the green light of the display element 23 is turned on. Irradiation is performed on the display surface 123 on which the subframe image to be displayed is displayed, and the red and blue light sources are not turned on during other periods. Further, the display element 23 may not display each sub-frame image corresponding to red and blue light, and may be in a drive-off state during this period.
- FIG. 10 is a conceptual diagram illustrating another example of a method for generating image light corresponding to the second warning display mode when the remaining battery level is low.
- control is performed so that monochromatic image light is emitted for each predetermined spaced frame with respect to the remaining amount of the battery below a predetermined first determination level (reference remaining amount).
- a period in which an image corresponding to each color in one video frame is synthesized and then converted into a predetermined single-color grayscale image of any one of the colors and an image of that color is displayed.
- the display surface 123 of the image display element 23 are displayed on the display surface 123 of the image display element 23, and the light of the color is irradiated onto the display surface of the image display element 23. That is, only the green light source G of the light source 21 is turned on during the time period (t 1 to t 2 ) within one frame period (t 0 to t 3 ), and the green light is green when the green light of the image display element 23 is turned on.
- the display surface 123 on which the grayscale image is displayed is irradiated, and the red and blue light sources are not turned on during other periods.
- the image display element 23 may not display each sub-frame image corresponding to red and blue light, and may be in a drive-off state during this period. Further, not all sub-frame images are generated in the time period (t 3 to t 6 ) that is the next frame period. That is, monochromatic grayscale image light (green in this example) is displayed at a normal half frame rate. Therefore, in this example, the power required for image display is further reduced.
- a predetermined level (reference remaining amount) of the remaining battery level that shifts to the warning display mode is defined as a first determination level, and the remaining battery level further falls below the first determination level (reference remaining amount).
- a second determination level corresponding to the case is set in advance, and when the remaining battery level becomes equal to or lower than the second determination level, control is performed to change the color of the monochromatic image light to a preset different color.
- FIG. 11 is a flowchart showing another example of image display control based on the remaining battery level that is executed while the head-mounted image display device according to the present embodiment is operating.
- the head-mounted image display device restarts from the start-up or standby state (step S200), and the control unit 220 acquires battery remaining amount data from the battery remaining amount detection unit 231 or the storage unit 250 (step S200).
- step S210 the remaining battery level data acquired in step S210 by the remaining battery level detection unit 231 is compared with a predetermined first determination level (reference remaining level) (step S220).
- a predetermined first determination level reference remaining level
- control unit 220 sequentially generates a normal display mode, that is, three-color sub-frame images for the image display unit of the image display unit. Control is performed to display a full-color image (step S230). Thereafter, control is performed so as to branch before step S210 and repeat the subsequent steps.
- the first remaining battery level signal is transmitted from the remaining battery level detection unit 231 to the control unit 220, and the process proceeds to step S240.
- control unit 220 When the remaining battery level is equal to or lower than a predetermined first determination level, the control unit 220 receives a first battery remaining level lowering signal and enters a warning display mode in which a display image is set in advance for the image display unit. Then, control is performed to generate and emit monochromatic image light corresponding to the first or second warning display mode shown in FIGS. 7 and 8 (step S240).
- control unit 220 instructs the remaining battery level detection unit 231 to monitor the remaining battery level, and the received remaining battery level detection unit 231 detects the remaining battery level and detects the remaining battery level as a detection result.
- Data is acquired (step S250).
- the remaining battery level detection unit 231 compares the remaining battery level data acquired in step S250 with a second determination level corresponding to the case where the remaining battery level further falls below the first determination level (reference remaining level) (step S260). ). If the remaining battery level is not less than or equal to the second determination level, the control unit 220 continues to emit the monochromatic image light corresponding to step S240, branches before step S240, and repeats the subsequent steps. To do.
- the remaining battery level detection unit 231 transmits a second lower battery level signal to the control unit 220, and the control unit 220 receives the second battery level.
- the image display unit is controlled to emit the display image by changing the display image to single color image light corresponding to the preset first or second warning display mode of another color. (Step S270). Thereafter, control is performed so that the user corresponding to step S150 in FIG. 6 branches before the step of confirming whether or not an event for detaching the apparatus from the head is generated and the subsequent steps are performed.
- FIG. 12 is a conceptual diagram showing a display image generation method corresponding to the first warning display mode when the remaining battery level shown in FIG. 11 is lowered.
- the control unit 220 displays light of only one color within one video frame. Control is performed so that the display surface of the element 23 is irradiated. For example, in the time period (t 1 to t 2 ) within one frame period (t 0 to t 3 ), only the green light source G of the light source 21 is turned on, and the green light corresponds to when the green light of the display element 23 is turned on. The display surface 123 on which the subframe image is displayed is irradiated, and the red and blue light sources are not turned on during other periods.
- the display element 23 may not display each sub-frame image corresponding to red and blue light, and may be in a drive-off state during this period. Thereafter, when the remaining battery level in the frame immediately before time t 30 falls below a second determination level set in advance, the time period (t 30 ) within the time period (t 30 to t 33 ) that is the next frame period. T 31 ), only the red light source G of the light source 21 is turned on, and the red light is irradiated on the display surface 123 on which the corresponding sub-frame image is displayed when the red light of the display element 23 is turned on. In addition, the green and blue light sources are not lit. That is, the monochromatic image light is changed from green to red. In the subsequent frames, red image light is emitted. Therefore, the user can easily recognize that the remaining battery level is further reduced.
- the remaining battery level is equal to or lower than the second determination level, it is possible to change the frame display interval of the display image shown in FIG. 9 in addition to the change of the color of the image light.
- FIG. 13 is a conceptual diagram showing a display image generation method corresponding to the second warning display mode when the remaining battery level shown in FIG. 11 is reduced.
- the control unit 220 combines images corresponding to the respective colors in one video frame. Later, it is converted into a predetermined single-color grayscale image of any one of the colors and displayed on the display surface 123 of the image display element 23 during a period in which the image of the color is displayed.
- the display surface is controlled so as to be irradiated.
- the green light source G of the light source 21 is turned on, and the green light is green when the green light of the image display element 23 is turned on.
- the display surface 123 on which the grayscale image is displayed is irradiated, and the red and blue light sources are not turned on during other periods.
- the image display element 23 may not display each sub-frame image corresponding to red and blue light, and may be in a drive-off state during this period.
- the remaining battery level is equal to or lower than the second determination level, it is possible to change the frame display interval of the display image shown in FIG. 10 in addition to the change of the color of the image light.
- the present invention since the user can easily recognize the remaining battery level of the head-mounted image display device at a glance, when the user wears the device and works, Therefore, it is possible to provide a head-mounted image display device with improved operability even when the size and weight are reduced.
- the power required for the screen display can be greatly reduced, the operation time can be extended, and it is possible to avoid the inconvenience due to the sudden disappearance of the screen during work.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Chemical & Material Sciences (AREA)
- Crystallography & Structural Chemistry (AREA)
- Optics & Photonics (AREA)
- Liquid Crystal Display Device Control (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
L'invention concerne un dispositif d'affichage d'image de type visiocasque qui permet à une capacité de batterie restante d'être facilement reconnue par l'utilisateur et qui permet un temps de fonctionnement étendue. Le dispositif d'affichage d'image de type visiocasque comprend : une unité d'affichage d'image composé d'un système optique d'affichage pour émettre une lumière d'image, un système optique oculaire pour projeter une lumière d'image sur un œil d'un utilisateur, et une section de support pour porter le système optique d'affichage et le système optique oculaire; une unité de commande ayant une batterie, une section de commande, une section de stockage, et une section de communication; et un élément de maintien pour maintenir l'unité d'affichage d'image et l'unité de commande sur la tête de l'utilisateur. L'unité de commande comprend en outre une section de détection de capacité de batterie restante pour détecter la capacité de batterie restante, la section de détection de capacité de batterie restante transmet un premier signal de faible capacité de batterie lorsque la capacité de batterie restante est égale ou inférieure à un premier niveau d'évaluation prédéterminé, la section de commande reçoit le premier signal de faible capacité de batterie et change la lumière d'image émise par le système optique d'affichage en une lumière d'image correspondant à un mode d'affichage d'avertissement prédéterminé.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2015166158A JP2018173430A (ja) | 2015-08-25 | 2015-08-25 | 頭部装着型画像表示装置 |
JP2015-166158 | 2015-08-25 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017033992A1 true WO2017033992A1 (fr) | 2017-03-02 |
Family
ID=58100501
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2016/074764 WO2017033992A1 (fr) | 2015-08-25 | 2016-08-25 | Dispositif d'affichage d'image de type visiocasque |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP2018173430A (fr) |
WO (1) | WO2017033992A1 (fr) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018163974A1 (fr) * | 2017-03-07 | 2018-09-13 | シャープ株式会社 | Dispositif d'affichage, dispositif d'affichage d'image virtuelle et procédé de commande du dispositif d'affichage |
WO2019231108A1 (fr) * | 2018-05-29 | 2019-12-05 | Samsung Electronics Co., Ltd. | Gestion de ressources de réalité virtuelle pour visiocasques de réalité virtuelle |
JP2019219628A (ja) * | 2018-06-22 | 2019-12-26 | カシオ計算機株式会社 | 表示装置、表示方法及び表示プログラム |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7298393B2 (ja) * | 2019-08-29 | 2023-06-27 | セイコーエプソン株式会社 | 装着型表示装置 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002032980A (ja) * | 2000-07-18 | 2002-01-31 | Aiwa Co Ltd | 電池残量表示装置 |
JP2003248463A (ja) * | 2002-02-25 | 2003-09-05 | Matsushita Electric Ind Co Ltd | 液晶表示装置 |
JP2009135719A (ja) * | 2007-11-30 | 2009-06-18 | Casio Hitachi Mobile Communications Co Ltd | 携帯端末装置及びプログラム |
JP2009192583A (ja) * | 2008-02-12 | 2009-08-27 | Konica Minolta Holdings Inc | 頭部装着式映像表示装置 |
JP2010145669A (ja) * | 2008-12-18 | 2010-07-01 | Brother Ind Ltd | ヘッドマウントディスプレイ |
JP2015154420A (ja) * | 2014-02-18 | 2015-08-24 | 株式会社島津製作所 | 表示装置 |
-
2015
- 2015-08-25 JP JP2015166158A patent/JP2018173430A/ja active Pending
-
2016
- 2016-08-25 WO PCT/JP2016/074764 patent/WO2017033992A1/fr active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002032980A (ja) * | 2000-07-18 | 2002-01-31 | Aiwa Co Ltd | 電池残量表示装置 |
JP2003248463A (ja) * | 2002-02-25 | 2003-09-05 | Matsushita Electric Ind Co Ltd | 液晶表示装置 |
JP2009135719A (ja) * | 2007-11-30 | 2009-06-18 | Casio Hitachi Mobile Communications Co Ltd | 携帯端末装置及びプログラム |
JP2009192583A (ja) * | 2008-02-12 | 2009-08-27 | Konica Minolta Holdings Inc | 頭部装着式映像表示装置 |
JP2010145669A (ja) * | 2008-12-18 | 2010-07-01 | Brother Ind Ltd | ヘッドマウントディスプレイ |
JP2015154420A (ja) * | 2014-02-18 | 2015-08-24 | 株式会社島津製作所 | 表示装置 |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018163974A1 (fr) * | 2017-03-07 | 2018-09-13 | シャープ株式会社 | Dispositif d'affichage, dispositif d'affichage d'image virtuelle et procédé de commande du dispositif d'affichage |
WO2019231108A1 (fr) * | 2018-05-29 | 2019-12-05 | Samsung Electronics Co., Ltd. | Gestion de ressources de réalité virtuelle pour visiocasques de réalité virtuelle |
US10978018B2 (en) | 2018-05-29 | 2021-04-13 | Samsung Electronics Co., Ltd. | Virtual reality resource management for virtual reality head mounted display devices |
JP2019219628A (ja) * | 2018-06-22 | 2019-12-26 | カシオ計算機株式会社 | 表示装置、表示方法及び表示プログラム |
JP7613530B2 (ja) | 2018-06-22 | 2025-01-15 | カシオ計算機株式会社 | 表示装置、表示方法及びプログラム |
Also Published As
Publication number | Publication date |
---|---|
JP2018173430A (ja) | 2018-11-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10009602B2 (en) | Head-mounted display device and control method for the head-mounted display device | |
US9652036B2 (en) | Device, head mounted display, control method of device and control method of head mounted display | |
JP6459711B2 (ja) | 表示装置、及び、表示装置の制御方法 | |
US8896500B2 (en) | Head-mounted display device and control method for the head-mounted display device | |
JP6089705B2 (ja) | 表示装置、および、表示装置の制御方法 | |
JP5742271B2 (ja) | 頭部装着型表示装置および頭部装着型表示装置の制御方法 | |
WO2017033992A1 (fr) | Dispositif d'affichage d'image de type visiocasque | |
US9348144B2 (en) | Display device and control method thereof | |
WO2012133021A1 (fr) | Afficheur de tête | |
US20110267321A1 (en) | Head mounted display and drive method thereof | |
JP2011091789A (ja) | ヘッドマウントディスプレイ | |
JP2013122519A (ja) | 透過型表示装置、表示方法および表示プログラム | |
WO2012133020A1 (fr) | Afficheur de tête | |
JP2009251154A (ja) | 頭部装着式映像表示装置 | |
US10121409B2 (en) | Display device, method of controlling display device, and program | |
CN103677245A (zh) | 互动式虚像显示器及互动式显示方法 | |
JP5803193B2 (ja) | 頭部装着型表示装置および頭部装着型表示装置の制御方法 | |
JP5742270B2 (ja) | 頭部装着型表示装置および頭部装着型表示装置の制御方法 | |
JP6464729B2 (ja) | 表示装置、及び、表示装置の制御方法 | |
JP2018054976A (ja) | 頭部搭載型表示装置及び頭部搭載型表示装置の表示制御方法 | |
JP2007052224A (ja) | 映像表示装置 | |
JP2016122085A (ja) | 表示装置、及び、表示装置の制御方法 | |
CN113050823A (zh) | 数据处理装置、显示系统和数据处理方法 | |
CN113050278A (zh) | 显示系统、显示方法以及记录介质 | |
JP5747815B2 (ja) | 画像表示装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16839339 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16839339 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: JP |