KR20150110254A - Head mounted display device and operating method thereof - Google Patents

Abstract

The present invention provides an HMD device and an operation method thereof that can alleviate wearer's fatigue or protect eyesight. The HMD device includes: a display for displaying contents; A first information acquiring unit acquiring information of an HMD device generated in association with provision of contents; The control unit may display a notification on the display as to whether or not to stop providing the content using the information of the HMD device and stop providing the content in response to receiving the provision stop request for the content.

Description

[0001] HMD DEVICE AND OPERATING METHOD THEREOF [0002]

The present invention relates to a wearable device and a method of operating the same, and more particularly, to a head mounted display (HMD) device and a method of operating the same, capable of reducing fatigue or protecting eyesight of a user.

As wearable devices are actively studied, various wearable devices are expected to be released or released. Wearable devices that are currently available or anticipated to launch may include smart watches, HMD (Head Mounted Display) devices, and smart belts.

The HMD device is a wearable display device which can be worn as wearing glasses and display images, and is also called smart glass. The HMD device places the display near one eye or two eyes of the wearer. Accordingly, when the HMD device is used for a long time, the wearer can feel the fatigue of the eyes and the decrease in the visual acuity.

SUMMARY OF THE INVENTION An object of the present invention is to provide an HMD device and its operation method capable of reducing wearer fatigue or protecting eyesight.

According to an aspect of the present invention, there is provided an HMD (Head Mounted Display) device including: a display for displaying contents; A first information obtaining unit for obtaining information of the HMD device generated in association with the provision of the content; A user input unit for inputting a command of a wearer; And displaying a notification on whether or not to stop providing the content on the display by using the information of the HMD device and stopping the providing of the content in response to receiving a provision stop request for the content through the user input unit And a control unit.

In a preferred embodiment, the information of the HMD device is obtained by wearing the HMD device, wearing the HMD device, playing back the content, and consuming battery power of the HMD device, And a heat generation temperature of the HMD device after the reproduction of the content starts.

In one preferred embodiment, the HMD device further includes a second information obtaining unit for obtaining the wearer's biometric information in association with the provision of the content, Can be displayed on the display.

According to an embodiment of the present invention, the HMD device further includes a third information obtaining unit for obtaining the surrounding information of the HMD device in association with the provision of the content, and the controller uses the information of the HMD device and the surrounding information To display the notification on the display.

In one preferred embodiment, the HMD device further includes a fourth information acquiring unit for acquiring the personal information of the wearer in association with the provision of the content, and the control unit controls the HMD device using the information of the HMD device and the personal information, Can be displayed on the display.

In a preferred embodiment, the control unit may display the notification on the display, and continuously provide the content through the display upon receiving the stoppage rejection of the content through the user input unit.

In a preferred embodiment, the control unit displays the notification on the display, superimposes the notification on the content, inserts a frame of the notification between the frames of the content and displays it on the display, and displays The notification can be displayed on the display by one of displaying the notification in the area and the other display area.

In one preferred embodiment, the controller may provide other contents by the HMD device as the provision of the contents is suspended.

In one preferred embodiment, the control unit displays information on a plurality of other contents on the display, and when a selection signal based on information on the plurality of different contents being displayed is received, Can be provided.

In a preferred embodiment, the control unit may apply different reference information to the information of the HMD device according to the type of the content, and display the notification on the display.

According to another aspect of the present invention, there is provided a method of operating an HMD (Head Mounted Display) device, comprising: providing content through a display of the HMD device; Obtaining information of the HMD device generated in association with the provision of the content; Displaying, on the display, a notification about whether to stop providing the content using the information of the HMD device; Receiving a provision stop request for the content by the HMD device; And stopping the provision of the content upon receiving a provision stop request for the content.

In a preferred embodiment, the method further includes acquiring biometric information of the wearer in association with the provision of the content, and the step of displaying the notification includes displaying the information of the HMD device and the biometric information And displaying the notification using the display.

In a preferred embodiment, the method further comprises acquiring the environment information of the HMD device in association with the provision of the content, wherein the step of displaying the notification on the display comprises: And displaying the notification on the display using the environment information.

In a preferred embodiment, the method further comprises acquiring personal information of the wearer in connection with the provision of the content, wherein the step of displaying the notification on the display comprises: And displaying the notification on the display.

In a preferred embodiment, the method further comprises the steps of: displaying the notification on the display and then receiving a continuous provisioning request for the content by the HMD device; And continuously providing the content according to receipt of a stoppage of stopping the provision of the content.

In a preferred embodiment, the step of displaying the notification on the display comprises overlapping the notification on the content and displaying it on the display; Inserting the notification between the contents and displaying it on the display; And displaying the notification in a display area different from the display area of the display on which the content is provided.

In a preferred embodiment, the method may further include providing other contents by the HMD device as the provision of the contents is stopped.

In a preferred embodiment, the step of providing the other contents comprises the steps of: displaying information on a plurality of other contents on the display; Receiving a selection signal based on information on the plurality of different contents being displayed; And providing the selected content from the plurality of different contents according to the selection signal.

In a preferred embodiment, the step of displaying the notification on the display may include applying different reference information to the obtained information according to the type of the content to display the notification on the display.

There is provided a computer-readable recording medium having recorded thereon one or more programs including instructions for executing an operation method of an HMD device according to a preferred embodiment of the present invention, And is performed in the same manner as the operation method of one HMD device.

1A is a diagram illustrating an operation method of an HMD (Head Mounted Display) device according to a preferred embodiment of the present invention.
1B is a table explaining a method of acquiring information of the HMD device and a criterion on which notifications are displayed.
1C is a table explaining a method for acquiring biometric information of a wearer and a criterion for displaying a notification.
FIG. 1D is an example of an eye image for explaining a method of acquiring biometric information regarding whether or not the pupil is changed in position.
FIG. 1E is an example of a pupil image for explaining a method of acquiring biometric information about whether a pupil changes. FIG.
1F is a table explaining a method for acquiring the environment information of the HMD device and a criterion for displaying the notification.
1G is a table explaining a method for acquiring personal information of a wearer and a criterion for displaying a notice.
FIG. 1H is a view for explaining a process of acquiring biometric information on whether or not the eye is congested using the eye image obtained by using the camera for acquiring the biometric information.
2A is an outline view of an HMD device referred to in the preferred embodiments.
Figure 2B is another outline view of the HMD device mentioned in the preferred embodiments.
2C is a view for explaining a process of acquiring information for judging whether or not the eye is dry.
3 is another outline view of the HMD device mentioned in the preferred embodiments.
4 is another outline view of the HMD device mentioned in the preferred embodiments.
Figure 5 is another outline view of the HMD device mentioned in the preferred embodiments.
6 is a flowchart illustrating an operation method of the HMD device according to an exemplary embodiment of the present invention.
7 is an example of a screen for explaining the flow chart of Fig.
8A is a diagram for explaining a relationship between a notification frame and an image frame to be displayed.
8B and 8C are examples in which a notification is displayed.
FIG. 9 is a detailed flowchart of step S603 of FIG.
10 is a flowchart illustrating an operation method of an HMD device according to another preferred embodiment of the present invention.
11 is a table showing the relationship between the reference information set in the HMD device and the number of notifications when the acquired information is the reproduction time of the content.
12 is a table showing the relationship between the reference information set in the HMD device and the number of notifications when the acquired information is the battery consumption amount.
13A is a table showing the relationship between the reference information set in the HMD device and the number of notifications when the obtained information relates to the heat generation temperature and includes the heat generation temperature and the maintenance time information.
13B is a table showing the relationship between the reference information set in the HMD device and the number of notifications when the acquired information relates to the heat generation temperature and includes the heat generation temperature.
14 is a table showing the relationship between the reference information set in the HMD device and the number of notifications when the acquired information is information for determining whether or not the eye of the wearer is congested.
FIG. 15 is a table showing the relationship between the reference information set in the HMD device and the number of notifications when the acquired information is information for determining whether or not the wearer's eyes are dry.
Fig. 16 is an operational flowchart for determining whether to display a notification on the display based on the combination of the two pieces of information described above. Fig.
17 is a flowchart illustrating an operation method of an HMD device according to another preferred embodiment of the present invention.
18 is an example of a table for explaining the relationship between the type of content and the reference information.
19 is a flowchart illustrating an operation method of an HMD device according to another preferred embodiment of the present invention.
Figs. 20 to 23 are display examples of the guidance information referred to in the preferred embodiments. Fig.
24 to 29 are examples of other contents mentioned in the preferred embodiments.
30 is a diagram illustrating an eye function or slim function that may be provided by the preferred embodiments.
Figure 31 is an example of an HMD device capable of providing a thermal function that may be provided by the preferred embodiments.
32 is a flowchart for explaining a method of operating an HMD device according to another preferred embodiment of the present invention.
33 shows an example of information on a plurality of selectable contents in a list form.
34 is an example of another screen for displaying information on a plurality of selectable contents.
FIG. 35 is a flowchart illustrating an operation method of an HMD device according to another preferred embodiment of the present invention.
FIG. 36 is a flowchart illustrating an operation method of an HMD device according to another preferred embodiment of the present invention.
37 is a flowchart illustrating an operation method of an HMD device according to another preferred embodiment of the present invention.
FIG. 38 is a flowchart illustrating an operation method of an HMD device according to another preferred embodiment of the present invention.
FIG. 39 is an example of another content providing result.
40 is a flowchart of a method of operating an HMD device according to another preferred embodiment of the present invention.
41 is a flowchart of a method of operating an HMD device according to another preferred embodiment of the present invention.
42 is an example of temporarily stopping the provision of the content and providing a notification including guidance information on other contents.
43 is a view for explaining an operation system of the HMD device.
44 is a flowchart illustrating a method of operating a system according to an exemplary embodiment of the present invention.
45 is a flowchart for explaining a method of operating a system according to another preferred embodiment of the present invention.
46 is a flowchart for explaining a method of operating a system according to another preferred embodiment of the present invention.
47 is a flowchart illustrating a method of operating a system according to another preferred embodiment of the present invention.
48 and 49 are block diagrams of a device according to a preferred embodiment.

BRIEF DESCRIPTION OF THE DRAWINGS The specific embodiments are illustrated and described in detail in the drawings below. It should be understood, however, that the invention is not limited to the specific embodiments described below, but includes all changes, equivalents, and alternatives falling within the spirit and scope of the invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the embodiments of the present general inventive concept, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout.

The terms first, second, etc. may be used to describe various elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. While the terms used throughout the specification have taken into account their function, they have chosen the general terms which are currently widely used, but may vary depending on the intentions, precedents, or emergence of new techniques employed by those skilled in the art. In addition, in certain cases, there may be a term arbitrarily selected by the applicant, in which case the meaning of the selected term will be described in detail. Therefore, terms used throughout the specification should be defined not based on the name of a simple term but on the meaning and meaning of the term throughout the specification.

The singular expressions include plural expressions unless the context clearly dictates otherwise. It is to be understood that the terms "comprises", "having", and the like in the specification are intended to specify the presence of stated features, integers, steps, operations, elements, parts or combinations thereof, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, parts, or combinations thereof. In particular, the numbers set forth in the specification are intended to be illustrative, and the invention should not be limited by the numbers set forth in the specification.

1A is a diagram illustrating an operation method of a head mounted display (HMD) device 100 according to a preferred embodiment of the present invention. Figure 1a shows a notification 103 about whether to stop providing content for content to reduce weariness of the wearer 101 or to protect sight when the content 102 is being provided by the HMD device 100 Yes.

The HMD device 100 has a form that can be worn on the user's head. The HMD device 100 may have the form of glasses. The HMD device 100 may be temporarily fixed on the head of the user by a frame or the like. The HMD device 10 may include a near-to-eye display that displays images within a few centimeters from the user's eyes. The HMD device 100 may be referred to as a wearable computing display system or a smart glass device.

FIG. 2A is an outline view of an HMD device 100 referred to in the preferred embodiments. Referring to FIG. 2A, the HMD device 100 is configured as a single display type or a monopod display type. 2B is a view showing a state in which the positions of the display 212, the camera 206, the microphone 214, the optical output device 213, the biometric information acquiring camera 208, and the temperature sensor 218 shown in FIG. FIG. 2 is an external view of an HMD device 100 '

2A, the HMD device 100 is configured in the form of glasses that are fixed to the face of the wearer 101 through the ears and nose of the wearer 101, but the configuration of the HMD device 100 is not limited thereto. For example, the HMD device 100 may be attached to a helmet structure or modified into a Goggles form.

The HMD device 100 shown in Figure 2A includes a lens frame 201, side-arms 202 and 203, a lens 204, an on-board computer 205, a camera A user input unit 207, a biometric information acquisition camera 208, sensors 209 and 210, a haptic module 211, a display 212, an optical output unit 213, a microphone 214, Output units 215 and 216, a battery 217, and a temperature sensor 218.

Some components included in the HMD device 100 may be embedded in the HMD device 100, and some other components may be mounted outside the HMD device 100. For example, the sensors 209, 210 and the battery 217 may be embedded in the HMD device 100. The display 212 may be mounted to the exterior of the HMD device 100. The components incorporated in the HMD device 100 and the components mounted on the outside of the HMD device 100 are not limited to those described above.

The components included in the HMD device 100 are not limited to those shown in FIG. 2A. For example, the HMD device 100 may not include some of the sensors 209, 210 and the haptic module 211. For example, the HMD device 100 may include only the sensor 210 of the sensors 209, 210 or may mount the sensors at more locations than shown in FIG. 2A.

For example, the HMD device 100 may be equipped with a sweat sensor (not shown) capable of sensing the sweat discharge amount of the wearer 101 at an adjacent position of the sensor 210. The HMD device 100 may mount a body temperature sensor (not shown) capable of sensing the body temperature of the wearer 101 on at least one of the audio output units 215 and 216.

The lens frame 201 and the side legs 202 and 203 may be constructed of a solid such as plastic or / and metal or may be hollowed to include a material such as wiring that may connect the components contained in the HMD device 100 to each other. Can be composed of solid plastic such as hollow plastic or / and metal.

The lens frame 201 and the side legs 202, 203 shown in Fig. 2A are configured as an integral body without a connecting member (not shown). Accordingly, the lens frame 201 and the side legs 202 and 203 may be referred to as one frame of the HMD device 100. [

The structure of the lens frame 201 and the side legs 202, 203 is not limited to that shown in Fig.

For example, the HMD device 100 may include a coupling member (not shown) between the lens frame 201 and the side legs 202, 203. For example, the HMD device 100 may include a coupling member (not shown) between the lens frame 201 and the right side legs 202 and between the lens frame 201 and the left side legs 203 . The side legs 202 and 203 can be folded in the direction of the lens frame 201 when the HMD device 100 includes a connecting member (not shown) as described above.

For example, the HMD device 100 is mounted between the center 201 'of the lens frame 201, between the lens frame 201 and the right side leg 202, between the lens frame 201 and the left side leg 203, And a connecting member (not shown) at each of the centers 202 ', 203' of the side legs 202, 203. When the HMD device 100 includes a connecting member (not shown) as described above, the lens frame 201 and the side legs 202, 203 are folded inwardly on the basis of the respective connecting members, The size of the device 100 can be minimized.

The above-described connecting members, which are not shown, may be configured in the form of a screw assembly, or may be configured in such a manner that a groove is interposed in the groove, but the present invention is not limited thereto.

The side legs 202 and 203 can be configured to extend around the back of the head of the wearer 101 .

A band capable of fixing the side legs 202 and 203 to the head of the wearer 101 when the side legs 202 and 203 are configured to extend around the back portion of the head of the wearer 101 May be added between the side legs 202,203.

The band (not shown) is configured in the form of a force-exerting band or a band-shape capable of adjusting the length so that the side legs 202 and 203 are fixed to the head of the wearer 101 regardless of the size of the head of the wearer 101 .

A preventive member (not shown) is attached to an inner position of the side legs 202, 203 contacting the ear wheel of the wearer 101 to prevent the side legs 202, 203 from slipping or flowing down . The slip or spill preventing member may be made of a material such as silicon, but the material of the slip or spill preventing member is not limited thereto. The slip or spill preventing member may be attached to the inside of the side legs 202, 203 in the form of a pad, but the shape of the slip or fall preventing member is not limited thereto.

The lens frame 201 can be configured so that the lens 204 can be detached. The lens 204 shown in FIG. 2A is constructed integrally with, but not limited to, a nosepiece 204 '. For example, in the case where the lens frame 201 is integral with the nose pads 204 ', the lens 204 may be composed of a right lens 404 and a left lens 405 as shown in FIG. 4 have.

The lens 204 may be constructed of a transparent material from which the wearer 101 can see the real world. The lens 204 may be made of a material that can pass light that is reflected through the display 212. The material that can be used as the lens 204 may include, but is not limited to, for example, plastic such as polycarbonate, or glass. The lens 204 may include at least one of a light reflection and anti-glare coating, an anti-fog coating, and an ultraviolet blocking coating.

The embedded computer 205 may be connected to the HMD device 100 either wired or wirelessly. The embedded computer 205 is located in a part of the left side leg 203 adjacent to the lens frame 201, but is not limited thereto. For example, the embedded computer 205 may be located in a portion of the right side leg 202 as shown in FIG. 2B. The embedded computer 205 may be located in another portion of the HMD device 100, such as another portion of the left side leg 203. [

The built-in computer 205 includes a camera 206, a user input 207, a biometric information acquisition camera 208, sensors 209, 210 and 218, a microphone 214, Lt; RTI ID = 0.0 > 218 < / RTI > The embedded computer 205 may analyze the received data and generate information to be communicated to the wearer 101 of the HMD device 100 via at least one of the display 212 and the audio output 215, Information transmission through the display 212 may be performed through the optical output 213. [

The information to be conveyed to the wearer 101 may include, but is not limited to, at least one of still image, moving image (or video), text, and audio.

The camera 206 may be located outside the left side leg 203 or may be embedded in the left side leg 203. The camera 206 may be mounted at another location of the HMD device 100. For example, the camera 206 may be located at a portion of the right side leg 202, as shown in FIG. 2B. For example, the camera 206 may be located at a portion (e.g., the center) of the lens frame 201. The camera 206 may be, but is not limited to, a camera used in a smart phone or a miniature camera such as a webcam. The camera 206 may be mounted in a position capable of capturing at least a portion of the real world perceived by the wearer 101 of the HMD device 100. [

The user input unit 207 may include, but is not limited to, at least one of a touch pad operable by a finger of the wearer 101 and a button or a switch operable by a push operation of the wearer 101. [ The user input 207 may be located at a portion of the left side leg 203, but may be located at another portion of the HMD device 100. For example, the user input 207 may be located at another portion of the left side leg 203, a portion of the right side leg 202 as shown in FIG. 2B, and a portion of the lens frame 201.

The user input 207 can be used by the wearer 101 to input an instruction. The user input unit 207 may include an on / off switch or an on / off button that can turn on / off the power of the HMD device 100.

The biometric information acquiring camera 208 can capture an eye image or a pupil image of the wearer 101 used for acquiring biometric information based on the eyes of the wearer 101. For example, the eye-based biometric information based on the eye image or the eye image using the eye image or the pupil image is used to determine whether the eye 101 of the wearer 101 is congested, the number of blinks of the eyes of the wearer 101, the blinking period of the eyes of the wearer 101, The position of the pupil of the wearer 101 and the pupil of the wearer 101 may be changed, and the like. However, the present invention is not limited thereto.

The biometric information acquiring camera 208 is provided in a protruding form at the lower right end of the lens frame 201, but the installation form of the biometric information acquiring camera 208 is not limited to this. For example, the biometric information acquiring camera 208 may be embedded in the lens frame 201. The biometric information acquisition camera 208 may be located at any other portion of the HMD device 100. [ The biometric information acquiring camera 208 may be installed at a position where the image sensor can capture an eye image or a pupil image of the wearer 101.

The sensor 209 may be a peripheral environmental sensor capable of sensing the surrounding environment of the HMD device 100. The sensor 209 is located inside the center of the lens frame 201, but is not limited thereto. For example, the sensor 209 may be configured such that an inner portion of the lens frame 201, an outer portion of the lens frame 201, an inner portion of the side legs 202 and 203, And at least one of the outer portions of the side legs 202 and 203, but the installation position and the installation structure of the sensor 209 are not limited to the above-described ones.

The sensor 209 may be a sensor capable of sensing a surrounding environment such as color temperature, light (or ultraviolet), temperature, humidity, wind, altitude, air pressure, fine dust, etc. of the HMD device 100, The possible surroundings are not limited to those just described.

When the sensor 209 is a humidity sensor, the HMD device 100 can acquire biometric information on whether or not the wearer 101 is drying the eye using the sensed value from the sensor 109. [ Therefore, in the case where the sensor 209 is a humidity sensor, the sensor 209 can be operated as a sensor for providing a biometric signal based on the eye of the wearer 101. [

The eye-based bio-signal is used to acquire eye-based bio-information. For example, in the case of a humidity sensor, the eye-based biomedical signal may be expressed in the form of an electrical signal corresponding to the amount of water vapor (g / m 3) per cubic meter of air. The eye-based biometric information may be an electrical signal output from the humidity sensor expressed in gram (g) form.

The sensor 210 may be an HMD device 100 wearing sensor capable of sensing whether the HMD device 100 is worn. The sensor 210 is located inside the right side leg 202 that is in contact with the ear rear surface of the wearer 101, but the position of the sensor 210 is not limited thereto. For example, the sensor 210 may be positioned within the left side leg 203, which is in contact with the back of the ear of the wearer 101, or in a position where the battery 217 is in contact with the back of the ear of the wearer 101 It can be located inside.

The sensor 210 may comprise, for example, a pressure sensor. In the case where the sensor 210 is constituted by a pressure sensor, the sensor 210 may transmit to the built-in computer 205 a sensing value indicating whether or not the pressure is applied and the magnitude of the pressure. Accordingly, the built-in computer 205 can detect the wearing time of the HMD device 100 based on the sensing value received from the sensor 210.

The haptic module 211 is located at a position adjacent to an end inside the left side leg 203 of the HMD device 100 but the mounting position of the haptic module 211 is not limited thereto. For example, the haptic module 211 may be located within a portion of the right side leg 202 or at another point of the HMD device 100.

The haptic module 211 may be made of a material capable of generating various tactile effects that the wearer 101 can feel. For example, the haptic module 211 may include a substance capable of generating a vibration effect, a substance capable of generating a stimulating effect on a contact skin surface, a substance capable of generating a stimulation effect based on injection or inhalation of air, electrode, it is possible to generate a variety of tactile effects such as a substance capable of generating a stimulation effect through contact with the electrode, a substance capable of generating a stimulation effect using electrostatic force, and a substance capable of generating a cold sensing effect using a device capable of endothermic or exothermic But the material used for the haptic module 211 is not limited thereto.

The display 212 is connected to the left side leg 203 of the HMD device 100 and is located at the upper left of the lens 204 but the position of the display 212 is not suggested. For example, the display 212 may be connected to the right side leg 202 to be located in the right center of the lens 204 or to the left side leg 203 to be located in the left center of the lens 204.

The display 212 may be connected to the right side leg 202 as shown in FIG. 2B and positioned at the upper right of the lens 204.

The display 212 of FIG. 2A may be composed of, but is not limited to, a translucent optical waveguide (e.g., a prism). The display 212 can focus the image on the fovea of the retina of the eye of the wearer 101 by reflecting light output from the optical output 213. [

The optical output device 213 may be composed of, for example, a mini projector, but the configuration of the optical output device 213 is not limited thereto.

The microphone 214 can receive sounds of the wearer 101, sounds other than the voice of the wearer 101, and the like.

The audio output units 215 and 216 are configured as earphones which can be mounted on the ear of the wearer 101 of the HMD device 100. However, the configuration of the audio output units 215 and 216 is not limited thereto. The audio output unit 215 is located inside the right side leg 202 so as to be mounted on the right ear of the wearer 101 of the HMD device 100. The audio output unit 216 may be located inside the left side leg 203 so as to be mounted on the left ear of the wearer 101 of the HMD device 100.

The audio output units 215 and 216 may be fixedly attached to the HMD device 100 as shown in FIG. 2A, but the mounting form of the audio output units 215 and 216 is not limited thereto. For example, the audio output units 215 and 216 may be configured to be detachable from the HMD device 100 such that the wearer 101 of the HMD device 100 selectively connects the audio output units 215 and 216 to the wearer 101 The ear can be configured to fit into the ear of the user.

When the audio output units 215 and 216 are detachable to the HMD device 100, the audio output units 215 and 216 are connected to the rear legs 202 and 203 of the wearer 101, It can be located inside. The wearer 101 can insert the audio output portions 215 and 216 from the respective side legs 202 and 203 and then fit into the ear of the wearer 101. [

When the audio output units 215 and 216 are removed from the respective side legs 202 and 203 and inserted into the ear of the wearer 101, the audio output units 215 and 216 are connected to the HMD device 100, .

A connection line (not shown) between the audio output units 215 and 216 and the HMD device 100 is connected to the audio output units 215 and 216 (not shown) when the audio output units 215 and 216 are connected to the HMD device 100 by wire, May be embedded in the HMD device 100 when the HMD device 100 is mounted on the HMD device 100.

When the audio output units 215 and 216 are wirelessly connected to the HMD device 100, the audio output units 215 and 216 can communicate with the HMD device 100 based on the near field wireless communication. A communication module (not shown) capable of performing close-range communication with the audio output units 215 and 216 and the built-in computer 205 when the audio output units 215 and 216 and the HMD device 100 are wirelessly connected, ) May be included.

The HMD device 100 may include a coupling member (not shown) based on an elastic material (e.g., a spring) between the audio output units 215, 216 and the HMD device 100. In this case, the connecting member based on the elastic material can be changed in shape depending on the position of the ear of the wearer 101.

For example, the connecting member may be modified to tilt the audio output units 215 and 216 in at least one of the east, west, south, north, east, south, south, It can be deformed according to rotation.

When the HMD device 100 includes a coupling member (not shown) based on elastic materials between the audio output units 215 and 216 and the HMD device 100, the audio output units 215 and 216 and the HMD device 210 may be configured to be able to communicate by wire or wireless.

The audio output units 215 and 216 may be configured as bone conduction speakers. According to the preferred embodiments, the audio output units 215 and 216 can output a notification as to an audio signal as to whether or not to stop providing contents.

A body temperature sensor (not shown) capable of sensing the body temperature of the wearer 101 may be mounted on at least one of the audio output units 215 and 216. The sensed values output from the body temperature sensors mounted on the audio output units 215 and 216 may be transmitted to the built-in computer 205. The built-in computer 205 can obtain body temperature information of the wearer 101 using the received sensed value.

The battery 217 is embedded in the end of the right side leg 102 of the HMD device 100, but the position where the battery 217 is embedded is not limited thereto. For example, the battery 217 may be embedded at the end of the left side leg 103 of the HMD device 100. A connector or a port capable of charging the battery 217 by connecting an external power supply device (not shown) and the battery 217 at a position adjacent to the position where the battery 217 is installed can be mounted.

The battery 217 may be embedded in a removable frame on the right side leg 202 of the HMD device 100. The frame incorporating the battery 217 may include a connector or port capable of connecting the external power supply device (not shown) and the battery 217 to charge the battery 217.

The temperature sensor 218 may be mounted at a position adjacent to the built-in computer 205 of the HMD device 100 to sense the heat generation temperature of the HMD device 100. The sensing value output from the temperature sensor 218 may be transmitted to the built-in computer 205. The embedded computer 205 can acquire the heat generation temperature of the HMD device 100 using the received sensing value. The position of the temperature sensor 218 is not limited to the above-described one.

2C is a view for explaining a process of acquiring information for judging whether or not the eye is dry. The HMD device 100 can receive sound generated when the eyes are dried from an electronic patch 219 containing a built-in microphone as shown in FIG. 2C. The electronic patch 219 may include a communication module (not shown) capable of wireless communication with the HMD device 100. The communication module (not shown) can communicate with the HMD device 100 based on a short-distance communication method such as NFC, Bluetooth, and infrared.

The HMD device 100 can execute the application for the electronic patch 219 as a background application when reproducing the content in order to receive sound generated when the eyes are dried through the electronic patch 219. [ The electronic patch 219 may be attached at a position adjacent to the eyes of the wearer 101. [ Due to the attachment position of the electronic patch 219, the microphones built in the electronic patch 219 can block the sound around the wearer 101 and the voice of the wearer, and can receive sound generated when the eyes are dry.

The HMD device 100 according to the preferred embodiment can be configured as the HMD device 300 shown in FIG. 3 is an HMD device 300 having an eye lens 303, which is configured as a single display form or a monopod display form as shown in FIG. 2A.

3, an HMD device 300 according to another preferred embodiment is in the form of a binocular eyeglass fixed to the face of the wearer 101 through the left ear of the wearer 101 and the left side of the nose of the wearer 101 The configuration of the HMD device 300 is not limited to this.

For example, the HMD device 300 may be configured in the form of a binocular eyeglass that is secured to the face of the wearer 101 via the right ear of the wearer 101 and the right side of the nose of the wearer 101. The HMD device 300 may be attached to a helmet structure.

The HMD device 300 includes a lens frame 301, a side-arm 302, a lens 303, an on-board computer 304, a camera 305, a user input 306, A haptic module 310, a display 311, an optical output unit 312, a microphone 313, an audio output unit 314, And a battery 315.

The components included in the HMD device 300 are not limited to those shown in FIG. For example, the HMD device 300 may not include some of the sensors 308, 309, 316, and the haptic module 310. For example, the HMD device 300 may include only the sensor 309 of the sensors 308, 309, 316 or may be mounted with more sensors than those shown in FIG. For example, the HMD device 300 may be equipped with a sweat sensor for sensing the sweat discharge amount of the wearer 101, a body temperature sensor for sensing the body temperature of the wearer 101, etc., as mentioned in FIG.

The lens frame 301 may be configured to detachably attach the lens 303 as described with reference to FIG. The HMD device 300 may include a connecting member between the lens frame 301 and the side legs 302 as described in FIG. The HMD device 300 may include a connecting member (not shown) at the center of the side leg 302 as described in FIG.

A lens 303, an on-board computer 304, a camera 305, a user input unit 306, a bio-information acquiring camera 307, sensors 308 and 308 included in the HMD device 300, The haptic module 310, the display 311, the optical output unit 312, the microphone 313, the audio output unit 314 and the battery 315 are connected to the lens 204 shown in Fig. An on-board computer 205, a camera 206, a user input unit 207, a biometric information acquisition camera 208, sensors 209, 210 and 218, a haptic module 211, And may similarly be configured and located similarly to the light source 212, the optical output device 213, the microphone 214, the audio output units 215 and 216, and the battery 217. In particular, the sensor 308 may correspond to the sensor 209. The sensor 309 may correspond to the sensor 210. The sensor 316 may correspond to the sensor 218. The position and configuration of the components included in the HMD device 300 are not limited to those described above.

The HMD device 100 used in the preferred embodiments may be configured as the HMD device 400 shown in FIG. The HMD device 400 shown in Fig. 4 is configured in the form of a biometric display. The HMD device 400 may be attached to a helmet structure or deformed into a goggle shape.

The HMD device 400 shown in Figure 4 includes a lens frame 401, side-arms 402 and 403, lenses 404 and 405, an on-board computer 406, A camera 407, a user input unit 408, a bio-information acquiring camera 409, sensors 410, 411 and 419, a haptic module 412, displays 413 and 414, a microphone 415, Audio output units 416 and 417, and a battery 418. [

The lens frame 401 included in the HMD device 400 shown in FIG. 4 is configured integrally with the nose pad 401 '. The lens frame 401 may have any one of various shapes such as a rectangular shape, an elliptical shape, and a circular shape, but the structure of the lens frame 401 is not limited thereto. The lens frame 401 may be made of a material similar to the lens frame 201 mentioned in Fig.

Lenses 404 and 405 may be constructed of any material suitable for displaying information, such as images or graphics, projected through an unillustrated light output device (projector referred to in FIG. 2A). Lenses 404 and 405 are used to illuminate the wearer 101 of the HMD device 400 with an image or graphic that is projected through the optical < RTI ID = 0.0 > And the like can be superimposed on each other. The material constituting the lenses 404 and 405 may be composed of plastic or glass, but not limited thereto, such as the material constituting the lens 204 mentioned in FIG. 2A.

Side-arms 402 and 403 shown in FIG. 4, an on-board computer 406, a camera 407, a user input unit 408, a bio-information acquiring camera 409, The sensors 410, 411 and 419, the haptic module 412, the microphone 415, the audio outputs 416 and 417 and the batteries 418 are connected to side-arms A camera 202, a user input unit 207, a biometric information acquisition camera 208, sensors 209, 210 and 218, a haptic 209, The module 211, the microphone 214, the audio output units 215 and 216, and the batteries 217, but the functions and configurations thereof may be similar. In particular, the sensor 410 may correspond to the sensor 209. The sensor 411 may correspond to the sensor 210. The sensor 419 may correspond to the sensor 218. The configuration and position of components included in the HMD device 400 are not limited to those described above.

The displays 413 and 414 shown in Figure 4 can display information such as images or graphics projected by optical projectors (not shown) mounted on the inner surfaces of the respective side legs 402 and 403 . The optical output devices (not shown) may be configured as, but not limited to, the optical output device 213 of FIG. 2A.

The HMD device 400 shown in FIG. 4 may be modified to operate the lenses 404, 405 as a display. In this case, the lenses 404 and 405 may be composed of a transparent display or a translucent display. When the lenses 404 and 405 are configured as a translucent display, the lenses 404 and 405 may include at least one optical waveguide (e.g., a prism), an electroluminescent display, or a liquid crystal display ), And the like, but are not limited thereto.

When the lenses 404 and 405 are configured as transparent displays, the above-described optical output devices (not shown) are not mounted on the HMD device 400 and information generated by the embedded computer 406 is transmitted to the lens 404 , ≪ / RTI > 405). Transparent display refers to a display with a certain degree of transparency of the display itself so that the back of the screen is visible.

The HMD device 100 referred to in the preferred embodiments can be configured as the HMD device 500 shown in FIG. The HMD device 500 shown in Fig. 5 is configured in the form of a stereoscopic display. The HMD device 500 may be modified into a helmet structure.

The HMD device 500 shown in Fig. 5 includes a frame 501 made of a plastic material, two independent displays 502 and 503 located adjacent to the eye of the wearer 101 inside the frame 501, a frame 501 A battery pack 506 connected to the frame 501 in a wired manner and a head 506 for fixing the HMD device 500 to the head of the wearer 101. The user input part 504, the earphone 505, A fixed band 507, a computer 508 embedded in the frame 501, a biometric information acquiring camera 510, and sensors 509, 511, and 512. The HMD device 500 may be modified to incorporate a battery.

The displays 502 and 503 may use a display such as an HD (High Definition) OLED (Organic Light Emitting Diodes) panel, but are not limited thereto. The displays 502 and 503 may be configured to view 2D content and 3D content.

The user input unit 504 is configured in the form of at least one of a power on / off button, a menu selection button, an adjustment button, a position control switch of the displays 502 and 503, a push operation based button including a volume switch, The configuration of the memory 504 is not limited thereto. For example, the user input unit 504 may comprise a touch panel.

The battery pack 506 may include a communication module capable of receiving content wirelessly and an interface capable of receiving contents by wire. The interface may include, but is not limited to, an HDMI (High Definition Multimedia Interface) port. The battery pack 506 may be connected to the HMD device 500 wirelessly.

The sensor 509 is located inside the head fixing band 507 and can perform the same function as the sensor 210 of FIG. 2A. The biometric information acquiring camera 510 is located at the upper end of the left display 503 and can perform the same function as the biometric information acquiring camera 208 of FIG. The sensor 511 is located on a part of the upper surface of the frame 501 and can perform the same function as the sensor 209 of FIG. 2A. The sensor 512 may be mounted adjacent to the embedded computer 508 to sense the heat generation temperature of the HMD device 500.

The positions of the biometric information acquiring camera 510 and the sensors 509, 511, and 512 are not limited to those described above. The biometric information acquiring camera 510 and the sensors 509, 511 and 512 may be located at different positions from the above-described positions of the HMD device 500. For example, the biometric information acquisition camera 510 may be located adjacent to the right display 502.

The haptic module 211, the microphone 214, and the like shown in FIG. 2A may be additionally mounted on a part of the HMD device 500. FIG. The HMD device 500 can be mounted on the top of the frame 501 with a forehead support (not shown) for supporting the weight of the HMD device 500. [ The HMD device 500 may include a body temperature sensor for sensing the body temperature of the wearer 101 mentioned in FIG. 2A, a sweat sensor for sensing the sweat discharge amount of the wearer 101, and the like.

The embedded computers 205, 304, 406 and 508 referred to in FIGS. 2A, 2B and 3 to 5 may include a controller (or processor) and a memory, but the embedded computers 205, 304, 406 and 508 ) Are not limited thereto. The control unit and the memory will be described in detail in Figs. 48 and 49 below. The embedded computers 205, 304, 406, and 508 can control all the functions of the respective HMD devices 100, 100 ', 300, 400, and 500.

The HMD devices 100 ', 300', 400 and 500 shown in FIG. 2B, FIGS. 3 to 5 and the HMD devices 100, 100 ', 300 and 400 described in FIGS. 400, and 500 may receive sounds obtained by the microphones included in the electronic patch 219, as described in FIG. 2C, based on wireless communications.

Although preferred embodiments will be described based on the HMD device 100 shown in FIG. 2A, the preferred embodiments are the same as the HMD devices 100 ', 300, 400, 500 shown in FIG. 2B, ), And variations of the HMD devices 100, 100 ', 300, 400, 500 described in FIGS. 2A, 2B and 3 to 5.

In FIG. 1A, the content 102 may be provided (or reproduced) in accordance with a playback command of the wearer 101 of the HMD device 100. For example, the HMD device 100 may provide the game image 102 reproduced according to the game play command of the wearer 101 through the display 212 as the screen 110 shown in FIG. 1A. An audio signal reproduced together with the game image 102 may be provided through the audio output units 215 and 216. [

The content provided by the HMD device 100 is not limited to the game image 102 shown in FIG. 1A. For example, the content provided by the HMD device 100 may include content requested to be provided based on the application installed in the HMD device 100. [

An application installed in the HMD device 100 can be used for various applications such as a video player application, an album application, a camera application, a DMB (Digital Multimedia Broadcasting) application, a map application, a browser application, an application store application, But are not limited to, weather applications, calendar applications, instant messenger applications, phone book applications, e-mail applications, content sharing applications, and e-book applications.

An application referred to throughout the specification refers to a program that can perform an object task using the HMD device 100. [ For example, an e-mail application is a program for sending and receiving e-mail, and managing the e-mail to be transmitted and received. The content referred to throughout the specification may be provided in the form of at least one of still image, moving image, audio, text, and multimedia, but is not limited thereto.

When content is being provided by the HMD device 100, the HMD device 100 stores the information of the HMD device 100 generated in association with the content provision, the biometric information of the wearer 101, The environment information, and the personal information of the wearer 101 can be acquired.

The information of the HMD device 100 may include information based on the operation of the HMD device 100. For example, the information of the HMD device 100 may include, but is not limited to, information based on at least one of the playback time of the content, the battery consumption of the HMD device 100, and the heating temperature of the HMD device 100 .

The method of acquiring the information of the HMD device 100 may be as described in the table shown in FIG. 1B, but is not limited thereto. 1B is a table explaining a method of acquiring information of the HMD device 100 and a criterion on which the notification 103 is displayed. The numerical values shown in Fig. 1B are merely examples, and preferred embodiments are not limited thereto.

Referring to FIG. 1B, the playback time of the content may be obtained in association with the content provision by the HMD device 100. [ For example, after the wear of the HMD device 100 is sensed by the wear sensor 210, the HMD device 100 counts the time counted while the playback of the content is started from the playback time Pt of the content, ). Associating with the content provision means that it is related to the content reproduction operation.

Referring to FIG. 1B, the amount of battery consumption of the HMD device 100 may be obtained in association with content provision by the HMD device 100. For example, after the wear of the HMD device 100 is sensed by the wear sensor 210, the HMD device 100 acquires the battery remaining amount detected as the reference battery remaining amount Brq1 while the reproduction of the content is started. The HMD device 100 periodically detects the remaining battery level Brq2 and stores the difference (D = Brq2-Brq1) between the remaining battery level of the reference battery and the remaining battery level detected periodically in the battery consumption amount of the HMD device 100 As shown in FIG. The battery remaining amount can be detected using the discharge current and voltage of the battery 217. [

Referring to FIG. 1B, the heat generation temperature of the HMD device 100 may be obtained in association with content provision by the HMD device 100. For example, the HMD device 100 senses that the wear of the HMD device 100 is sensed by the wear sensor 210, and after the playback of the content starts, the content is detected using the temperature sensor 218 It is possible to obtain the temperature T as the heat generation temperature of the HMD device 100.

The exothermic temperature may be updated each time the sensed value of the temperature sensor 218 is received. The HMD device 100 periodically operates the temperature sensor 218 to receive the sensing value of the temperature sensor 218 or continually monitor the sensing value of the temperature sensor 218 to acquire the heating temperature can do.

The information of the HMD device 100 as described above may be obtained using a sensing value by at least one sensor (e.g., a temperature sensor 218) mounted on the HMD device 100, but is not limited thereto . For example, the amount of battery consumption may be obtained using the discharge current and voltage of the battery 217. [

The method of acquiring the information of the HMD device 100 is not limited to that shown in FIG. 1B. For example, the information of the HMD device 100 can be acquired based on the content playback start point regardless of the sensing value of the wear sensor 210. [

When the sensing value indicating the wearing state is received from the wearing sensor 210 regardless of the starting point of content reproduction, the battery consumption amount can be periodically monitored and the battery consumption amount can be acquired using the difference between the remaining battery remaining amounts . When the battery consumption is thus obtained, the time when the reference battery remaining amount Brq1 is detected is the time when the wear is sensed by the sensing value of the wear sensor 210. [

The heating temperature may be obtained by monitoring the output value of the temperature sensor 218 periodically when the sensing value indicating the wearing state is received from the wearing sensor 210 regardless of the starting point of the content reproduction.

The method of acquiring the biometric information of the wearer 101 may be as described in the table shown in Fig. 1C, but is not limited thereto. 1C is a table explaining a method for acquiring biometric information of the wearer 101 and a criterion for displaying the notification 103. Fig. The numerical values set forth in FIG. 1C are merely examples, and preferred embodiments are not limited thereto.

1C, the biometric information of the wearer 101 may include at least one of at least one biometric information based on the eyes of the wearer 101 and the health information of the wearer 101, but is not limited thereto.

At least one piece of biometric information based on the eyes of the wearer 101 includes information indicating whether or not the eye is congested, whether the eye is dry, the number of blinks of the eyes, the blink period of the eyes, whether the pupil is changed in position, But the at least one eye-based biometric information is not limited thereto.

At least one biometric information based on the eyes of the wearer 101 can be acquired using the biometric information acquisition camera 208 mounted on the HMD device 100, the sensor 209 and the external electronic patch 219 But are not limited to. For example, the health information of the wearer 101 can be obtained using a sensor mounted on an external device.

The biometric information related to whether or not the eye is congested is sensed by the wear of the HMD device 100 by the sensed value of the wear sensor 210 and then the eye image acquired by the biometric information acquiring camera 208, Can be obtained using the color distribution diagram of FIG. The color distribution of the eye image may include, but is not limited to, a value indicating the ratio of pixels having an R value close to 255 in the total pixels included in the eye image. The R value close to 255 may mean, for example, that the R value is 240 or more, but is not limited thereto.

FIG. 1H is a diagram for explaining a process of acquiring biometric information on whether or not the eye is congested using the eye image obtained using the biometric information acquiring camera 208. FIG. The biometric information acquiring camera 208 may periodically acquire the eye image when the content reproduction is started by the HMD device 100 and while the content is being reproduced as shown in FIG. The HMD device 100 compares the color distribution diagram of the eye image 115 acquired when the content starts to be reproduced with the color distribution diagram of the eye image 116 obtained periodically while the content is reproduced have. The HMD device 100 can acquire the result of judging whether or not the eye is congested as biometric information related to whether or not the eye is congested.

The biometric information about the dryness of the eye is obtained by sensing the wearing of the HMD device 100 by the sensing value of the wear sensor 210 and then using a value indicating the humidity sensed by the sensor 209 But not limited to, For example, biometric information on whether or not the eyes are dry may be obtained by sensing the wearing of the HMD device 100, and when the content reproduction is started, an electrical signal for the sound received from the electronic patch 219, And may be obtained using the eye image acquired by the camera 208. [

The biometric information on the number of blinks of eyes and the blink cycle of eyes is sensed when the wear of the HMD device 100 is sensed by the sensed value of the wear sensor 210 and then the biometric information acquisition camera 208 (For example, 1 second) by comparing the acquired eye images with each other.

The biometric information about whether or not the pupils are changed is sensed by the sensing value of the wear sensor 210 and the HMD device 100 is worn by the biometric information acquiring camera 208, (For example, a content reproduction time) or by comparing eye images acquired in units of a predetermined time (for example, 30 minutes).

1D is an eye image 104 for explaining a method of acquiring biometric information about whether or not the pupil is changed in position. 1D, each time the eye image 104 as shown in FIG. 1D is acquired by the biometric information acquiring camera 208, the HMD device 100 acquires the eye image 104 The eye region 105, the pupil region 106, and the center point 107, respectively. The eye recognition algorithm may include an edge detection algorithm. The HMD device 100 can compare the position of the center point 107 detected in each eye image 104 to acquire biometric information on whether or not the pupil position is changed.

The eye recognition algorithm detects the eye area 105 by the outline algorithm and detects a line segment 110 connecting the points 108 and 109 on the eye area 105 and detects a line segment 111 bisecting the line segment vertically And the point where the detected line segments 110 and 111 intersect can be detected as the center point 107, but the eye recognition algorithm is not limited thereto.

The biometric information about the change of the pupil is sensed by the sensing value of the wear sensor 210 and then the content reproduction is started. For example, a content reproduction time) or a predetermined time (for example, 30 minutes).

FIG. 1E is a pupil image 112 for explaining a method of acquiring biometric information about whether a pupil changes. 1E, every time the pupil image 112 as shown in FIG. 1E is acquired by the biometric information acquiring camera 208, the HMD device 100 acquires the pupil image 112 The diameter 114 of the pupil region 113 and the pupil region 113 are detected. The HMD device 100 compares the pupil area 113 detected by each pupil image 112 with the diameter 114 of the pupil area 113 to obtain biometric information related to the pupil change.

The method of acquiring biometric information regarding whether the pupil is changed is not limited to the above-described one. For example, it is possible to compare the width of the pupil region 113 included in each pupil image 112 to obtain biometric information on whether the pupil changes. The radius of the pupil region 113 can be detected by detecting the radius using the diameter 114 of the pupil region 113 and applying the detected radius to an equation for obtaining the circle width.

The biometric information based on the eyes of the wearer 101 is not limited to the above-mentioned ones. For example, the biometric information based on the eyes of the wearer 1010 can be obtained based on the point at which the content reproduction starts, regardless of the sensed value of the wear sensor 210. [

Health information of the wearer 101 can be acquired in association with content provision by the HMD device 100. [ For example, after the wear of the HMD device 100 is sensed by the sensed value of the wear sensor 210, the HMD device 100 starts to reproduce the content after the biosensor (not shown) mounted on the HMD device 100 (For example, a body temperature sensor mounted on one of the audio output units 215 and 216) or a biosensor mounted on an external device (not shown) Body temperature). The biosensor may include, but is not limited to, a body temperature sensor, a sweat sensor, a blood pressure sensor, a pulse sensor, a blood glucose sensor, and the like.

The health information of the wearer 101 is detected by sensing the sensed value of the biosensor when the content starts to be reproduced, periodically detecting the sensed value of the biosensor, comparing the detected sensed value, As health information of the patient.

Health information on sweat discharge amount, blood pressure, pulse, blood sugar, etc. of the wearer 101 can be obtained as well as health information on the above-described body temperature.

Information about the amount of activity of the wearer 101 (e.g., the travel distance of the wearer 101, the travel speed of the wearer 101, the calorie consumption of the wearer 101, etc.) (E. G., An activity measurement device of the wearer 101, such as a communicable pedometer, a treadmill, etc.) of the healthcare application or HMD device 100. [

After the wearing of the HMD device 100 is sensed, the amount of activity of the wearer 101 can be obtained, but is not limited thereto, when the reproduction of the content is started. For example, when the reproduction of the content is started irrespective of the sensed value of the wearing sensor 210, the amount of activity of the wearer 101 can be obtained. In addition, the amount of activity of the wearer 101 is obtained when the reproduction of the content is started, and the amount of activity of the wearer 101 obtained at the start of the reproduction of the content is compared with the amount of activity of the wearer 101, So that the amount of change in the activity of the wearer 101 can be obtained as information on the amount of activity of the wearer 101. [

When the contents of the HMD device 100 are reproduced after the wearing of the HMD device 100 is sensed, the HMD device 100 accesses the information management server, such as the medical information management server, ≪ / RTI > Medical information can include, but is not limited to, past medical history information, current medical history information, and the like, for example.

The method of acquiring the environment information of the HMD device 100 may be as described in the table shown in FIG. 1F, but is not limited thereto. 1F is a table for explaining a method for acquiring the surrounding information of the HMD device 100 and a criterion for displaying the notification 103. Fig. The numerical values set forth in Fig. 1F are merely examples, and preferred embodiments are not limited thereto.

1F, the ambient environment information of the HMD device 100 may include information about the surrounding color temperature, light (or ultraviolet), temperature, humidity, wind, altitude, air pressure, But is not limited thereto.

The surroundings information of the HMD device 100 is sensed when the wear of the HMD device 100 is sensed by the sensed value of the wear sensor 210 and when the content starts to be reproduced, But is not limited to, the sensing value of the sensor 209 or the sensing value of at least one sensor mounted on an external device (e.g., a smart watch, etc.) connected to the HMD device 100. [

For example, the ambient environment information of the HMD device 100 can be acquired at the time when the content is reproduced regardless of the sensed value of the wear sensor 210. The ambient environment information of the HMD device 100 may be acquired using an environment information providing application that provides environment information based on the physical location of the HMD device 100. [ The environment information providing application can receive environment information from the environment information providing server by connecting the HMD device 100 and the environment information providing server (not shown).

The method of acquiring the personal information of the wearer 101 may be as described in the table shown in Fig. 1G, but is not limited thereto. 1G is a table explaining a method for acquiring the personal information of the wearer 101 and a criterion for displaying the notification 103. Fig.

Referring to FIG. 1G, the personal information of the wearer 101 may include, but is not limited to, at least one of age information and schedule information.

The age information of the wearer 101 may request the wearer 101 to input age information when the content starts to be reproduced after the wear of the HMD device 100 is sensed by the sensing value of the wear sensor 210, Can be acquired as age information of the wearer (101). The method of acquiring the age information of the wearer 101 is not limited to this. For example, when the reproduction of the content starts, the life log information of the wearer 101 stored in the HMD device 100, the life log information stored in an external device (not shown) of the HMD device 100, Management software), and acquires the information received in response to the request as the age information of the wearer 101. The age information of the wearer 101,

The schedule information of the wearer 101 is stored in the HMD device 100 after the wear of the HMD device 100 is sensed by the sensing value of the wear sensor 210 Log information, life log information stored in an external device (not shown) of the HMD device 100, or schedule information having information related to content currently being played back by PIMS (Personal Information Management Software) As the schedule information of the wearer (101).

The information related to the currently reproduced content may include, but is not limited to, the schedule information of the wearer 101 having the time information before or after the content reproduction. For example, it is possible to request the wearer 101 to input a schedule before reproducing the content, and to obtain the information inputted in accordance with the request as the schedule information of the wearer 101.

The personal information of the wearer 101 can be acquired in association with the content reproduction start point regardless of the sensed value of the wear sensor 210. [

The HMD device 100 may display the notification 103 about whether or not to stop providing the contents as shown in the screen 120 of FIG. 1A using the obtained information. The notification 103 regarding the stoppage of the provision of the content means notifying the wearer 101 of the stoppage of the provision of the content provided by the HMD device 100. [

The notification 103 regarding whether or not to stop providing contents can be provided for preventing or solving a problem that may be caused to the wearer 101 by continuously providing the content by the HMD device 100. [

For example, in order to alleviate the eye fatigue of the wearer 101 viewing the content provided by the HMD device 100, the HMD device 100 displays a notification 103 about whether to stop providing the content .

Mitigating the eye fatigue of the wearer 101 referred to in the preferred embodiments can be variously expressed on the basis of the effects that can be provided to the wearer 101. For example, relieving eye fatigue of the wearer 101 may include relieving tension and fatigue of the eyes of the wearer 101, protecting the eyesight of the wearer 101, relieving the stress of the wearer 101 Stabilizing the mind, improving the concentration of the wearer 101, and the like. The various expressions for relieving eye fatigue of the wearer 101 are not limited to the above-mentioned ones.

The HMD device 100 can set the reference information to determine whether to display the notification 103 about whether or not to stop provisioning the content using the acquired information. The reference information may be different according to the information obtained by the HMD device 100.

Referring to FIG. 1B, when the obtained information is the reproduction time Pt of the content, the reference information may be set as the time information. The time information set as the reference information takes into account the time at which fatigue of the eye of the wearer 101 is predicted to accumulate.

For example, if the playback time Pt is greater than or equal to two hours (2H), the HMD device 100 may display the notification 103 on the display 212 as shown in screen 120 of FIG. have. The reference information for the reproduction time Pt of the content is not limited to two hours. For example, the reference information for the playback time Pt of the content may include at least one time information such as 3 o'clock, 3 hours and 30 minutes, and so on.

Referring to FIG. 1B, when the acquired information is battery consumption, the reference information may be set to ratio information (for example, 50%). The reference information considers the amount of battery consumption predicted to cause eye fatigue of the wearer 101. The amount of battery consumption can be detected in such a manner as to detect difference information between remaining battery levels. For example, when the remaining battery level detected when the content starts to be reproduced is 90% and the remaining battery level detected while reproducing the content is 40%, the battery consumption amount can be detected as 50%.

When the battery consumption is 50% or more when the reference information is set to 50%, the HMD device 100 displays the notification 103 on the display 212 as shown in the screen 120 of FIG. 1 . The baseline information on battery consumption is not limited to 50%. For example, the baseline information for battery consumption may include at least one percentage information (%) such as 40%, 45%, and the like.

Referring to FIG. 1B, if the obtained information relates to the exothermic temperature and includes information on the exothermic temperature and the retention time, the reference information may be set to include temperature and retention time information. The reference information is based on the heat generation temperature at which the eye fatigue of the wearer 101 is expected to accumulate and the time at which the heat generation temperature is maintained.

For example, if the exothermic temperature is maintained at 49 占 폚 for more than one hour, the HMD device 100 may display the notification 103 on the display 212 as shown in the screen 120 of Fig. In order to detect the holding time of the heating temperature, the HMD device 100 counts the time from when the heating temperature is detected at 49 占 폚.

The reference information for the exothermic temperature is not limited to this. For example, the reference information for the exothermic temperature may include at least one exothermic temperature and retention time information, such as maintained at 49 DEG C for at least 2 hours or at 50 DEG C for 1 hour and 30 minutes. The reference information of the exothermic temperature is not limited to 49 캜.

Referring to FIG. 1B, when the obtained information relates to the exothermic temperature and includes the exothermic temperature, the reference information may be set to include the temperature. The reference information takes into account the heat generation temperature at which fatigue of the eyes of the wearer 101 is expected to accumulate. At this time, the period of receiving the sensed value by the temperature sensor 218 may be set in consideration of eye fatigue of the wearer 101. [ For example, the HMD device 100 may receive a sensing value by the temperature sensor 218 every 30 minutes. The HMD device 100 can display the notification 103 on the display 212 when the sensed value by the temperature sensor 218 received at 30 minute intervals is 49 占 폚.

Referring to FIG. 1C, when the acquired information is information on whether or not the wearer 101 has eye irritation, the reference information may include information indicating whether the number of pixels adjacent to the R value 255 (for example, pixels having an R value of 241 or more) Information about the growth rate (for example, 40%). The rate of increase in the number of pixels adjacent to the R value of 255 is determined by the number of pixels whose R value is included in the eye image detected when the content starts reproducing and the R value included in the eye image detected while the content is being reproduced The number of pixels adjacent to 255 can be compared to detect the difference, and it can be detected by the detected difference. 1C, if the rate of increase of the number of pixels adjacent to the R value of 255 is 40% or more, the HMD device 100 displays the notification 103 on the display 212 as shown in the screen 120 of FIG. 1A, Can be displayed on the screen.

The reference information for detecting whether or not the eye is congested is not limited to the above-mentioned one. For example, the reference information may be set to determine if the number of pixels adjacent to R value 255 is greater than or equal to 50% of the total number of pixels. When the reference information is set, the HMD device 100 acquires the eye image using the camera 208 for acquiring the biological information at predetermined time intervals when the content starts to be reproduced, It is checked whether the number of pixels adjacent to the R value 255 is 50% or more of the total number of pixels. If the number of pixels adjacent to the R value 255 included in the acquired eye image is 50% or more of the total number of pixels, (S) 103 can be displayed on the display 212.

Further, the reference information for detecting whether or not the eye is congested can be set based on the number of pixels having an R value of 255.

1C, when the obtained information is information on whether or not the eye of the wearer 101 is dry and the sensor 209 is used, the reference information includes humidity information (for example, 30%) and holding time information For example one hour). For example, the HMD device 100 monitors the sensing value of the sensor 209 on a predetermined time basis when the content starts to be reproduced. The HMD device 100 can display the notification 103 on the display 212 if it is determined that the sensed value of the sensor 209 is held at 30% or less for more than one hour. The HMD device 100 may count the time from when the sensing value of the sensor 9209 is detected to be 30% or less.

The reference information for judging whether or not the eye is dry is not limited to the above-mentioned one. For example, it may be set to be maintained for 2 hours or more at a humidity of 30% or less, for 1 hour and 30 minutes or less at a humidity of 29% or less, and the like. The reference information for determining whether the eyes are dry can be set based on the amount of change in humidity. For example, if the amount of change in humidity is detected to decrease by more than 20%, the reference information can be set to display the notification 103 on the display 212.

The humidity included in the reference information for determining whether or not the eyes of the wearer 101 are dry can be set differently according to the average humidity of the environment in which the HDM device 100 is used.

1C, the reference information for detecting whether or not the eye is dry can be obtained by an electrical signal for the sound received from the microphones included in the electronic patch 219 shown in FIG. 2C, 208 may be used to determine whether the eyes are dry or not.

For example, when the amplitude of the electrical signal for the sound received from the electronic patch 219 at the same time as the blinking of the eye is detected by the eye image acquired by the biological information acquiring camera 208, (For example, 30 minutes) longer than the amplitude of the electrical signal for the sound received from the electronic patch 219 at the time when the eye flicker is not detected by the HMD device 100 May be set to display the notification 103 on the display 212. [ The electrical signal can indicate the magnitude level of the sound. In order to detect blinking of eyes, the eye image acquired by the biological information acquiring camera 208 may be composed of a moving image continuously captured for a predetermined period of time.

Referring to FIG. 1C, the reference information on the number of blinks of the eyes may be set to 9 or less per minute. For example, when the content reproduction is started by the HMD device 100, the eye blinking frequency per minute is detected using the eye image acquired by the biological information acquiring camera 208, and the number of blinking times per minute is 9 times or less per minute The HMD device 100 may display the notification 103 on the display 212, The eye image acquired by the biometric information acquiring camera 208 to detect the number of times of blinking of the eye may be composed of a moving image continuously captured for a predetermined time.

The reference information regarding the number of blinking times of eyes is not limited to the above-mentioned one. For example, the reference information may be set such that the notification 103 is displayed on the display 212 in a situation where the state in which the number of blinks of eyes is 9 or less per minute is maintained for 30 minutes or more. The reference information can set the number of eye blinks per minute to 6 or less.

Further, the reference information on the number of blinks of the eyes can be set based on the amount of change in the number of blinks of the eyes. For example, if the blinking number of eyes detected from the eye image acquired by the camera 208 for acquiring the biological information at regular intervals during the content reproduction period is compared, if the variation of the blinking number of eyes is 15% or more, The reference information on the number of blinks of eyes can be set so that the user 100 can display the notification 103 on the display 212. [ The amount of change in the number of blinks of the eyes may include both the case where the number of blinks of the eyes increases and the case where the number of blinks decreases.

Referring to FIG. 1C, the reference information on the blink period of the eyes may be set to 15 seconds. For example, when the content reproduction is started by the HMD device 100, the eye blinking period is detected based on the eye image acquired by the biological information acquiring camera 208, and the time corresponding to the detected eye blinking period Is 15 seconds or longer, the reference information can be set so as to display the notification 103 on the display 212. [ The reference information regarding the blink period of the eyes is not limited to the above-mentioned one. And a moving image captured continuously for a predetermined period of time by an eye image acquired by the biometric information acquiring camera 208 to detect a flicker period of the eye.

The reference information on the blink cycle of the eye can be set based on the variation of the blink cycle of the eye. For example, the blink period of the detected eye is compared using the eye image acquired by the camera 208 for acquiring the biological information at regular intervals while the content is being reproduced. If the variation of the blink period of the eye is 15 %, The HMD device 100 may display the notification 103 on the display 212. The amount of change in the blink period of the eye may include both a case where the blink period of the eye is long and a case where the blink period of the eye is shortened.

Referring to FIG. 1C, the reference information for determining whether the pupil position is changed may be set to determine whether the positional variation is 0.4 mm or less. For example, when content reproduction is started by the HMD device 100, the center point 107 is detected based on the eye image acquired by the biometric information acquisition camera 208 as described with reference to FIG. 1D. If the distance between the position of the center point detected in the previous eye image and the position of the center point 107 detected in the current eye image is 0.4 mm or less, the HMD device 100 has almost no change in the pupil position of the wearer 101 It can be judged. According to this judgment, the HMD device 100 can display the notification 103 on the display 212. [ The eye image acquired by the biometric information acquiring camera 208 to determine whether the pupil position is changed may be composed of a moving image continuously captured for a predetermined period of time.

Referring to FIG. 1C, the reference information for determining whether the pupil has changed may be set so as to determine whether the pupil is maintained for at least one hour in a state in which the pupil width is small. For example, when content reproduction is started by the HMD device 100, based on the pupil image acquired by the HMD device 100 by the biological information acquiring camera 208, the pupil 113 The diameter 114 of each of the first and second electrodes. The HMD device 100 obtains the width of the pupil 113 based on the detected pupil diameter 114. [ The HMD device 100 compares the width of the pupil 113 detected from the current pupil image with the width of the pupil detected from the previous pupil image to determine whether the pupil 113 has a smaller width. If the width of the pupil 113 detected from the current pupil image is determined to be smaller than the pupil width detected from the previous pupil image, the HMD device 100 determines whether the pupil width has remained small for 1 hour or longer . The HMD device 100 can count the time from the time when the pupil has been reduced in size to determine whether it has continued for more than one hour.

The HMD device 100 can display the notification 103 on the display 212 if it is determined that the pupil has been kept in the reduced size for more than one hour. The pupil image acquired by the biological information acquiring camera 208 to determine whether the pupil has changed may be composed of a moving image continuously captured for a predetermined period of time.

The reference information for determining whether the pupil has changed is not limited to the above-described one. For example, the reference information can be set so that it can be determined whether the diameter of the pupil detected from the pupil image is kept at about 3 mm or less for 1 hour and 30 minutes or more.

Or comparing the diameter of the pupil detected from the currently obtained pupil image with the diameter detected from the previously obtained pupil image to determine whether the diameter of the pupil has decreased and the state in which the diameter of the pupil is reduced is maintained for 1 hour or more And reference information for determining whether the pupil has changed to display the notification 103 on the display 212 can be set.

The biometric information related to the change of the pupil by the above-described reference information can be referred to as biometric information related to the state of the pupil.

 1C, the reference information on the body temperature is set so that the notification 103 is displayed on the display 212 when the body temperature of the wearer 101 is higher than the average body temperature or lower than the average body temperature during the content reproduction period But is not limited to. For example, the reference information on the body temperature can be set so that the notification 103 is displayed on the display 212 when the body temperature change amount of the wearer 101 becomes higher than 1 占 폚 during the content reproduction period. The average body temperature may be the average body temperature of the wearer 101, but may be a generally known average body temperature.

In the case of a generally known average body temperature, the average body temperature may be applied differently depending on whether the wearer 101 is an adult or a child. For example, for adults, the average body temperature is 36.6 to 36.9 ° C, and for children, the average body temperature is 36.0 to 37.5 ° C.

Further, different average body temperatures may be applied depending on the position where the current body temperature of the wearer 101 is measured. For example, different average body temperatures may be applied depending on the case where the current body temperature is measured based on the ear of the wearer 101 and the case where the current body temperature is measured based on the armpit of the wearer 101. The position at which the current body temperature is measured can be determined according to the device that measured the body temperature. For example, if the device is of the ear-type, the HMD device 100 can recognize the current body temperature as an ear-based body temperature. When the device is of the shoulder band type, the HMD device 100 can recognize the current body temperature as a body temperature based on the armpit. The device is an external device connected to the HMD device 100 in a wired or wireless manner.

Referring to FIG. 1C, the reference information on the sweat discharge amount can be set such that the notification 103 is displayed on the display 212 when the sweat discharge amount of the wearer 101 is larger than the average sweat discharge amount during the content reproduction period, It is not limited. For example, the reference information can be set so that the notification 103 is displayed on the display 212 when the amount of change in sweat discharge amount of the wearer 101 is more than 10% during the content reproduction period. The average sweat discharge amount may be an average sweat discharge amount of the wearer 101, but is not limited thereto.

The reference information on the sweat discharge amount may be set differently according to the use environment of the HMD device 100. [ For example, the reference information in an environment where the use environment of the HMD device 100 is dry and the amount of sweat discharge is small and the use environment of the HMD device 100 are different from each other may be different in an environment in which sweat discharge amount is high due to high humidity .

Referring to FIG. 1C, the reference information on the blood pressure may be set such that the notification 103 is displayed on the display 212 when the blood pressure of the wearer 101 is higher or lower than the normal blood pressure during the content reproduction period, Do not. For example, if the amount of blood pressure change of the wearer 101 is higher than 20% during the content reproduction period, the reference information may be set so that the notification 103 is displayed on the display 212, but the present invention is not limited thereto.

Referring to FIG. 1C, the reference information on the pulse may be set such that the notification 103 is displayed on the display 212 when the pulse of the wearer 101 is faster or slower than the normal pulse during the content reproduction period, Do not. For example, if the amount of change in the pulse of the wearer 101 is greater than 10% during the content reproduction period, the reference information may be set so that the notification 1003 is displayed on the display 212, but is not limited thereto.

Referring to FIG. 1C, the reference information on blood glucose may be set to be displayed on the display 212 when the blood glucose level of the wearer 101 is higher than the normal blood glucose level during the content reproduction period, but is not limited thereto. For example, the reference information may be set so that the notification 103 is displayed on the display 212 when the change amount of the blood sugar of the wearer 101 is larger than 20%, but is not limited thereto.

Referring to FIG. 1C, the reference information on the amount of activity may be set to be displayed on the display 212, but is not limited thereto, if the amount of activity of the wearer 101 is greater than the amount of normal activity during the content reproduction period. The normal activity amount refers to an amount of activity (e.g., a moving distance, a moving speed, and a calorie consumption amount expressed numerically) in which respiration of the wearer 101 can be determined to be a constant state.

Referring to FIG. 1C, the medical information may change the criteria of the information used by the HMD device 100 to display the notification 103 on the display 212. For example, when the wearer 101 is determined to be a diabetic based on the acquired medical information, the HMD device 100 can change the reference information on the blood glucose change amount from 20% to 10%. If it is determined that the wearer 101 is suffering from conjunctivitis based on the acquired medical information, the HMD device 1000 may change the reference information for determining whether or not the eye is congested. Not only the biometric information of the wearer 101 but also the reference information such as the information of the HMD device 100 and the surrounding environment information can be changed.

Referring to FIG. 1F, the reference information on the color temperature may be set based on the color temperature and the holding time of the surroundings of the HMD device 100 during the content reproduction time. For example, when the color temperature is high blue light, the reference information can be set to display the notification 103 on the display 212 after two hours have elapsed. When the color temperature is a low red light, the reference information can be set to display the notification 103 on the display 212 after 4 hours have elapsed. The reference information for the color temperature is not limited to this.

Referring to FIG. 1F, the reference information for the light may be set according to the brightness level and the exposure time of the surroundings of the HMD device 100 during the content reproduction period. The reference information for the ultraviolet ray may be set according to the ultraviolet ray index of the periphery of the HMD device 100 and the exposure time during the content reproduction period.

Referring to FIG. 1F, the reference information on the temperature indicates that when the temperature around the HMD device 100 is higher than the reference temperature or the change amount of the temperature is higher than 3 DEG C during the content reproduction period, the notification 103 is displayed on the display 212 Can be set to be displayed.

Referring to FIG. 1F, the reference information on the humidity is set so that the notification 103 is displayed on the display 212 if the ambient humidity of the HMD device 100 is lower than 30% or the humidity is higher than 70% Can be set.

Referring to FIG. 1F, the reference information on the wind may include notifications 103 if the wind intensity around the HMD device 100 is greater than the reference wind intensity or the wind intensity variation is greater than 10% May be set to be displayed on the display 212. The reference wind intensity may be, but is not limited to, the wind intensity generated in the room.

Referring to FIG. 1F, the reference information for the altitude includes information indicating that the altitude of the periphery of the HMD device 100 during the content reproduction period is higher than or less than the reference altitude (for example, 700 m) The notification 103 may be set to be displayed on the display 212. If the change amount of the notification 103 is greater than 40%

Referring to FIG. 1F, when the ambient pressure of the HMD device 100 is higher than the reference pressure (for example, 2 atmospheres) or the variation of the atmospheric pressure is greater than 10% during the content reproduction period, The notification 103 may be set to be displayed on the display 212. [

Referring to FIG. 1F, the reference information on the fine dust may be such that the fine dust density around the HMD device 100 is higher than the reference fine dust density (for example, 30-80 占 퐂 / m3) If the concentration change amount is greater than 10%, the notification 103 may be set to be displayed on the display 212. [ The criterion for fine dust concentration can be divided into fine dust mode and ultrafine dust mode.

Referring to FIG. 1G, age information and schedule information may change the criteria of information used to determine whether to display notification 103 on display 212 during a content playback period.

For example, in the case of age information, the criteria used may vary depending on the age range. For example, the reference information for the content playback time applied to the twenties is changed from 2 hours to 4 hours, the reference information for the content playback time applied to the 30s is changed from 2 hours to 3 hours, The reference information for the content playback time applied to the content playback time can be maintained for 2 hours.

And may change the criteria of the information used to determine whether to display the notification 103 on the display 212 according to the schedule content in the case of the schedule information. For example, when the schedule of the wearer 101 is a conference before playing the content, the reference information on the content playback time can be changed from 2 hours to 1 hour. When the tomorrow's schedule of the wearer 101 is on leave, the reference information on the content reproduction time can be changed from 2 hours to 4 hours.

The reference information may be set in advance by the wearer 101 or set by the external device (not shown) of the HMD device 100, but is not limited thereto, based on the experiment value. The experiment value is information of the HMD device 100 generated, biometric information of the wearer 101, surrounding environment information of the HMD device 100, and information of the wearer 101 when the content is being provided by the HMD device 100 But not limited to, monitoring personal information.

6 is a flowchart illustrating an operation method of the HMD device 100 according to an exemplary embodiment of the present invention. 7 is an example of a screen for explaining the flow chart of Fig. Hereinafter, the flow chart of Fig. 6 will be described with reference to Fig.

The game image 701 is provided through the display 212 while the game selected by the wearer 101 is being reproduced by the HMD device 100 in step S601 of Fig. Accordingly, as shown in the screen 710 of FIG. 7, the wearer 101 of the HMD device 100 sees the game image 701 through the display 212.

The HMD device 100 acquires the information of the HMD device 100 generated in association with the content provision, the biometric information of the wearer 101, the information of the HMD device 100, And the personal information of the wearer 101 are acquired.

The information of the HMD device 100, the biometric information of the wearer 101, the surrounding information of the HMD device 100, and the personal information of the wearer 101 can be obtained as described in FIGS. 1B to 1G.

In step S603, the HMD device 100 displays a provision stop notification 702 (hereinafter referred to as a notification) for the content using the obtained information. The notification 702 may be displayed on the display 212 as shown in screen 720 of FIG. The notification 702 may be referred to as a notification image for confirming to the wearer 101 whether or not to stop providing the content.

Referring to the screen 720 of FIG. 7, the notification 702 may include a query (for example, stop providing the content) about whether or not to stop providing the content, an instruction (for example, (E.g., NO), and the like, but the notification information included in the notification 702 is not limited to this.

For example, the query regarding whether or not to stop providing content is output as an audio signal, and the notification information included in the notification 702 includes an input for a command (for example, And an entry for a command (e.g., no) that may deny the pause.

A command for requesting the stop of contents provision and an instruction for forcibly stopping the provision of contents can be received by the voice signal of the wearer 101. [ When a command based on the voice signal of the wearer 101 is received via the microphone 214, the notification 702 indicates that the input item (e.g., YES) corresponding to the received command among the displayed input items is selected The notification 703 shown in the screen 730 of Fig.

Referring to the screens 720 and 730 of FIG. 7, notifications 702 and 703 are displayed in the area where the game image 701 was displayed. In order to display a notification, such as screens 720 and 730 in FIG. 7, the HMD device 101 may temporarily stop providing game images and provide notifications 702 and 703. The period in which the game image provision is temporarily stopped can be preset in accordance with the period for displaying the notifications 702 and 703. [

The HMD device 100 may use a method of inserting a still image or a moving image into the moving image in order to display the notifications 702 and 703 as shown in the screens 720 and 730 of FIG.

8A is an example of a relationship between a notice 702 and 703 frame and a game frame 801 in a frame structure for inserting a moving picture into a moving picture. 8A, a frame 803 is created by inserting M notification frames 802 between frames N + 1 and N + 2 of a game frame 801 being reproduced. The frame referred to in FIG. 8A can be viewed as based on an I (Intra) frame. The M notification frames inserted between the game frames may be determined according to the time at which the notification 702 is to be reproduced. For example, if the notification 702 is played for two seconds, then M may be 60. The section in which the notification frame is reproduced is not limited to the above-mentioned one.

When the command (e.g., example) of the wearer 101 is received in the section in which the notification frame is reproduced as described above, the contents of the notification frame can be changed from the screen 720 to the screen 730 in Fig. 7 . As the notification frame is inserted, the playback period of the audio signal corresponding to the subsequent game frame including the game frame N + 2 may be changed to be synchronized with the game frame N + 2.

The notification 702 may be displayed in an overlapping manner on the game image 701 as shown in FIG. 8B. The above-mentioned overlap can be processed in a manner of inserting caption information into an image, but is not limited thereto. For example, the notification 702 may be displayed in the form of a pop-up window. In this case, the game image 701 may still be provided. The area where the notification 702 overlapped with the game image 701 is displayed can be set to an area where the wearer 101 does not have difficulty in seeing the game image 701 provided by the HMD device 100. [

The notification 702 may be displayed in a display area independent of the game image 701 as shown in FIG. 8C. The notification 702 can be displayed on the display of the HMD device 100 and another device (or external device) when the notification 702 is displayed in the display area independent of the game image 701 as shown in Fig. 8C. The other device may be a device in which the display is located in the real world, which can be recognized through the lens 204 of the HMD device 100. [

To this end, when it is time to display the notification 702, the HMD device 100 may send information about the notification 702 to another device. The information about the notification 702 may include, but is not limited to, a notification message. For example, the information about the notification 702 may include notification information and indication standard information for the notification message. The display specification information may include, but is not limited to, resolution and format information of the notification message (e.g., JPG, etc.). The format information of the notification message means the file format of the notification message.

The communication channel between the HMD device 100 and another device may be set, but is not limited to, when it is time to display the notification 702. [ For example, the communication channel between the HMD device 100 and another device may be set before it becomes a situation to display the notification 702. [ That is, the HMD device 100 may send information about the notification 702 to the device where the display is located in the real world, which may be recognized via the lens 204 among other devices for which a communication channel is established.

The device in which the display is located in the real world that can be recognized through the lens 204 among other devices may be selected by the wearer 101 based on the list of devices connected to the HMD device 100 but is not limited thereto.

For example, the HMD device 100 receives and stores information regarding the location of another device in the communication channel setting, and stores information on the location of the other device stored therein and other devices on the basis of the current location of the HMD device 100 You can choose. In the case where the other device is a mobile device, the location information of another device stored in the HMD device 100 may be changed each time the location of the other device is changed. The communication channel of the HMD device 100 with another device may be set based on a short range wireless communication such as Bluetooth, RFID, etc., but is not limited thereto.

When the notification 702 is displayed as shown in FIGS. 8B and 8C, the notification information included in the notification 702 may be displayed more briefly than the notification information displayed on the screens 720 of FIG. 7 .

When the notification 702 is being displayed as shown in the screen 720 of FIG. 7, when a provision stop request for the content is received through the user input unit 207 (S604), the HMD device 100 (S605). The HMD device 100 may display an image indicating a state in which the content is not provided in the display area provided with the game image 701 and the notifications 702 and 703 as the provision of the content is stopped, . The image indicating the state in which the content is not provided may be one of a black image or a white image, but is not limited thereto.

6 is configured such that the HMD device 100 remains in a standby state until a content provision stop request is received unless a content provision stop request is received in step S604. However, as a result of the determination in step S604, if the content provision stop request is not received, the operation flow chart of FIG. 6 may be configured such that the operation of the HMD device 100 is returned to step S601.

The absence of a content provision stop request may include a request to deny the content provision termination. If it is determined in step S604 that the contents provision stop request is not received due to the receipt of the contents provision stoppage rejection request, the HMD device 100 returns to step S601 to continue providing the contents that were being provided. .

FIG. 9 is a detailed flowchart of the notification 702 display process performed in step S603 of FIG. FIG. 9 shows an example in which a one-time notification 702 is displayed using one piece of reference information.

In step S901 of FIG. 9, the HMD device 100 compares the information obtained in step S602 with the reference information. The reference information may be different according to the information obtained in step S602 as mentioned in Figs. 1B to 1G.

If it is determined in step S901 that it is necessary to display the notification 702 (S902), the HMD device 100 determines whether or not the notification 702 is necessary to be displayed by one of the above described Figs. 7, 8 (b), and 8 The notification 702 is displayed (S903). The manner of displaying the notification 702 may be preset in the HMD device 100 or selected by the wearer 101, but the manner in which the notification 702 is displayed is not limited thereto. When it is necessary to display the notification 702, the contents reproduced by the HMD device 100 are displayed on the wearer 101 as shown in Figs. 1A to 1G, It is a situation that needs to be relaxed. This situation can be judged based on the reference information set according to the obtained information as described in Figs. 1B to 1G.

10 is a flowchart illustrating an operation method of the HMD device 100 according to another preferred embodiment of the present invention. 10 shows an example in which the notification 702 is displayed a plurality of times using the reference information.

Steps S1001 and S1002 operate similarly to steps S601 and S602 in Fig.

In step S1003, the HMD device 100 compares the information obtained in step S1002 with the reference information. The reference information may have a different form or number of information depending on the acquired information.

11 is a table showing the relationship between the reference information set in the HMD device 100 and the number of notifications when the acquired information is the content playback time. The table shown in Fig. 11 is not limited to the case where the type of the reference information is time, the number of reference information is five, the number of times of notification is five, the type of reference information, the number of reference information, and the number of notifications.

12 is a table showing the relationship between the reference information set in the HMD device 100 and the number of notifications when the acquired information is the battery consumption amount. The table shown in Fig. 12 is not limited to the case where the type of reference information is a ratio, the number of reference information is three, the number of times of notification is three, the type of reference information, the number of reference information, and the number of notifications.

13A is a table showing the relationship between the reference information set in the HMD device 100 and the number of notifications when the obtained information relates to the heat generation temperature and includes the heat generation temperature and the maintenance time information. The table shown in Fig. 13A is not limited to the case where the type of reference information is temperature and time, the number of reference information is three, the number of times of notification is three, the type of reference information, the number of reference information, .

13B is a table showing the relationship between the reference information set in the HMD device 100 and the number of notifications when the acquired information is about the heat generation temperature and includes the heat generation temperature. The table shown in FIG. 13B is not limited to the case where the type of the reference information is temperature, the number of reference information is one, the number of times of notification is three, the type of reference information, the number of reference information, and the number of times of notification.

14 is a table showing the relationship between the reference information set in the HMD device 100 and the number of notifications when the obtained information is information for determining whether or not the eye of the wearer 101 is congested. The table shown in Fig. 14 shows the case where the form of the reference information is an increase rate of the number of pixels whose R value is adjacent to 255, the number of reference information is three, the number of times of notification is three, the form of reference information, And the number of notifications are not limited to this.

As shown in FIG. 14, when determining whether or not the eye is congested using a plurality of pieces of reference information, whether or not the eye is congested may mean the degree of congestion of the eye. For example, when the rate of increase is 20%, the degree of congestion of the eye is the lower level. When the rate of increase is 30%, the degree of congestion of the eye is the middle level. When the rate of increase is 40% It can mean level.

Fig. 15 is a table showing the relationship between the reference information set in the HMD device 100 and the number of notifications when the obtained information is information for judging whether or not the wearer's eyes are dry. The table shown in Fig. 15 shows the case where the type of the reference information is humidity and time information, the number of reference information is three, the number of times of notification is three, the type of reference information, the number of reference information, Do not.

As shown in FIG. 15, when the wearer 101 determines whether or not the eyes of the wearer 101 are dry using the plurality of pieces of reference information, whether the eyes are dry or not can mean the dryness of the eyes. For example, when the degree of dryness of the eyes is determined based on the humidity and the time as shown in FIG. 1C, the degree of dryness of the eyes is a low level and the humidity is 30% , The degree of dryness of the eyes may mean the upper level when the degree of dryness of the eyes is the medium level and the state of the eyes is maintained at the humidity of 30% for 2 hours.

11 to 15 means the number of times that the notification 702 is displayed on the display 212. [ In the case where there are a plurality of times of the reference information, the number of times of notification may be equal to the number of reference information but is not limited thereto. For example, as shown in FIG. 13B, a plurality of notification times may be set for one piece of reference information. The higher the notification frequency, the higher the degree of eye fatigue of the wearer 101 may be.

The number of notifications allocated to one reference information may be set and used in advance in the HMD device 100 according to the kind of information to be obtained, but is not limited thereto. For example, the number of times of notifications allocated to one piece of reference information may be set by the wearer 101 or set by an external device (e.g., a service providing server or the like) of the HMD device 100 and then transmitted to the HMD device 100 Can be provided.

A table showing the relationship between at least one reference information and the number of times of notifying of the biometric information shown in Fig. 1C and the surrounding information shown in Fig. 1F, in addition to the biometric information of the wearer 101 shown in Figs. 14 and 15, May be set in the device 100. The table set in the HMD device 100 can be made based on the notification criteria defined in Figs. 1C and 1F. The at least one reference information and the number of notifications for the acquired information can be set differently based on the medical information of the wearer 101 mentioned in FIG. 1C and the personal information of the wearer 101 mentioned in FIG. 1G.

On the other hand, if the information obtained in step S1002 is the content reproduction time, the HMD device 100 compares the reference information shown in FIG. 11 with the reproduction time of the acquired content in step S1003 of FIG.

As a result of the comparison, when the playback time of the obtained content reaches one hour, the HMD device 100 determines in step S1004 that it is necessary to display the notification 702 on the display 212. [ Accordingly, the HMD device 100 displays the notification 702 on the display 212 (S1005).

If the wearer 101 requests the content provision stop in step S1006 based on the displayed notification 702, the HMD device 100 stops providing the content in step S1007. The provision stop process for the content may be performed as in step S605 of FIG. 6 described above.

In step S1006 of Fig. 10, if the wearer 101 refuses to stop providing contents, the HMD device 100 checks the number of notifications 702 in step S1008. As a result of the check, if the number of times the notification 702 is displayed is not equal to the maximum value, the HMD device 100 proceeds to step S1009 to continuously provide the content and obtain the content playback time.

The maximum value may be set differently depending on each acquired information. The maximum value may be determined according to the number of reference information, but may be determined according to the fatigue management strength of the wearer 101 during the content providing period. For example, in the case of weakening the fatigue management strength for the wearer 101, one notification 702 for one piece of reference information as shown in Figs. 11, 12, 13A, 14, and 15 ) Can be displayed.

When the fatigue management strength for the wearer 101 is strengthened, a maximum value can be set so that a plurality of notifications 702 are displayed for one piece of reference information as shown in FIG. 13B. The case of weakening the fatigue management strength of the wearer 101 and strengthening the fatigue strength of the wearer 101 are not limited to those described above.

(For example, a strong mode or a weak mode) of a plurality of wearers 101 with respect to information (for example, an exothermic temperature) to be obtained by the HMD device 100 , The wearer 101 can select the fatigue management strength of the wearer 101 before reproducing the content, but is not limited thereto. The HMD device 100 can display the guidance information on the display 212 before reproducing the content so that the wearer 101 can select the fatigue management strength of the wearer 101. [

A mode in which the wearer 101 has a high degree of fatigue management strength may mean a mode in which a plurality of notifications 702 are displayed for one piece of standard information. The mode in which the wearer 101 has a weak fatigue strength may mean a mode in which one notification 702 is displayed on one piece of reference information. The condition for judging whether to relieve the fatigue of the wearer 101 can be set to be more restrictive than the mode in which the fatigue management strength of the wearer 101 is weak or the fatigue management strength of the wearer 101 is weak.

In the case of the table shown in Fig. 11, the maximum value is 5. In the case of the tables shown in Figs. 12 to 15, the maximum value is 3, but the maximum value for each information is not limited to this.

On the other hand, in step S1009 of FIG. 10, when the content is reproduced and the reproduction time of the content is obtained, the HMD device 100 returns to step S1003 and repeats the above-described process.

If the number of times the notification 702 is displayed is equal to the maximum value as a result of checking in step S1008, the HMD device 100 does not display the notification 702 on the display 212 and proceeds to step S1007, Forcibly.

The operation of the HMD device 100 based on steps S1008 and S1007 is not limited to the above-described one. For example, as a result of checking in step S1008, when the number of times the notification 702 is displayed on the display 212 is equal to the maximum value, the HMD device 100 notifies the reproduction of the content Can be stopped. The warning notification may be provided, for example, as " C minutes later, the content will be stopped from playing. &Quot; By the warning notice, the wearer 101 can prepare for the forced stop of the reproduction of the content.

When the obtained information is the content reproduction time and the reference information set in the HMD device 100 is the same as the table shown in Fig. 11, the notification 702 is based on the operation flow chart of Fig. 10, Up to five times depending on the rejection command.

When the acquired information is battery consumption and the reference information set in the HMD device 100 is the same as the table shown in Fig. 12, the notification 702 is based on the operation flowchart of Fig. 10, Up to three times depending on the command.

When the obtained information is the heat generation temperature and the holding time, and the reference information set in the HMD device 100 is the same as the table shown in Fig. 13A, the notification 702 is based on the operation flow chart of Fig. 10, Up to three times may be provided in accordance with the denial of play stop command.

When the acquired information is the heat generation temperature and the reference information set in the HMD device 100 is the same as the table shown in Fig. 13B, the notification 702 is based on the operation flowchart of Fig. 10, Up to three times depending on the command.

When the obtained information is the degree of congestion of the eye of the wearer 101 and the reference information set in the HMD device 100 is the same as the table shown in Fig. 14, the notification 702 is based on the operation flow chart of Fig. 10, 101 may be provided up to three times in response to the content playback interruption denial command.

When the acquired information is the eye dryness based on the ambient humidity of the HMD device 100 and the reference information set in the HMD device 100 is the same as the table shown in Fig. 15, 702 may be provided up to a maximum of three times in accordance with the content playback stop denial command of the wearer 101.

The repeated process of FIG. 10 based on the maximum value will be described in more detail using a table relating to the content reproduction time shown in FIG.

As described above, since the number of times of notification 702 is one in step S1008, the HMD device 100 acquires the content reproduction time information while continuing to provide the content in step S1009, and returns to step S1003, Compare the reference information.

As a result of the comparison, if the reproduction time of the content is two hours, the HMD device 100 determines in step S1004 that it is necessary to display the notification 702 on the display 212. [ Accordingly, in step S1005, the HMD device 100 displays the notification 702 on the display 212. [

If the wearer 101 requests the content provision stop based on the notification 702, the HMD device 100 proceeds to step S1007 to stop providing the content.

If the wearer 101 rejects the content provision stop based on the notification 702, the HMD device 100 checks in step S1008 if the number of notifications 702 is equal to the maximum value. Referring to FIG. 11, since the current number of notifications 702 is twice, the HMD device 100 determines that the number of notifications 702 is not equal to the maximum of five times.

Accordingly, the HMD device 100 acquires the content reproduction time information while continuously reproducing the content in step S1009, and returns to step S1003 to compare the acquired content reproduction time with the reference information.

If the content reproduction time information is three hours, the HMD device 100 determines in step S1004 that it is necessary to display the notification 702 on the display 212. [ Accordingly, in step S1005, the HMD device 100 displays the notification 702 on the display 212. [

If the wearer 101 requests the content provision stop based on the notification 702, the HMD device 100 proceeds to step S1007 to stop providing the content.

If the wearer 101 rejects the content provision stop based on the notification 702, the HMD device 100 checks in step S1008 if the number of notifications 702 is equal to the maximum value. Referring to FIG. 11, since the current number of notifications 702 is three, it is determined that the current notification is not equal to the maximum value of five times.

Accordingly, the HMD device 100 acquires the content reproduction time information while continuously reproducing the content in step S1009, and returns to step S1003 to compare the acquired content reproduction time with the reference information.

If the content reproduction time information is four hours, the HMD device 100 determines in step S1004 that it is necessary to display the notification 702 on the display 212. [ Accordingly, in step S1005, the HMD device 100 displays the notification 702 on the display 212. [

If the wearer 101 requests the content provision stop based on the notification 702, the HMD device 100 proceeds to step S1007 to stop providing the content.

If the wearer 101 rejects the content provision stop based on the notification 702, the HMD device 100 checks in step S1008 if the number of notifications 702 is equal to the maximum value. Referring to FIG. 11, since the number of times of the current notification 702 is four, it is determined that the current notification is not equal to the maximum value of five times.

Accordingly, the HMD device 100 acquires the content reproduction time information while continuously reproducing the content in step S1009, and returns to step S1003 to compare the acquired content reproduction time with the reference information.

If the content reproduction time information is not less than 5 hours, the HMD device 100 determines in step S1004 that it is necessary to display the notification 702 on the display 212. [ Accordingly, in step S1005, the HMD device 100 displays the notification 702 on the display 212. [

If the wearer 101 requests the content provision stop based on the notification 702, the HMD device 100 proceeds to step S1007 to stop providing the content.

If the wearer 101 rejects the content provision stop based on the notification 702, the HMD device 100 checks in step S1008 if the number of notifications 702 is equal to the maximum value. Referring to FIG. 11, since the number of times of the current notification 702 is five, it is determined to be equal to the maximum value of five times.

Accordingly, the HMD device 100 may proceed to step S1007 and forcibly stop the content reproduction as described above.

Using the table shown in Figs. 12 to 15, the operation flow chart of Fig. 10 shows that even when the acquired information is the battery consumption amount, the heat generation temperature, the degree of congestion of the eyes of the wearer 101, and the dryness of the eyes of the wearer 101 An operation of displaying the notification 702 on the display 212 a plurality of times as in the above-described content reproduction time can be performed. The number of notifications 702 mentioned in the above-mentioned operation flow chart of FIG. 10 means the number of notifications 702 displayed.

The flow chart shown in Fig. 10 shows a table relating to the reference information made as shown in Figs. 11 to 15 for each information mentioned in Figs. 1B, 1C, 1F and 1G or a combination of at least two pieces of information Can be operated. The tables shown in Figs. 11, 12, 13A, 13B, 14, and 15 are tables for one piece of information. In the case of the table shown in Figs. 13A and 15, two reference information are used but a table for one piece of information. That is, FIG. 13A is a table relating to the heat generation temperature shown in FIG. 1B, and FIG. 15 is a table concerning the drying degree of the eyes of the wearer 101 shown in FIG.

The combination of at least two pieces of information can be defined as follows.

(One)  Combination of at least two pieces of information of the HMD device 100 of FIG.

(2)  At least one of the information of the HMD device 100 of FIG. 1B and at least one of the eye-based biometric information of the wearer 101 of FIG. 1C is combined.

(3)  A combination using at least one of the information of the HMD device 100 of FIG. 1B and the health information of the wearer 101 of FIG. 1C.

(4)  The combination using at least one of the information of the HMD device 100 of FIG. 1B and the surrounding information of FIG. 1F.

(5)  And combines at least two pieces of information of the biometric information based on the eyes of the wearer 101 of Fig. 1C.

(6)  At least one of the biometric information based on the eyes of the wearer 101 of FIG. 1C and the health information of the wearer 101 of FIG. 1C are combined.

(7)  At least one of the biometric information based on the eyes of the wearer 101 of Fig. 1C and the surrounding environment information of Fig. 1F is combined.

(8)  Combination of at least two pieces of health information in Fig. 1C.

(9)  At least one of the health information of FIG. 1C and the surrounding information of FIG. 1F is combined.

(10) The combination of at least two pieces of information of the surrounding environment shown in Fig. 1F.

The health information of the wearer 101 described in the above examples may refer to health information excluding the medical information described in Fig. 1C. Examples of combinations of at least two pieces of information are not limited to those described above.

16 is an operational flow chart for determining whether to display the notification 702 on the display 212 based on the combination of the above two pieces of information. Fig. 16 may be included in step S1003 of Fig. 10 or step S603 of Fig. When the operational flowchart of FIG. 16 is included in step S603 of FIG. 6, step S602 of FIG. 6 may be defined as acquiring the first information and the second information, respectively.

In step S1601 of Fig. 16, the HMD device 100 compares the acquired first information with the reference information. The first information may include one of the information mentioned in the combination examples (1) to (10) of the above two pieces of information. For example, the first information may be but is not limited to one of the information of the HMD device 100 referred to in FIG. 1B. When the first information is the reproduction time of the content, the reference information may be set as the notification reference described in Fig. 1B or the reference information shown in Fig. 11, but is not limited thereto.

In step S1602, the HMD device 100 compares the acquired second information with the reference information. The second information may include one of the information mentioned in the combination examples (1) to (10) of the above two pieces of information. For example, the second information may be, but is not limited to, one of the information of the HMD device 100 referred to in FIG. 1B. For example, in the case where the second information is battery consumption, the reference information may be set as the notification reference described in FIG. 1B or the reference information shown in FIG. 12, but is not limited thereto.

Steps S1601 and S1602 may be performed simultaneously as shown in FIG. 16, but are not limited thereto. For example, step S1601 may be performed before step S1602, or step S1602 may be performed before step S1601.

In step S1603, the HMD device 100 determines that it is necessary to display the notification 702 on the display 212 in accordance with the comparison result in step S1601, and according to the comparison result in step S1602, It may be determined that it is necessary to display the notification 702 on the display 212 when it is determined that it is necessary to display it on the display 212. [

However, in step S1603, it is possible to determine whether to display the notification 702 according to the priority information for each information set in advance among the first information and the second information. For example, if the first information has a higher priority than the second information, the notification 702 is displayed on the display 212 As shown in Fig. On the other hand, when the second information has a higher priority than the first information, the notification 702 is displayed on the display 212 according to the comparison result between the second information and the reference information regardless of the comparison result between the first information and the reference information Can be determined.

If it is determined in step S1603 that it is necessary to display the notification 702 on the display 212 according to a result of comparison between at least one of the first information and the second information and the reference information, As shown in FIG.

The condition for determining whether to display the notification 702 on the display 212 based on the plurality of pieces of information may be preset in the HMD device 100, but is not limited thereto. For example, the above-described conditions can be set by the wearer 101 or set by an external device (for example, a parent portable terminal).

The above-mentioned conditions are, for example, a first condition for considering both the comparison result based on the first information in step S1601 and the comparison result based on the second information in step S1602 described above, A second condition that considers the comparison result based on the second information among the comparison results based on the above-described second information, a comparison condition based on the first information, and a comparison result based on the second information described above A third condition that takes into account the results, and the like. A comparison result referred to in the third condition may include, but is not limited to, the comparison result obtained first.

When the first information is one of the information of the HMD device 100 of FIG. 1B, the second information may be one of the biometric information of the wearer 101 of FIG. 1C.

If the first information is one of the information of the HMD device 100 of FIG. 1B, the second information may be one of the surrounding information of the HMD device 100 of FIG. 1F.

When the first information is one of the biometric information of the wearer 101 of FIG. 1C, the second information may be one of the biometric information of the wearer 101 of FIG. 1C.

When the first information is one of the biometric information of the wearer 101 of FIG. 1C, the second information may be one of the surrounding information of the HMD device 100 of FIG. 1F.

If the first information is one of the surrounding information of the HMD device 100 of FIG. 1F, the second information may be one of the surrounding information of the HMD device 100 of FIG. 1F.

17 is a flowchart illustrating an operation method of the HMD device 100 according to another preferred embodiment of the present invention. FIG. 17 is an example of displaying a notice of stoppage of provision of content according to content type information.

Steps S1701, S1703, S1705, and S1706 of FIG. 17 are similar to steps S601, S602, S604, and S605 of FIG. 6, and the description thereof will be omitted.

In step S1702, the HMD device 100 detects the type information of the provided content. The type information of the content means information indicating which category of information the content is intended to transmit. Therefore, the type information of the content can be determined according to the application providing the content. For example, when the application executed by the HMD device 100 is a game application, the type information of the content can be detected as " game ". When the application executed by the HMD device 100 is a DMB application, the type information of the content can be detected as " broadcast ". When the application executed by the HMD device 100 is a video player application, the type information of the content can be detected as " movie ". When the application executed by the HMD device 100 is an e-book application, the type information of the content can be detected as " e-book ".

The type information of the content can be detected from the information on the application currently being executed by the HMD device 100. The information about the application may include, but is not limited to, information such as the application name and the category to which the application belongs (e.g., game, life, music, video on demand (VOD), e-book . The category to which the application belongs refers to the range to which the application of the same type belongs. The category to which the application belongs may be, but is not limited to, keywords assigned to the same type of application. The HMD device 100 can detect the type information of the content using the category information to which the application belongs, but is not limited thereto.

In step S1704, the HMD device 100 compares the acquired information with the reference information. The reference information to be compared at this time may include reference information set according to the type of the content detected in step S1702. The form of the reference information may be as described in FIG. 6 and FIG.

18 is an example of a table for explaining the relationship between the type of content and the reference information. The reference information shown in FIG. 18 is the reference information for the content reproduction time, but the reference information is not limited thereto. For example, the reference information may be set based on the notification criteria and the content type shown in Figs. 1B, 1C, and 1F according to the information obtained in step S1703.

Different reference information can be set according to the content type as shown in FIG. For example, when the content type is a game, the reference information is one hour. When the content type is movie, the reference information is 2 hours. When the content type is an electronic book, the reference information is 3 hours. When the content type is music, the reference information is 4 hours.

As can be seen from the reference information set in FIG. 18, the reference information can be set in consideration of the concentration of the wearer 101 according to the content type. The concentration of the wearer 101 means the degree to which the wearer 101 is immersed in the content provided by the HMD device 100. [

The concentration according to the content type may be set based on the experimental result when producing the content, but is not limited thereto. The concentration of the wearer 101 may be included in the metadata of each content, but is not limited thereto. For example, the concentration of the wearer 101 for each content can be managed by the content manager.

The content manager may be, but is not limited to, an application that manages information about each content that may be provided by the HMD device 100. The information on each content may include, but is not limited to, the capacity of the content, the provider of the content, the concentration of the user on the content, and the like. For example, in the case where the content is a movie, the information on the content may further include information on the actor, shooting location, and props.

The concentration of the wearer 101 can be expressed as Level 1, Level 2, Level 3, Level 4. If the level of concentration of the wearer 101 is lower than that of the level 1, the game shown in Fig. 18 may be set to level 4, the movie to level 3, the e-book to level 2, and the music to level 1.

The reference information can be set by further subdividing the type of the same content. For example, in the table shown in Fig. 18, the reference information of the movie is set to 2 hours regardless of the genre of the movie. However, the reference information can be set differently according to the genre of the movie. For example, the reference information may be set differently depending on the horror movie, the melody movie, and the comedy movie. For example, the reference information for the horror movie may be set to 2 hours, the reference information of the melody movie may be set to 3 hours, and the reference information of the comedy movie may be set to 4 hours.

The reference information may be set differently for each application installed in the HMD device 100. For example, a video player application, an album application, a camera application, a DMB (Digital Multimedia Broadcasting) application, a map application, a search application, an application store application, a video call application, a news and weather application, And the like can be set.

The flowchart shown in FIG. 10 may also be modified to insert the step of detecting the content type information between step S1002 and step S1003, and to compare the obtained information with the reference information adjusted according to the content type in step S1003.

19 is a flowchart for explaining a method of operating the HMD device 100 according to another preferred embodiment of the present invention. 19 is an example in which another content providing function is included. The other contents can relieve eye fatigue, protect eyesight, or provide healing to the wearer 101 as the contents (for example, game contents, movie contents, etc.) reproduced by the HMD device 100 are displayed And the like.

Steps S1901 to S1905 in Fig. 19 can be performed similarly to steps S601 to S605 in Fig. 6, and therefore, the description will be omitted.

In step S1905, the HMD device 100 stops providing the provided content. In step S1906, the HMD device 100 provides the wearer 101 with guidance information on other contents. The guide information on other contents means guide information for confirming whether or not the contents 101 are provided to the wearer 101. For example, the guide information may include information that allows the wearer 101 to select whether to execute the content that can provide the effect described above, but the guide information is not limited thereto.

For example, the guidance information may be displayed on the display 212 as shown in Figures 20-23.

20 shows an example of displaying a notification 2001 including guide information that the degree of drying of eyes is high. The guide information included in the notice 2001 includes a text (e.g., a degree of dryness) indicating a degree of dryness of the eyes, a symbol (e.g., arrow) (For example, please try to run content that can protect your eyesight), but the information included in the notice (2001) is not limited to this.

For example, instead of the symbol, the height of the dryness of the eye can be displayed according to the color of the text (for example, the degree of drying) described above. For example, if the dryness of the eyes is high, the text can be displayed in red. The notification 2001 may include a notification message and instructions in the form of a query, such as the notification 702 in FIG.

FIG. 21 shows an example of displaying a notification 2101 including guide information based on eye flicker. The guidance information included in the notification 2101 includes a text (e.g., blinking) indicating that the blinking of the eyes is related to a blinking of the eyes, a symbol (e.g., arrow) Eye flicker is measured lower than usual, try to execute content that can relieve eye fatigue), but the information included in notification 2101 is not limited thereto.

For example, instead of the symbol, the height of the blink of the eye can be displayed according to the color of the text (flicker) described above. For example, when the blinking of the eyes is low, the text (blinking) can be displayed in red. The notification 2101 may include a notification message and instructions in the form of a query, such as the notification 702 in FIG.

Fig. 22 is an example in which a notification 2201 including guide information based on eye congestion is displayed. The guidance information included in the notification 2201 includes a text (e.g., red blood cell) indicating that the eye is related to the degree of redness of the eye, a symbol (e.g., arrow) For example, the contents of the notification 2201 may include, but are not limited to, the contents of the notification 2201 may include content that has been measured to have a higher degree of eye congestion than usual.

For example, instead of the above-mentioned symbol, the height of the degree of congestion of the eye can be displayed according to the color of the text (congestion degree) described above. For example, if the degree of congestion in the eye is high, the text (congestion) can be displayed in red. The notification 2201 may include a notification message in the form of a query message and instructions as in the notification 702 of FIG.

23 is an example of a screen on which a notification 2301 including guide information in the form of an icon is displayed. The eye icon 2302 is an icon representing the degree of dryness of the eye. The eye icon 2303 is an icon indicating the degree of eye congestion. The eye icon 2304 is an icon indicating blinking of the eyes.

The notifications 2001, 2101, and 2201 in Figs. 20 to 23 can be represented by eye icons 2302, 2303, and 2304 shown in Fig. The notifications 2001, 2101, and 2201 in Figs. 20 to 23 may include, but are not limited to, text (e.g., high eye congestion, low eye flicker frequency,

In step S1907, if the wearer 101 receives a request for providing other contents based on the guidance information provided in step S1906, the HMD device 100 provides other contents (S1908).

The other contents may include, but are not limited to, at least one of food information that can alleviate fatigue of the wearer 101, a recipe of food information, and information on where to buy food. For example, link information that can be connected to an Internet site that provides information related to the above-described food information. When the link information is provided, the HMD device 100 displays an image containing information related to the food information provided from the connected Internet site on the display 212 via the display 212 101).

Other contents may include contents as shown in Figs. 24 to 29.

24 is an example in which a two-dimensional image is provided. The two-dimensional image can include, but is not limited to, natural phenomena such as trees, mountains, rivers, fields, images containing colors that comfort the user's eyes, and images containing patterns that comfort the user's eyes .

25 is an example in which sound is provided. The provided sound includes sound that can alleviate the fatigue of the wearer < RTI ID = 0.0 > 101. < / RTI > For example, the sound may include sound flowing through the stream, natural sounds such as new sounds, slow music, and sounds that can alleviate the fatigue of the wearer 101, such as ballads or classics. The size and the output time of the output sound can be set by the wearer 101, but the sound can be output based on the size and output time of the preset sound.

26 is an example in which a two-dimensional image and sound are provided together. The two-dimensional image is the same image as the image mentioned in Fig. 24, and the sound may be the sound mentioned in Fig. 25, but is not limited thereto.

27 is an example in which a three-dimensional image is provided. The three-dimensional image may include a water polo image which can remotely gaze at a close range so as to release the muscles of the contracted eye of the wearer 101. Images that can take a close range and a long distance can be repeatedly provided. The number of repetitions provided may be, for example, 64 times, but is not limited thereto. It is possible to help the wearer 101 to perform the perspective motion of the eyes by repeatedly providing an image capable of gazing near and far.

28 is an example in which a three-dimensional image and sound are provided together. The three-dimensional image is the same as the three-dimensional image mentioned in Fig. 27, and the sound may be the same as the sound mentioned in Fig. 25, but is not limited thereto.

29 is an example in which an image having a pupil stretching function is provided. The pupil stretching function is a mode for guiding the pupil movement so as to release the hardened muscles of the eye. The pupil motion may include, but is not limited to, at least one of linear motion, diagonal motion, rotational motion, random motion, and perspective motion of the pupil.

In the pupil stretching function, an object 2901 is displayed as shown in Fig. 29, and the object 2901 can be moved and displayed. The wearer 101 can perform the pupil movement while moving the focus along the object 2901 to be moved. The object 2901 may be displayed in a circular shape as shown in FIG. 29, but is not limited thereto. For example, the object 2901 may be configured as a square, a triangle, or a specific symbol. Also, the object 2901 can be moved to perform a pupil movement in the direction of 12:00 -> 3:00 -> 6:00 -> 9:00, and then perform a pupil movement in the reverse direction. The object 2901 can be moved so as to repeat the pupil movement a plurality of times.

Further, the object 2901 can be guided to move in the vertical direction or on the straight line in the lateral direction so as to move the pupil of the wearer 101 in a linear direction (linear movement of the pupil). In addition, the object 2901 can be guided to diagonally move the pupil of the wearer 101 (diagonal movement of the pupil) while moving in the diagonal direction. The object 2901 can guide the pupil of the wearer 101 to rotate (pupil rotational motion) while moving the object 2901 to draw a circle.

The random movement of the pupil of the wearer 101 can be guided by moving the object 2901 at random. For example, the HMD device 100 may display a predetermined drawing image on the display 212 and guide the random movement of the pupil of the wearer 101 by moving the object 2901 along the contour of the drawing image .

The moving speed of the object 2901 and the size, shape, color, etc. of the object 2901 can be variously set by the wearer 101 input. The HMD device 100 recognizes the wearer 101 and displays the drawing image and the object 2901 according to the moving speed, size, shape, and color of the object 2901, the drawing image set for the recognized wearer 101 can do.

The guidance information provided in step S1906 may be changed to guide information for notifying whether or not to provide a function capable of relieving the wearer ' s fatigue. The function of mitigating fatigue of the wearer 101 includes one of the content providing function shown in Figs. 24 to 29 and the lining function or the slim function shown in Fig. 30 and the thermal function shown in Fig. 31 can do.

30 is an example in which a lining function or a slim function is provided. The lens 204 may be made of a material such as smart glass to perform the lining function. For example, the lens 204 may include, but is not limited to, a laminated glass in which a special film sealed with a liquid crystal is interposed between the glass so that the transparent state is switched to an opaque state when power is applied. For example, the eye function can be implemented using an electrochromic method. The electrochromic method is a method in which a special electrochromic material is injected between glass plates and a special electrochromic material is colored by applying a voltage. The slim function is a function in which the operation of the HMD device 100 is set to the slim mode. The slim mode refers to a state where the power of the HMD device 100 is not turned off but the operation of the HMD device 100 is stopped. The slim mode may be referred to as the power saving mode of the HMD device 100. [

31 is an example of an HMD device 100 capable of providing a thermal function. 31, a heating unit 3101 is mounted on the inner side of the lens frame 201 of the HMD device 100 and the inner side surface of the lens 204, or the heating unit 3101 is mounted on the inner side of the lens frame 201 and the lens 204 A heat generating part 3101 is built in the heat generating part 3101 and heat is generated so that the eyes can be padded around the eyes. The heat generating portion 3101 may be configured to emit far-infrared rays. The heat generating portion 3101 may be installed or incorporated at a position where the inner portion of the lens frame 201 and the inner surface of the lens 204 can massage the blood point around the eye of the wearer 101, but is not limited thereto. The lens frame 201 may be configured as shown in the frame 501 shown in Fig. 5 for mounting the heating portion 3101, but is not limited thereto.

32 is a flowchart for explaining a method of operating the HMD device 100 according to another preferred embodiment of the present invention. 32 is an example in which guidance information on a plurality of different contents is provided.

Steps S3201 to S3205 of Fig. 32 operate similarly to steps S1901 to S1905 of Fig. 19 described above.

In step S3206, the HMD device 100 provides guidance information on a plurality of other selectable contents. Information on a plurality of selectable other contents can be displayed on the display 212 as shown in Fig. A screen 3301 shown in FIG. 33 is an example of information on a plurality of selectable contents in the form of a list. Referring to the screen 3301 shown in FIG. 33, it can be seen that selectable contents are C1 and C3. The selectable content may include, but is not limited to, for example, at least one of those mentioned in Figs. 24 to 29 above.

Information on a plurality of selectable contents can be displayed on the display 212 as shown in Fig. 34 is an example of another screen for displaying information on a plurality of selectable contents. 34, information on a plurality of selectable contents is displayed on one screen, and information on selectable contents is displayed on the basis of the input of the wearer 101 while being moved.

34, the input of the wearer 101 may be an input based on the user input 207, or may be an eye-based input, such as blinking of the wearer's 101 or pupil movement, but is not limited thereto. For example, the input of the wearer 101 may be a voice signal of the wearer 101 received via the microphone 214 or a gesture of the wearer 101 recognized by the camera 206.

The input of the wearer 101 may include an input for moving information about a plurality of contents being displayed in order to search for the content and an input for selecting the content. A plurality of contents displayed in the case of FIG. 34 are moved in the left and right direction, but a plurality of contents can be moved in the vertical direction according to the input of the wearer 101. [

The input of the wearer 101 based on the eyes may use the eye image obtained by the biometric information acquiring camera 208, but is not limited thereto. Information on a plurality of other contents that can be selected may be provided in the form of at least one of an icon, a representative image representing contents of other contents, and text. For example, information on a plurality of different contents that can be selected may be provided in the form of a combination of icons and names of other contents.

In step S3207, when a selection signal for other contents desired to be executed is received, the HMD device 100 executes other selected contents in step S3208.

Fig. 32 can change the guide information on a plurality of different contents into the guide information on a plurality of functions as shown in Fig. The plurality of functions include a function of relieving fatigue of the wearer (101). The plurality of functions may include, for example, at least two of the content providing function shown in Figs. 24 to 29 and the lining function or the slim function shown in Fig. 30 and the thermal function shown in Fig. 31 have.

FIG. 35 is a flowchart illustrating an operation of continuously providing content that has been stopped when content provided in the flow chart of FIG. 19 is completed.

Steps S3501 to S3508 may be performed similarly to steps S1901 to S1908 in Fig.

If it is determined in step S3509 that the provision of the other contents is completed, the HMD device 100 continuously provides the contents previously provided before providing the other contents in step S3510.

Providing the contents continuously can provide contents from the point where the contents provision is stopped or the point before the point where the stop is stopped, but the present invention is not limited thereto. In the case where the provided content is a video, the predetermined section may be set to several frames, but is not limited thereto. For example, if the contents are contents obtained by restoring an image compressed by an I picture (Intra-Picture), a P picture (Predict-Picture), and a B picture (Bi-direction-Picture) In the case where it is not a point, the predetermined section may be set to be provided from the I picture before the stopped point, but is not limited thereto. Completion of the provision of other contents means that the execution of the other contents is completed.

FIG. 36 is a flowchart illustrating an operation of stopping provision of other contents according to another contents provision stop request during the provision of contents according to the flowchart of FIG. 19, and continuously providing the stopped contents.

Referring to FIG. 36, steps S3601 to S3608 and step S3611 may be performed similarly to steps S1901 to S1908 in FIG.

In step S3609, if another content provision stop request is received, the HMD device 100 stops providing other contents in step S3610, and continuously provides the content that was stopped in step S3605 in step S3611. Providing the contents continuously can be performed as in step S3510 of Fig.

Another content provision stop request received in step S3609 includes an input based on an eye of the wearer 101 (e.g., eye blinking, pupil movement, etc.), a voice signal of the wearer 101 received via the microphone 214 , Gesture information (e.g., finger-based gesture information) of the wearer 101 that can be obtained by the camera 206, and input based on the user input 207. However, the present invention is not limited thereto.

FIG. 37 is a flowchart illustrating an operation of continuously providing contents that have been stopped after completion of providing other contents according to the flowchart of FIG. 19; FIG.

Steps S3701 to S3710 in FIG. 37 can be operated similarly to steps S3501 to S3510 in FIG.

Steps S3711 to S3713 in Fig. 37 can be operated similarly to steps S3609 to S3611 in Fig.

FIG. 38 is a flowchart illustrating an operation of providing another content providing result after the provision of contents according to the flowchart of FIG. 19 is completed.

Steps S3801 to S3809 of Fig. 38 operate similarly to steps S3501 to S3509 of Fig.

In step S3809, if it is determined that the other content provision is completed, the HMD device 100 provides another content provision result. Other content providing results may be provided based on the biometric information of the wearer 101's eyes. For example, the HMD device 100 detects eye-based biometric information by the biometric information acquiring camera 208. The eye-based biometric information detection method can be performed as described in FIG. 1C. The biometric information based on the detected eyes may be compared with the notification criteria referred to in FIG. 1C, and the comparison result may be provided as another content providing result.

The other contents providing result includes information informing the wearer 101 of the degree of fatigue of the wearer 101 as the other contents are provided. Other content providing results may be provided in the form of at least one of video, text, audio, and icon, but is not limited thereto. For example, another content providing result may be provided with an image that can compare an image of an eye before providing another content with an image of an eye after providing another content.

FIG. 39 is an example of another content providing result. 39, the HMD device 100 may provide a screen 3901 that includes other content provision results (e.g., reduced eye congestion), but is not limited thereto.

40 is a flowchart of a method of operating the HMD device 100 according to another preferred embodiment of the present invention. 40 is an example of providing other contents by providing guide information on other contents after the contents are provided.

Steps S4001 and S4002 are operated similar to steps S601 and S602 of Fig. 6, and steps S4004 to S4006 may be operated similar to steps S1906 to S1908 of Fig.

In step S4003, the HMD device 100 displays guidance information on other contents on the display 212 when the provision of the contents is completed. Completion of the provision of the content may include completion of the provision of the content by reaching the end point of the content regardless of the command of the wearer 101 or completion of the provision of the content according to the command of the wearer 101.

41 is a flowchart of a method of operating the HMD device 100 according to another preferred embodiment of the present invention. 41 is an example of providing notifications including guide information on other contents while providing contents, and continuously providing contents.

Steps S4101 and S4102 may be performed similarly to steps S601 and S602 of Fig. 6 described above.

If it is determined in step S4103 that the information obtained in step S4102 and the reference information are compared with each other as in step S603 in Fig. 6 described above and it is determined that it is necessary to provide other contents, the HMD device 100 displays And provides a notification containing information. In step S4103, the HMD device 100 may temporarily suspend the provision of contents, and may provide a notification including guidance information on other contents.

42 is an example of temporarily stopping the provision of the content and providing a notification including guidance information (execute other content) for the other contents.

Referring to the screen 4210 of FIG. 42, when the movie image 4211 is provided to the wearer 101 using the HMD device 100, if the HMD device 100 is in a situation to provide other contents, Instead of the movie image 4211, a notification 4221 including guidance information such as " execute other contents " as shown in the screen 4220. [ The notification 4221 may be displayed for a predetermined time or longer. The predetermined time may be set to 1 second, but is not limited thereto. The situation in which other contents are to be provided can be detected by comparing the information obtained in step S4102 with the reference information (reference information mentioned in FIG. 1B to FIG. H) as a situation in which the wearer 101 must release fatigue.

In step S4103, the notification 4221 including guidance information on other content provision is displayed. In step S4104, the HMD device 100 continuously provides the movie image 4231 (screen 4230 in Fig. 42) Reference). The movie image 4221 and the movie image 4231 shown in FIG. 42 may be the same image or the same image. For example, the movie image 4221 and the movie image 4231 may be frame images of the stopped point before displaying the notification 4221 including guidance information on other contents. However, the movie image 4231 is a frame image at a point stopped before the notification 4221 including guide information on other contents is displayed as described in Fig. 8 (a), and the movie image 4231 is notified The relationship between the movie image 4231 and the movie image 4211 may be based on the next frame of the frame of the stopped point before the display 4221 is displayed. For example, the movie image 4231 may be a frame image before a certain interval described in step S3510 of FIG.

The notification 4221 displayed in step S4203 can be displayed as shown in Fig. 8 (b) or Fig. 8 (c).

FIG. 43 is a diagram for explaining the operation system 4300 of the HMD device 100. FIG. FIG. 43 may be referred to as a relationship diagram or a network configuration between devices to explain a method of operating the HMD device 100 according to a preferred embodiment, but is not limited thereto.

The system 4300 shown in Figure 43 includes an HMD device 100, a smart watch 4310, a smartphone 4320, a smart TV 4330, a server 4340, and a network 4350 . However, the system 4300 is not limited to the one shown in Fig.

For example, the smart watch 4310, the smartphone 4320, the smart TV 4330, and the server 4340 may be included in at least one external device of the HMD device 100. The smart watch 4310 may be included in an assist device connected to the HMD device 100 and operated. The auxiliary device may correspond to an appset. An app set refers to a device that is connected to a main device (for example, the HMD device 100) and operates as an app.

The server 4340 is a server that can provide other contents providing services according to the preferred embodiments using the HMD device 100 or the external device of the HMD device 100 and the HMD device 100, But is not limited to, a cloud server of wearer 101. The other contents providing service is a service for providing the wearer 101 with contents that can alleviate the fatigue of the wearer 101. The system 4300 may further include an external storage device that stores PIMS information or life log information of the wearer 101. [

Network 4350 may include a wired or wireless based network. The network 4350 can be used for short-range communication or direct communication between the HMD device 100 and the smart watch 4310, between the HMD device 100 and the smartphone 4320, between the HMD device 100 and the smart TV 4330, But is not limited to, a network and a network capable of long distance communication between the HMD device 100 and the server 4340.

The near field communication or direct communication may be a Bluetooth communication, a BLE (Bluetooth Low Energy) communication, a NFC (Near Field Communication), a WLAN (WiFi) communication, a Zigbee communication, an IrDA , WFD (Wi-Fi Direct) communication, UWB (ultra wideband) communication, Ant + communication, and the like.

The long-distance communication may include, for example, communication based on a mobile communication network (e.g., D2D, Device-to-Device communication, base station based communication, Internet of Thinking (IoT), M2M Machine, etc.), wired or wireless Internet, satellite-based communications, broadcast communications, and the like.

The smart watch 4310 may be used to input a user ' s command to execute other content, but the function in which the smart watch 4310 is utilized is not limited to this. For example, the smart watch 4310 may be used to display a notification containing other content provisioning information.

The smartphone 4320 may be used to input a command of the user to provide other content or to display a notification containing guidance information on other content provision or to provide other content, but the smartphone 4320 may be used The function is not limited to this.

Smart TV 4330 may be used to display notifications that contain guidance information regarding other content provision or to provide other content.

The server 4340 can be used to provide the information necessary for providing other contents to at least one of the HMD device 100, the smart watch 4310, the smartphone 4320 and the smart TV 4330. [

Information provided from an app store such as smart watch 4310 may include health information of wearer 101. [ For example, the health information includes health information of the wearer 101 sensed by using a biosensor such as a sweat sensor, a blood pressure sensor, a pulse sensor, and a blood glucose sensor mounted on the smart watch 4310 and the activity information of the wearer 101 And may include measurement information. The health information that can be sensed by the smart watch 4310 is not limited to the one just described.

System 4300 may include appsets other than smart watch 4310. App stores other than the smart watch 4310 may be used for various types of smart ornaments (e.g., smart ring, smart earring, smart band, smart necklace, etc.), various smart patches, Applications such as smart office supplies such as smart clips, smart body protectors such as smart knee protectors, smart arm protectors, smart shoes, smart gloves, smart clothing, smart caps, smart prostheses, But it is not limited thereto. System 4300 may include at least one of the above-described appsets instead of smart watch 4310. [ The system 4300 may include at least one of the smart watch 4310 and the above-described appset.

Information provided from an external device such as smartphone 4320 or server 4340 may include personal information and / or health information of wearer 101. [ The personal information includes, for example, profile information, life log information of the wearer 101, PIMS information of the wearer 101, age of the wearer 101, sex of the wearer 101, The history information of the wearer 101, and the current medical history information of the wearer 101, and the like.

The smartphone 4320 and the smart TV 4340 may be replaced by various types of devices such as, for example, a Portable Device, a Home Internet Appliance, and a Mobile Device. have.

The portable device may be a notebook, a smart board, a tablet PC, a handheld device, a handheld computer, a media player, an electronic book terminal, a PDA (Personal Digital Assistant) But are not limited thereto.

Home Internet appliances include home devices that make up M2M (Machine to Machine) or IoT (Internet of Things) such as Smart TV, PC (Personal Computer), Desktop PC (Personal Computer), refrigerator, washing machine, But is not limited to.

A mobile device may include, but is not limited to, a device such as an automobile that forms an M2M (Machine to Machine) or Internet of Things (IoT).

The information that may be provided based on the application installed in the HMD device 100 may include, but is not limited to, environmental information, such as weather, provided by weather stations. The ambient information provided by the HMD device 100 may be used to detect situations in which the wearer 101 should be relieved of fatigue.

Figure 44 is a flow chart illustrating a method of operating system 4300 in accordance with one preferred embodiment. 44 is a flowchart illustrating a method of stopping the provision of content through the external device of the HMD device 100 (for example, the smart watch 4310, the smartphone 4320) (702), and stops the provision of the content by the HMD device (100) when a provision stop request for the content is received via the external device.

In the case of FIG. 44, the external device may include at least one of the smart watch 4310 and the smartphone 4320, but the external device is not limited thereto. Hereinafter, the case where the external device is the smartphone 4320 will be described, but the following description may be applied to the smart watch 4310 as well.

The smartphone 4320 may be a smartphone of the wearer 101 of the HMD device 100 but may be a smartphone of the wearer 101 or a person located near the wearer 101, But it is not limited to this. The position of the wearer 101 in the periphery may be an open space (or area) within a certain radius (e.g., 5 m) based on one closed space (e.g., room or groove) or the wearer 101 But is not limited thereto. If the smartphone 4320 is the parent smartphone, the HMD device 100 can be controlled by the parent smartphone 3220 to stop the content provisioning function.

In FIG. 44, the connection between the HMD device 100 and the smartphone 4320 can be executed when the content is provided by the HMD device 100, but in step S4404, information for displaying the provision stop notification on the content is transmitted . The above connection may be connected, but not limited to, based on one of short-range wireless communication, long-range wireless communication, and wired communication.

In step S4401, the HMD device 100 provides the contents. The HMD device 100 can provide the contents according to the execution of the application installed in the HMD device 100 as described with reference to FIG.

In step S4402, the HMD device 100 acquires information. Information acquisition by the HMD device 100 may be performed as described in step S602 of FIG.

In step S4403, the HMD device 100 determines whether to stop providing the content using the acquired information and the reference information. The determination as to whether or not to stop providing contents can be performed as described in step S603 of FIG. As a result of the determination, if it is detected that the provision of the content should be stopped, the HMD device 100 transmits information for displaying the provision stop notification to the smartphone 4320.

The termination of the provision of the content refers to a situation in which the content provided by the HMD device 100 should be relieved from fatigue accumulated in the wearer 101 as described in FIG. The information for displaying the notification sent to the smartphone 4320 can be determined according to the form in which the notification is displayed, but is not limited thereto. For example, the information for displaying the notification may include information as described in the notification 702 in Fig.

In step S4405, the smartphone 5420 displays a provision stop notification for the content based on the information for displaying the received notification. The notification may be expressed in one of the above-described Figs. 7, 8 (b), and 8 (c), but is not limited thereto. For example, the notification may be displayed using the status bar area of the smartphone 4320. [ When a notification is displayed using the status bar area, the smartphone 4320 can change the information for displaying the received notification to a form that can be displayed in the status bar area of the smartphone 4320. [

When a notification is displayed, the smartphone 4320 may provide content different from the content provided by the HMD device 100. [ The content provided by the smartphone 4320 is not limited to the content requested or provided by the user of the smartphone 4320. [ .

When the notification is displayed as shown in Fig. 8 (c), the smartphone 4320 displays a notification 702 in a display area that is independent of the area where the content currently being displayed is displayed, without using any other device can do.

As the notification 702 is displayed, the user of the smartphone 4320 may recognize that the wearer 101 of the HMD device 100 needs to relax the fatigue.

The smartphone 4320 transmits the received content provision stop request signal to the HMD device 100 (S4407) if a content provision stop request is received based on the notification displayed on the smartphone 4320 (S4406). The smartphone 4320 may receive a content provision stop request based on at least one of a user's voice input, a user's gesture input, and a touch input based on information displayed on the smartphone 4320, but is not limited thereto.

In step S4408, the HMD device 100 stops providing content.

Fig. 44 may be modified so that steps S1906 to S1908 of Fig. 19 are added after step S4408. Fig. 44 may be modified so that steps S3206 to S3208 of Fig. 32 are added after step S4408. Fig. 44 may be modified so that steps S3506 to S3510 of Fig. 35 are added after step S4408. FIG. 44 may be modified so that steps S3606 to S3611 of FIG. 36 are added after step S4408. FIG. 44 may be modified so that steps S3706 to S3713 of FIG. 37 are added after step S4408. Fig. 44 may be modified so that steps S3806 to S3810 of Fig. 38 are added after step S4408.

When the functions related to contents other than the flowchart of Fig. 44 are applied, other contents may be provided by the smartphone 4320 or the smart TV 4330. What other contents are provided by the smartphone 4320 or the smart TV 4330 means that other contents are reproduced by the smartphone 4320 or the smart TV 4330. [

Information related to other contents is transmitted from the smartphone 4320, the smart TV 4330, and the server 4340 to the HMD device 100, and the HMD The device 100 can reproduce the received content to alleviate the wearer 101 fatigue. Reproduction of other contents can be interpreted as a performance of function that can alleviate fatigue of the wearer 101 as mentioned in Figs. 19 and 32 and the like.

Figure 45 is a flow chart illustrating a method of operating system 4300 in accordance with another preferred embodiment. FIG. 45 is a flowchart illustrating a method of controlling the content providing operation of the HMD device 100 based on information obtained by the HMD device 100, by the smart phone 4320, Yes. 45 may be applied between the HMD device 100 and the smart TV 4330, between the HMD device 100 and the server 4340, and so on.

Steps S4501, S4502, S4505 to S4508 of Fig. 45 operate similarly to steps S4401, S4402, S4405 to S4408 of Fig. 44 described above.

In step S4503, the HMD device 100 transmits the information obtained in step S4502 to the smartphone 4320. [ The smartphone 4320 compares the information received from the HMD device 100 with the reference information described in FIG. 1B to FIG. 1G to determine whether to stop providing the contents.

As a result of the determination, if a situation to stop the provision of the content is detected, the smartphone 4320 displays the content provision stop notification in step S4504.

45 may be modified such that steps S1906 to S1908 of Fig. 19 are added after step S4508 as in Fig. Fig. 45 may be modified so that steps S3206 to S3208 of Fig. 32 are added after step S4508. Fig. 45 may be modified so that steps S3506 to S3510 of Fig. 35 are added after step S4408. Fig. 45 may be modified so that steps S3606 to S3611 of Fig. 36 are added after step S4508. Fig. 45 may be modified so that steps S3706 to S3713 of Fig. 37 are added after step S4508. Fig. 45 may be modified so that steps S3806 to S3810 of Fig. 38 are added after step S4508. 45, a function related to providing other contents may be applied as shown in FIG.

46 is a flow diagram of a method of operating system 4300 in accordance with another preferred embodiment. 46 is an example in which the HMD device 100 notifies whether or not the content provision is suspended based on the information provided from the smart watch 4310. [

Steps S4601, S4604, and S4607 of Fig. 46 operate similarly to steps S4401, S4403, and S4408 of Fig. 44 described above.

43, the smart watch 4310 acquires health information such as sweat discharge amount, blood pressure, pulse, blood sugar, etc. of the wearer 101 using the biosensor mounted on the smart watch 4310, Information on the amount of activity of the wearer 101 can be obtained by using the measurement function.

In step S4603, the smart watch 4310 transmits the obtained information to the HMD device 100. [ Accordingly, in step S4604, the HMD device 100 determines whether to stop providing the content. The discontinuation of provision for the content may be determined by comparing the notification reference information mentioned in the health information of FIG. 1C with the information received from the smart watch 4310. [

As a result of the determination, if it is detected that the provision of the content should be stopped, in step S4605, the HMD device 100 displays the content provision stop notification. The notification may be expressed in the form of one of Figs. 7, 8 (b) and 8 (c), but is not limited thereto.

If the content provision stop request is received in step S4606 based on the notification being displayed, the HMD device 100 stops providing the content.

46 may also be applied between the HMD device 100 and the smartphone 4320. 46 is applied between the HMD device 100 and the smartphone 4320, the information obtained in step S4602 includes information on the amount of activity of the wearer 101 mentioned in Fig. 1C, the surrounding information referred to in Fig. 1F , And personal information of the wearer 101 referred to in Fig. 1G.

46 may also be applied between the HMD device 100 and the server 4340. 46 is applied between the HMD device 100 and the server 4340, the information obtained in step S4602 includes the medical information of the wearer 101 referred to in Fig. 1C, the surrounding information referred to in Fig. 1F, And personal information of the wearer 101 referred to in 1g.

Step S4603 of FIG. 46 may be changed to transmit information obtained by the smart watch 4310 as information transmission is requested by the HMD device 100. FIG.

Fig. 46 may be modified so that steps S1906 to S1908 of Fig. 19 are added after step S4607 as shown in Fig. Fig. 46 may be modified so that steps S3206 to S3208 of Fig. 32 are added after step S4607. Fig. 46 may be modified so that steps S3506 to S3510 of Fig. 35 are added after step S4607. Fig. 46 may be modified so that steps S3606 to S3611 of Fig. 36 are added after step S4607. Fig. 46 may be modified so that steps S3706 to S3713 of Fig. 37 are added after step S4607. Fig. 46 may be modified so that step S3806 to step S3810 of Fig. 38 are added after step S4607. 46, a function related to providing other contents can be applied as shown in FIG.

Figure 47 is a flow diagram of a method of operating system 4300 in accordance with another preferred embodiment. FIG. 47 is a view for determining whether content provision is suspended using information acquired by the HMD device 100 and information acquired by an external device (for example, a smart watch 4310 or a smartphone 4320) Yes.

Steps S4701 and S4702 in Fig. 47 can be operated similarly to steps S4401 and S4402 in Fig. Steps S4703 and S4704 in Fig. 47 can be operated similar to steps S4602 and S4603 in Fig. Steps S4706 to S4708 in Fig. 47 can be operated similarly to steps S4605 to S4607 in Fig.

In step S4705, the HMD device 100 transmits the information obtained by the HMD device 100 and the information transmitted from the smart watch 4310 or the smartphone 4320 to the reference information for notification described in Figs. 1B to 1H And determines whether to stop the provision of the content provided by the HMD device 100. [

For example, the information obtained in step S4702 is one of the information of the HMD device 100 described in Fig. 1B, the eye-based biometric information described in Fig. 1C, and the environment information described in Fig. 1F, and step S4704 The information to be transmitted may be but is not limited to the health information described in Fig. 1C, the environment information described in Fig. 1F, and the personal information described in Fig. 1G.

In step S4705, the HMD device 100 can determine whether or not to stop providing the content in the same manner as determining whether to display the notification using the plurality of pieces of information described in Fig.

47 may be applied between the HMD device 100 and the server 4340 as well. 47 is applied to the HMD device 100 and the server 4340, the server 4340 receives the health information described in FIG. 1C, the environment information described in FIG. 1F, and the individual Information may be provided to the HMD device 100, but the information provided is not limited thereto.

Fig. 47 may be modified so that steps S1906 to S1908 of Fig. 19 are added after step S4708 as shown in Fig. Fig. 47 can be modified so that steps S3206 to S3208 of Fig. 32 are added after step S4708. Fig. 47 may be modified so that steps S3506 to S3510 of Fig. 35 are added after step S4708. Fig. 47 can be modified so that steps S3606 to S3611 of Fig. 36 are added after step S4708. Fig. 47 can be modified so that steps S3706 to S3713 of Fig. 37 are added after step S4708. Fig. 47 may be modified so that steps S3806 to S3810 of Fig. 38 are added after step S4708. 47, a function related to providing other contents may be applied as shown in FIG.

48 is a functional block diagram of an HMD device 100 in accordance with a preferred embodiment. 48, the HMD device 100 may include an information obtaining unit 4810, a control unit 4820, a display 4820, and a user input unit 4840. [ However, not all illustrated components are required. The HMD device 100 may be implemented by more components than the components shown, and the HMD device 110 may be implemented by fewer components.

49, the HMD device 100 according to an exemplary embodiment includes an information obtaining unit 4910, a control unit 4920, a user interface unit 4930, a sensor unit 4940, a memory (not shown) 4950, an image processing unit 4960, an audio output unit 4970, an audio input unit 4975, a camera 4980, and a communication unit 499. For example, the HMD device 100 may further include a battery.

The information obtaining unit 4810, the control unit 4820, the display 4830, and the user input unit 4840 shown in FIG. 48 correspond to the information obtaining unit 4910, the control unit 4920, the user interface unit 4930 and the user input 4932 included in the display 4931 and the user input 4932. [

The information acquisition unit 4910 acquires information generated in association with the content provided by the HMD device 100. [ The method of acquiring the information may use a method as described in Figs. 1A to 1H.

The information obtaining unit 4910 includes but is not limited to a first information obtaining unit 4911, a second information obtaining unit 4912, a third information obtaining unit 4913, and a fourth information obtaining unit 4914 .

The first information obtaining unit 4911 may obtain the information of the HMD device 100 according to the method mentioned in FIG. 1B. The second information obtaining unit 4912 can obtain the biometric information of the wearer 101 according to the method described in FIG. The third information obtaining unit 4913 can obtain the surrounding information of the HMD device 100 according to the method described with reference to FIG. 1F. The fourth information acquiring unit 4914 can acquire the personal information of the wearer 101 according to the manner mentioned in FIG. 1G.

The first to fourth information acquisition units 4911 to 4914 may have different components depending on the information to be acquired.

For example, when acquiring information on the content reproduction time by the first information acquisition unit 4911, the first information acquisition unit 4911 is configured with a timer connected to the wear sensor 4941 and the control unit 4920 Or a timer connected to the control unit 4920. When the first information obtaining unit 4911 includes a timer connected to the wear sensor 4941 and the control unit 4920, the first information obtaining unit 4911 obtains the signal sensed by the wear sensor 4941 When a signal indicating the content reproduction time is received from the control unit 4920, the control unit 4920 counts time to obtain the content reproduction time information, and provides the acquired content reproduction time information to the control unit 4920. [

When acquiring information on the battery consumption amount by the first information acquisition unit 4911, the first information acquisition unit 4911 acquires a component capable of detecting the remaining battery power based on the discharge voltage or the discharge current of the battery . In the case where the first information obtaining unit 4911 includes a component capable of detecting the remaining amount of the battery, the first information obtaining unit 4911 may provide the detected remaining amount of the battery to the control unit 4920. [

When acquiring the information about the heat generation temperature by the first information acquisition unit 4911, the first information acquisition unit 4911 may be constituted by a temperature sensor or a temperature sensor and a timer. When the first information obtaining section 4911 is constituted by a temperature sensor and a timer, the first information obtaining section 4911 obtains the temperature detected by the temperature sensor at a predetermined temperature (for example, 49 degrees) Acquire information on the time, and provide the acquired information to the control unit 4920.

The first information obtaining unit 4911 may be configured to obtain one of the information of the HMD device 100 shown in FIG. 1B, to be capable of acquiring at least two or more information, .

When acquiring biometric information based on the eyes of the wearer 101 shown in Fig. 1C by the second information acquiring unit 4912, the second information acquiring unit 4912 is constituted by the biometric information acquiring camera 208 . The second information acquiring unit 4912 is connected to the communication unit 4990 to acquire health information of the wearer 101 shown in Fig. 1C by the second information acquiring unit 4912, Or may receive the health information of the biosensor 4943 and transmit the sensed value to the controller 4920. The control unit 4920 may receive the health information of the biosensor 4943,

The re-2 information obtaining unit 4912 can be configured to obtain one piece of information shown in Fig. 1C, but can be configured to obtain at least two pieces of information or all the pieces of information shown in Fig. 1C. Information obtained by the second information obtaining unit 4912 is provided to the control unit 4920. [

1F is acquired by the third information obtaining unit 4913, the third information obtaining unit 4913 is connected to the environmental sensor 4942 to control the sensing value of the environmental sensor 4942 to the control unit 4920). ≪ / RTI > The third information obtaining unit 4913 may be configured to obtain one piece of the surrounding information of FIG. 1F, but may be configured to obtain at least two pieces of information, or may be configured to obtain all the pieces of information. The information obtained by the third information obtaining unit 4913 is provided to the control unit 4920. [

A component for reading private information from the memory 4950 and transferring it to the control unit 4920 when acquiring the personal information of Fig. 1G by the fourth information acquiring unit 4914; A component for receiving the personal information and transmitting the personal information to the control unit 4920, and a component for transmitting the personal information received from the external device to the control unit 4920 through the communication unit 4990.

The fourth information acquiring unit 4914 may be configured to acquire one piece of personal information of the personal information of FIG. 1G, but may be configured to acquire at least two pieces of information or all pieces of information. The information obtained by the fourth information obtaining unit 4914 is provided to the control unit 4920. [

The control unit 4920 compares the information obtained by the information obtaining unit 4910 with the notification standard information described in FIG. 1B to FIG. 1H to determine whether to stop providing the content reproduced by the HMD device 100. FIG. If it is determined that the content should be stopped, the control unit 4920 displays a notice on the display 4931 as to whether or not to stop providing the content. The notification can be displayed in the form of one of Figs. 7, 8 (b), and 8 (c). The above-described situation refers to a situation in which the wearer 101 should be relieved of fatigue as mentioned in the above embodiments.

If a provision stop request for the content via the user input unit 4932 is received based on the notification displayed on the display 4931, the control unit 4920 stops providing the content by the HMD device 100. [

The control unit 4920 controls the overall operation of the HMD device 100. The control unit 4920 may be referred to as a processor that controls the operation of the HMD device 100. [ The control unit 4920 can control the components 4910, 4930 to 4990 shown in Fig. 49 by executing the program stored in the memory 4950. [

The control unit 6820 controls at least one of the operation flowcharts shown in Figs. 6, 9, 10, 16, 17, 19, 32, 35-38, 40, 41, As shown in FIG.

The user interface unit 4930 includes a display 4931 and a user input unit 4932.

The display 4931 may be comprised of one of the displays 212, 311, 413, 414, 502, 503 referred to in FIGS. The display 4931 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a three-dimensional display (3D display), an electrophoretic display electrophoretic display (EPD), or may be composed of, but not limited to, an optical wavelength guide (e.g., a prism) as referred to in Figures 2A-4.

The user input unit 4932 may be configured as one of the user input units 207, 306, 408, and 504 described in FIGS. The input information of the user that can be input through the user input unit 4932 may include at least one of touch-based input information, movement-based input information, and vision-based input information But is not limited thereto.

The sensor unit 4940 includes a wear sensor 4941, an environmental sensor 4942, a biosensor 4943, a proximity sensor 4944, a motion detection sensor 4945, a position sensor 4946, a gyroscope sensor 4947, An acceleration sensor 4948, and a geomagnetic sensor 4949.

The wear sensor 4941 may include the sensor 210 of FIG. 2A. The environmental sensor 4942 may include the sensor 209 of FIG. 2A. The environmental sensor 4942 may include a sensor capable of sensing the environment mentioned in FIG. 1F. The biosensor 4943 may include sensors capable of sensing health information of the wearer 101 referred to in Fig. 1C.

The proximity sensor 4944 can sense whether or not a part of the body such as the hand of the wearer 101 is approaching the HMD device 100. [ The motion detection sensor 4945 can sense the activity of the wearer 101. The position sensor 4946 can detect the position of the HMD device 100. [ For example, the position sensor 4945 may be configured as a Global Positioning System (GPS) receiver. The gyroscope sensor 4947 can measure the azimuth angle of the HMD device 100. The accelerometer sensor 4948 can measure the inclination and acceleration of the HMD device 100 around the ground surface. The geomagnetic sensor 4949 can sense the east, west, north, and south directions based on the HMD device 100.

The sensor unit 4940 may include a pressure sensor (e.g., a touch sensor, a piezoelectric sensor, a physical button, etc.), a status sensor (e.g., an earphone terminal, a Digital Multimedia Broadcasting (DMB) A terminal capable of recognizing whether the charging is progressed, a terminal capable of recognizing whether or not an external device is connected, a terminal capable of recognizing whether or not a doc connection is established), a time sensor, a stress sensor, an emotion sensor, .

The memory 4950 may include a UI module 4951, a notification module 4952, and an application module 4953. The notification module 4952 may include a notification module that provides the contents provision suspension notification, guidance information on other contents, and the like mentioned in the above-mentioned preferred embodiments.

The memory 4950 can store a program for processing and controlling the control unit 4920. [ The program stored in memory 4950 may include a content provisioning application, other content provisioning application, or other function provisioning application that may mitigate wearer 101 fatigue according to the preferred embodiment. The memory 4950 may store information necessary to execute the above-described applications. For example, the notification reference information mentioned in Figs. 1B to 1H may be stored.

The memory 4950 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory) , A random access memory (SRAM), a read only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM) A magnetic disk, and / or an optical disk.

The HMD device 100 may be configured to use a web storage or server 4340 that performs the storage function of the memory 4950 on the Internet.

Programs stored in the memory 4950 can be classified into a plurality of modules according to their functions. For example, programs stored in the memory 4950 may be classified into a UI module 4952, a notification module 4952, and an application module 4953, but are not limited thereto.

The UI module 4951 can provide the UI information about the content playback suspension notification, guide information on other contents, guide information on other functions, and the like to the control unit 4920, which is mentioned in the above-described preferred embodiments. The UI module 4951 can provide UIs and GUIs specific to each application installed in the HMD device 100 to the control unit 4920.

The notification module 4952 can generate a signal for notifying the provision of the UI for notification or guidance information mentioned in the preferred embodiments or for informing reception of information from the external devices 4310 to 4340, but is not limited thereto.

The notification module 4952 can output the notification signal in the form of a video signal through the display 4931 and output the notification signal in the form of an audio signal through the audio output unit 4970. However,

The application module 4953 may include, but is not limited to, the applications mentioned in FIG. 1A set in the HMD device 100 and the applications described above.

The image processing unit 4960 can process the image to be displayed on the display 4931. [ The image processing unit 4950 may include a function of restoring the compressed image. The image processing unit 4950 may include a function of editing the content frame and the notification frame as described with reference to Fig. 8 (a), which is controlled by the control unit 4920. [

The audio output unit 4970 may be configured as one of the audio output units 215, 216, 314, 416, 417, and 505 described in FIGS. 2A to 5, but is not limited thereto.

The audio output unit 4970 can output audio data received from the communication unit 4990 or stored in the memory 4950. In addition, the audio output unit 4970 can output an acoustic signal related to a function (e.g., a notification sound) performed by the HMD device 100. [ The audio output unit 4970 may include, but is not limited to, a speaker, a buzzer, and the like.

The audio input unit 4975 receives an audio signal input from the outside of the HMD device 100, converts the received audio signal into an electrical audio signal, and transmits the electrical audio signal to the controller 4920. The audio input unit 4975 may be constituted by a microphone.

The audio signal input from the outside receives the audio signal of the wearer 101 of the HMD device 100 or the ambient sound signal of the HMD device 100 of at least one of the external devices 4310 to 4340 of the HMD device 100 . The audio input unit 4975 may use various noise reduction algorithms to remove noise generated in receiving an external sound signal.

The camera 4980 can obtain an image frame such as a still image or a moving image in a video communication mode or a photographing mode. The camera 4980 can take a finger gesture image of the wearer 101 or an image of the real world that the wearer 101 can see and transmit to the control unit 4920. [ The image captured through the camera 4980 may be transmitted to the control unit 4920 or the image processing unit 4960 and processed. The image frame captured by the camera 4980 may be stored in the memory 4950 or may be transmitted to the outside via the communication unit 4990. [

The communication unit 4990 may include one or more components for communication between the HMD device 100 and at least one external device (at least one of 4310 to 4340). For example, the communication unit 4990 may include, but is not limited to, a local communicator 4991, a mobile communication device 4992, and a broadcast receiver 4993.

The local communicator 4991 includes a Bluetooth communication unit, a Bluetooth low energy communication unit, a near field communication unit (RFID), a WLAN communication unit, a Zigbee communication unit, an IrDA (infrared data association) , A WFD (Wi-Fi Direct) communication unit, an UWB (ultra wideband) communication unit, an Ant + communication unit, and the like.

The mobile communication device 4992 transmits and receives radio signals to at least one of a base station, an external device, and a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception. The mobile communication device 4992 is a communication device that transmits and receives data based on the mobile communication network-based communication (e.g., D2D, Device to Device), base station based communication, Internet of Thinking (IoT) (Machine to Machine), wired or wireless Internet, satellite-based communications, broadcast communications, and the like.

The broadcast receiver 4993 receives broadcast signals and / or broadcast-related information from outside through a broadcast channel. The broadcast channel may include, but is not limited to, at least one of a satellite channel, a terrestrial channel, and a radio channel.

The HMD devices 100 ', 300, 400, and 500 shown in FIGS. 2B to 5 may be configured as shown in FIG. 48 or 49, but are not limited thereto.

Other content providing services mentioned in the above embodiments may mean a function providing service that can alleviate fatigue of the wearer 101.

The method according to an embodiment of the present invention can be implemented in the form of a program command which can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and configured for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.

Claims (20)

An HMD (Head Mounted Display) device,
A display for displaying content;
A first information obtaining unit for obtaining information of the HMD device generated in association with the provision of the content;
A user input unit for inputting a command of a wearer; And
Displaying on the display a notification about whether to stop providing the content using the information of the HMD device,
And stopping provision of the content in response to receiving a provision stop request for the content through the user input unit
HMD device. 2. The apparatus of claim 1, wherein the information of the HMD device comprises:
The HMD device is worn and the playback time of the content,
The amount of battery consumption of the HMD device after the start of reproduction of the content, and
The method comprising: wearing the HMD device and storing at least one of the heating temperatures of the HMD device
HMD device. The apparatus of claim 1, wherein the HMD device
Further comprising a second information obtaining unit for obtaining the biometric information of the wearer in association with the provision of the content,
Wherein the controller displays the notification on the display using the information of the HMD device and the biometric information
HMD device. The apparatus of claim 1, wherein the HMD device
Further comprising a third information obtaining unit for obtaining the surrounding information of the HMD device in association with the provision of the content,
Wherein the controller displays the notification on the display using the information of the HMD device and the surrounding environment information
HMD device. The apparatus of claim 1, wherein the HMD device
Further comprising a fourth information acquiring unit acquiring the personal information of the wearer in association with the provision of the content,
The control unit displays the notification on the display using the information of the HMD device and the personal information
HMD device. The apparatus of claim 1,
After displaying the notification on the display, continuously providing the content through the display upon receiving a denial-of-provision refusal for the content through the user input unit
HMD device. The apparatus of claim 1,
Overlapping the notification with the content and displaying it on the display,
Inserting a frame of said notification between frames of said content and displaying said frame on said display; and
The notification is displayed in a display area different from the display area of the display on which the content is provided
Wherein the notification is displayed on the display by one. The apparatus of claim 1,
When the providing of the content is stopped, the HMD device provides another content
HMD device. 9. The apparatus according to claim 8,
Displaying information on a plurality of other contents on the display,
A selection signal based on information on a plurality of other contents being displayed is received, and a content selected from the plurality of other contents is provided
HMD device. The apparatus of claim 1,
Applying different reference information to the information of the HMD device according to the type of the content and displaying the notification on the display
HMD device. A method of operating an HMD (Head Mounted Display) device,
Providing content through a display of the HMD device;
Obtaining information of the HMD device generated in association with the provision of the content;
Displaying, on the display, a notification about whether to stop providing the content using the information of the HMD device;
Receiving a provision stop request for the content by the HMD device; And
Stopping provision of the content upon receiving a provision stop request for the content
≪ / RTI > 12. The method of claim 11, wherein the information of the HMD device comprises:
The HMD device is worn and the playback time of the content,
After the HMD device is worn and the reproduction of the content starts, the amount of battery consumption of the HMD device, and
After the HMD device is started to be played and the playback of the content is started,
A method of operating an HMD device. 12. The method of claim 11,
Further comprising the step of acquiring the biometric information of the wearer in association with the provision of the content,
Wherein the displaying the notification comprises:
And displaying the notification on the display using the information of the HMD device and the biometric information
A method of operating an HMD device. 12. The method of claim 11,
Further comprising the step of acquiring the surrounding information of the HMD device in association with the provision of the content,
Wherein the displaying the notification on the display comprises:
And displaying the notification on the display using the information of the HMD device and the surrounding environment information
A method of operating an HMD device. 12. The method of claim 11,
Further comprising the step of acquiring the personal information of the wearer in association with the provision of the content,
Wherein the displaying the notification on the display comprises:
And displaying the notification on the display using the information of the HMD device and the personal information
A method of operating an HMD device. 12. The method of claim 11,
Displaying the notification on the display, and receiving a continuous provisioning request for the content by the HMD device; And
The step of continuously providing the contents in response to receiving the stoppage of stopping the provision of the contents
Lt; RTI ID = 0.0 > HMD < / RTI > 12. The method of claim 11, wherein displaying the notification on the display further comprises:
Overlapping the notification on the content and displaying it on the display;
Inserting the notification between the contents and displaying it on the display; And
Displaying the notification in a display area different from the display area of the display on which the content is provided
A method of operating an HMD device, the method comprising one step. 12. The method of claim 11,
Providing the other contents by the HMD device as the provision of the contents is stopped
≪ / RTI > 19. The method of claim 18, wherein providing the other content comprises:
Displaying information on a plurality of other contents on the display;
Receiving a selection signal based on information on the plurality of different contents being displayed; And
Providing the selected content from among the plurality of different contents upon receipt of the selection signal
≪ / RTI > 12. The method of claim 11, wherein displaying the notification on the display further comprises:
Applying different reference information to the obtained information according to the type of the content and displaying the notification on the display
≪ / RTI >

Images