WO2017003069A1

WO2017003069A1 - Display device and control method therefor

Info

Publication number: WO2017003069A1
Application number: PCT/KR2016/003435
Authority: WO
Inventors: 정진혁; 김대현; 최용진
Original assignee: 삼성전자 주식회사
Priority date: 2015-07-02
Filing date: 2016-04-04
Publication date: 2017-01-05

Abstract

A display device is disclosed. The display device comprises: a display; a motion sensor for sensing a movement of the display device; a photographing unit for photographing peripheral areas of the display device; and a processor for displaying content on a preset area of the display, and controlling the display such that the display displays, on at least a partial area of the remaining areas excluding the preset area, an image captured through the photographing unit, if a preset movement of the display device is sensed by the motion sensor.

Description

Display device and control method thereof

The present invention relates to a display apparatus and a control method thereof, and more particularly, to a display apparatus and a control method thereof capable of providing VR content.

Recently, as research on wearable devices has been actively conducted, various wearable devices have been released. Wearable devices that are or will be released today include smart watches, head mounted display (HMD) devices, and smart belts.

The HMD device is a wearable display device that can be worn as if wearing glasses, and can display an image. The HMD device is also called a face mounted display (FMD) because the display is disposed near the wearer's eyes. The HMD device can be combined with augmented reality technology, N screen technology, and the like to provide various conveniences to the user beyond simple display functions.

In particular, the HMD device may provide a surrounding image to provide a user with a more realistic and realistic virtual space. The surrounding image may represent visual information unfolded in all directions around the HMD device. Accordingly, the HMD device may direct a direction that the face of the user wearing the HMD device faces, and display an image corresponding to the corresponding direction among the surrounding images. In this way, the user can feel as if he is actually present in the virtual space.

On the other hand, since the HMD device is worn on the user's head to block the view of the outside for more realistic and immersive content viewing, in order to check the external situation while the user is viewing the content, the HMD device is visually external to the outside of the HMD device. There was a problem that can only confirm the situation.

Therefore, in order to solve such inconvenience, a solution for easily and quickly recognizing the external situation during content viewing is required.

The present invention has been made to solve the above-described problem, an object of the present invention is to provide a display device and a control method that can be made to recognize the external situation easily and quickly while viewing the content through the HMD device.

According to an aspect of the present invention, a display device includes a display, a motion sensor for detecting a movement of the display device, a photographing unit for capturing a peripheral area of the display device, and a content of the display device. And controlling the display to display an image photographed through the photographing unit in at least a portion of the remaining areas other than the preset area when the motion is detected by the motion sensor. It includes a processor.

The processor may display an image photographed by the display apparatus moved in the movement direction in an area corresponding to the movement direction of the display apparatus based on the region in which the content is displayed among the remaining regions.

The processor may be further configured to display the content in a center area of the display, and to move the content in an area corresponding to the movement direction among first to fourth areas respectively positioned in the up, down, left, and right directions based on the center area. An image captured by the moved display device may be displayed.

The processor may reduce and display the contents, and when the region corresponding to the movement direction of the display device is expanded according to the reduction of the contents, the processor may capture an image captured by the display apparatus moved in the movement direction to the expanded region. Can be displayed.

The processor may move the position of the area where the content is displayed and move in the movement direction to the extended area when an area corresponding to a direction opposite to the direction in which the content is displayed is moved. An image captured by the display device may be displayed.

The processor may display the captured image in the at least some region when at least one of the distance and the speed at which the display device sensed by the motion sensor moves exceeds a preset threshold.

The apparatus may further include an acoustic sensor, and when the acoustic signal detected by the acoustic sensor is equal to or larger than a preset size, the processor may display the captured image on the at least some region.

The processor may change the at least some region to a state before the image photographed by the photographing unit is displayed when the display apparatus moved in the movement direction is returned to the state before the movement of the display apparatus.

The processor may change the at least some region to a state before the image photographed by the photographing unit is displayed when a predetermined time elapses.

In addition, the processor may control the display to replace and display the content displayed in the preset area with an image photographed through the photographing unit.

The display device may be a head mounted display (HMD) device for providing VR (Virtual Reality) content.

On the other hand, the control method of the display device according to an embodiment of the present invention, the step of displaying the content in a predetermined area of the display, detecting a predetermined movement of the display device, photographing the peripheral area of the display device And displaying an image of the photographed peripheral area in at least some of the remaining areas other than the preset area.

The displaying may include displaying an image photographed by the display apparatus moved in the movement direction in a region corresponding to the movement direction of the display apparatus based on the region where the content is displayed among the remaining regions.

The displaying may include displaying the content in a center region of the display, and displaying the content in a region corresponding to the movement direction among the first to fourth regions respectively positioned in the up, down, left, and right directions based on the center region. The image photographed by the display apparatus moved in the movement direction may be displayed.

In addition, the displaying may include reducing and displaying the content, and when the area corresponding to the movement direction of the display device is expanded according to the reduction of the content, the display device may be photographed by the display device moved in the movement direction to the expanded area. One image can be displayed.

The displaying may include moving a position of an area where the content is displayed and extending an area corresponding to a direction opposite to a direction in which the content is displayed is moved in the movement direction in the extended area. An image captured by the moved display device may be displayed.

The displaying may include displaying the captured image in the at least some region when at least one of the detected distance and speed of the display device exceeds a preset threshold.

The method may further include detecting an acoustic signal, and the displaying may include displaying the captured image on the at least some region when the detected acoustic signal is greater than or equal to a preset size.

The method may further include changing the at least some region to a state before the captured image is displayed when the display apparatus moved in the movement direction returns to the state before the movement of the display apparatus.

The method may further include changing the at least some region to a state before the photographed image is displayed when a preset time elapses.

According to various embodiments of the present disclosure as described above, an external situation can be easily and quickly recognized while viewing contents through the HMD device, thereby improving user convenience.

1A and 1B illustrate a form and appearance of use of a display apparatus according to an embodiment of the present invention;

2 is a block diagram schematically illustrating a configuration of a display apparatus according to an exemplary embodiment of the present disclosure;

3 is a diagram illustrating a screen on which content is displayed in a display device according to an embodiment of the present disclosure;

4 and 5 are views for explaining the remaining areas other than the preset area where content is displayed, according to an embodiment of the present invention;

6 to 8 are diagrams for describing various methods of displaying an image photographed according to a movement of a display apparatus according to one embodiment of the present invention;

9 is a block diagram schematically illustrating a configuration of a display apparatus according to another embodiment of the present disclosure;

10 is a diagram for describing a method of displaying an image photographed as a sound is detected, according to an embodiment of the present disclosure;

11 is a block diagram illustrating in detail a configuration of a display apparatus according to another exemplary embodiment.

12 is a flowchart illustrating a control method of a display apparatus according to an exemplary embodiment.

Before describing this invention concretely, the description method of this specification and drawing is demonstrated.

First, terms used in the present specification and claims are selected from general terms in consideration of functions in various embodiments of the present invention. However, these terms may vary depending on the intention of a person skilled in the art, legal or technical interpretation, and the emergence of new technology. In addition, some terms may be arbitrarily selected by the applicant. Such terms may be interpreted in the meanings defined herein, and may be interpreted based on the general contents of the present specification and common technical knowledge in the art without specific term definitions.

In addition, the same reference numerals or symbols described in each drawing attached to the present specification represent parts or components that perform substantially the same function. For convenience of explanation and understanding, different embodiments will be described using the same reference numerals or symbols. That is, although all the components having the same reference numerals are shown in the plurality of drawings, the plurality of drawings does not mean an embodiment.

In addition, in the present specification and claims, terms including ordinal numbers such as “first” and “second” may be used to distinguish between components. These ordinal numbers are used to distinguish the same or similar components from each other, and the meaning of the terms should not be construed as limited by the use of these ordinal numbers. For example, the components combined with these ordinal numbers should not be construed as limiting the order of use or arrangement of the components. If necessary, the ordinal numbers may be used interchangeably.

As used herein, the singular forms "a", "an" and "the" include plural forms unless the context clearly indicates otherwise. In this application, the terms “comprise” or “comprise” are intended to indicate that there is a feature, number, step, action, component, part, or combination thereof described on the specification, one or more other It is to be understood that the present invention does not exclude the possibility of the presence or the addition of features, numbers, steps, operations, components, components, or a combination thereof.

In an embodiment of the present invention, terms such as “module”, “unit”, “part”, and the like are terms for referring to a component that performs at least one function or operation, and such components are referred to as hardware or software. It may be implemented or in a combination of hardware and software. In addition, a plurality of "modules", "units", "parts", etc. are integrated into at least one module or chip, except that each needs to be implemented as a specific specific hardware, at least one processor It may be implemented as (not shown).

In addition, in an embodiment of the present invention, when a part is connected to another part, this includes not only a direct connection but also an indirect connection through another medium. In addition, the meaning that a part includes a certain component means that it may further include other components, without excluding other components, unless specifically stated otherwise.

Hereinafter, with reference to the drawings will be described in detail with respect to the present invention.

1A and 1B illustrate a form and appearance of use of a display apparatus according to an exemplary embodiment.

The display device of the present invention may be implemented as an HMD device that can be worn around a user's head or like a pair of glasses to provide VR content. In this case, the display device is a terminal device which is implemented as an integrated HMD device in which a band for wearing on a user's head and various user input units and displays are integrated or detached from a detachable HMD device without a display to provide a display. It may be implemented as.

FIG. 1A illustrates a state in which a user wears a display device 100A implemented as an integrated HMD device on a head. Here, the display apparatus 100A may be worn in a form of fixing the user's forehead and the back of the head by a Velcro band, and may block a view of the user's external environment in addition to the contents provided by the display apparatus 100A.

FIG. 1B illustrates an appearance of a display apparatus 100B that is implemented to be detachably used for a detachable HMD device. As shown in FIG. 1B, the display apparatus 100B may be implemented as a terminal device such as a smart phone to provide a display in a form detachable from the main body 10 of the HMD device.

However, in the embodiment shown in Figure 1B, the display device of the present invention is not limited to a smart phone, a tablet PC (tablet personal computer), mobile phone (mobile phone), video phone, e-book reader (e-book) reader, personal digital assistant (PDA), portable multimedia player (PMP), MP3 player, navigation, camera, and the like.

The following display devices are collectively referred to as display devices used by being detached from an integrated HMD device or a separate HMD device.

2 is a block diagram schematically illustrating a configuration of a display apparatus according to an exemplary embodiment.

Referring to FIG. 2, the display apparatus 100 according to an exemplary embodiment includes a display 110, a motion sensor 120, a photographing unit 130, and a processor 140.

The display 110 is a configuration that provides a screen including various contents that can be reproduced by the display apparatus 100. Here, the content may include content in various formats such as text, image, video, and graphical user interface (GUI). In particular, the content may be implemented as VR content for providing a 3D image.

Implementation of the display 110 is not limited, and includes, for example, a liquid crystal display (LCD), an organic light emitting diodes (OLED) display, an active-matrix organic light-emitting diode (AM-OLED), a plasma display panel (PDP). It can be implemented in various forms of display such as. The display 110 may additionally include additional components, depending on its implementation. For example, when the display 110 is a liquid crystal system, the display 110 may include an LCD display panel (not shown), a backlight unit (not shown) for supplying light thereto, and a panel driving substrate for driving the panel (not shown). (Not shown).

The motion sensor 120 is a component for detecting a movement of the display apparatus 100. The motion sensor 120 may include at least one sensor of an acceleration sensor (not shown), a geomagnetic sensor (not shown), and a gyro sensor (not shown). Various sensors included in the motion sensor 120 may detect 3D motion of the display apparatus 100 through one or a combination of two or more of them.

The acceleration sensor is a sensor that measures the spatial movement of the display apparatus 100. That is, the acceleration sensor refers to a sensor that detects a change in acceleration and / or a change in angular acceleration that occurs when the user moves the display apparatus 100. The acceleration sensor may detect acceleration in three axes. In addition, the acceleration sensor may detect the inclination of the display apparatus 100.

Geomagnetic sensors are sensors that measure azimuth. That is, the geomagnetic sensor refers to a sensor for measuring azimuth by sensing a magnetic field formed in the north-south direction of the earth. The geomagnetic sensor can detect geomagnetism in three axes. The north direction measured by the geomagnetic sensor may be magnetic north. However, even if the geomagnetic sensor measures the direction of magnetic north, it is of course possible to output the true north direction through internal calculation.

The gyro sensor is an inertial sensor that measures the rotational angular velocity of the display apparatus 100. That is, it means a sensor that can know the current direction by using the inertial force of the rotating object. The gyro sensor can measure the rotational angular velocity in two axes.

The motion sensor 120 may sense a movement of the display apparatus 100 to recognize a direction in which the display apparatus 100 moves, a rotational angular velocity, and the like.

The photographing unit 130 is a component for obtaining an image by photographing a peripheral area of the display apparatus 100. The photographing unit 130 may include a camera, a video camera, and the like. However, in the present exemplary embodiment, the photographing unit 130 is described as being included in the display apparatus 100, but the photographing unit 130 may be implemented as an external device connected to an external terminal of the display apparatus 100. It may be a configuration provided in the main body of the detachable HMD device.

In addition, the photographing unit 130 is preferably provided at the position where the display device 100 can photograph a peripheral area in a direction that the face of the user faces.

The processor 140 is a component that performs a function of controlling the overall operation of the display apparatus 100.

In particular, when the processor 140 displays the content in a predetermined area of the display 110 and detects a predetermined movement of the display apparatus 100 by the motion sensor 120, at least one of the remaining areas other than the predetermined area. The display 110 may be controlled to display an image photographed by the photographing unit 130 in a partial region. Detailed description thereof will be described below with reference to the accompanying drawings.

3 is a diagram illustrating a screen on which content is displayed in a display device according to an exemplary embodiment.

The user may watch various contents through the display 110, and the contents may include various contents such as a 3D movie or a virtual reality game. 3 illustrates a display screen of the display 100 viewed by a user, and the display screen may include a preset area where content is displayed and a remaining area other than the preset area where content is displayed.

For example, as shown in FIG. 3, the main content that the user wants to watch may be displayed in a predetermined size in the center area 31 of the display screen. Here, the main content may be content displayed in a picture in picture (PIP) format. In the remaining outer area 32 other than the area where the main content is displayed, additional auxiliary content may be displayed to enhance immersion of the main content. FIG. 3 shows that in order to maximize the effect of the virtual reality such as a user watching a movie at a real movie theater, the center area 31 is reduced to a preset size while the main area is displayed, and the remaining area 32 is a real movie theater. It shows the display of the auxiliary content, such as the ceiling, left and right walls and the audience chair.

In the middle area 31 in which the main content is displayed, the content to be displayed by the user interface input through the user interface unit 195 or a user gesture provided in the display apparatus 100 or the HMD device to which the display apparatus 100 is detached. A menu for selecting can be displayed.

4 and 5 are diagrams for describing remaining areas other than a preset area where content is displayed, according to an embodiment of the present invention.

The processor 140 displays an image captured by the display apparatus moved in the movement direction in an area corresponding to the movement direction of the display apparatus 100 based on the region in which the main content is displayed among the remaining areas where the auxiliary content is displayed on the display screen. Control to display.

As an example, as shown in FIG. 4, when the user plays content while wearing the HMD device, the processor 140 may display the center area 41 of the display 110 in which the main content is displayed. The display device may be configured to have a predetermined size and may be configured by dividing the remaining area where the auxiliary content is displayed into first to fourth areas 42 to 45 respectively positioned in the up, down, left, and right directions with respect to the center area 41.

Meanwhile, as illustrated in FIG. 5, it may be assumed that the user senses some sound coming from the left side and turns his head in the left direction to check what happened. In this case, when a predetermined movement of the display apparatus 100 is detected through the motion sensor 120, the processor 140 may correspond to the movement direction of the display apparatus 100 among the first to fourth regions 42 ˜ 45. The display device may be controlled to display the image 51 captured by the display apparatus moved in the movement direction in the first region 42, which is the region.

In this case, the processor 140 may display the image 51 photographed only when at least one of the distance and the speed at which the display apparatus 100 sensed by the motion sensor 120 moves exceeds a preset threshold. have.

In detail, the distance moved by the display apparatus 100 is proportional to an angle at which the user wearing the display apparatus 100 turns his / her head, and the processor 140 detects the distance moved by the display apparatus 100 to set the preset distance. The critical distance value is compared. The processor 140 may display the captured image 51 by controlling the photographing unit 130 only when the distance moved by the display apparatus 100 is equal to or greater than a preset threshold distance value. Here, the threshold distance value may be set based on the direction of the user's gaze and the direction in which the content is displayed.

In addition, the processor 140 may detect a speed at which the user turns his head, that is, a speed at which the display apparatus 100 moves, and compares it with a preset threshold speed value. The processor 140 may display the captured image 51 by controlling the photographing unit 130 only when the moving speed of the display apparatus 100 is equal to or greater than a preset threshold speed value.

Accordingly, while the user continuously watches the main content 41 being viewed, the user can check the surrounding area in the direction in which the user turns his / her head based on the display apparatus 100.

Meanwhile, the main content 41 may be displayed on the entire area of the display 110. When a preset movement of the display apparatus 100 is detected, the main content 41 is reduced and displayed as described above. An image displayed on the preset area of 110 and photographed in some areas of the remaining areas may be displayed.

On the other hand, when the display device 100 moved in the movement direction returns to the state before the processor 140 moves, the processor 140 may control to return the captured image 51 to the state before the display. That is, when the user turns his head back to the original position, the motion sensor 120 may detect the movement and change the captured image 51 back to the auxiliary content 42 to display it.

6 to 8 are diagrams for describing various methods of displaying an image photographed according to a movement of a display apparatus according to another exemplary embodiment.

As illustrated in FIG. 6, when a predetermined movement of the display apparatus 100 is detected by the motion sensor 120, the processor 140 may display the entire remaining area 61 other than the area 41 in which main content is displayed. The controller 130 may control to display an image photographed by the photographing unit 130. In this case, regardless of the direction of movement of the display apparatus 100 sensed by the motion sensor 120, the image photographed is displayed on all regions in the up, down, left, and right directions of the region 41 in which the main content is displayed. The user may check the peripheral area of the omnidirectional direction based on the device 100.

Meanwhile, as shown in FIG. 7, the processor 140 moves the position of the region 41 in which the content is displayed, and corresponds to an area corresponding to the direction opposite to the direction in which the region 41 in which the content is displayed is moved. When 71 is extended, the image captured by the display device moved in the movement direction may be displayed on the extended area 71.

In detail, when the user wearing the display apparatus 100 turns his head in the left direction, the motion sensor 120 may detect the movement of the display apparatus 100. When the movement of the display apparatus 100 corresponds to a preset movement, the processor 140 moves the position of the region 41 in which the main content is displayed in the right direction opposite to the left direction, which is the movement direction of the display apparatus 100. As a result, the size of the area 71 corresponding to the direction opposite to the direction in which the area 41 in which the main content is displayed is expanded is increased and the direction in which the area 41 in which the main content is displayed is moved. The size of the region 44 corresponding to the same direction may be reduced.

Meanwhile, FIG. 8 assumes a case in which a user wearing the display apparatus 100 turns his head to the right while viewing contents according to an embodiment of the present disclosure. When the movement of the display apparatus 100 corresponds to a preset movement, the processor 140 may reduce and display the main content as illustrated in FIG. 8. Accordingly, when the size of the area 41 in which the main content is displayed is reduced and the size of the remaining areas 42 to 45 in which the auxiliary content is displayed is expanded, the processor 140 is located in an area corresponding to the movement direction of the display device. The display apparatus may be controlled to display an image photographed by the display apparatus moved in the movement direction.

According to various embodiments of the present disclosure, a user wearing the display apparatus 100 may recognize a wider peripheral area through the

extended areas

71 and 81.

9 is a block diagram schematically illustrating a configuration of a display apparatus according to another exemplary embodiment.

As shown in FIG. 9, the display apparatus 100 ′ according to another exemplary embodiment may further include an acoustic sensor 150. The acoustic sensor 150 is a component for detecting an acoustic signal. When a user of the display apparatus 100 ′ listens to the sound of content being played by using a receiver such as an earphone or a headphone connected to a receiver terminal (not shown) of the display apparatus 100 ′, the sound of the surrounding area is recognized. Not easy to do

When the acoustic sensor 150 detects an acoustic signal having a predetermined size or more, the processor 140 captures the image on the at least some region other than the region 41 where the main content is displayed through the photographing unit 130. An image can be displayed. As illustrated in FIG. 10, the processor 140 may display an image captured by the photographing unit 130 in the entire area of the remaining area 1001.

Meanwhile, when the sound signal is detected, the operation of displaying the captured image may be performed only when the user connects the receiver to the display apparatus 100 ′ and listens to the sound of the content being played. This is to minimize the disturbance of the content by displaying an image photographed by the photographing unit 130 only in a situation where it is difficult for the user to listen to the sound of the content through the receiver to recognize the sound generated in the surrounding environment.

In addition, as another embodiment, the processor 140 detects an acoustic signal having a predetermined magnitude or more through the acoustic sensor 150 and satisfies the photographing unit 130 when all of the conditions for detecting a motion having a predetermined magnitude or more are satisfied. It is also possible to display an image taken by operating.

On the other hand, when the display device 100 ′ of the present invention includes a plurality of acoustic sensors 150 spaced at predetermined intervals, the processor 140 sounds based on the time difference at which the acoustic signal is detected by each acoustic sensor. The direction in which the signal is generated can be determined. In this case, the processor 140 may display an image captured only in an area corresponding to the direction in which the sound signal is generated in the remaining area 1001 other than the area 41 in which the main content is displayed.

Meanwhile, when a predetermined time elapses, the processor 140 may change the area where the captured image is displayed to a state before the captured image is displayed.

As shown in FIG. 11, the display apparatus 100 ″ according to another exemplary embodiment of the present invention may include a display 110, a motion sensor 120, a photographing unit 130, a processor 140, and an acoustic sensor 150. ), A storage unit 160, an image processor 170, an audio processor 180, an audio output unit 190, and a user interface unit 195. Hereinafter, descriptions of parts overlapping with those in FIGS. 2 and 9 will be omitted.

The processor 140 includes a ROM 141, a RAM 142, a CPU 143, a graphics processor 144, and first through n-th interfaces 145-1 through 145-n. Here, the ROM 141, the RAM 142, the CPU 143, the graphic processor 144, the first to n-th interfaces 145-1 to 145-n, and the like may be connected to each other through the bus 146. .

The first to n-th interfaces 145-1 to 145-n are connected to the aforementioned various components. One of the interfaces may be a network interface connected to an external device through a network.

The CPU 143 accesses the storage 160 and performs booting using an operating system stored in the storage 160. In addition, various operations, contents, and data stored in the CPU 143 storage unit 160 may be performed.

The RAM 142 stores a command set for system booting. When the turn-on command is input and the power is supplied, the CPU 143 copies the O / S stored in the storage 160 to the RAM 142 according to the command stored in the ROM 141, and executes the O / S to execute the system. Boot up. When the booting is completed, the CPU 143 copies various application programs stored in the storage unit 160 to the RAM 142 and executes the application programs copied to the RAM 142 to perform various operations.

The graphic processor 144 generates a screen including various objects such as an icon, an image, and a text by using a calculator (not shown) and a renderer (not shown). The calculator calculates attribute values such as coordinates, shapes, sizes, and colors for displaying the objects according to the layout of the screen. The renderer generates screens of various layouts including objects based on the attribute values calculated by the calculator.

Meanwhile, the above-described operation of the processor 140 may be performed by executing a program stored in the storage 160.

The storage unit 160 may store various data such as an operating system (O / S) software module for driving the display apparatus 100 ″ and various multimedia contents.

In more detail, the storage unit 160 may be configured to generate a base module for processing signals transmitted from hardware included in the display apparatus 100 ″, a storage module for managing a database or registry, and a layout screen. Graphics processing modules and security modules can be stored. In particular, the graphic processing module is a module capable of displaying main content in a predetermined area on the display screen and displaying an image photographed by the photographing unit 130 in at least some of the remaining areas. In addition, the storage 160 may store a preset threshold value for at least one of a distance and a speed at which the display apparatus 100 ″ is moved, according to an exemplary embodiment.

The image processor 170 is a component that performs various image processing such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, and the like on the content.

The audio processor 180 is a component that performs processing on audio data.

The audio output unit 190 is a component that outputs audio data processed by the audio processor 180.

The user interface 195 is a component for detecting a user interaction for controlling the overall operation of the display apparatus 100 ″.

First, the content is displayed in a predetermined area of the display (S1210). The preset area may be located at the center of the display in a smaller size than the entire display screen. In addition, the size and position of the preset area may be flexible.

Thereafter, a preset movement of the display device is detected (S1220). In this case, the preset movement refers to a movement in which at least one of the distance and the speed at which the display device has moved exceeds the preset threshold. Here, the distance moved by the display device includes a distance moved by the user wearing the display device by rotating his head.

Thereafter, the peripheral area of the display device is photographed (S1230). The peripheral area of the display device means an area photographed in a direction toward the photographing unit included in the display device, and the photographing unit is preferably provided in the same direction as the line of sight of the user wearing the display device.

Thereafter, an image of the peripheral area photographed in at least some of the remaining areas other than the preset area is displayed (S1240). In this case, an image photographed by the display apparatus moved in the movement direction may be displayed in an area corresponding to the movement direction of the display apparatus based on the region where the content is displayed among the remaining regions.

Meanwhile, when the acoustic signal is detected and the detected acoustic signal is greater than or equal to a preset size, an image photographed in at least some of the remaining areas may be displayed.

As described above, according to various embodiments of the present disclosure, the user who is viewing the content using the HMD device may view the external environment through the camera without removing the HMD device, and thus may recognize the external situation quickly and conveniently.

The control method according to the above various embodiments of the present disclosure may be implemented as a program and stored in various recording media. That is, a computer program processed by various processors and capable of executing the various control methods described above may be used in a state stored in a recording medium.

For example, displaying the content in a predetermined area of the display, detecting a predetermined movement of the display device, photographing a peripheral area of the display device, and a peripheral area captured in at least some of the remaining areas other than the predetermined area. A non-transitory computer readable medium may be provided in which a program for performing an image display of an area is stored.

The non-transitory readable medium refers to a medium that stores data semi-permanently and is readable by a device, not a medium storing data for a short time such as a register, a cache, a memory, and the like. Specifically, the various applications or programs described above may be stored and provided in a non-transitory readable medium such as a CD, a DVD, a hard disk, a Blu-ray disk, a USB, a memory card, a ROM, or the like.

In addition, although the preferred embodiment of the present invention has been shown and described above, the present invention is not limited to the above-described specific embodiment, the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

Claims

In the display device,

display;

A motion sensor for detecting a motion of the display device;

A photographing unit for photographing a peripheral area of the display device; And

Display content on a predetermined area of the display, and when a motion of the display device is detected by the motion sensor, display an image captured by the photographing unit in at least some of the remaining areas other than the preset area. And a processor to control the display to control the display.
The method of claim 1,

The processor,

And displaying an image photographed by the display apparatus moved in the movement direction in an area corresponding to the movement direction of the display apparatus based on the region in which the content is displayed among the remaining regions.
The method of claim 2,

The processor,

The display apparatus is configured to display the content in a center area of the display and move in the direction of movement to an area corresponding to the direction of movement among the first to fourth areas respectively positioned in the up, down, left, and right directions based on the center area. A display device that displays an image to be photographed.
The method of claim 2,

The processor,

The display apparatus reduces and displays the content, and displays an image photographed by the display apparatus moved in the movement direction in the expanded region when the region corresponding to the movement direction of the display apparatus expands as the content is reduced. .
The method of claim 2,

The processor,

When the location of the area where the content is displayed is moved and an area corresponding to a direction opposite to the direction in which the content is displayed is expanded, an image photographed by the display apparatus moved to the extended area in the movement direction A display device.
The method of claim 1,

The processor,

And displaying the captured image in the at least some region when at least one of the distance and the speed of movement of the display device sensed by the motion sensor exceeds a preset threshold.
The method of claim 1,

It further comprises an acoustic sensor,

The processor,

And displaying the captured image on the at least some region if the acoustic signal sensed by the acoustic sensor is equal to or greater than a predetermined size.
The method of claim 2,

The processor,

And when the display device moved in the movement direction returns to a state before the movement of the display device, the display apparatus changes the at least some region to a state before the image photographed through the photographing unit is displayed.
The method of claim 7, wherein

The processor,

And when the predetermined time elapses, changing the at least some area to a state before the image photographed by the photographing unit is displayed.
The method of claim 7, wherein

The processor,

And when the predetermined time elapses, changing the at least some area to a state before the image photographed by the photographing unit is displayed.
The method according to any one of claims 1 to 10,

The display device,

A display device, which is a head mounted display (HMD) device for providing VR (Virtual Reality) content.
In the control method of the display device,

Displaying content in a predetermined area of the display;

Detecting a predetermined movement of the display device;

Photographing a peripheral area of the display device; And

And displaying an image of the photographed peripheral area on at least some of the remaining areas other than the preset area.
The method of claim 12,

The displaying step,

And displaying an image photographed by the display apparatus moved in the movement direction in a region corresponding to the movement direction of the display apparatus based on the region in which the content is displayed among the remaining regions.
The method of claim 13,

The displaying step,

The display apparatus is configured to display the content in a center area of the display and move in the direction of movement to an area corresponding to the direction of movement among the first to fourth areas respectively positioned in the up, down, left, and right directions based on the center area. A control method for displaying a captured image.
The method of claim 13,

The displaying step,

And displaying the image captured by the display apparatus moved in the movement direction in the expanded region when the region corresponding to the movement direction of the display device is expanded according to the reduction of the content. .