WO2018139073A1 - Display control device, second display device, method for controlling display control device, and control program - Google Patents

Abstract

The present invention allows one user to recognize the display area of a display device used by another user. A display control device (1) comprises: a display area identification unit (12) for identifying an area in an image area that a display device (3) defines as a display area, the display device (3) displaying a partial image in a display area designated in the image area of an omnidirectional image (21); and a display area notification unit (13) for presenting display area information representing the area identified by the display area identification unit (12) on a display unit (17).

Description

Display control device, second display device, display control device control method, and control program

One aspect of the present invention relates to a display control device that displays content on a display device, a display device that displays a partial image in a specified display region of the image region of the content, and the like.

The following Patent Document 1 discloses a technology related to panoramic video distribution. Patent Document 2 below discloses a technique related to display of an omnidirectional image. These documents relate to a technique for causing a display device to display a partial image of a designated display region for an image such as a omnidirectional image having an image region having a size that does not fit on one screen of the display device.

Japanese Patent Publication “Japanese Unexamined Patent Application Publication No. 2015-173424 (Published October 1, 2015)” Japanese Patent Publication “Japanese Patent Laid-Open No. 2015-18296 (published Jan. 29, 2015)”

A head mounted display (HMD) is known as a display device for displaying the partial image as described above. By browsing the omnidirectional image using the HMD, the user can be immersed in the video space and enjoy viewing the image.

However, conventionally, other users could not recognize which area of the omnidirectional image the user using the HMD is looking at. Also, even when a partial image is displayed on a normal flat panel display that is not an HMD, which area of the omnidirectional image is viewed by a user at a remote location away from the flat panel display. I couldn't recognize it.

This can be a problem when, for example, spherical images are used for educational or teaching purposes. The display area can basically be freely specified by the educator or the instructor, so the educator or instructor may not see the area that the educator or instructor wants to pay attention to. This is because the effects of education and guidance cannot be expected unless the educator or leader can recognize this. This is not limited to displaying a partial image of an omnidirectional image, but is a problem that occurs in common when displaying a partial image of a designated display area of the image area.

One embodiment of the present invention realizes a display control device or the like that allows a user other than the user of the display device to recognize a display region of a display device that displays a partial image of a specified display region of the image region. For the purpose.

In order to solve the above-described problem, a display control device according to an aspect of the present invention is a display control device that displays content on a first display device, and is a display region specified among image regions of the content. A display area specifying unit for specifying which area of the image area is the display area, and display area information indicating the area specified by the display area specifying unit. And a display area notification unit to be displayed on the first display device.

In order to solve the above problem, the second display device according to one embodiment of the present invention can communicate directly or indirectly with a display control device that displays content on the first display device, and the image of the content A second display device that displays a partial image of a specified display area of the area, a display area specifying unit that specifies which area of the image area is specified as a display area, and the display area The display area information indicating the area specified by the specifying unit is notified to the display control apparatus, and the display area notification unit is configured to display the display area information on the first display apparatus.

In order to solve the above problem, a control method for a display control apparatus according to an aspect of the present invention is a control method for a display control apparatus that displays a content on a first display device, and includes: The second display device that displays the partial image of the designated display area includes a display area specifying step for specifying which area of the image area is the display area, and the area specified in the display area specifying step. A display area notification step of causing the first display device to display display area information to be displayed.

According to one aspect of the present invention, the display area of the second display device can be recognized by the user of the first display device.

It is a block diagram which shows an example of a principal part structure of the display control apparatus and display apparatus which are included in the control system which concerns on Embodiment 1 of this invention. It is a figure which shows the relationship between an omnidirectional image and a display area. It is a figure which shows the image which the said display control apparatus displays. It is a figure which shows an example of guide information. It is a figure which shows an example of display area information. It is a flowchart which shows an example of the process which the said display control apparatus performs. It is a flowchart which shows an example of the process which the said display apparatus performs. It is a figure which shows the image which the display control apparatus which concerns on Embodiment 2 of this invention displays. It is a figure which shows an example of area | region management information. It is a figure which shows the example which displayed the superimposition area | region information and the superimposition prohibition area | region information after enlarging and displaying the content. It is a flowchart which shows an example of the process which the said display control apparatus performs. It is a block diagram which shows an example of a principal part structure of the display control apparatus contained in the control system which concerns on Embodiment 3 of this invention, and a display apparatus. It is a block diagram which shows the outline | summary of the control system which concerns on Embodiment 4 of this invention.

Embodiment 1
An embodiment of the present invention will be described with reference to FIGS.

[System Overview]
FIG. 1 is a block diagram illustrating an example of a main configuration of a display control device 1 and a display device (second display device) 3 included in a control system 5 according to the present embodiment. In the present embodiment, the display device 3 is a head mounted display (HMD) that is used by being mounted on the user's head. In the present embodiment, an example will be described in which a user who is a leader uses the display control device 1 to guide a trainee user who is a user who uses the display device 3. The guidance is performed while displaying the same content on both the display control device 1 and the display device 3. The display device 3 is not limited to the HMD, and may be a personal computer, a television receiver, a smartphone, a tablet terminal, or the like provided with a display. The display control device 1 may be a personal computer, a television receiver, a smartphone, a tablet terminal, or the like.

[Configuration of display control device]
The display control device 1 includes a control unit 10, a display unit (first display device) 17, an input unit 18, a communication unit 19, and a storage unit 20. The control unit 10 controls each unit of the display control device 1 in an integrated manner, and includes an omnidirectional image drawing unit 11, a display region specifying unit 12, a display region notification unit 13, and a guide unit (display region control unit) 14. , A combining unit 15 and a superimposition processing unit 16.

The omnidirectional image drawing unit 11 displays the omnidirectional image (content) on the display unit 17. The display device 3 displays a partial image that is a part of the omnidirectional image, but the omnidirectional image drawing unit 11 causes the display unit 17 to display the entire image area of the omnidirectional image on one screen. Note that the image displayed by the omnidirectional image drawing unit 11 only needs to include at least the partial image displayed on the display device 3, and may be a partial image of the image area of the omnidirectional image. .

The display area specifying unit 12 specifies which area of the image area of the content the display device 3 uses as the display area. Then, the display area notification unit 13 notifies the user of the display control device 1 of the display area information by displaying the display area information indicating the area specified by the display area specifying unit 12 on the display unit 17.

The guide unit 14 causes the display unit 17 to display area guide information indicating a guide area that is an image area to be displayed on the display device 3. The guide area can be designated by the instructor through an input operation to the input unit 18. In addition, a guide area can be set in advance in guide information 22 described later. When the displayed area guide information is selected by the user, the guide unit 14 causes the display device 3 to display the image area indicated by the area guide information. Furthermore, when the display area information is moved on the content displayed on the display section 17, the guide section 14 also performs control to move the image area of the display device 3 to the position where the display area information is moved. Note that the process of moving the image area of the display device 3 may be performed by providing a processing block different from the guide unit 14.

The synthesizing unit 15 synthesizes the display area information described above with the omnidirectional image, generates a synthesized image in which the display area information is superimposed on the omnidirectional image, and causes the display unit 17 to display the synthesized image. Similarly, the composition unit 15 generates a composite image in which the above-described area guide information is superimposed on the omnidirectional image and causes the display unit 17 to display the composite image. Further, the synthesizing unit 15 generates a synthesized image obtained by superimposing a later-described superimposed image on the omnidirectional image and causes the display unit 17 to display the synthesized image.

The superimposition processing unit 16 causes the display device 3 to display a superimposed image related to the omnidirectional image. Since the partial image of the omnidirectional image is displayed on the display device 3, the superimposed image is displayed superimposed on the partial image. In addition, the superimposition processing unit 16 sets a region designated in the omnidirectional image displayed by the display unit 17 as a superimposition region of the superimposed image. Details of the superimposition processing unit 16 will be described in the second embodiment.

The display unit 17 is a device that displays an image. The display unit 17 may be a display device externally attached to the display control device 1.

The input unit 18 receives a user input operation, and outputs information indicating the content of the received input operation to the control unit 10. The input unit 18 may be, for example, a receiving unit that receives a signal indicating the content of a user input operation on a controller (not shown) from the controller. The input unit 18 performs an operation for specifying the position of the guide area on the content, an operation for moving the display area information on the omnidirectional image, an operation for selecting the area guide information, an operation for specifying the overlapping area on the content, and the like. Anything can be accepted.

The communication unit 19 is for the display control device 1 to communicate with another device (display device 3 in this example). The communication unit 19 and the communication unit 38 of the display device 3 may communicate with each other in a full mesh (peer-to-peer) or indirectly via a predetermined communication network (for example, the Internet) and other devices. You may do.

The storage unit 20 stores various data used by the display control device 1. The storage unit 20 stores an omnidirectional image 21, guide information 22, and a superimposed image 23. The omnidirectional image 21 is an image obtained by imaging all directions from the imaging point. In the present embodiment, the content displayed by the display control device 1 is the omnidirectional image 21. The guide information 22 is information indicating which of the display areas of the omnidirectional image 21 is a guide area. The guide unit 14 can display area guide information based on the guide information 22. The superimposed image 23 is an image having contents related to the omnidirectional image 21. Details of the superimposed image 23 will be described in a second embodiment. The omnidirectional image 21 and the superimposed image 23 may be a moving image or a still image. In the present embodiment, an example in which the omnidirectional image 21 is a moving image will be described.

[Configuration of display device]
The display device 3 is a device that displays content, and includes a control unit 30, a display unit 35, a storage unit 36, a sensor 37, and a communication unit 38. The control unit 30 controls each unit of the display device 3 in an integrated manner, and includes a line-of-sight direction specifying unit 31, an omnidirectional image drawing unit (display region specifying unit) 32, a combining unit 33, and a display region notifying unit 34. including.

The line-of-sight direction specifying unit 31 determines the line-of-sight direction of the user of the display device 3 from the output value of the sensor 37. The sensor 37 detects the orientation of the display device 3, that is, the orientation of the face of the user wearing the display device 3 (front direction). The sensor 37 may be configured by a six-axis sensor that combines at least two of a three-axis gyro sensor, a three-axis acceleration sensor, a three-axis magnetic sensor, and the like. The line-of-sight direction specifying unit 31 sets the direction of the user's face specified from the output values of these sensors as the user's line-of-sight direction. The sensor 37 may detect the position of the user's black eye. In this case, the line-of-sight direction specifying unit 31 specifies the line-of-sight direction from the position of the user's black eye. The sensor 37 may include a sensor that detects the orientation of the user's face and a sensor that detects the position of the user's black eyes. The identification of the line-of-sight direction can also be realized by a configuration other than the above. For example, instead of the sensor 37, a camera installed outside the display device 3 may be used. In this case, the display device 3 is provided with a light emitting device, which is blinked, and this state is photographed by the camera, and the position and orientation of the display device 3 can be detected from the image. In addition, for example, the line-of-sight direction can be determined by back-calculating from the light reception time when the laser emitted from the external light emitting device is received by the light receiver provided in the display device 3, the angle of each point light reception, or the time difference.

The omnidirectional image drawing unit 32 specifies which region in the image region of the omnidirectional image 21 is designated as the display region from the line-of-sight direction specified by the line-of-sight direction specifying unit 31. Then, the omnidirectional image drawing unit 32 causes the display unit 35 to display the partial image of the identified display region in the image region of the omnidirectional image 21 via the synthesis unit 33.

The synthesizing unit 33, when there is a superimposed image 23 to be superimposed on the partial image, generates a synthesized image in which the superimposed image is superimposed on the partial image and causes the display unit 35 to display the synthesized image.

The display area notification unit 34 notifies the display control apparatus 1 of display area information indicating the display area specified by the omnidirectional image drawing unit 32 via the communication unit 38, thereby displaying the display area information. 1 on the display unit 17.

The display unit 35 is a device that displays an image. The display unit 35 may be a non-transmissive type or a transmissive type. When the transmissive display unit 35 is used, it is possible to provide the user with a mixed reality space in which the image displayed by the display unit 35 is superimposed on the visual field outside the display device 3 (real space). Further, the display unit 35 may be a display device externally attached to the display device 3, or a normal flat panel display or the like.

The storage unit 36 stores various data used by the display device 3. Although not shown in FIG. 1, the omnidirectional image 21 is stored in the storage unit 36 as in the display control device 1. When displaying the superimposed image 23, the superimposed image 23 is also stored in the storage unit 36.

The communication unit 38 is for the display device 3 to communicate with another device (in this example, the display control device 1). The communication unit 38 and the communication unit 19 of the display control device 1 may communicate with each other in a full mesh (peer-to-peer) or indirectly via a predetermined communication network (for example, the Internet) and other devices. You may communicate.

[Display of image according to line of sight]
A method in which the display device 3 displays an image corresponding to the user's line-of-sight direction will be described with reference to FIG. FIG. 2 is a diagram illustrating the relationship between the omnidirectional image and the display area. In FIG. 2, the omnidirectional image A1 is shown in a three-dimensional coordinate space defined by x, y, and z axes orthogonal to each other. The omnidirectional image A1 forms an omnidirectional sphere that is a sphere of radius r. The z-axis direction coincides with the vertical direction of the sensor 37 in the real space, the y-axis direction coincides with the front direction of the sensor 37 in the real space, and the x-axis direction coincides with the left-right direction of the sensor 37 in the real space. I'm doing it.

The line-of-sight direction identifying unit 31 determines which direction the sensor 37 is facing from the output value of the sensor 37. Since the sensor 37 is mounted on the display device 3 in a predetermined orientation, if the user wears the display device 3 in the correct orientation, the orientation of the sensor 37 can be regarded as the user's line-of-sight direction. Therefore, in the following, the direction of the sensor 37 is described as the user's line-of-sight direction. The line-of-sight direction identifying unit 31 rotates the line-of-sight direction around an azimuth angle (yaw) θ (−180 ° ≦ θ ≦ 180 °) that is a rotation angle around the vertical axis (z-axis) and a horizontal axis (x-axis). It can be expressed in combination with an angle of elevation (pitch) φ (−90 ° ≦ φ ≦ 90 °).

When the line-of-sight direction specifying unit 31 specifies the azimuth angle and elevation angle indicating the line-of-sight direction, the omnidirectional image drawing unit 32 includes a straight line extending from the user's viewpoint position Q in the direction indicated by the specified azimuth angle and elevation angle, An intersection point P with the sphere image A1 is obtained. Then, in the omnidirectional image A1, an area having a height h and a width w with the intersection P as the center is specified as the display area A11. Then, the omnidirectional image drawing unit 32 causes the display unit 35 to display a portion in the display area A11 of the omnidirectional image A1. As a result, the display area A11 changes in conjunction with the user's line-of-sight direction, and the image displayed on the display unit 35 also changes accordingly. In the present embodiment, the viewpoint position Q in the omnidirectional sphere is assumed to be stationary in order to simplify the description, but the viewpoint position in the omnidirectional sphere is linked with the movement of the user in the real space. Q may be moved.

[Image to be displayed]
An image displayed by the display control device 1 will be described with reference to FIG. FIG. 3 is a diagram illustrating an image displayed by the display control device 1. As illustrated in FIG. 3, the display control device 1 displays a planar image obtained by mapping the omnidirectional image A1 on a two-dimensional plane on the display unit 17. As described above, the position on the omnidirectional image A1 includes the azimuth angle θ (−180 ° ≦ θ ≦ 180 °) and the elevation angle φ (−90 ° ≦ φ that is a rotation angle around the horizontal axis (x axis). ≦ 90 °). In the illustrated example, the azimuth angle at the left end of the omnidirectional image A1 is −180 °, the azimuth angle at the right end is 180 °, the elevation angle at the upper end is 90 °, and the elevation angle at the lower end is −90 °.

The display area information A11 indicating the display area in the display device 3 is superimposed on the omnidirectional image A1. In addition, display area information A12 and A13 indicating display areas in the other display devices 3 are also displayed in a superimposed manner. That is, in FIG. 3, the display areas of the three display devices 3 are represented by A11 to A13, respectively. As described above, the display control device 1 can also display the display area information of the plurality of display devices 3 on one screen.

In addition, the area guide information B1 and B2 are superimposed on the omnidirectional image A1. The area guide information B1 and B2 indicate guide areas that are image areas to be displayed on the display device 3. By displaying the area guide information B1 and B2 and the display area information A11 to A13, the instructor can easily recognize that the instructor who uses the display device 3 is not looking at the guide area. .

The area guide information B1 and B2 can be selected by an input operation via the input unit 18. When the instructor selects the area guide information B1, a partial image of the guide area indicated by the area guide information B1 is displayed on the display device 3. The same applies when the area guide information B2 is selected. Thereby, the partial image of the guide area indicated by the area guide information B1 and B2 can be forcibly displayed on the display device 3. It should be noted that the same partial image may be displayed collectively for the plurality of display devices 3, or different partial images may be displayed by selecting different region guide information for each display device 3.

Also, the display position of the display area information may be changed by an input operation via the input unit 18. When the display position of the display area information is moved, the image area of the display device 3 may be moved to the position to which the display area information is moved.

[Example of guide information]
The guide information 22 may be information as shown in FIG. 4, for example. FIG. 4 is a diagram illustrating an example of the guide information 22. The guide information 22 in FIG. 4A is data in a table format in which information on “guide area”, “azimuth angle range”, “elevation angle range”, and “reproduction time” is associated.

“Guide area” is identification information of the guide area, and in this example, the name of the guide area is described. “Azimuth angle range” and “elevation angle range” are information indicating the range occupied by the guide region in the omnidirectional image. For example, in the illustrated guide information 22, the guide region B1 (the guide region indicated by the region guide information B1 in FIG. 3) has an azimuth angle of −110 ° at the left end and −30 ° at the right end in the omnidirectional image. , It is defined as a region occupying a rectangle having a lower end elevation angle of −10 ° and an upper end elevation angle of 40 °.

“Reproduction time” is information indicating a reproduction time zone in which the guide area is set. For example, since the “reproduction time” of the illustrated guide area B1 is 00:01:00 to 00:05:00, the content reproduction time of this guide area B1 is 00:01:00 to 00:05:00. The time zone is set.

On the other hand, the guide information 22 shown in FIG. 4B includes the “azimuth range” and “elevation range” included in the guide information 22 shown in FIG. ”,“ Azimuth angle ”, and“ elevation angle ”. That is, in the guide information 22 in FIG. 4B, “width”, “height”, “azimuth angle”, and “elevation angle” are information indicating the range occupied by the guide region. More specifically, “width” and “height” indicate the width and height of the guide region, respectively. Further, “azimuth angle” and “elevation angle” indicate reference positions for specifying the guide region. The reference position can be an arbitrary position on the guide area. However, for example, when the guide area is rectangular, the position of the lower left corner may be used as the reference position. In this case, the lower left corner is the position indicated by “azimuth angle” and “elevation angle”, and the area having the width and height indicated by “width” and “height” is the guide area.

[Example of display area management information]
As described above, the display area specifying unit 12 specifies the display area of the display device 3. The display area specifying unit 12 may manage the specified display area as display area management information as shown in FIG. 5, for example. FIG. 5 is a diagram illustrating an example of display area management information for managing the display area of the display device 3. The display area management information in FIG. 5A is data in a table format in which information on “user”, “azimuth angle range”, and “elevation angle range” is associated.

“User” is identification information of the user corresponding to the display area, that is, the user who is viewing the image in the display area. In this example, the user name is described. Note that the display area management information may include identification information of the display device 3 in addition to the “user” information or instead of the “user” information.

“Azimuth range” and “elevation range” are information indicating the range occupied by the display area of the display device 3 in the omnidirectional image. For example, in the illustrated display area management information, the display area on the display device 3 of the user X1 is a omnidirectional image with a left azimuth angle of −85 °, a right azimuth angle of −5 °, and a lower elevation angle of 25. It is defined that the region occupies a rectangle having an elevation angle of 75 ° at the upper end.

On the other hand, the display area management information in FIG. 5B includes the “azimuth angle range” and the “elevation angle range” included in the display area management information in FIG. It replaces “height”, “azimuth”, and “elevation”. That is, in the display area management information in FIG. 5B, “width”, “height”, “azimuth angle”, and “elevation angle” are information indicating the range occupied by the display area. More specifically, “width” and “height” indicate the width and height of the display area, respectively. Further, “azimuth angle” and “elevation angle” indicate reference positions for specifying the display area. The reference position can be an arbitrary position on the display area. For example, when the display area is rectangular, the center position may be used as the reference position. In this case, the center is the position indicated by “azimuth angle” and “elevation angle”, and the area having the width and height indicated by “width” and “height” is the display area.

[Process flow (display control device)]
An example of the flow of processing executed by the display control device 1 (control method of the display control device) will be described with reference to FIG. FIG. 6 is a flowchart illustrating an example of processing in which the display control device 1 displays an image. In the following, an example in which there is one display device 3 will be described, but the processing in the case where there are a plurality of display devices 3 is the same as the following.

In S <b> 1, the omnidirectional image drawing unit 11 acquires the omnidirectional image 21 from the storage unit 20 and displays it on the display unit 17 via the synthesis unit 15. In S <b> 2 (display region specifying step), the display region specifying unit 12 specifies the display region of the display device 3 by communicating with the display device 3. The display area specifying unit 12 may manage the specified display area as display area management information as shown in FIG.

In S3, the guide unit 14 receives the designation of the position of the guide area by the instructor. In S4, the guide unit 14 specifies a guide region. The designation of the position of the guide region in S3 may be performed by inputting a desired position of the instructor in the omnidirectional image 21 via the input unit 18, for example. In this case, in S4, the guide unit 14 specifies a guide region having a size corresponding to the width and height of the display region of the display device 3 with the input position as the center. When the guide area is specified using the guide information 22 (see FIG. 4), the process of S3 is omitted, and the guide unit 14 specifies the guide area with reference to the guide information 22 in S4.

In S5 (display area notification step), the guide unit 14 causes the display unit 17 to display the area guide information indicating the guide area specified in S4 via the combining unit 15. Further, the display area notification unit 13 causes the display unit 17 to display display area information indicating the display area specified in S <b> 2 via the synthesis unit 15. Thereby, the area guide information and the display area information are displayed superimposed on the omnidirectional image 21. Note that the area guide information and the display area information may be displayed in separate steps. Moreover, the process of S3 and S4 may be performed before S2, and may be performed in parallel with S2.

In S6, the guide unit 14 determines whether or not the area guide information displayed in S5 has been selected. For example, the guide unit 14 may determine that the region guide information has been selected when the displayed region guide information is selected by the instructor through an input operation via the input unit 18. The method for selecting the area guide information is not particularly limited. For example, the area guide information may be selected by clicking or tapping the displayed area guide information. On the other hand, the area guide information is not selected when the state where the displayed area guide information is not selected continues for a predetermined time or when an input operation of a leader who selects not to select the area guide information is detected. It may be determined that If it is determined that the area guide information is selected in S6 (YES in S6), the process proceeds to S7. If it is determined that the area guide information is not selected (NO in S6), the process returns to S1.

In S7, the guide unit 14 notifies the display device 3 of the guide region indicated by the selected region guide information, and instructs the display device 3 to set the region as the display region. Thereby, in the display device 3, the display area is changed, and an image of the guide area indicated by the area guide information is displayed. Thereafter, the process returns to S1.

[Automatic extraction of guide area]
The guide area may be set by automatically detecting an object from the omnidirectional image. In this case, a predetermined area including the display area of the detected object may be extracted as the guide area. Thereby, the instructor can easily confirm whether or not the instructor is looking at a predetermined object in the content.

In the case of automatic detection, the appearance (shape, size, color, etc.) of the object to be detected may be determined in advance. Thus, by analyzing the omnidirectional image, an object having such an appearance can be automatically detected. Further, the object may be detected using machine learning or the like. The function of the detection unit for detecting an object may be provided in the guide unit 14, or a processing block of the detection unit may be provided separately and an object may be detected by the processing block.

[Processing flow (display device)]
An example of the flow of processing (display device control method) executed by the display device 3 will be described with reference to FIG. FIG. 7 is a flowchart illustrating an example of processing in which the display device 3 displays an image.

In S <b> 11, the line-of-sight direction specifying unit 31 specifies the line-of-sight direction of the instructor wearing the display device 3, and the omnidirectional image drawing unit 32 determines all of the line-of-sight directions specified by the line-of-sight direction specifying unit 31. The display area in the celestial sphere image is specified. In S <b> 12, the omnidirectional image drawing unit 32 causes the display unit 35 to draw (display) the partial image of the omnidirectional image corresponding to the specified display area via the synthesis unit 33.

In S13, the display area notification unit 34 notifies the display control apparatus 1 of the specified display area. Specifically, the display area notification unit 34 includes the identification information of the display device 3 or the user of the display device 3 and information indicating the range occupied by the display area of the display device 3 in the omnidirectional image (for example, the range of the azimuth angle). Information indicating the range of the elevation angle) is transmitted to the display control device 1 in association with each other.

In S14, the omnidirectional image drawing unit 32 determines whether or not a display area change instruction is received from the display control device 1. If it is determined that it has not been received (NO in S14), the process returns to S11, and if it is determined that it has been received (YES in S14), the process proceeds to S15.

In S <b> 15, the omnidirectional image drawing unit 32 changes the display area according to the instruction received from the display control apparatus 1, and the partial image of the omnidirectional image corresponding to the changed display area is passed through the synthesis unit 33. Then, the display unit 35 is drawn (displayed). Thereafter, the process returns to S11.

[About changing the display area]
If the amount of change in the position of the display area before and after the change (the amount of change in the azimuth angle and the elevation angle) is equal to or greater than a predetermined value in S15, the omnidirectional image drawing unit 32 performs the following (1) to (4) The display area may be changed after performing any one of the image processing. This makes it difficult for the instructor to get drunk even when the display area changes suddenly.
(1) Black out while changing the display area (display a black screen)
(2) Switching the display area by crossfade (fading out the changed partial image while fading out the changed partial image)
(3) Blur the image while changing the display area (decrease resolution or resolution)
(4) Decreasing the speed at which the display area is changed Note that the display control apparatus 1 may determine whether the amount of change in the position of the display area before and after the change is greater than or equal to a predetermined value. In this case, when it is determined in the above determination that the value is equal to or greater than the predetermined value, the display control device 1 instructs the display device 3 to execute any one of the image processes (1) to (4). May be.

[Embodiment 2]
Another embodiment of the present invention will be described with reference to FIGS. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted. The same applies to the third and subsequent embodiments.

In the present embodiment, an example will be described in which a superimposed image is displayed superimposed on the omnidirectional image. The superimposed image is displayed on the display unit 17 of the display control device 1 and also displayed on the display unit 35 of the display device 3. An image displayed by the display control apparatus 1 of the present embodiment will be described with reference to FIG. FIG. 8 is a diagram illustrating an image displayed by the display control device 1 in which a superimposed image is superimposed on an omnidirectional image.

In the example of FIG. 8, as in FIG. 3, display area information A11 to A13 and area guide information B1 and B2 are displayed superimposed on the omnidirectional image A1. In addition, the area information C1 to C3 is superimposed and displayed on the omnidirectional image A1. Among these, the area information C1 and C2 is superimposition area information indicating a superimposition area that is an area in which the superimposed image is superimposed and displayed. The area information C3 is superposition prohibition area information indicating a superposition prohibition area that is an area where a superimposed image is not displayed.

The instructor who uses the display control device 1 can select the region information C1 or C2 and display the superimposed image in the superimposed region indicated by the region information C1 or C2.

The superimposed image may be an image related to the content to be superimposed (the omnidirectional image A1 in this example). For example, the superimposed image may be a moving image content, a still image content, or an annotation displayed as an annotation regarding the omnidirectional image A1 or another superimposed image.

The superimposed image is an image obtained by imaging the same imaging target as the imaging target of the omnidirectional image A1 (in this example, the cityscape), but the imaging device used for imaging is different from the imaging device that images the omnidirectional image A1. It may be an image. Further, the superimposed image has a higher resolution than the omnidirectional image A1, and therefore may be a higher definition image than the omnidirectional image A1. The superimposed image may be, for example, an image obtained by photographing the imaging target of the omnidirectional image A1 at the same angle as the omnidirectional image A1, or an image (for example, a specific image) taken at an angle different from the omnidirectional image A1. Image of the viewpoint). Further, the superimposed image may be an image obtained by enlarging a part of the imaging target of the omnidirectional image A1.

By displaying the superimposed image, multifaceted information about the imaging target of the omnidirectional image A1 can be given to the user. For example, by using a high-resolution image obtained by enlarging a specific building in the guide area in the area guide information B1 as a superimposed image, the user can check a part of the specific building in detail while checking the entire cityscape. can do. Further, for example, by using an image obtained by capturing a specific building at an angle different from that of the omnidirectional image A1 as a superimposed image, the user can select a portion of the specific building that is not captured at the imaging angle of the omnidirectional image A1. Can also be confirmed.

The content of the annotation is not particularly limited as long as it relates to the omnidirectional image A1 or the superimposed image. For example, the information regarding the omnidirectional image A1 may be information indicating the state of the imaging target, the operation, the name, the notable part of the omnidirectional image A1, and the like. Further, examples of the information related to the superimposed image include the angle at which the image is captured, whether the image is an enlarged image, and which portion of the image to be imaged. In addition to this, for example, a UI (User Interface) menu for operating the display control device 1 or a UI menu for operation control of the display device 3 may be displayed as an annotation.

In the example of FIG. 8, the omnidirectional image A1 is an image in which the cityscape is an imaging target, but the imaging target is arbitrary. For example, the omnidirectional image A1 may be an image obtained by imaging the entire state of the operating room where the operation is performed. In this case, the imaging target may include a surgeon, an assistant, a patient, a surgical instrument, various devices, and the like. By using the omnidirectional image A1 as such an image, the display control device 1 and the display device 3 can be used for medical education.

For example, by setting the superimposed image as an image of the eyes of a person in the omnidirectional image A1 such as a surgeon or an assistant, the instructor can check the progress of the entire operation in the omnidirectional image A1, It is possible to learn how to take care of a person during surgery. Note that it may be possible to switch which person's eye-gaze image is displayed according to the learning purpose. For example, a superimposed image of the surgeon's eyes may be displayed when used for surgeon education, and a superimposed image of the assistant's eyes may be displayed when used for assistant education. Moreover, you may display the superimposition image of a different eyes | visual_axis in a several to-be-led | instructed person, respectively. In addition, by using an image obtained by capturing a screen displaying patient vital data as a superimposed image, the user can recognize the relationship between the transition of vital data during surgery and the movement of each person. In addition to this, for example, a high-resolution image of the operative field may be used as a superimposed image, thereby allowing the user to recognize the details of the surgeon's detailed work. Furthermore, information necessary for surgery, device operation information (for example, on / off of heart-lung machine), and the like may be displayed as annotations.

[Example of area management information]
The area management information that defines the overlapping area and the overlapping prohibited area as described above may be stored in the storage unit 20 or the like. In this case, the superimposition processing unit 16 can specify the superimposition region and the superposition prohibition region by referring to the stored region management information.

The area management information may be information as shown in FIG. 9, for example. FIG. 9 is a diagram illustrating an example of region management information that defines a superimposition region and a superposition prohibition region. The area management information in (a) of FIG. 9 has a table format in which information of “area”, “azimuth angle range”, “elevation angle range”, “superimposition / prohibition”, and “reproduction time” is associated. Information.

“Area” is identification information of a superimposition area or a superposition prohibition area, and in this example, the name of the area is described. “Azimuth angle range” and “elevation angle range” are information indicating the range occupied by the superimposition region or the superposition prohibition region in the omnidirectional image. For example, in the area management information shown in the drawing, the azimuth angle at the left end is −80 °, the azimuth angle at the right end is −100 °, the elevation angle at the lower end is 15 °, and the elevation angle at the upper end is 30 °. It is specified that the area occupies a rectangle.

“Superposition / prohibition” is information indicating whether the “region” is a superposition region or a superposition prohibition region. A region where the “superimposition / prohibition” information is “superimposition” is a superimposition region, and a region where “prohibition” is a superimposition prohibition region.

“Reproduction time” is information indicating a reproduction time zone in which a superimposition area or a superposition prohibition area is set. For example, since the “reproduction time” of the illustrated area C1 (the area indicated by the area information C1 in FIG. 8) is 00:01:00 to 00:05:00, the content reproduction time of this area C1 is 00:00. The time zone is set to 01:00 to 00:05:00.

On the other hand, the area management information in (b) of FIG. 9 indicates that the “azimuth angle range” and “elevation angle range” included in the area management information in (a) of FIG. ”,“ Azimuth angle ”, and“ elevation angle ”. That is, in the area management information of FIG. 9B, “width”, “height”, “azimuth angle”, and “elevation angle” are information indicating the range occupied by the overlapping area or the overlapping prohibited area. More specifically, “width” and “height” indicate the width and height of the overlapping region or the overlapping prohibition region, respectively. In addition, “azimuth angle” and “elevation angle” indicate reference positions for specifying a superimposition region or a superposition prohibition region. The reference position can be an arbitrary position on the superposition area or the superposition prohibition area. For example, when the superposition area or the superposition prohibition area is a rectangle, the position of the lower left corner may be used as the reference position. In this case, the lower left corner is the position indicated by “azimuth angle” and “elevation angle”, and the region having the width and height indicated by “width” and “height” is the overlapping region or the overlapping prohibition region.

[Enlarged display of overlapping area and prohibited area]
The superimposition area may have a size that fits within the display area. In this case, the superimposition area is a narrower area than the display area that is a part of the image area of the omnidirectional image. For this reason, the content may be enlarged and displayed when the instructor selects the overlapping region. Thereby, compared with the example of FIG. 8, it is possible to easily select the overlapping region. This will be described with reference to FIG.

FIG. 10 is a diagram showing an example in which the superimposition area information and the superposition prohibition area information are displayed after the content is enlarged and displayed. In the example of FIG. 10, the partial image of the display area B <b> 1 of FIG. 8 is displayed on the entire screen of the display unit 17 of the display control device 1. By displaying the partial image on the full screen, the area information C1 and C3 can be confirmed in more detail than the example of FIG. Although the content is enlarged and displayed on the entire screen here, it may be superimposed on the original content after being enlarged at an arbitrary enlargement ratio.

Further, in the example of FIG. 10, the display mode of the area information C1 indicating the overlapping area and the area information C3 indicating the overlapping prohibited area are different. Specifically, the area information C3 is marked with “X” indicating that superposition is prohibited. As a result, the instructor can intuitively recognize the overlapping area and the overlapping prohibited area.

Area information C3 is an area set to include the display area of the object D1. Thereby, even when the superimposed image is displayed, the object D1 does not disappear. The superposition prohibition area may be set by automatically detecting the object D1 from the omnidirectional image. In this case, a predetermined range including the display area of the detected object D1 may be set as the superposition prohibition area. In the case of automatic detection, the appearance (shape, size, color, etc.) of the object to be detected may be determined in advance. Thus, by analyzing the omnidirectional image, an object having such an appearance can be automatically detected. Further, the object may be detected using machine learning or the like. Such an object detection may be configured to be performed by the superimposition processing unit 16 or may be configured to separately provide a processing block for detecting an object and detect the object in the processing block.

[Processing flow (superimposed image display)]
An example of the flow of processing executed by the display control device 1 of the present embodiment (control method of the display control device) will be described with reference to FIG. FIG. 11 is a flowchart illustrating an example of processing when the display control device 1 displays a superimposed image on the display device 3. Note that FIG. 11 illustrates processing after the omnidirectional image is displayed on the display unit 17. In the following, an example in which there is one display device 3 will be described, but the processing in the case where there are a plurality of display devices 3 is the same as the following.

In S <b> 21, the display area specifying unit 12 specifies the display area of the display device 3 by communicating with the display device 3. In S22, the superimposition processing unit 16 extracts a superimposition region in the displayed omnidirectional image. Specifically, the superimposition processing unit 16 selects an area corresponding to the playback time of the content and having “superimposition / prohibition” information “superimposition” among the areas indicated in the area management information (see FIG. 9). Extract. In S22, only the display area specified in S21 may be the extraction target, or a wider range (for example, the display area and a predetermined area around it) may be the extraction target. In this case, a predetermined area (area specified by the azimuth angle range and the elevation angle range) indicated in the area management information (see FIG. 9) is extracted at least a part of which is included in the extraction target area. To do.

In S23, the superimposition processing unit 16 determines whether there is a superimposed image to be displayed in the superimposition region extracted in S22. When the area management information as shown in FIG. 9 is set in advance, the overlapping area to be displayed in each area may be set in advance. In this case, in S23, the superimposition processing unit 16 determines the presence or absence of a superimposed image associated with the superimposition region extracted in S22. If it is determined in S23 that there is a superimposed image (YES in S23), the process proceeds to S24. On the other hand, if it is determined that there is no superimposed image (NO in S23), the process returns to S21.

In S24, the superimposition processing unit 16 acquires information indicating the display mode of the superimposed image. Such information may be stored in advance in association with the superimposed image. The information indicating the display mode includes, for example, the presence / absence of perspective (perspective display, that is, display by perspective projection), the transmittance of the superimposed image, and the superimposed decoration method (for example, presence / absence of application of image processing for blurring the outline of the superimposed image). The information to show is mentioned.

In S25, the superimposition processing unit 16 causes the display unit 17 to display superimposition region information indicating the superimposition region extracted in S22. At this time, the superimposition processing unit 16 may enlarge and display an image area including the superimposition area (see FIG. 10).

In S26, the superimposition processing unit 16 receives selection of a superimposition region and a superimposed image. The selection of the overlapping area may be performed by selecting the displayed overlapping area information by an input operation to the input unit 18, for example. Further, when a plurality of superimposed images are associated with the selected superimposed region, the plurality of superimposed images may be displayed and selected by the instructor.

In S27, the synthesizing unit 15 synthesizes an image of the superimposed image in the superimposition area received in S26 and draws (displays) the image on the display unit 17. Note that the superimposed image may be displayed as a preview before S26.

In S28, the superimposition processing unit 16 notifies the display device 3 of the superposed region and the superposed image that have been selected in S26, and instructs the superposed region to superimpose and display this superposed image. Thereby, also on the display device 3, the superimposed image is superimposed and displayed on the superimposed region. When the display device 3 does not store the superimposed image, the superimposition processing unit 16 may transmit the superimposed image to the display device 3. Thereafter, the process returns to S21.

[Overlapping prohibited area]
In the process of S22, the superposition prohibition area may be extracted, and in S25, the superposition prohibition area information indicating the superposition prohibition area may be displayed. The superimposition prohibition area is (1) when the instructor can freely set the position of the superimposition area, (2) when determining the position of the superimposition area based on the position of the object in the content, and (3) This is useful, for example, when determining the position of the superimposition area based on the position of the display area.

In the case of (1) above, since the instructor can freely set the position of the superimposition area except for the superposition prohibition area, the superposition prohibition area is hidden by the superimposition image while ensuring the degree of freedom of the position of the superposition area. Nothing will happen.

In the case of (2) above, for example, an object having a predetermined appearance (for example, a building in the example of FIG. 8) is detected in the content, and is shifted by a predetermined offset from the periphery of the object (for example, a reference position in the object). Suppose that a superimposed image is displayed at (position). At this time, if there is a superposition prohibition area around the object, the superposition image can be displayed in association with the object by setting the superposition area while avoiding this, and the superposition prohibition area is hidden by the superposition image. It will not be done.

As an example of the above (3), there is an example in which a superimposed image is displayed at a position shifted by a predetermined offset from a reference position of the display area (for example, the center of the display area). Thereby, even if the display area moves, the display area and the overlapping area are in a predetermined positional relationship, so that the visibility of the overlapping area can be improved. However, if there is a superposition prohibition area at a position shifted by a predetermined offset, the superposition area is set avoiding this. As a result, the superposition prohibition area is not hidden by the superposition image.

[Embodiment 3]
Still another embodiment of the present invention will be described with reference to FIG. In the present embodiment, an example will be described in which an image to be displayed on a display device is generated by a display control device. FIG. 12 is a block diagram illustrating an example of a main configuration of the display control device 1 and the display device 3 configuring the control system 5 according to an embodiment of the present invention.

The display control device 1 is different from the display control device 1 of each embodiment described above in that it includes an image transmission unit 40. The display device 3 is different from the display device 3 of each of the above embodiments in that the omnidirectional image drawing unit 32 is not provided but the image acquisition unit 45 is provided.

The image transmission unit 40 transmits an image to the display device 3 via the communication unit 19. The image to be transmitted is a partial image corresponding to the display area of the display device 3 in the omnidirectional image. The display area is specified by the display area specifying unit 12 based on a notification from the display area notifying unit 34. In addition, when the superimposed image is superimposed and displayed on the omnidirectional image on the display unit 17, the partial image in a state where the superimposed image is superimposed is transmitted. Then, the image acquisition unit 45 acquires the image transmitted by the display control device 1 via the communication unit 38 and causes the display unit 35 to display the image. Accordingly, the display device 3 can display a partial image of the omnidirectional image or an image in which the superimposed image is superimposed on the omnidirectional image without storing the omnidirectional image or the superimposed image.

[Embodiment 4]
The functions of the display control device 1 and the display device 3 of each of the above embodiments can also be realized by a control system including a server, a display control device, and a display device. In the present embodiment, another example of the control system will be described with reference to FIG. FIG. 13 is a diagram showing an overview of a control system 50 according to Embodiment 4 of the present invention. The control system 50 includes a display control device 1, a display device 3, and a server 7. The control system 50 may include a plurality of display devices 3.

The display control device 1, the display device 3, and the server 7 are communicably connected via a predetermined communication network (for example, the Internet). Therefore, the user of the display control device 1 (instructor) or the user of the display device 3 (instructor) can be connected to the communication network from other users (instructors or instructors). The control system 50 can be used even if the user is in a remote location.

The server 7 stores various information used in the control system 50, and transmits the information to the display control device 1 and the display device 3. The server 7 stores a communication unit for the server 7 to communicate with other devices (in the present embodiment, the display control device 1 and the display device 3), a control unit that controls each unit of the server 7, and various information. A storage unit is provided.

Further, the control unit of the server 7 includes an omnidirectional image transmission unit that transmits the omnidirectional image 21 in response to a request from another device. Therefore, the display control device 1 and the display device 3 can acquire and display the omnidirectional image 21 from the omnidirectional image transmission unit. For this reason, the display control device 1 and the display device 3 of the present embodiment do not need to store the omnidirectional image 21.

Furthermore, the control unit of the server 7 includes a guide information transmission unit that transmits guide information 22 in response to a request from another device. Therefore, the display control apparatus 1 can acquire the guide information 22 from the guide information transmission unit and display the area guide information. For this reason, the display control apparatus 1 of this embodiment does not need to memorize | store guide information 22. FIG. When the displayed area guide information is selected, the display control apparatus 1 notifies the display apparatus 3 of the guide area indicated by the selected area guide information. The display device 3 acquires the notified partial image of the guide area from the server 7 and displays it.

The control unit of the server 7 includes a superimposed image transmission unit that transmits the superimposed image 23 in response to a request from another device. Therefore, the display control device 1 and the display device 3 can acquire and display the superimposed image 23 from the superimposed image transmission unit. For this reason, the display control device 1 and the display device 3 of the present embodiment do not need to store the superimposed image 23. Similarly, the area management information (see FIG. 9) can be obtained from the server 7.

[Modification]
In each of the embodiments described above, the display control device 1 has described an example of displaying a rectangular planar image obtained by mapping the omnidirectional image on a two-dimensional plane. However, the display control device 1 displays at least the display area of the display device 3. It is only necessary to display an image including it, and is not limited to this example. For example, when displaying omnidirectional images captured by two fisheye cameras, each image captured by each fisheye camera is mapped to a two-dimensional plane to generate two circular planar images, which are displayed. May be.

In each of the above embodiments, the example in which the content is a spherical image has been described. However, the content can display a partial image of a display area that is a specified part of the entire image area. What is necessary is not limited to the spherical image. For example, the image may be a hemispherical image, or may be a flat image (such as a panoramic photograph) having a display size that does not fit on one screen of the display device 3. Further, for example, when displayed at a normal scale, even an image having a display size that can fit on one screen of the display device 3 may not fit on one screen when displayed in an enlarged size. May be displayed on the display control device 1. Also, the content is not limited to those intended for education and guidance.

Furthermore, in each of the above-described embodiments, an example in which the content is a moving image has been shown. However, the content may be a still image or may include a plurality of still images as components. In this case, the still images displayed on the display control device 1 and the display device 3 are synchronized.

In each of the above embodiments, an example has been described in which the instructor who is the user of the display device 3 designates the display area by directing his / her line of sight in a desired direction, but the display area designation method is not particularly limited. For example, the display area may be specified by a controller or the like for specifying the display area.

Further, in each of the above embodiments, the example in which the display control apparatus 1 changes the display area by instructing the display apparatus 3 has been described. However, by prompting the user of the display apparatus 3 to change the display area, the display apparatus 3 can be changed. The display area may be changed. The display area is changed by displaying a superimposed image or an annotation including a message prompting the display of the guide area, a symbol (arrow or the like) indicating the moving direction of the line of sight for displaying the guide area, or a message on the display device 3. Can be urged to. In addition, when the display device 3 has a function of outputting sound, the display device 3 can be prompted to change the display area by causing the display device 3 to output the sound. For example, a message such as “Move the line of sight to the right and pay attention to a triangular building” may be displayed as an annotation. In addition, a message that guides the user's line-of-sight direction to a predetermined line-of-sight direction such as "Please move your line of sight slightly to the left so that a low-cylindrical building is located in the center of the field of view" It may be displayed. In addition, the user may be prompted to display the guide area by changing the display mode of the guide area and the other image areas. For example, the display brightness of the guide area may be made higher than other areas. In this case, the user can easily find the guide area by moving the line-of-sight direction.

[Example of software implementation]
The control blocks of the display control device 1 and the display device 3 (particularly, each unit included in the control unit 10 and the control unit 30) may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like. However, it may be realized by software using a CPU (Central Processing Unit).

In the latter case, the display control device 1 and the display device 3 include a CPU that executes instructions of a program that is software that implements each function, and a ROM (in which the program and various data are recorded so as to be readable by a computer (or CPU)). Read Only Memory) or a storage device (these are referred to as "recording media"), a RAM (Random Access Memory) for expanding the program, and the like. The computer (or CPU) reads the program from the recording medium and executes the program, thereby achieving the object of one embodiment of the present invention. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. Note that one embodiment of the present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.

[Summary]
A display control device (1) according to aspect 1 of the present invention is a display control device that displays content on a first display device (display unit 17), and displays a specified display region among the image regions of the content. A display area specifying unit (12) for specifying which area of the image area the second display device (display apparatus 3) for displaying a partial image is a display area, and an area specified by the display area specifying unit And a display area notification unit (13) for displaying the display area information on the first display device.

According to the above configuration, the display area of the second display device is specified, and display area information indicating the area is displayed on the first display device. Therefore, the display area of the second display device can be recognized by the user of the first display device. The first display device only needs to display an area including at least the display area in the content. The first display device may display the entire image area of the content, or a narrower area. It may be displayed.

The display control device according to aspect 2 of the present invention is the display control device according to aspect 1, in which the image of the second display device is displayed when the display area information is moved on the content displayed on the first display device. It is good also as a structure provided with the display area control part (guide part 14) which moves an area | region to the position of the movement destination of the said display area information.

According to the above configuration, the user of the first display device moves the display region information to the image region that the user of the second display device wants to view, thereby displaying the partial image of the image region on the second display. It can be displayed on the device.

The display control device according to aspect 3 of the present invention is the guide unit (14) that causes the first display device to display region guide information indicating an image region to be displayed on the second display device in the above aspect 1. It is good also as a structure provided with.

According to the above configuration, the user of the first display device can recognize the image region to be displayed on the second display device based on the region guide information. Further, as described above, the display area of the second display device can be recognized by the user of the first display device based on the display area information. Therefore, the user of the first display device can recognize whether the image region to be displayed on the second display device matches the actual display region of the second display device.

The display control apparatus according to aspect 4 of the present invention is the display area control unit that causes the second display apparatus to display an image area indicated by the area guide information when the area guide information is selected in the aspect 3. It is good also as a structure provided with (guide part 14).

According to the above configuration, the user of the first display device can display the partial image of the image region on the second display device by selecting the region guide information. Therefore, the user of the second display device can browse the partial image of the image area to be displayed on the second display device.

The display control device according to aspect 5 of the present invention includes a detection unit that detects an object having a predetermined appearance from the content in the aspect 3 or 4, and the guide unit includes the object detected by the detection unit. The area guide information indicating the image area may be displayed on the first display device.

According to the above configuration, area guide information indicating an image area including an object having a predetermined appearance in the content is displayed on the first display device. Therefore, the first display indicates whether the display area of the object and the display area of the second display device are coincident with each other, that is, whether or not the user of the second display device is viewing the object. It can be recognized by the user of the device.

The display control device according to aspect 6 of the present invention is the superimposition processing unit according to any one of the aspects 1 to 5 described above, wherein the superimposed image related to the content is superimposed on the partial image and displayed on the second display device. 16), and the superimposed region in which the superimposed image is superimposed on the partial image may be a region designated in the content displayed by the first display device.

According to the above configuration, the user of the first display device designates a region in the content displayed by the first display device, thereby superimposing the region on the partial image displayed on the second display device. An image can be displayed.

The second display device (display device 3) according to aspect 7 of the present invention can communicate directly or indirectly with the display control device (1) that displays the content on the first display device (display unit 17). A second display device that displays a partial image of a designated display area of the image area of the content, wherein a display area identifying unit that identifies which area of the image area is designated as the display area ( A display area for notifying the display control apparatus of display area information indicating the area specified by the omnidirectional image drawing section 32) and the display area specifying section and displaying the display area information on the first display apparatus And a notification unit (34).

According to the above configuration, the display area of the second display device is specified, the display area information indicating the specified area is notified to the display control device, and the display area information is displayed on the first display device. Therefore, the display area of the second display device can be recognized by the user of the first display device.

A control method of the display control device (1) according to the aspect 8 of the present invention is a control method of a display control device that causes a content to be displayed on the first display device (display unit 17). A display region specifying step (S2) for specifying which region of the image region the second display device (display device 3) for displaying the partial image of the specified display region is used as the display region; and the display region A display area notifying step (S5) for causing the first display device to display display area information indicating the area specified in the specifying step. Therefore, the same effects as those of the first aspect are obtained.

The display control device (1) according to each aspect of the present invention may be realized by a computer. In this case, display control is performed by operating the computer as each unit (software element) included in the display control device (1). A control program for a display control apparatus for realizing the apparatus (1) by a computer and a computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention. The second display device (3) according to the above aspect of the present invention may also be realized by a computer. In this case, the computer operates as each unit (software element) included in the second display device (3). Thus, a control program for the second display device for realizing the second display device (3) by a computer and a computer-readable recording medium on which the control program is recorded fall within the scope of the present invention.

The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

(Cross-reference of related applications)
This application claims the benefit of priority over Japanese patent application filed on Jan. 24, 2017: Japanese Patent Application No. 2017-010316. Included in this document.

DESCRIPTION OF SYMBOLS 1 Display control apparatus 12 Display area specific | specification part 13 Display area notification part 14 Guide part (display area control part)
16 Superimposition processing unit 17 Display unit (first display device)
21 Spherical image (content)
23 superimposed image 3 display device (second display device)
32 Spherical image drawing part (display area specifying part)
34 Display area notification section

Claims (9)

1. A display control device for displaying content on a first display device,
   A display area specifying unit for specifying which area of the image area is a second display device that displays a partial image of a specified display area of the image area of the content;
   A display control device, comprising: a display region notification unit that causes the first display device to display display region information indicating a region specified by the display region specifying unit.
2. Display area control for moving the image area of the second display device to a position to which the display area information is moved when the display area information is moved on the content displayed on the first display device. The display control apparatus according to claim 1, further comprising a unit.
3. 2. The display control device according to claim 1, further comprising a guide unit that causes the first display device to display region guide information indicating an image region to be displayed on the second display device.
4. 4. The display control according to claim 3, further comprising: a display area control unit configured to display an image area indicated by the area guide information on the second display device when the area guide information is selected. apparatus.
5. A detection unit for detecting an object having a predetermined appearance from the content;
   The display control device according to claim 3, wherein the guide unit displays the region guide information indicating an image region including the object detected by the detection unit on the first display device.
6. A superimposing processor that superimposes the superimposed image related to the content on the partial image and displays the superimposed image on the second display device;
   6. The superimposing region in which the superimposing image is superimposed on the partial image is a region designated in the content displayed by the first display device, according to claim 1. Display control device.
7. A second display device that is capable of directly or indirectly communicating with a display control device that displays content on a first display device, and that displays a partial image of a specified display region of the image region of the content,
   A display area specifying unit for specifying which area of the image area is designated as a display area;
   A display area notifying unit for notifying the display control device of display area information indicating the area specified by the display area specifying unit and displaying the display area information on the first display device. A featured second display device.
8. A control method of a display control device for displaying content on a first display device,
   A display area specifying step for specifying which area of the image area the second display device for displaying a partial image of a specified display area of the image area of the content includes:
   And a display area notifying step for causing the first display device to display display area information indicating the area specified in the display area specifying step.
9. A control program for causing a computer to function as the display control device according to claim 1, wherein the control program causes the computer to function as the display area specifying unit and the display area notifying unit.

Images