+

WO2018143360A1 - Relative position detection system and image display system - Google Patents

Relative position detection system and image display system Download PDF

Info

Publication number
WO2018143360A1
WO2018143360A1 PCT/JP2018/003457 JP2018003457W WO2018143360A1 WO 2018143360 A1 WO2018143360 A1 WO 2018143360A1 JP 2018003457 W JP2018003457 W JP 2018003457W WO 2018143360 A1 WO2018143360 A1 WO 2018143360A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal device
type terminal
relative position
position detection
glasses
Prior art date
Application number
PCT/JP2018/003457
Other languages
French (fr)
Japanese (ja)
Inventor
良夫 川又
純一郎 和智
Original Assignee
良夫 川又
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 良夫 川又 filed Critical 良夫 川又
Priority to JP2018566093A priority Critical patent/JPWO2018143360A1/en
Publication of WO2018143360A1 publication Critical patent/WO2018143360A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B21/00Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/02Viewing or reading apparatus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/38Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory with means for controlling the display position

Definitions

  • the present invention relates to a relative position detection system that detects a relative position between a first terminal device and a second terminal device, and an image display system including the relative position detection system.
  • Patent Document 1 Conventionally, for example, as a technique for detecting the relative positions of a plurality of devices and devices, there is a device as shown in Patent Document 1, for example.
  • the apparatus shown in Patent Document 1 is a manipulator system including a head-mounted display mounted on an operator's head and an operation unit that operates a display object (manipulator) displayed on the display.
  • a relative position sensor for detecting a relative position and a relative posture of the wearable display and one of the operation units with respect to the other is provided.
  • the relative position sensor described in Patent Document 1 includes an LED as an index provided on one of the head-mounted display and the operation unit, and a CCD having a field of view provided on the other and capable of photographing the front. And an imaging unit.
  • the absolute position information of each device is obtained by receiving information from the outside such as GPS (Global Positioning System) and the Internet (communication network),
  • GPS Global Positioning System
  • the Internet communication network
  • the relative position between devices is detected from the acquired absolute position information of each device.
  • a position detection system equipped with a camera may cause problems related to shooting related to the privacy of third parties in public places such as streets and trains, and copyrights at bookstores and movie theaters. There is a risk of unintentionally taking a picture.
  • data such as an image taken by a camera is at least temporarily stored in a storage unit in the apparatus. For this reason, there is a possibility that problems may arise in privacy protection and security due to leakage of data such as the image.
  • a storage medium such as a memory for storing captured image data and to increase the processing capability of a processing device for performing arithmetic processing.
  • the present invention has been made in view of the above points, and its object is not to hinder downsizing of the apparatus and simplification of the configuration and processing, but to detect relative positions between a plurality of apparatuses with high accuracy. It is an object of the present invention to provide a possible relative position detection system and an image display system including the same.
  • a relative position detection system is a relative position detection system that detects a relative position between a first terminal device and a second terminal device, and includes the first terminal device and the second terminal.
  • a position detection unit including an acceleration sensor and an angular velocity sensor provided in each of the devices, a data transmission unit provided in at least one of the first terminal device and the second terminal device, and the data transmission provided in the other
  • a data receiving unit that receives data from a unit; and a relative position information acquisition unit that acquires relative position information provided in at least one of the first terminal device and the second terminal device, and the relative position information
  • the acquisition unit is configured to acquire relative position information between the first terminal device and the second terminal device using only the measurement value of the acceleration sensor and the measurement value of the angular velocity sensor. Characterized in that was.
  • the relative position between the first terminal device and the second terminal device is detected only by the detection of the acceleration sensor and the angular velocity sensor.
  • the configuration of the device is greatly simplified, miniaturized and reduced in weight.
  • the relative position can be detected by simple processing, the processing speed of relative position detection can be increased.
  • power saving can be achieved compared to a conventional system including a camera (imaging means), it contributes to the reduction in size and weight of the battery even when a battery is mounted on the terminal device. Can do.
  • the relative position between the first terminal device and the second terminal device is detected only by the detection of the acceleration sensor and the angular velocity sensor. There is no need to receive external information. Therefore, the relative position between the first terminal device and the second terminal device can be detected even in an environment or device configuration that cannot receive information from outside such as GPS and the Internet.
  • the relative position between the first terminal device and the second terminal device is detected only by the detection of the acceleration sensor and the angular velocity sensor. There is no need to be in a position where the apparatuses can visually recognize each other as in the relative position detection system using the means. Therefore, for example, when there is a shield between the devices, or in an environment where the field of view is not good enough, the relative position can be detected even in an environment where the devices are not visible. Results in a relative position detection system with less.
  • the relative position detection system further includes reset means for resetting the measurement values of the acceleration sensor and the angular velocity sensor in the position detection unit when a predetermined condition is satisfied, and the measurement values of the acceleration sensor and the angular velocity sensor. May be a cumulative value from the time when the reset by the reset means is performed.
  • the relative position information acquisition unit uses the relative position between the first terminal device and the second terminal device, or the postures of the first terminal device and the second terminal device as coordinate data. It may be obtainable.
  • the relative position information acquisition unit can acquire the relative position between the first terminal device and the second terminal device or the orientation of the first terminal device and the second terminal device as coordinate data.
  • the relative position or posture between the first terminal device and the second terminal device can be grasped more accurately by simple processing. Therefore, it is possible to simplify the processing in the first terminal device or the second terminal device, and it is possible to acquire the relative position information quickly and reliably.
  • the attitude of the terminal device refers to an inclination with respect to a reference angle (in the same position) that does not include the position information of the terminal device.
  • An image processing system is an image processing system including any one of the above-described relative position detection systems according to the present invention, wherein the first terminal device generates image display data.
  • the second terminal device includes an image display unit for displaying an image based on the image display data, and the image generated by the image display data generation unit of the first terminal device. Display data is transmitted to the second terminal device, an image is displayed by the image display means of the second terminal device based on the image display data, and the image display means Based on the relative position information between the first terminal device and the second terminal device acquired by the information acquisition means, the display position of the image to be displayed based on at least the image display data Characterized in that it constant.
  • the image display position may be determined by the image display unit based on the position of the first terminal device viewed from the second terminal device.
  • the first terminal device and the second terminal device are used.
  • An image can be displayed at a position based on relative position information with the terminal device.
  • the image displayed on the second terminal device is always displayed at the same position with respect to the first terminal device.
  • the relative position detection system of the present invention it is possible to accurately detect the relative position between a plurality of apparatuses while reducing the size and weight of the apparatus and simplifying the configuration and processing. According to such an image display system, the convenience of image display by the first terminal device and the second terminal device can be effectively improved.
  • FIG. 1 is a diagram illustrating an overall configuration example of an image display system including a relative position detection system according to a first embodiment of the present invention. It is a block diagram which shows the function structure of a wristwatch-type terminal device and a glasses-type terminal device. It is a flowchart for demonstrating the procedure of the relative position detection performed between a wristwatch type
  • FIG. 1 It is a figure which shows the image of the display screen displayed based on the data for display screens transmitted to the spectacles type terminal device from the wristwatch type terminal device. It is a figure which shows the example of whole structure of the image display system containing the relative position detection system concerning 2nd embodiment of this invention. It is a block diagram which shows the function structure of a portable terminal device (smart phone).
  • FIG. 1 is a diagram showing an example of the overall configuration of an image display system including a relative position detection system according to the first embodiment of the present invention.
  • the image display system 1 including the relative position detection system shown in FIG. 1 includes a wristwatch type terminal device (first terminal device) 100 and a glasses type terminal device (second terminal device) 200.
  • the wristwatch type terminal device 100 is a wearable terminal in the shape of a wristwatch having a main body portion 101 and a band 102 for mounting the main body portion 101 on an arm
  • the glasses-type terminal device 200 is a pair of glasses functioning as glasses.
  • the eyeglass portion 210 is composed of lenses 201 and 201 and a frame portion 202 that supports the pair of lenses 201 and 201, and a main body portion 205 attached to the frame portion 202 of the eyeglass portion 210. It is a wearable terminal that did.
  • the glasses-type terminal device 200 projects (displays) an image 220 projected from an image projection unit 213, which will be described later, on a lens 201. Thereby, the wearer wearing the glasses-type terminal device 200 visually recognizes that the image projected on the lens 201 exists (is displayed) in the actual scenery viewed through the lens 201. Can do.
  • the image 220 is projected by projecting an image (including video, the same applies hereinafter) such as a display screen of application software executed on the wristwatch-type terminal device 100 as the image 220. It is projected so as to be (visible) at the position of the wristwatch type terminal device 100 or the vicinity thereof. Thus, it appears to the wearer of the glasses-type terminal device 200 that the image (video) 5 on the display screen is displayed at a position near the wristwatch-type terminal device 100, for example.
  • the said image when displaying the said image, it displays so that the said image exists in the vicinity position of the wristwatch-type terminal device 100, and the position (relative position with respect to the glasses-type terminal device 200) of the wristwatch-type terminal device 100 changes.
  • information on the relative position between the wristwatch type terminal device 100 and the eyeglass type terminal device 200 is always acquired (ascertained). It is necessary to be able to do it.
  • the glasses type terminal device 200 and the wristwatch type terminal device 100 are relatively A relative position detection function (relative position detection system) for detecting the position is provided.
  • FIG. 2 is a block diagram showing a functional configuration of the wristwatch type terminal device 100 and the glasses type terminal device 200.
  • the wristwatch type terminal device 100 shown in FIG. 1 includes a control unit (control unit) 111, a storage unit (storage unit) 112, a display unit (display unit) 113, an operation unit (input unit) 114, a data transmission / reception unit 115, and an acceleration sensor. 116a and an angular velocity sensor 116b.
  • the control unit 111 is a part for executing various processes for operating the wristwatch-type terminal device 100, and includes a microprocessor, various peripheral circuits, and the like.
  • the control unit 111 has a function for executing a program (application software, hereinafter simply referred to as “application”) 120 stored in the storage unit 112.
  • control unit 111 detects position information (data) detected by the position detection unit 116 of the wristwatch type terminal device 100 and position information (data) detected by the position detection unit 216 of the glasses type terminal device 200. ), The relative position information of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 can be acquired (understood). Therefore, the control unit 111 also functions as a relative position information acquisition unit that acquires relative position information of the wristwatch type terminal device 100 and the glasses type terminal device 200.
  • the storage unit 112 is a storage medium such as a flash memory.
  • the storage unit 112 stores various data such as the application 120 executed by the control unit 111. That is, the data stored in the storage unit 112 is read from the storage unit 112 by the control unit 111 as necessary, and is used for various processes and controls executed by the control unit 111.
  • the control unit 111 can store new data in the storage unit 112 or update already stored data.
  • the display unit 113 is a device for displaying various images and videos in addition to displaying a display screen and an operation screen for displaying the execution contents of the application, a time display screen as a clock, and the like.
  • a liquid crystal display or the like is used.
  • the operation unit 114 detects various operations input by the operator in order to use various functions of the wristwatch type terminal device 100, and includes various input means (operation buttons, a touch panel, a voice recognition device, or the like). Is possible. The operator can perform various operations necessary for executing an application, which will be described later, performed on the wristwatch type terminal device 100 by operating the operation unit 114.
  • the position detection unit 116 is a part for acquiring data related to the position of the wristwatch type terminal device 100, and includes an acceleration sensor 116a and an angular velocity sensor 116b.
  • an acceleration sensor 116a and the angular velocity sensor 116b for example, a MEMS (Micro Electro Mechanical System) type sensor can be used.
  • the acceleration sensor 116a can measure the change in position from the gravitational acceleration on the earth and the acceleration of the wristwatch type terminal device 100. (Here, the change in position also includes a change in angle (orientation / tilt).)
  • the angular velocity sensor 116b measures the change in angle from the reference angle of the wristwatch type terminal device 100.
  • position detection for the wristwatch type terminal device 100 in this specification refers to the detection of the position (change) and posture (change) of the wristwatch type terminal device 100 by the acceleration sensor 116a and the angular velocity sensor 116b. To do.
  • the position detection unit 116 is configured to reset data detected (measured) when a predetermined reset operation described later is performed, and newly start position detection (measurement) from that point. . Therefore, in the position detection by the position detection unit 116, the position at the time when the data is reset is set as the initial position (movement amount 0), and the movement amount (relative position with respect to the initial position) from the initial position is continuously measured. To detect the current position. Therefore, in the following description, “position detection” refers to detection of the movement amount from the initial position.
  • the data transmission / reception unit 115 transmits a data signal including various data input from the control unit 111 and the storage unit 112 to the data transmission / reception unit 215 of the glasses-type terminal device 200, and the data transmission / reception unit of the glasses-type terminal device 200.
  • 215 has a function of receiving data transmitted from 215.
  • the data transmission / reception unit 115 has a function of transmitting data regarding the position of itself (the wristwatch type terminal device 100) detected by the position detection unit 116 to the glasses-type terminal device 200.
  • the glasses-type terminal device 200 has a function of receiving data related to the position of the glasses-type terminal device 200 detected by the position detection unit 216 from the data transmission / reception unit 215 of the glasses-type terminal device 200.
  • the data transmission / reception unit 115 displays an image on the glasses-type terminal device 200 such as an application display screen and a web browser display screen data (data corrected by relative position information described later). It has a function of transmitting necessary data to the data transmission / reception unit 215 of the glasses-type terminal device 200.
  • the glasses-type terminal device 200 includes a control unit (control unit) 211, a storage unit (storage unit) 212, an image projection unit 213, a data transmission / reception unit 215, an acceleration sensor 216a, and an angular velocity sensor 216b.
  • the position detecting unit 216 includes a configuration.
  • the control unit 211 is a part for executing various processes for operating the glasses-type terminal device 200, and includes a microprocessor, various peripheral circuits, and the like.
  • the control unit 211 controls the image projection unit 213 based on the data related to the image display transmitted from the wristwatch type terminal device 100, thereby causing the image projection unit 213 to display the image 220 on the lens 201 of the glasses-type terminal device 200. It has a function to project.
  • the storage unit 212 is a storage medium such as a flash memory. Note that the data stored in the storage unit 212 is read from the storage unit 212 by the control unit 211 as necessary, and is used for various processes and controls executed by the control unit 211. In addition, the control unit 211 can store new data in the storage unit 212 or update already stored data. The storage unit 212 can temporarily store various data such as data related to images transmitted from the wristwatch type terminal device 100.
  • the position detection unit 216 is a component for acquiring data relating to the position of the glasses-type terminal device 200, and is configured to include an acceleration sensor 216a and an angular velocity sensor 216b, similar to the position detection unit 116 of the wristwatch-type terminal device 100. ing.
  • an acceleration sensor 216a and the angular velocity sensor 216b for example, a MEMS-type (Micro-Electro-Mechanical System) -type sensor can be used.
  • the acceleration sensor 216a measures the position change of the glasses-type terminal device 200 from the gravitational acceleration on the earth and the acceleration of the glasses-type terminal device 200.
  • the positional change here includes a change in angle (orientation / inclination).
  • the angular velocity sensor 216b measures an angular change from the reference angle of the glasses-type terminal device 200. Therefore, by correcting the information on the angle (direction / tilt) included in the detection value of the acceleration sensor 216a with the detection value of the angular velocity sensor 216b, the angle (direction / tilt) included in the detection value of the glasses-type terminal device 200 is corrected. By correcting the information, it is possible to measure a so-called pure movement (position) change (change in three-dimensional coordinate values (x, y, z)) that excludes changes in the direction and inclination of the glasses-type terminal device 200. .
  • a change in the posture (angle not including position information (at the same position)) (change in three-dimensional coordinate values (x, y, z)) of the glasses-type terminal device 200 can be measured from the detection value of the angular velocity sensor 216b. it can.
  • position detection for the glasses-type terminal device 200 in this specification refers to detection of the position (change) and posture (change) of the glasses-type terminal device 200 by the acceleration sensor 216a and the angular velocity sensor 216b. To do.
  • the data transmission / reception unit 215 transmits a data signal including various data input from the control unit 211 and the storage unit 212 to the data transmission / reception unit 115 of the wristwatch type terminal device 100 and the data transmission / reception unit of the wristwatch type terminal device 100.
  • 115 has a function of receiving data transmitted from 115.
  • the data transmission / reception unit 215 has a function of transmitting data regarding the position of itself (the glasses-type terminal device 200) detected by the position detection unit 216 to the wristwatch-type terminal device 100.
  • the wristwatch type terminal device 100 has a function of receiving data related to the position of the wristwatch type terminal device 100 detected by the position detection unit 216 from the data transmission / reception unit 115 of the wristwatch type terminal device 100.
  • the communication means for exchanging data between the data transmission / reception unit 115 of the wristwatch type terminal device 100 and the data transmission / reception unit 215 of the glasses-type terminal device 200
  • various known short-range wireless communication standards for digital devices are used. It is possible to use a communication means or the like.
  • the communication means here is not only communication means that exchanges data by direct communication between the data transmission / reception unit 115 of the wristwatch type terminal device 100 and the data transmission / reception unit 215 of the glasses-type terminal device 200,
  • communication means that performs communication over a long distance using radio waves such as radio waves or mobile communication networks or communication networks is also included.
  • FIG. 3 is a flowchart for explaining a relative position detection process (procedure) performed between the wristwatch-type terminal device 100 and the glasses-type terminal device 200.
  • a predetermined reset condition is satisfied in each of the wristwatch type terminal device 100 and the glasses type terminal device 200 (steps ST1-1 and ST2-1).
  • the reset here refers to resetting (initializing) the detection values (measurement values) of the position detection units 116 and 216.
  • the case where the predetermined reset condition is satisfied includes, for example, determining that the reset condition is satisfied when each of the wristwatch type terminal device 100 and the glasses type terminal device 200 can be regarded as being in the reference position. It is done.
  • the reference position mentioned here corresponds to a predetermined position or a position where measurement (determination) can be clearly performed.
  • a charging device for supplying power to the wristwatch type terminal device 100 and the glasses type terminal device 200 is provided, and the wristwatch type terminal device 100 and the glasses type terminal device 200 are provided in the charging device.
  • the wristwatch-type terminal device 100 and the glasses-type terminal device 200 can be regarded as being in a predetermined reference position when the item is placed.
  • the wristwatch type terminal device 100 and the eyeglass type terminal device 200 are configured to be able to detect contact (contact) with each other by some means, and the wristwatch type terminal device 100 and the eyeglass type terminal device 200 are in contact with each other.
  • the user is at a predetermined reference position. Specifically, it can be considered that resetting is performed by the operator performing a reset operation (such as pressing a reset button) when the terminal devices are at the reference position.
  • a weak electrical signal is made to flow on the surface of the casing of the wristwatch-type terminal device 100 and the glasses-type terminal device 200, or information such as a unique number is made to flow by weak radio waves, thereby detecting mutual contact. It is possible to make it possible.
  • step S1-1 when a predetermined reset condition is satisfied in the wristwatch type terminal device 100 (YES in step ST1-1), the detected position information (data) of the position detector 116 of the wristwatch type terminal device 100 is reset (step S1).
  • step S1-1 On the other hand, if the predetermined reset condition is not satisfied (NO in step ST1-1), the detected position information (data) of the position detector 116 is not reset.
  • step ST2-1 when a predetermined reset condition is satisfied in the glasses-type terminal device 200 (YES in step ST2-1), the detected position information (data) of the position detection unit 216 of the glasses-type terminal device 200 is reset (step).
  • step ST2-2 On the other hand, if the predetermined reset condition is not satisfied (NO in step ST2-1), the detected position information (data) of the position detector 216 is not reset.
  • the position detection unit 116 of the wristwatch type terminal device 100 determines whether to reset the detected position information (step ST1-1) and reset processing (step ST1-2), and the glasses type terminal device 200
  • the reset determination (step ST2-1) and the reset process (ST2-2) of the detected position information of the position detection unit 216 can be performed as separate processes at different timings, these watch types It is desirable that the reset determination and reset processing in the terminal device 100 and the reset determination and reset processing in the glasses-type terminal device 200 be performed at the same timing as the same processing.
  • the wristwatch type terminal device 100 performs position detection (step ST1-3). This is detection of its own position by detection of a position detection unit 116 (acceleration sensor 116a, angular velocity sensor 116b) provided in the wristwatch type terminal device 100. If the detected position information is reset by the position detector 116 in the previous step ST1-1, the detection data of the position detector 116 is an integrated value with respect to the reset value (initial value). . That is, position detection (measurement) is performed with the reset position as the initial position. On the other hand, in the glasses-type terminal device 200, the position of the glasses-type terminal device 200 is detected (step ST2-3).
  • the position information detected by the glasses-type terminal apparatus 200 is transmitted to the wristwatch-type terminal apparatus 100 (step ST2-4), and the position information is received by the wristwatch-type terminal apparatus 100 (step ST1-4).
  • the wristwatch type terminal device 100 uses the position information of the wristwatch type terminal device 100 acquired in the previous step ST1-3 and the position information of the eyeglass type terminal device 200 acquired in step ST1-4.
  • the relative position information of the type terminal device 100 and the eyeglass type terminal device 200 is acquired (step ST1-5). Thereby, the relative position of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 is grasped.
  • FIG. 4 is a diagram for explaining the acquisition of relative position information performed when the position detection data is reset by the position detection units 116 and 216 and when the relative position is grasped after the reset.
  • the relative position detection system of the present embodiment when a predetermined reset condition is satisfied in the wristwatch type terminal device 100 and the glasses type terminal device 200, the wristwatch type terminal device 100 and the glasses type terminal device.
  • the position detection information (measurement) is reset in the position detection units 116 and 216 in both 200.
  • a change in position (amount of movement) with the position where the reset is performed as an initial position is detected, and a relative position can be acquired (understood).
  • the relative position (change) between the wristwatch-type terminal device 100 and the glasses-type terminal device 200 and the postures (changes) of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 can be acquired as coordinate data. is there.
  • the acquisition (ascertaining) of the relative position of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 here means that if one of the positions of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 is used as a starting point, the other position is obtained. It is possible to grasp the relative movement amount when the wristwatch-type terminal device 100 and the glasses-type terminal device 200 are respectively moved from the positions where the reset is performed. State. When the wristwatch-type terminal device 100 and the glasses-type terminal device 200 change the same position from the reset position, there is no change in the relative position (that is, the relative movement amount is 0).
  • FIG. 5 is a flowchart for explaining a procedure of image display processing performed between the wristwatch type terminal device 100 and the glasses type terminal device 200.
  • image display process a process of projecting and displaying the display screen of the application 120 activated on the wristwatch type terminal apparatus 100 by the function of the image projection unit 213 of the glasses type terminal apparatus 200 (hereinafter, this process is referred to as “projection display”). Will be referred to as “processing”).
  • step ST3-1 it is determined whether or not the operation of the operation unit 114 (operation for starting the application 120) has been performed on the wristwatch type terminal device 100 (step ST3-1). As a result, when the operation of the operation unit 114 is not performed (NO), the process does not proceed to the next process until the operation of the operation unit 114 is performed. On the other hand, when the operation unit 114 is operated (YES), the application is started (step ST3-2). Thereafter, the relative position information of the wristwatch type terminal device 100 and the glasses type terminal device 200 is acquired (step ST3-3). The acquisition of the relative position information in step ST3-3 is the process of step ST1-5 in the flowchart of FIG. Thereby, the relative position information of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 is grasped.
  • step ST3-4 a process for converting screen data of the application 120 into data for projection display processing is performed (step ST3-4).
  • the relative position information of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 is incorporated into the screen display data of the application 120, so that the image on the screen is suitable for the position corresponding to the wristwatch-type terminal device 100. It is a process for making it display by various sizes and shapes.
  • the screen data subjected to the conversion process is transmitted to the data transmitting / receiving unit 215 of the glasses-type terminal device 200 (step ST3-5).
  • the glasses-type terminal device 200 receives the screen data transmitted from the wristwatch-type terminal device 100 (step ST4-1), and the image projection unit 213 based on the received screen data receives the screen image (or video). ) 220 is projected toward the lens 201 (step ST4-2). Thereby, the wearer of the glasses-type terminal device 200 visually recognizes the image 220 of the application screen as if it is projected directly above the wristwatch-type terminal device 100 by the image 220 projected on the lens 201. Can do.
  • the wristwatch type terminal device 100 determines whether or not the operation of the operation unit 114 (operation for ending the application 120) has been performed (step ST3-6). As a result, when the operation unit 114 is not operated (NO), the process returns to step ST3-3 and the process is repeated from the procedure for acquiring (obtaining) the relative position. On the other hand, if the operation unit 114 is operated (YES), the application is terminated (step ST3-7). On the other hand, in the glasses-type terminal device 200, the process of outputting the display screen image is continued until the reception of the display screen data transmitted from the wristwatch type terminal device 100 is completed (step ST4-3).
  • FIG. 6 is a diagram showing a display screen image 5 displayed based on the display screen data transmitted from the wristwatch type terminal device 100 to the glasses type terminal device 200.
  • the eyeglass-type terminal device 200 projects (displays) an image 220 from an image projection unit 213 onto a lens 201.
  • the wearer wearing the glasses-type terminal device 200 seems to have the image 220 projected on the lens 201 present (displayed) in the actual scenery seen through the lens 201. Can be visually recognized.
  • the relative position information of the wristwatch type terminal device 100 and the eyeglass type terminal device 200 is grasped, and based on this relative position information, the image seen through the lens 201 is always the wristwatch type such as the position directly above the wristwatch type terminal device 100. It can be controlled to be displayed at the same position with respect to the terminal device 100.
  • the relative positions of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 are detected only by the detection of the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b.
  • the configuration of the apparatus is significantly larger than that of a conventional position detection system including a camera (imaging means) and a system that performs relative position detection based on absolute position detection based on external information such as GPS. Simplification and reduction in size and weight can be achieved.
  • the relative position can be detected by simple processing, the processing speed of relative position detection can be increased.
  • the wristwatch type terminal device (first terminal device) 100 and the glasses type terminal device (second terminal device) are only detected by the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b. ) Since it is configured to detect the relative position of 200, it is not necessary to receive information from outside such as GPS and the Internet. Therefore, the relative position of the wristwatch type terminal device 100 and the glasses type terminal device 200 can be detected even in an environment or device configuration in which information from outside such as GPS or the Internet cannot be received.
  • the relative positions of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 are detected only by the detection of the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b.
  • the relative position can be detected even in an environment where the watch-type terminal device 100 and the glasses-type terminal device 200 are not directly visible, such as when there is a shield between the watch-type terminal device 100 and the glasses-type terminal device 200.
  • the relative position detection system of the present embodiment like a relative position detection system provided with a conventional camera, shooting related to the privacy of a third party in a public place such as in a city or on a train, a bookstore or a movie There is no risk of unintentionally taking a photo or the like that may cause a problem with copyrights in a hall.
  • data such as a photographed image is not stored in the storage units 112 and 212 in the apparatus. Accordingly, there is no possibility of leakage of data such as the image, so that there is no problem in protecting privacy and ensuring security.
  • a storage medium such as a memory for storing captured image data and to increase the processing capability of the processing device for performing arithmetic processing.
  • the relative position and orientation of the wristwatch type terminal device 100 and the glasses type terminal device 200 can be acquired as coordinate data, so that the wristwatch type terminal device 100 can be obtained with simple processing. And the relative position of the glasses-type terminal device 200 can be accurately grasped. Therefore, it is possible to simplify the processing in the wristwatch type terminal device 100 and the glasses type terminal device 200, and it is possible to acquire the relative position information quickly and reliably.
  • the image display system 1 including the relative position detection system of the present embodiment information on the relative positions of the wristwatch type terminal device 100 and the glasses type terminal device 200 detected by the relative position detection system having the above configuration is used. It can be controlled so that the image 5 of the screen seen through the lens 201 is always located at a position directly above the wristwatch type terminal device 100 or the like. Therefore, the convenience of the screen display of the wristwatch type terminal device 100 can be improved while the wristwatch type terminal device 100 and the eyeglass type terminal device 200 have a simple configuration with a reduced number of parts.
  • the case where the detection of the relative position of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 is performed as a function of the wristwatch-type terminal device 100 is described. It is also possible to configure so that the detection of the relative position of the glasses-type terminal device 200 (the process of step ST1-5 in FIG. 3) is performed as a function of the glasses-type terminal device 200.
  • the glasses-type terminal device 200 has a configuration in which a main body unit 205 having a functional configuration such as a control unit 211 is integrally attached to a frame unit 202 of the glasses unit 210 as shown in FIG.
  • the main body 205 does not necessarily have to be configured integrally with the glasses portion 210, and may be configured as another device that can be retrofitted to ready-made glasses. Good. That is, the main body 205 shown in FIG. 1 may be configured to be able to be attached later to, for example, existing glasses.
  • the display screen of the application was illustrated as an example of the display screen at the time of displaying an image using the relative position detection system concerning this invention, not only this but another display screen (for example, It is also possible to use a display screen of a web browser).
  • the wristwatch type terminal device 100 and the glasses type terminal device 200 are provided with the components shown in FIG. 2 , but the components shown in FIG. Only the components as the relative position detection system and the image display system according to the present invention are shown. Therefore, in addition to the components shown in FIG. 2, the wristwatch-type terminal device 100 and the glasses-type terminal device 200 are, for example, imaging means such as a camera, means for performing position detection by GPS, and external communication such as the Internet. Communication means for connecting to a network may be provided.
  • these image pickup means and communication means are not used as means for detecting position information in the relative position detection system according to the present invention, and the relative position detection system according to the present invention is merely the position shown in FIG. It is assumed that the position detection is performed only by the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b included in the detection units 116 and 216.
  • the acceleration sensors 116a and 216a and the angular velocity sensor 116b are used to increase the accuracy of the detection values of the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b included in the position detection units 116 and 216. It is preferable to provide correction means for correcting the detection value of 216b.
  • the following correction means (1) to (5) are conceivable.
  • the relative distance between the wristwatch-type terminal device 100 and the glasses-type terminal device 200 can be reset ( At that time, the measurement values of the position detection units 116 and 216 of the wristwatch type terminal device 100 and the glasses type terminal device 200 are corrected (the error included in the measurement values is corrected). Can be.
  • the watch-type terminal device 100 and the glasses-type terminal device 200 are configured to detect contact (contact) with each other by some means. As a result, the measurement value of the position detection unit of the wristwatch type terminal device 100 and the glasses type terminal device 200 can be corrected at that time. That is, in these cases, processing for correcting the measurement values of the position detection units 116 and 216 of the wristwatch type terminal device 100 and the glasses type terminal device 200 is performed in accordance with the reset processing.
  • Relative positions of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 are determined according to the strength of radio waves received by the data transmission / reception units 115 and 215 of the wristwatch-type terminal device 100 and the glasses-type terminal device 200. Based on the information, it is possible to correct the measurement values (correct the errors included in the measurement values) of the position detection units 116 and 216 of the wristwatch type terminal device 100 and the glasses type terminal device 200 based on the information. That is, for example, when one of the data transmission / reception units 115 and 215 of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 has received a radio wave having an intensity greater than or equal to a predetermined threshold value, the wristwatch-type terminal device 100. It is possible to determine that the relative position (distance) of the glasses-type terminal device 200 has become equal to or less than a predetermined value, and correct the measured values of the position detectors 116 and 216 based on the information on the distance.
  • the sensor further includes a correction sensor for correcting the measurement values of the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b included in the position detection units 116 and 216, and the correction sensors include the acceleration sensors 116a and 216a.
  • the measurement values of the angular velocity sensors 116b and 216b are corrected.
  • An example of the correction sensor here is a geomagnetic sensor (electronic compass).
  • the above-described geomagnetic sensor is provided as an integral or separate body in addition to the acceleration sensors 116a and 216a and the angular velocity sensors 216b and 216b.
  • a chip-type sensor may be provided.
  • a value obtained by correcting the measurement values of the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b with the measurement values of the geomagnetic sensor can be obtained as the detection values of the position detection units 116 and 216.
  • the position detection of the wristwatch-type terminal device 100 or the glasses-type terminal device 200 is performed only by the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b, and the geomagnetic sensor is the acceleration sensor 116a or 216a. It functions as a means for correcting the measurement value of position detection by the angular velocity sensors 116b and 216b.
  • the measured values of the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b included in the position detectors 116 and 216 are accumulated as data, and by analyzing the accumulated data, the tendency of errors occurring in the measured values can be grasped.
  • the measurement value may be corrected based on this tendency.
  • the degree of deterioration of the measured values of the position detection unit 116 of the wristwatch type terminal device 100 and the position detection unit 216 of the glasses type terminal device 200 is determined, and correction is performed so as to match the measurement value with the smaller degree of deterioration. Do. That is, as the movement amount of the wristwatch-type terminal device 100 or the glasses-type terminal device 200 after the reset process is larger, the error is accumulated in the measurement values of the position detection unit 116 or 216, and thus the deterioration of the measurement value tends to progress. There is.
  • the movement amount after reset processing of each of the wristwatch type terminal device 100 and the eyeglass type terminal device 200 is determined at a certain point in time, and the position detection unit 116 or 216 measures so as to match the measurement value with the smaller movement amount. Processing for correcting the value can be performed.
  • the correction processes (1) to (5) may be configured to be performed independently or may be performed in combination. By performing these correction processes, errors occurring in the measurement values of the position detectors 116 and 216 provided with only the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b can be suppressed, and therefore the position detector 116, The accuracy of detection of the relative position based on the measured value of 216 can be effectively increased.
  • FIG. 7 is a diagram showing an example of the overall configuration of an image display system 1-2 including a relative position detection system according to the second embodiment of the present invention.
  • FIG. 8 is a block diagram illustrating a functional configuration of the portable terminal device 300.
  • the image display system 1-2 according to this embodiment includes a wristwatch-type terminal device (first terminal device) 100 and a glasses-type terminal device (second terminal device) 200, as well as other portable terminal devices (first devices). 3 terminal device) 300.
  • the portable terminal device 300 is a small communication terminal device or computer device such as a so-called smartphone or tablet computer. As shown in FIG.
  • the portable terminal device 300 includes a control unit (control unit) 311, a storage unit (storage unit) 312, a display unit (display unit) 313, an operation unit (input unit) 314, and a data transmission / reception unit. 315 is provided.
  • the control unit 311 is a part for executing various processes for operating the portable terminal device 300, and includes a microprocessor, various peripheral circuits, and the like.
  • the control unit 311 has a function for executing the program (application) 320 stored in the storage unit 312.
  • the storage unit 312 is a storage medium such as a flash memory or a hard disk.
  • the storage unit 312 stores various data such as the application 320 executed by the control unit 311. That is, the data stored in the storage unit 312 is read from the storage unit 312 by the control unit 311 as necessary, and is used for various processes and controls executed by the control unit 311.
  • the control unit 311 can store new data in the storage unit 312 or update already stored data.
  • the display unit 313 is a device for displaying various images and videos in addition to displaying a display screen and an operation screen for displaying the execution contents of the application 320, and a liquid crystal display or the like is used.
  • the operation unit 314 detects various operations input by the operator in order to use various functions of the portable terminal device 300, and includes various input means (operation buttons, a touch panel, a voice recognition device, or the like). Is possible. The operator can perform various operations necessary for executing an application, which will be described later, performed on the portable terminal device 300 by operating the operation unit 314.
  • the data transmission / reception unit 315 transmits data signals including various data input from the control unit 311 and the storage unit 312 to the data transmission / reception units 115 and 215 of the wristwatch-type terminal device 100 or the glasses-type terminal device 200, and
  • the terminal device 100 has a function of receiving data transmitted from the data transmission / reception units 115 and 215 of the glasses-type terminal device 100 or the glasses-type terminal device 200.
  • the data transmission / reception unit 315 receives data relating to the position of the glasses-type terminal device 200 detected by the glasses-type terminal device 200 by the position detection unit 216 from the data transmission / reception unit 215 of the glasses-type terminal device 200, and also a wristwatch-type terminal.
  • the device 100 has a function of receiving data related to the position of the wristwatch type terminal device 100 detected by the position detection unit 116 from the data transmission / reception unit 115 of the wristwatch type terminal device 100.
  • the data transmission / reception unit 315 also includes data necessary for displaying images on the glasses-type terminal device 200, such as display screen data of the application 320 and data of the display screen of the web browser (data corrected by relative position information). Is transmitted to the data transmission / reception unit 215 of the glasses-type terminal device 200.
  • the image display system 1-2 of the present embodiment is different from the image display system 1 of the first embodiment in that the application for displaying an image is executed by the wristwatch type terminal device 100 in the first embodiment.
  • the wristwatch type is based on the point that the portable terminal device 300 performs, and the positional information detected by the wristwatch type terminal device 100 and the positional information detected by the glasses type terminal device 200.
  • the detection of the relative position information of the terminal device 100 and the glasses-type terminal device 200 is performed by the wristwatch-type terminal device 100 in the first embodiment, whereas in the present embodiment, the detection is performed by the portable terminal device 300. It is.
  • data related to the screen of the application executed on the portable terminal device 300 is transmitted to the glasses-type terminal device 200, and the screen image 220 is displayed on the lens 201 of the glasses-type terminal device 200 from the image projection unit 213. Project.
  • the portable terminal device 300 and the glasses The relative position information of the portable terminal device 200 is detected, and the detected relative position information is transmitted from the portable terminal device 300 to the glasses-type terminal device 200, thereby converting the screen data using the relative position information.
  • the wristwatch type terminal device 100 of the present embodiment only needs to include the position detection unit 116 and the data transmission / reception unit 115, and does not necessarily include the storage unit 112 that stores the application. Further, the data transmission / reception unit 115 of the wristwatch-type terminal device 100 and the data transmission / reception unit 215 of the glasses-type terminal device 200 both exchange data (communication) with at least the data transmission / reception unit 315 of the portable terminal device 300. As long as it has a function, it does not necessarily have to have a function of directly transferring data between the data transmission / reception unit 115 of the wristwatch type terminal device 100 and the data transmission / reception unit 215 of the glasses-type terminal device 200. .
  • the portable terminal device 300 is configured to execute the application and detect the relative position, thereby further simplifying the configuration of the wristwatch type terminal device 100, It becomes possible to reduce the size and weight.
  • the system that detects the relative position between the two terminal devices of the wristwatch type terminal device 100 and the glasses type terminal device 200 has been described as an example.
  • the relative position detection system according to the present invention includes three systems. It is also possible to configure as a system that detects the relative positions of two or more terminal devices. Therefore, for example, a plurality of glasses-type terminal devices shown in the above embodiment may be provided. In that case, it is possible to set so that a plurality of glasses-type terminal devices can see a common image by grasping the relative position of each of the plurality of glasses-type terminal devices with the wristwatch-type terminal device. Is possible.
  • the relative position detection system concerning this invention is used for the relative position detection of the glasses-type terminal device 200 and the wristwatch-type terminal device 100, and the image of the glasses-type terminal device 200 is the vicinity of the wristwatch-type terminal device 100.
  • detection of the relative position by the relative position detection system concerning the present invention is applicable also to other techniques. That is, the terminal device that detects the relative position by the position detection system of the present invention is not limited to these, and may be a terminal device having another configuration.
  • the position of the displayed image or video follows the position of the wristwatch type terminal device 100 has been described.
  • the position of the displayed image is temporarily fixed. Etc. are also possible.
  • an image or video displayed on the upper part of the wristwatch type terminal device may be displayed by being enlarged or reduced by an operation.
  • the images displayed by the image display system according to the present invention include not only 2D images and 2D videos but also 3D display images or videos such as 3D images and 3D videos.
  • the present invention can be used in the following system in place of the system including the wristwatch type terminal device 100 and the glasses type terminal device 200 as described above.
  • a terminal device corresponding to the first terminal device of the present invention is placed beside the car handle, and a car navigation image (video) is projected on the upper portion of the terminal device so as to be seen through the glasses-type terminal device.
  • a car navigation image video
  • Allow wristwatch-type terminal devices to obtain information about exhibitions at museums, etc., and view exhibits etc. in a 360-degree range with 3D images or video displayed on the top of the wristwatch-type terminal devices through glasses-type terminal devices To be able to.
  • the said embodiment demonstrated the case where the position detection between the two terminal devices of the wristwatch-type terminal device 100 which is a 1st terminal device, and the spectacles-type terminal device 200 which is a 2nd terminal device was performed, other than this
  • the first terminal device and the second terminal device reset the relative position information at a certain point, and the second terminal device sends its own position information to the first terminal device thereafter
  • the second terminal device resets the position information with another third terminal device, and if the information transmission means to the first terminal device can be transmitted to the third terminal device, then the second terminal device Even if the 1 terminal device does not go through the 2nd terminal device (if the reset point of the 2nd terminal device is known), the position of the 3rd terminal device can also be grasped. In this way, it is possible to increase the number of terminal devices capable of position detection by repeating the position detection operation between the two terminal devices.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Length Measuring Devices With Unspecified Measuring Means (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

Provided is a relative position detection system that does not prevent downsizing of a device or prevent simplifying the configuration or processing of a device and that is able to detect, with high accuracy, relative positions among a plurality of devices. This relative position detection system for detecting relative positions of a first terminal device and a second terminal device is configured such that: each of the first terminal device and the second terminal device is provided with a position detection unit that includes an acceleration sensor and an angular speed sensor and a data transmission/reception unit for mutually transmitting/receiving data; at least one of the first terminal device and the second terminal device is provided with a relative position information acquisition unit for acquiring information about the relative positions of the first terminal device and the second terminal device; and this relative position information acquisition unit acquires information about the relative positions of the first terminal device and the second terminal device by using only measured values of the acceleration sensors and measured values of the angular speed sensors.

Description

相対位置検出システム及び画像表示システムRelative position detection system and image display system
 本発明は、第1端末装置と第2端末装置の相対位置を検出する相対位置検出システム、及び当該相対位置検出システムを備えた画像表示システムに関する。 The present invention relates to a relative position detection system that detects a relative position between a first terminal device and a second terminal device, and an image display system including the relative position detection system.
 従来、例えば、複数の装置や機器同士の相対位置を検出するための技術として、例えば特許文献1に示すような装置がある。この特許文献1に示す装置は、操作者の頭部に装着される頭部装着型ディスプレイと、当該ディスプレイに表示された表示物(マニピュレータ)を操作する操作部とを備えるマニピュレータシステムにおいて、頭部装着型ディスプレイと操作部の一方に対する他方の相対位置および相対姿勢を検出する相対位置センサを備えている。そして、この特許文献1に記載の相対位置センサは、頭部装着型ディスプレイと操作部の一方に設けられた指標としてのLEDと、他方に設けられて前方を撮影可能な視野を有するCCDなどの撮像部とで構成されている。 Conventionally, for example, as a technique for detecting the relative positions of a plurality of devices and devices, there is a device as shown in Patent Document 1, for example. The apparatus shown in Patent Document 1 is a manipulator system including a head-mounted display mounted on an operator's head and an operation unit that operates a display object (manipulator) displayed on the display. A relative position sensor for detecting a relative position and a relative posture of the wearable display and one of the operation units with respect to the other is provided. The relative position sensor described in Patent Document 1 includes an LED as an index provided on one of the head-mounted display and the operation unit, and a CCD having a field of view provided on the other and capable of photographing the front. And an imaging unit.
 また、従来複数の装置の相対位置を検出する方法として、GPS(Global Positioning System)やインターネット(通信ネットワーク)など外部からの情報を受信することによって各装置の絶対的な位置情報を取得し、当該取得した各装置の絶対的な位置情報から装置間の相対位置を検出することが一般的に行われている。 In addition, as a method for detecting the relative positions of a plurality of conventional devices, the absolute position information of each device is obtained by receiving information from the outside such as GPS (Global Positioning System) and the Internet (communication network), In general, the relative position between devices is detected from the acquired absolute position information of each device.
 しかしながら、近年、通信端末装置など各種の端末装置の小型化・軽量化及び装置構成の簡素化が進んでいる。そのため、複数の装置や機器、特に小型の装置や機器の相対位置を検出する場合においても、装置の構成要素を可能な限り少なく抑えることで、装置の小型化・軽量化を図ると共に構成及び処理の簡素化や省電力化などを図ることが重要である。この点、相対位置センサの構成部品としてカメラ(撮像手段)を備えると、装置の構成の複雑化、部品点数の増加や装置の大型化につながる。また、GPSなど外部からのデータの提供を受けて絶対的な位置情報を取得する方法では、そのための受信機器などの構成要素が必要になるうえ、受信したデータに基づいて装置間の相対位置を検出するための処理が煩雑になる。 However, in recent years, various terminal devices such as communication terminal devices have been reduced in size and weight and simplified in device configuration. Therefore, even when detecting the relative positions of a plurality of devices and devices, particularly small devices and devices, the device components are reduced as much as possible, thereby reducing the size and weight of the device and configuring and processing the device. It is important to simplify the system and save power. In this regard, if a camera (imaging means) is provided as a component of the relative position sensor, the configuration of the device becomes complicated, the number of components increases, and the size of the device increases. In addition, the method of obtaining absolute position information by receiving external data such as GPS requires components such as a receiving device for that purpose, and the relative position between devices based on the received data. Processing for detection becomes complicated.
 また、上記のようなカメラを備える位置検出システムでは、カメラで相手側装置を撮影する必要があるため、装置同士が互いに視認できる位置にあることが必要である。そのため、例えば互いの装置の間に遮蔽物があるなどして互いが視認できない環境にある場合には位置検出を行えない、という不都合がある。 Also, in the position detection system provided with the camera as described above, it is necessary to photograph the counterpart device with the camera, and therefore it is necessary that the devices are in a position where they can be seen from each other. Therefore, for example, there is an inconvenience that position detection cannot be performed when there is an environment in which each other cannot be visually recognized due to, for example, a shield between the devices.
 さらに、カメラを備える位置検出システムでは、例えば、街中や電車内などの公共の場での第三者のプライバシーに関わる撮影や、書店や映画館などでの著作権等に問題が生じる可能性のある撮影などを意図せずに行ってしまうおそれがある。また、カメラで撮影した画像などのデータが装置内の記憶手段などに少なくとも一時的に保存される場合がある。そのため、当該画像などのデータの漏洩などによってプライバシーの保護やセキュリティーの確保に問題が生じるおそれがある。また、撮影した画像のデータを記憶するためのメモリなどの記憶媒体の大容量化や、演算処理を行うための処理装置の処理能力の高度化が必要になるという問題もある。 In addition, a position detection system equipped with a camera may cause problems related to shooting related to the privacy of third parties in public places such as streets and trains, and copyrights at bookstores and movie theaters. There is a risk of unintentionally taking a picture. In some cases, data such as an image taken by a camera is at least temporarily stored in a storage unit in the apparatus. For this reason, there is a possibility that problems may arise in privacy protection and security due to leakage of data such as the image. In addition, there is a problem that it is necessary to increase the capacity of a storage medium such as a memory for storing captured image data and to increase the processing capability of a processing device for performing arithmetic processing.
特開2011-237987号公報JP2011-237987A
 本発明は上述の点に鑑みてなされたものであり、その目的は、装置の小型化及び構成や処理の簡素化の妨げにならず、複数の装置間の相対位置を精度良く検出することが可能な相対位置検出システム、及びそれを備えた画像表示システムを提供することにある。 The present invention has been made in view of the above points, and its object is not to hinder downsizing of the apparatus and simplification of the configuration and processing, but to detect relative positions between a plurality of apparatuses with high accuracy. It is an object of the present invention to provide a possible relative position detection system and an image display system including the same.
 上記課題を解決するため、本発明にかかる相対位置検出システムは、第1端末装置と第2端末装置の相対位置を検出する相対位置検出システムであって、前記第1端末装置と前記第2端末装置のそれぞれに設けた加速度センサ及び角速度センサを含む位置検出部と、前記第1端末装置と前記第2端末装置の少なくともいずれか一方に設けたデータ送信部といずれか他方に設けた前記データ送信部からのデータを受信するデータ受信部と、前記第1端末装置と前記第2端末装置の少なくともいずれかに設けた相対位置情報を取得する相対位置情報取得部と、を備え、前記相対位置情報取得部は、前記加速度センサの測定値と前記角速度センサの測定値のみを用いて前記第1端末装置と前記第2端末装置との相対位置情報を取得するように構成したことを特徴とする。 In order to solve the above problems, a relative position detection system according to the present invention is a relative position detection system that detects a relative position between a first terminal device and a second terminal device, and includes the first terminal device and the second terminal. A position detection unit including an acceleration sensor and an angular velocity sensor provided in each of the devices, a data transmission unit provided in at least one of the first terminal device and the second terminal device, and the data transmission provided in the other A data receiving unit that receives data from a unit; and a relative position information acquisition unit that acquires relative position information provided in at least one of the first terminal device and the second terminal device, and the relative position information The acquisition unit is configured to acquire relative position information between the first terminal device and the second terminal device using only the measurement value of the acceleration sensor and the measurement value of the angular velocity sensor. Characterized in that was.
 本発明にかかる相対位置検出システムによれば、加速度センサと角速度センサの検出のみによって第1端末装置と第2端末装置の相対位置を検出するように構成したことで、従来のカメラ(撮像手段)を備える位置検知システムや、GPSやインターネットなどの外部からの情報に基づく絶対位置検出による相対位置検出を行うシステムと比較して、装置の構成の大幅な簡素化及び小型化・軽量化を図ることができる。また、簡単な処理で相対位置の検出が行えるようになるので、相対位置検出の処理速度を高めることができる。また、データを記憶するためのメモリなどの記憶媒体の容量を少なく抑えたり、演算処理を行うための処理装置の処理能力を低く抑えることが可能となり、装置の低廉化を図ることができるようになる。また、カメラ(撮像手段)などを備える従来のシステムと比較して省電力化を図ることができるので、端末装置にバッテリなどを搭載する場合でも、当該バッテリの小型化・軽量化に寄与することができる。 According to the relative position detection system of the present invention, the relative position between the first terminal device and the second terminal device is detected only by the detection of the acceleration sensor and the angular velocity sensor. Compared with a position detection system equipped with GPS and a system that performs relative position detection by absolute position detection based on information from the outside such as GPS and the Internet, the configuration of the device is greatly simplified, miniaturized and reduced in weight. Can do. In addition, since the relative position can be detected by simple processing, the processing speed of relative position detection can be increased. In addition, it is possible to reduce the capacity of a storage medium such as a memory for storing data and to reduce the processing capacity of a processing device for performing arithmetic processing, thereby reducing the cost of the device. Become. In addition, since power saving can be achieved compared to a conventional system including a camera (imaging means), it contributes to the reduction in size and weight of the battery even when a battery is mounted on the terminal device. Can do.
 また、本発明にかかる相対位置検出システムによれば、加速度センサと角速度センサの検出のみによって第1端末装置と第2端末装置の相対位置を検出するように構成したことで、GPSやインターネットなどの外部からの情報を受信する必要がない。したがって、GPSやインターネットなどの外部からの情報を受信することができない環境や装置構成であっても、第1端末装置と第2端末装置の相対位置の検出を行うことができる。 Further, according to the relative position detection system of the present invention, the relative position between the first terminal device and the second terminal device is detected only by the detection of the acceleration sensor and the angular velocity sensor. There is no need to receive external information. Therefore, the relative position between the first terminal device and the second terminal device can be detected even in an environment or device configuration that cannot receive information from outside such as GPS and the Internet.
 さらに、本発明にかかる相対位置検出システムによれば、加速度センサと角速度センサの検出のみによって第1端末装置と第2端末装置の相対位置を検出するように構成したことで、従来のカメラ(撮像手段)を用いた相対位置検出システムのように装置同士が互いに視認できる位置に有る必要が無い。したがって、例えば互いの装置の間に遮蔽物がある場合や視界が十分に利かない水中などで互いを視認できない環境であっても相対位置検出を行うことができるので、装置が置かれる環境の制限がより少ない相対位置検出システムとなる。 Furthermore, according to the relative position detection system according to the present invention, the relative position between the first terminal device and the second terminal device is detected only by the detection of the acceleration sensor and the angular velocity sensor. There is no need to be in a position where the apparatuses can visually recognize each other as in the relative position detection system using the means. Therefore, for example, when there is a shield between the devices, or in an environment where the field of view is not good enough, the relative position can be detected even in an environment where the devices are not visible. Results in a relative position detection system with less.
 加えて、本発明にかかる相対位置検出システムでは、従来のカメラを備える相対位置検出システムのように、第三者のプライバシーに関わる撮影や著作権等の権利関係に問題が生じる可能性のある撮影を意図せずに行ってしまうおそれが無い。また、撮影した画像などのデータが装置内の記憶手段などに保存されることが無い。したがって、当該画像などのデータの漏洩が生じるおそれがないため、その点においてもプライバシーの保護やセキュリティーの確保に問題が生じずに済む。さらに、撮影した画像のデータを記憶するためのメモリなどの記憶媒体の大容量化や、演算処理を行うための処理装置の処理能力の高度化が必要になるという問題も生じずに済む。 In addition, in the relative position detection system according to the present invention, as with a relative position detection system provided with a conventional camera, there is a possibility that a problem may arise in the third party's privacy-related shooting or copyright relations. There is no risk of going unintentionally. In addition, data such as a photographed image is not stored in a storage unit in the apparatus. Therefore, there is no possibility of leakage of data such as the image, and in this respect, there is no problem in protecting privacy and ensuring security. Further, there is no problem that it is necessary to increase the capacity of a storage medium such as a memory for storing captured image data and to increase the processing capability of a processing device for performing arithmetic processing.
 また、この相対位置検出システムでは、所定の条件が成立した場合に、前記位置検出部における前記加速度センサと前記角速度センサの測定値をリセットするリセット手段を備え、前記加速度センサ及び角速度センサの測定値は、前記リセット手段によるリセットが行われた時点からの累積値であってもよい。 The relative position detection system further includes reset means for resetting the measurement values of the acceleration sensor and the angular velocity sensor in the position detection unit when a predetermined condition is satisfied, and the measurement values of the acceleration sensor and the angular velocity sensor. May be a cumulative value from the time when the reset by the reset means is performed.
 加速度センサと角速度センサによる相対位置の検出では、検出値に累積の誤差が生じるところ、このリセット処理を行うことで、検出値に生じた累積の誤差をリセットすることが可能となる。したがって、相対位置検出の精度を効果的に高めることができる。 In the detection of the relative position by the acceleration sensor and the angular velocity sensor, a cumulative error occurs in the detected value. By performing this reset process, it is possible to reset the cumulative error generated in the detected value. Therefore, the accuracy of relative position detection can be effectively increased.
 また、この相対位置検出システムでは、相対位置情報取得部は、前記第1端末装置と前記第2端末装置との相対位置、又は前記第1端末装置及び前記第2端末装置の姿勢を座標データとして取得可能であってよい。 In the relative position detection system, the relative position information acquisition unit uses the relative position between the first terminal device and the second terminal device, or the postures of the first terminal device and the second terminal device as coordinate data. It may be obtainable.
 この構成によれば、相対位置情報取得部は、第1端末装置と第2端末装置との相対位置又は前記第1端末装置及び前記第2端末装置の姿勢を座標データとして取得可能であることで、簡単な処理で第1端末装置と第2端末装置との相対位置又は姿勢をより正確に把握することができる。したがって、第1端末装置又は第2端末装置における処理の簡素化を図ることができると共に、相対位置情報を迅速かつ確実に取得することが可能となる。なお、ここでいう端末装置の姿勢とは、端末装置の位置情報を含まない(同一位置における)基準角度に対する傾きを指す。 According to this configuration, the relative position information acquisition unit can acquire the relative position between the first terminal device and the second terminal device or the orientation of the first terminal device and the second terminal device as coordinate data. The relative position or posture between the first terminal device and the second terminal device can be grasped more accurately by simple processing. Therefore, it is possible to simplify the processing in the first terminal device or the second terminal device, and it is possible to acquire the relative position information quickly and reliably. Here, the attitude of the terminal device refers to an inclination with respect to a reference angle (in the same position) that does not include the position information of the terminal device.
 また、本発明にかかる画像処理システムは、本発明にかかる上記いずれかの相対位置検出システムを備える画像処理システムであって、前記第1端末装置は、画像表示用のデータを生成する画像表示用データ生成手段を備え、前記第2端末装置は、画像表示用のデータに基づいて画像を表示するための画像表示手段を備え、前記第1端末装置の前記画像表示用データ生成手段で生成した画像表示用のデータが前記第2端末装置に送信され、前記画像表示用のデータに基づいて前記第2端末装置の前記画像表示手段で画像の表示が行われ、前記画像表示手段は、前記相対位置情報取得手段が取得した前記第1端末装置と前記第2端末装置との相対位置情報に基づいて、少なくとも前記画像表示用データに基づいて表示させる画像の表示位置を決定することを特徴とする。またこの場合、前記画像表示手段による画像の表示位置の決定は、前記第2端末装置から見た前記第1端末装置の位置に基づいて行われるとよい。 An image processing system according to the present invention is an image processing system including any one of the above-described relative position detection systems according to the present invention, wherein the first terminal device generates image display data. The second terminal device includes an image display unit for displaying an image based on the image display data, and the image generated by the image display data generation unit of the first terminal device. Display data is transmitted to the second terminal device, an image is displayed by the image display means of the second terminal device based on the image display data, and the image display means Based on the relative position information between the first terminal device and the second terminal device acquired by the information acquisition means, the display position of the image to be displayed based on at least the image display data Characterized in that it constant. In this case, the image display position may be determined by the image display unit based on the position of the first terminal device viewed from the second terminal device.
 本発明にかかる画像表示システムによれば、本発明にかかる上記構成の相対位置検出システムで検出した第1端末装置と第2端末装置の相対位置の情報を用いて、第1端末装置と第2端末装置との相対位置情報に基づく位置に画像を表示させることができる。これにより、例えば、第1端末装置と第2端末装置との相対位置が刻々と変化するような場合でも、常に第2端末装置で表示する画像が第1端末装置に対して常に同じ位置に表示されるように制御することができる。したがって、第1端末装置と第2端末装置の構成の簡素化による小型化・軽量化を図りながらも、第1端末装置と第2端末装置による画像表示の利便性を効果的に向上させることができる。 According to the image display system of the present invention, using the information on the relative positions of the first terminal device and the second terminal device detected by the relative position detection system configured as described above, the first terminal device and the second terminal device are used. An image can be displayed at a position based on relative position information with the terminal device. Thereby, for example, even when the relative position between the first terminal device and the second terminal device changes every moment, the image displayed on the second terminal device is always displayed at the same position with respect to the first terminal device. Can be controlled. Therefore, it is possible to effectively improve the convenience of image display by the first terminal device and the second terminal device, while reducing the size and weight by simplifying the configuration of the first terminal device and the second terminal device. it can.
 本発明にかかる相対位置検出システムによれば、装置の小型化・軽量化や構成及び処理の簡素化を図りながらも、複数の装置間の相対位置を精度良く検出することができ、本発明にかかる画像表示システムによれば、第1端末装置と第2端末装置による画像表示の利便性を効果的に向上させることができる。 According to the relative position detection system of the present invention, it is possible to accurately detect the relative position between a plurality of apparatuses while reducing the size and weight of the apparatus and simplifying the configuration and processing. According to such an image display system, the convenience of image display by the first terminal device and the second terminal device can be effectively improved.
本発明の第一実施形態にかかる相対位置検出システムを含む画像表示システムの全体構成例を示す図である。1 is a diagram illustrating an overall configuration example of an image display system including a relative position detection system according to a first embodiment of the present invention. 腕時計型端末装置とメガネ型端末装置の機能構成を示すブロック図である。It is a block diagram which shows the function structure of a wristwatch-type terminal device and a glasses-type terminal device. 腕時計型端末装置とメガネ型端末装置との間で行われる相対位置検出の手順を説明するためのフローチャートである。It is a flowchart for demonstrating the procedure of the relative position detection performed between a wristwatch type | mold terminal device and a spectacles type terminal device. 位置検出部による位置検出データのリセットと、リセット後の相対位置情報の取得について説明するための図である。It is a figure for demonstrating reset of the position detection data by a position detection part, and acquisition of the relative position information after reset. 腕時計型端末装置とメガネ型端末装置との間で行われる画像表示処理の手順を説明するためのフローチャートである。It is a flowchart for demonstrating the procedure of the image display process performed between a wristwatch-type terminal device and a glasses-type terminal device. 腕時計型端末装置からメガネ型端末装置に送信された表示画面用のデータに基づいて表示された表示画面の画像を示す図である。It is a figure which shows the image of the display screen displayed based on the data for display screens transmitted to the spectacles type terminal device from the wristwatch type terminal device. 本発明の第二実施形態にかかる相対位置検出システムを含む画像表示システムの全体構成例を示す図である。It is a figure which shows the example of whole structure of the image display system containing the relative position detection system concerning 2nd embodiment of this invention. 携帯型端末装置(スマートフォン)の機能構成を示すブロック図である。It is a block diagram which shows the function structure of a portable terminal device (smart phone).
 以下、添付図面を参照して本発明の実施形態を詳細に説明する。
〔第一実施形態〕
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[First embodiment]
 図1は、本発明の第一実施形態にかかる相対位置検出システムを含む画像表示システムの全体構成例を示す図である。図1に示す相対位置検出システムを含む画像表示システム1は、腕時計型端末装置(第1端末装置)100と、メガネ型端末装置(第2端末装置)200とを備えている。腕時計型端末装置100は、本体部101と該本体部101を腕に装着するためのバンド102とを有する腕時計の形状をしたウェアラブル端末であり、メガネ型端末装置200は、メガネとして機能する一対のレンズ201,201と該一対のレンズ201,201を支持するフレーム部202とからなるメガネ部分210と、該メガネ部分210のフレーム部202に取り付けた本体部205とで構成され、全体がメガネの形状をしたウェアラブル端末である。 FIG. 1 is a diagram showing an example of the overall configuration of an image display system including a relative position detection system according to the first embodiment of the present invention. The image display system 1 including the relative position detection system shown in FIG. 1 includes a wristwatch type terminal device (first terminal device) 100 and a glasses type terminal device (second terminal device) 200. The wristwatch type terminal device 100 is a wearable terminal in the shape of a wristwatch having a main body portion 101 and a band 102 for mounting the main body portion 101 on an arm, and the glasses-type terminal device 200 is a pair of glasses functioning as glasses. The eyeglass portion 210 is composed of lenses 201 and 201 and a frame portion 202 that supports the pair of lenses 201 and 201, and a main body portion 205 attached to the frame portion 202 of the eyeglass portion 210. It is a wearable terminal that did.
 メガネ型端末装置200は、後述する画像投影部213から投影した画像220をレンズ201に投影する(表示させる)ようになっている。これにより、メガネ型端末装置200を装着している装着者は、レンズ201に投影された画像がレンズ201を通してみた実際の景色の中に存在している(表示されている)ように視認することができる。そして、後述するように、この画像220として、腕時計型端末装置100で実行しているアプリケーションソフトウエアの表示画面などの画像(映像を含む、以下同じ。)を投影することで、この画像220が腕時計型端末装置100の位置又はその近傍位置にある(見える)ように投影される。これにより、メガネ型端末装置200の装着者にとって、表示画面の画像(映像)5があたかも腕時計型端末装置100の真上位置などの近傍位置に表示されているように見える。 The glasses-type terminal device 200 projects (displays) an image 220 projected from an image projection unit 213, which will be described later, on a lens 201. Thereby, the wearer wearing the glasses-type terminal device 200 visually recognizes that the image projected on the lens 201 exists (is displayed) in the actual scenery viewed through the lens 201. Can do. As will be described later, the image 220 is projected by projecting an image (including video, the same applies hereinafter) such as a display screen of application software executed on the wristwatch-type terminal device 100 as the image 220. It is projected so as to be (visible) at the position of the wristwatch type terminal device 100 or the vicinity thereof. Thus, it appears to the wearer of the glasses-type terminal device 200 that the image (video) 5 on the display screen is displayed at a position near the wristwatch-type terminal device 100, for example.
 そして、当該画像を表示する際、当該画像が腕時計型端末装置100の近傍位置にあるように表示し、かつ、腕時計型端末装置100の位置(メガネ型端末装置200に対する相対位置)が変化しても、当該画像が常に腕時計型端末装置100を追従してその近傍位置に表示され続けるようにするために、腕時計型端末装置100とメガネ型端末装置200との相対位置の情報を常時取得(把握)できるようにすることが必要である。そのために、本実施形態の画像表示システム1では、表示する画像を常に腕時計型端末装置100の近傍にあるように表示させるための手段として、メガネ型端末装置200と腕時計型端末装置100との相対位置を検出するための相対位置検出機能(相対位置検出システム)を備えている。 And when displaying the said image, it displays so that the said image exists in the vicinity position of the wristwatch-type terminal device 100, and the position (relative position with respect to the glasses-type terminal device 200) of the wristwatch-type terminal device 100 changes. In addition, in order to keep the image constantly following the wristwatch type terminal device 100 and being displayed in the vicinity thereof, information on the relative position between the wristwatch type terminal device 100 and the eyeglass type terminal device 200 is always acquired (ascertained). It is necessary to be able to do it. Therefore, in the image display system 1 of the present embodiment, as a means for displaying an image to be displayed so as to be always in the vicinity of the wristwatch type terminal device 100, the glasses type terminal device 200 and the wristwatch type terminal device 100 are relatively A relative position detection function (relative position detection system) for detecting the position is provided.
 図2は、腕時計型端末装置100とメガネ型端末装置200の機能構成を示すブロック図である。同図に示す腕時計型端末装置100は、制御部(制御手段)111、記憶部(記憶手段)112、表示部(表示手段)113、操作部(入力手段)114、データ送受信部115、加速度センサ116a及び角速度センサ116bを含む位置検出部116を備えて構成されている。 FIG. 2 is a block diagram showing a functional configuration of the wristwatch type terminal device 100 and the glasses type terminal device 200. The wristwatch type terminal device 100 shown in FIG. 1 includes a control unit (control unit) 111, a storage unit (storage unit) 112, a display unit (display unit) 113, an operation unit (input unit) 114, a data transmission / reception unit 115, and an acceleration sensor. 116a and an angular velocity sensor 116b.
 制御部111は、腕時計型端末装置100を動作させるための各種処理を実行するための部分であり、マイクロプロセッサ、各種周辺回路等によって構成される。この制御部111は、記憶部112に記憶されたプログラム(アプリケーションソフトウェア、以下単に「アプリケーション」という。)120を実行するための機能などを備えている。 The control unit 111 is a part for executing various processes for operating the wristwatch-type terminal device 100, and includes a microprocessor, various peripheral circuits, and the like. The control unit 111 has a function for executing a program (application software, hereinafter simply referred to as “application”) 120 stored in the storage unit 112.
 また、制御部111は、後述するように、腕時計型端末装置100の位置検出部116で検出した位置の情報(データ)とメガネ型端末装置200の位置検出部216で検出した位置の情報(データ)とに基づいて腕時計型端末装置100とメガネ型端末装置200の相対位置情報を取得(把握)することができる。したがって制御部111は、腕時計型端末装置100とメガネ型端末装置200の相対位置情報を取得する相対位置情報取得部としても機能する。 Further, as will be described later, the control unit 111 detects position information (data) detected by the position detection unit 116 of the wristwatch type terminal device 100 and position information (data) detected by the position detection unit 216 of the glasses type terminal device 200. ), The relative position information of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 can be acquired (understood). Therefore, the control unit 111 also functions as a relative position information acquisition unit that acquires relative position information of the wristwatch type terminal device 100 and the glasses type terminal device 200.
 記憶部112は、フラッシュメモリ等の記憶媒体である。記憶部112には、制御部111によって実行されるアプリケーション120などの各種データが記憶されている。すなわち、記憶部112に記憶されているデータは、必要に応じて制御部111により記憶部112から読み出され、制御部111が実行する様々な処理や制御に利用される。また、制御部111は、記憶部112に新たなデータを記憶したり既に記憶されているデータを更新することもできる。 The storage unit 112 is a storage medium such as a flash memory. The storage unit 112 stores various data such as the application 120 executed by the control unit 111. That is, the data stored in the storage unit 112 is read from the storage unit 112 by the control unit 111 as necessary, and is used for various processes and controls executed by the control unit 111. In addition, the control unit 111 can store new data in the storage unit 112 or update already stored data.
 表示部113は、アプリケーションの実行内容などを表示するための表示画面や操作画面、あるいは、時計としての時刻表示画面などを表示するほか、様々な画像や映像等を表示するための装置であり、液晶ディスプレイ等が用いられる。 The display unit 113 is a device for displaying various images and videos in addition to displaying a display screen and an operation screen for displaying the execution contents of the application, a time display screen as a clock, and the like. A liquid crystal display or the like is used.
 操作部114は、腕時計型端末装置100の各種機能を用いるために操作者によって入力される各種操作を検出するものであり、各種の入力手段(操作ボタン、タッチパネル、あるいは音声認識装置など)で構成することが可能である。操作者は、操作部114を操作することにより、腕時計型端末装置100で行われる後述するアプリケーションの実行などに必要な各種の操作を行うことができる。 The operation unit 114 detects various operations input by the operator in order to use various functions of the wristwatch type terminal device 100, and includes various input means (operation buttons, a touch panel, a voice recognition device, or the like). Is possible. The operator can perform various operations necessary for executing an application, which will be described later, performed on the wristwatch type terminal device 100 by operating the operation unit 114.
 位置検出部116は、腕時計型端末装置100の位置に関するデータを取得するための部分であり、加速度センサ116aと角速度センサ116bを備えて構成されている。これら加速度センサ116aと角速度センサ116bは、一例としてMEMS (Micro Electro Mechanical System) 型のセンサを用いることができる。加速度センサ116aは、地球上の重力加速度と当該腕時計型端末装置100の加速度とからその位置変化を測定することができる。(なお、ここでいう位置変化には、角度(向き・傾き)の変化も含まれる。)また、角速度センサ116bは、腕時計型端末装置100の基準角度からの角度変化を測定する。したがって、角速度センサ116bの検出値で加速度センサ116aの検出値に含まれる角度(向き・傾き)の情報を補正することで、腕時計型端末装置100の向き・傾きの変化を排除したいわゆる純粋な移動(位置)変化(三次元座標値(x,y,z)の変化)を測定することができる。さらに角速度センサ116bの検出値から腕時計型端末装置100の姿勢(位置情報を含まない(同一位置での)角度)変化(三次元座標値(x,y,z)の変化)を測定することができる。 The position detection unit 116 is a part for acquiring data related to the position of the wristwatch type terminal device 100, and includes an acceleration sensor 116a and an angular velocity sensor 116b. As the acceleration sensor 116a and the angular velocity sensor 116b, for example, a MEMS (Micro Electro Mechanical System) type sensor can be used. The acceleration sensor 116a can measure the change in position from the gravitational acceleration on the earth and the acceleration of the wristwatch type terminal device 100. (Here, the change in position also includes a change in angle (orientation / tilt).) The angular velocity sensor 116b measures the change in angle from the reference angle of the wristwatch type terminal device 100. Therefore, by correcting the angle (orientation / inclination) information included in the detection value of the acceleration sensor 116a with the detection value of the angular velocity sensor 116b, so-called pure movement that eliminates changes in the orientation / inclination of the wristwatch-type terminal device 100. Changes in (position) (changes in three-dimensional coordinate values (x, y, z)) can be measured. Further, it is possible to measure a change in attitude (angle not including position information (at the same position)) (change in three-dimensional coordinate values (x, y, z)) of the wristwatch-type terminal device 100 from a detection value of the angular velocity sensor 116b. it can.
 したがって、本明細書で腕時計型端末装置100について「位置検出」というときは、これら加速度センサ116a及び角速度センサ116bによる腕時計型端末装置100の位置(変化)及び姿勢(変化)の検出を指すものとする。 Therefore, the term “position detection” for the wristwatch type terminal device 100 in this specification refers to the detection of the position (change) and posture (change) of the wristwatch type terminal device 100 by the acceleration sensor 116a and the angular velocity sensor 116b. To do.
 また、位置検出部116は、後述する所定のリセット操作が行われた時点で位置検出(計測)したデータをリセットし、その時点から新たに位置検出(計測)を開始するように構成されている。したがって、位置検出部116による位置検出では、データのリセットが行われた時点の位置を初期位置(移動量0)とし、当該初期位置からの移動量(初期位置に対する相対位置)を計測し続けることで現在の位置を検出する。したがって以降の説明で「位置検出」というときは、この初期位置からの移動量の検出を指すものとする。 The position detection unit 116 is configured to reset data detected (measured) when a predetermined reset operation described later is performed, and newly start position detection (measurement) from that point. . Therefore, in the position detection by the position detection unit 116, the position at the time when the data is reset is set as the initial position (movement amount 0), and the movement amount (relative position with respect to the initial position) from the initial position is continuously measured. To detect the current position. Therefore, in the following description, “position detection” refers to detection of the movement amount from the initial position.
 データ送受信部115は、制御部111や記憶部112から入力した各種データを含むデータ信号等をメガネ型端末装置200のデータ送受信部215に向けて送信すると共に、メガネ型端末装置200のデータ送受信部215から送信されたデータを受信する機能を備えている。このデータ送受信部115は、位置検出部116で検出した自身(腕時計型端末装置100)の位置に関するデータをメガネ型端末装置200に向けて送信する機能を有する。また、メガネ型端末装置200がその位置検出部216で検出した当該メガネ型端末装置200の位置に関するデータをメガネ型端末装置200のデータ送受信部215から受信する機能を有する。また、データ送受信部115は、後述するアプリケーションの表示画面やウェブブラウザの表示画面のデータ(後述する相対位置情報による修正が施されたデータ)など、メガネ型端末装置200で画像表示をするために必要なデータをメガネ型端末装置200のデータ送受信部215に向けて送信する機能を有する。 The data transmission / reception unit 115 transmits a data signal including various data input from the control unit 111 and the storage unit 112 to the data transmission / reception unit 215 of the glasses-type terminal device 200, and the data transmission / reception unit of the glasses-type terminal device 200. 215 has a function of receiving data transmitted from 215. The data transmission / reception unit 115 has a function of transmitting data regarding the position of itself (the wristwatch type terminal device 100) detected by the position detection unit 116 to the glasses-type terminal device 200. Further, the glasses-type terminal device 200 has a function of receiving data related to the position of the glasses-type terminal device 200 detected by the position detection unit 216 from the data transmission / reception unit 215 of the glasses-type terminal device 200. In addition, the data transmission / reception unit 115 displays an image on the glasses-type terminal device 200 such as an application display screen and a web browser display screen data (data corrected by relative position information described later). It has a function of transmitting necessary data to the data transmission / reception unit 215 of the glasses-type terminal device 200.
 また、メガネ型端末装置200は、図2に示すように、制御部(制御手段)211、記憶部(記憶手段)212、画像投影部213、データ送受信部215、加速度センサ216a及び角速度センサ216bを含む位置検出部216を備えて構成されている。 In addition, as shown in FIG. 2, the glasses-type terminal device 200 includes a control unit (control unit) 211, a storage unit (storage unit) 212, an image projection unit 213, a data transmission / reception unit 215, an acceleration sensor 216a, and an angular velocity sensor 216b. The position detecting unit 216 includes a configuration.
 制御部211は、メガネ型端末装置200を動作させるための各種処理を実行するための部分であり、マイクロプロセッサ、各種周辺回路等によって構成される。この制御部211は、腕時計型端末装置100から送信された画像表示に関するデータに基づいて画像投影部213を制御することで、当該画像投影部213によってメガネ型端末装置200のレンズ201に画像220を投影する機能を備えている。 The control unit 211 is a part for executing various processes for operating the glasses-type terminal device 200, and includes a microprocessor, various peripheral circuits, and the like. The control unit 211 controls the image projection unit 213 based on the data related to the image display transmitted from the wristwatch type terminal device 100, thereby causing the image projection unit 213 to display the image 220 on the lens 201 of the glasses-type terminal device 200. It has a function to project.
 記憶部212は、フラッシュメモリ等の記憶媒体である。なお、記憶部212に記憶されているデータは、必要に応じて制御部211により記憶部212から読み出され、制御部211が実行する様々な処理や制御に利用される。また、制御部211は、記憶部212に新たなデータを記憶したり既に記憶されているデータを更新することもできる。記憶部212は、腕時計型端末装置100から送信された画像に関するデータなどの各種データを一時的に記憶することができる。 The storage unit 212 is a storage medium such as a flash memory. Note that the data stored in the storage unit 212 is read from the storage unit 212 by the control unit 211 as necessary, and is used for various processes and controls executed by the control unit 211. In addition, the control unit 211 can store new data in the storage unit 212 or update already stored data. The storage unit 212 can temporarily store various data such as data related to images transmitted from the wristwatch type terminal device 100.
 位置検出部216は、メガネ型端末装置200の位置に関するデータを取得するための構成要素であり、腕時計型端末装置100の位置検出部116と同様、加速度センサ216aと角速度センサ216bを備えて構成されている。これら加速度センサ216aと角速度センサ216bは、一例としてMEMS (Micro Electro Mechanical System) 型のセンサを用いることができる。加速度センサ216aは、地球上の重力加速度とメガネ型端末装置200の加速度とから当該メガネ型端末装置200の位置変化を測定する。(ここでいう位置変化には、角度(向き・傾き)の変化も含まれる。)また、角速度センサ216bは、メガネ型端末装置200の基準角度からの角度変化を測定する。したがって、角速度センサ216bの検出値で加速度センサ216aの検出値に含まれる角度(向き・傾き)の情報を補正することで、メガネ型端末装置200の検出値に含まれる角度(向き・傾き)の情報を補正することで、メガネ型端末装置200の向き・傾きの変化を排除したいわゆる純粋な移動(位置)変化(三次元座標値(x,y,z)の変化)を測定することができる。さらに角速度センサ216bの検出値からメガネ型端末装置200の姿勢(位置情報を含まない(同一位置での)角度)変化(三次元座標値(x,y,z)の変化)を測定することができる。 The position detection unit 216 is a component for acquiring data relating to the position of the glasses-type terminal device 200, and is configured to include an acceleration sensor 216a and an angular velocity sensor 216b, similar to the position detection unit 116 of the wristwatch-type terminal device 100. ing. As the acceleration sensor 216a and the angular velocity sensor 216b, for example, a MEMS-type (Micro-Electro-Mechanical System) -type sensor can be used. The acceleration sensor 216a measures the position change of the glasses-type terminal device 200 from the gravitational acceleration on the earth and the acceleration of the glasses-type terminal device 200. (The positional change here includes a change in angle (orientation / inclination).) Also, the angular velocity sensor 216b measures an angular change from the reference angle of the glasses-type terminal device 200. Therefore, by correcting the information on the angle (direction / tilt) included in the detection value of the acceleration sensor 216a with the detection value of the angular velocity sensor 216b, the angle (direction / tilt) included in the detection value of the glasses-type terminal device 200 is corrected. By correcting the information, it is possible to measure a so-called pure movement (position) change (change in three-dimensional coordinate values (x, y, z)) that excludes changes in the direction and inclination of the glasses-type terminal device 200. . Furthermore, a change in the posture (angle not including position information (at the same position)) (change in three-dimensional coordinate values (x, y, z)) of the glasses-type terminal device 200 can be measured from the detection value of the angular velocity sensor 216b. it can.
 したがって、本明細書でメガネ型端末装置200について「位置検出」というときは、これら加速度センサ216a及び角速度センサ216bによるメガネ型端末装置200の位置(変化)及び姿勢(変化)の検出を指すものとする。 Therefore, the term “position detection” for the glasses-type terminal device 200 in this specification refers to detection of the position (change) and posture (change) of the glasses-type terminal device 200 by the acceleration sensor 216a and the angular velocity sensor 216b. To do.
 データ送受信部215は、制御部211や記憶部212から入力した各種データを含むデータ信号等を腕時計型端末装置100のデータ送受信部115に向けて送信すると共に、腕時計型端末装置100のデータ送受信部115から送信されたデータを受信する機能を備えている。このデータ送受信部215は、位置検出部216で検出した自身(メガネ型端末装置200)の位置に関するデータを腕時計型端末装置100に向けて送信する機能を有する。また、腕時計型端末装置100がその位置検出部216で検出した当該腕時計型端末装置100の位置に関するデータを腕時計型端末装置100のデータ送受信部115から受信する機能を有する。 The data transmission / reception unit 215 transmits a data signal including various data input from the control unit 211 and the storage unit 212 to the data transmission / reception unit 115 of the wristwatch type terminal device 100 and the data transmission / reception unit of the wristwatch type terminal device 100. 115 has a function of receiving data transmitted from 115. The data transmission / reception unit 215 has a function of transmitting data regarding the position of itself (the glasses-type terminal device 200) detected by the position detection unit 216 to the wristwatch-type terminal device 100. Further, the wristwatch type terminal device 100 has a function of receiving data related to the position of the wristwatch type terminal device 100 detected by the position detection unit 216 from the data transmission / reception unit 115 of the wristwatch type terminal device 100.
 腕時計型端末装置100のデータ送受信部115とメガネ型端末装置200のデータ送受信部215との間でデータの授受を行うための通信手段としては、各種の既知のデジタル機器用の近距離無線通信規格による通信手段などを用いることが可能である。また、ここでの通信手段は、腕時計型端末装置100のデータ送受信部115とメガネ型端末装置200のデータ送受信部215との間で直接的な通信によってデータの授受を行う通信手段だけではなく、例えば、ラジオ波や携帯通信網などの電波や通信網などを用いて遠距離での通信を行うような通信手段も含まれる。 As a communication means for exchanging data between the data transmission / reception unit 115 of the wristwatch type terminal device 100 and the data transmission / reception unit 215 of the glasses-type terminal device 200, various known short-range wireless communication standards for digital devices are used. It is possible to use a communication means or the like. Further, the communication means here is not only communication means that exchanges data by direct communication between the data transmission / reception unit 115 of the wristwatch type terminal device 100 and the data transmission / reception unit 215 of the glasses-type terminal device 200, For example, communication means that performs communication over a long distance using radio waves such as radio waves or mobile communication networks or communication networks is also included.
 図3は、腕時計型端末装置100とメガネ型端末装置200との間で行われる相対位置検出の処理(手順)を説明するためのフローチャートである。図3に示すフローチャートでは、まず、腕時計型端末装置100とメガネ型端末装置200のそれぞれにおいて、所定のリセット条件が成立するか否かが判断される(ステップST1-1、ST2-1)。ここでいうリセットとは、位置検出部116,216の検出値(測定値)をリセット(初期化)することを指している。また、所定のリセット条件が成立する場合とは、例えば、腕時計型端末装置100とメガネ型端末装置200のそれぞれが基準位置にあると見なすことができる場合にリセット条件が成立すると判断することが挙げられる。また、ここでいう基準位置としては、予め定めた位置や明確に測定(確定)が可能な位置などが該当する。詳細には、例えば、腕時計型端末装置100とメガネ型端末装置200に電源を供給する充電用の装置(クレードル)などを設け、この充電用の装置に腕時計型端末装置100とメガネ型端末装置200を載せた際にこれら腕時計型端末装置100とメガネ型端末装置200が予め定めた基準位置にあると見なすことができるようにするとよい。また、腕時計型端末装置100とメガネ型端末装置200が互いに接触(当接)したことを何らかの手段で検知できるように構成し、これら腕時計型端末装置100とメガネ型端末装置200が互いに接触(当接)したことをもって予め定めた基準位置にあると見なすようにしてもよい。具体的には、互いの端末装置が基準位置にあるときに操作者によってリセット操作(リセット用のボタンを押すなど)が行われることでリセットすることが考えられる。また、腕時計型端末装置100とメガネ型端末装置200の筐体の表面に微弱な電気信号を流しておいたり、微弱な電波で固有番号などの情報を流しておくことで、互いの接触を検知できるようにすることが考えられる。 FIG. 3 is a flowchart for explaining a relative position detection process (procedure) performed between the wristwatch-type terminal device 100 and the glasses-type terminal device 200. In the flowchart shown in FIG. 3, it is first determined whether or not a predetermined reset condition is satisfied in each of the wristwatch type terminal device 100 and the glasses type terminal device 200 (steps ST1-1 and ST2-1). The reset here refers to resetting (initializing) the detection values (measurement values) of the position detection units 116 and 216. The case where the predetermined reset condition is satisfied includes, for example, determining that the reset condition is satisfied when each of the wristwatch type terminal device 100 and the glasses type terminal device 200 can be regarded as being in the reference position. It is done. Further, the reference position mentioned here corresponds to a predetermined position or a position where measurement (determination) can be clearly performed. Specifically, for example, a charging device (cradle) for supplying power to the wristwatch type terminal device 100 and the glasses type terminal device 200 is provided, and the wristwatch type terminal device 100 and the glasses type terminal device 200 are provided in the charging device. It is preferable that the wristwatch-type terminal device 100 and the glasses-type terminal device 200 can be regarded as being in a predetermined reference position when the item is placed. Further, the wristwatch type terminal device 100 and the eyeglass type terminal device 200 are configured to be able to detect contact (contact) with each other by some means, and the wristwatch type terminal device 100 and the eyeglass type terminal device 200 are in contact with each other. It may be considered that the user is at a predetermined reference position. Specifically, it can be considered that resetting is performed by the operator performing a reset operation (such as pressing a reset button) when the terminal devices are at the reference position. In addition, a weak electrical signal is made to flow on the surface of the casing of the wristwatch-type terminal device 100 and the glasses-type terminal device 200, or information such as a unique number is made to flow by weak radio waves, thereby detecting mutual contact. It is possible to make it possible.
 その結果、腕時計型端末装置100において所定のリセット条件が成立する場合(ステップST1-1でYES)には、腕時計型端末装置100の位置検出部116の検出位置情報(データ)をリセットする(ステップST1-2)一方、所定のリセット条件が成立しない場合(ステップST1-1でNO)には、位置検出部116の検出位置情報(データ)をリセットしない。同様に、メガネ型端末装置200において所定のリセット条件が成立する場合(ステップST2-1でYES)には、メガネ型端末装置200の位置検出部216の検出位置情報(データ)をリセットする(ステップST2-2)一方、所定のリセット条件が成立しない場合(ステップST2-1でNO)には、位置検出部216の検出位置情報(データ)をリセットしない。 As a result, when a predetermined reset condition is satisfied in the wristwatch type terminal device 100 (YES in step ST1-1), the detected position information (data) of the position detector 116 of the wristwatch type terminal device 100 is reset (step S1). ST1-2) On the other hand, if the predetermined reset condition is not satisfied (NO in step ST1-1), the detected position information (data) of the position detector 116 is not reset. Similarly, when a predetermined reset condition is satisfied in the glasses-type terminal device 200 (YES in step ST2-1), the detected position information (data) of the position detection unit 216 of the glasses-type terminal device 200 is reset (step). ST2-2) On the other hand, if the predetermined reset condition is not satisfied (NO in step ST2-1), the detected position information (data) of the position detector 216 is not reset.
 なお、図3のフローチャートでは、腕時計型端末装置100における位置検出部116の検出位置情報のリセットの判断(ステップST1-1)及びリセットの処理(ステップST1-2)と、メガネ型端末装置200における位置検出部216の検出位置情報のリセットの判断(ステップST2-1)及びリセットの処理(ST2-2)とを別個の処理として別のタイミングで行うこともできるように示したが、これら腕時計型端末装置100におけるリセットの判断及びリセットの処理とメガネ型端末装置200におけるリセットの判断及びリセットの処理とは同一の処理として同じタイミングで行うようにすることが望ましい。 In the flowchart of FIG. 3, the position detection unit 116 of the wristwatch type terminal device 100 determines whether to reset the detected position information (step ST1-1) and reset processing (step ST1-2), and the glasses type terminal device 200 Although it has been shown that the reset determination (step ST2-1) and the reset process (ST2-2) of the detected position information of the position detection unit 216 can be performed as separate processes at different timings, these watch types It is desirable that the reset determination and reset processing in the terminal device 100 and the reset determination and reset processing in the glasses-type terminal device 200 be performed at the same timing as the same processing.
 続けて、腕時計型端末装置100では位置検出が行われる(ステップST1-3)。これは、腕時計型端末装置100が備える位置検出部116(加速度センサ116a、角速度センサ116b)の検出による自身の位置の検出である。なお、先のステップST1-1で位置検出部116による検出位置情報のリセットが行われている場合には、位置検出部116の検出データは、リセットされた値(初期値)に対する積算値となる。すなわち、リセットが行われた位置を初期位置とする位置検出(計測)が行われる。一方、メガネ型端末装置200においても、当該メガネ型端末装置200の位置検出が行われる(ステップST2-3)。これは、メガネ型端末装置200が備える位置検出部216(加速度センサ216a、角速度センサ216b)の検出による自身の位置の検出である。なお、この場合にも、先のステップST2-1で位置検出部216による検出位置情報のリセットが行われている場合には、位置検出部216の検出データは、リセットされた値(初期値)に対する積算値となる。すなわち、リセットが行われた位置を初期位置とする位置検出(計測)が行われる。 Subsequently, the wristwatch type terminal device 100 performs position detection (step ST1-3). This is detection of its own position by detection of a position detection unit 116 (acceleration sensor 116a, angular velocity sensor 116b) provided in the wristwatch type terminal device 100. If the detected position information is reset by the position detector 116 in the previous step ST1-1, the detection data of the position detector 116 is an integrated value with respect to the reset value (initial value). . That is, position detection (measurement) is performed with the reset position as the initial position. On the other hand, in the glasses-type terminal device 200, the position of the glasses-type terminal device 200 is detected (step ST2-3). This is detection of its own position by detection of a position detection unit 216 (acceleration sensor 216a, angular velocity sensor 216b) provided in the glasses-type terminal device 200. Also in this case, when the detected position information is reset by the position detector 216 in the previous step ST2-1, the detection data of the position detector 216 is a reset value (initial value). The integrated value for. That is, position detection (measurement) is performed with the reset position as the initial position.
 そして、メガネ型端末装置200が検出した位置情報が腕時計型端末装置100に送信され(ステップST2-4)、腕時計型端末装置100で当該位置情報が受信される(ステップST1-4)。その後、腕時計型端末装置100では、先のステップST1-3で取得した当該腕時計型端末装置100の位置情報と、ステップST1-4で取得したメガネ型端末装置200の位置情報とに基づいて、腕時計型端末装置100とメガネ型端末装置200の相対位置情報を取得する(ステップST1-5)。これにより、腕時計型端末装置100とメガネ型端末装置200の相対位置が把握される。 Then, the position information detected by the glasses-type terminal apparatus 200 is transmitted to the wristwatch-type terminal apparatus 100 (step ST2-4), and the position information is received by the wristwatch-type terminal apparatus 100 (step ST1-4). After that, the wristwatch type terminal device 100 uses the position information of the wristwatch type terminal device 100 acquired in the previous step ST1-3 and the position information of the eyeglass type terminal device 200 acquired in step ST1-4. The relative position information of the type terminal device 100 and the eyeglass type terminal device 200 is acquired (step ST1-5). Thereby, the relative position of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 is grasped.
 図4は、位置検出部116,216による位置検出データのリセット時と、当該リセット後の相対位置把握時に行う相対位置情報の取得について説明するための図である。同図に示すように、本実施形態の相対位置検出システムでは、腕時計型端末装置100とメガネ型端末装置200とにおいて所定のリセット条件が成立する場合に、腕時計型端末装置100とメガネ型端末装置200の双方における位置検出部116,216における位置検出情報(計測)のリセットが行われる。そして、リセットが行われた後、当該リセットが行われた位置を初期位置とする位置変化(移動量)の検出が行われ、相対位置を取得(把握)できる状態となる。この状態では、腕時計型端末装置100とメガネ型端末装置200との相対位置(の変化)、及び腕時計型端末装置100とメガネ型端末装置200それぞれの姿勢(の変化)を座標データとして取得可能である。 FIG. 4 is a diagram for explaining the acquisition of relative position information performed when the position detection data is reset by the position detection units 116 and 216 and when the relative position is grasped after the reset. As shown in the figure, in the relative position detection system of the present embodiment, when a predetermined reset condition is satisfied in the wristwatch type terminal device 100 and the glasses type terminal device 200, the wristwatch type terminal device 100 and the glasses type terminal device. The position detection information (measurement) is reset in the position detection units 116 and 216 in both 200. Then, after the reset is performed, a change in position (amount of movement) with the position where the reset is performed as an initial position is detected, and a relative position can be acquired (understood). In this state, the relative position (change) between the wristwatch-type terminal device 100 and the glasses-type terminal device 200 and the postures (changes) of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 can be acquired as coordinate data. is there.
 そして、ここでいう腕時計型端末装置100とメガネ型端末装置200の相対位置の取得(把握)とは、腕時計型端末装置100とメガネ型端末装置200のいずれか一方の位置を起点にすれば他方の位置がわかるという相互関係が成立している状態をいい、腕時計型端末装置100とメガネ型端末装置200が上記のリセットが行われた位置からそれぞれ移動した場合の相対的な移動量を把握できる状態である。なお、腕時計型端末装置100とメガネ型端末装置200がリセットが行われた位置から互いに同じ位置変化をした場合には、相対位置の変化は無し(すなわち相対的な移動量は0)となる。 The acquisition (ascertaining) of the relative position of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 here means that if one of the positions of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 is used as a starting point, the other position is obtained. It is possible to grasp the relative movement amount when the wristwatch-type terminal device 100 and the glasses-type terminal device 200 are respectively moved from the positions where the reset is performed. State. When the wristwatch-type terminal device 100 and the glasses-type terminal device 200 change the same position from the reset position, there is no change in the relative position (that is, the relative movement amount is 0).
 図5は、腕時計型端末装置100とメガネ型端末装置200との間で行われる画像表示処理の手順を説明するためのフローチャートである。ここでは、画像表示処理の一例として、腕時計型端末装置100で起動したアプリケーション120の表示画面をメガネ型端末装置200の画像投影部213の機能で投影表示させる処理(以下、この処理を「投影表示処理」と称す場合がある。)について説明する。 FIG. 5 is a flowchart for explaining a procedure of image display processing performed between the wristwatch type terminal device 100 and the glasses type terminal device 200. Here, as an example of the image display process, a process of projecting and displaying the display screen of the application 120 activated on the wristwatch type terminal apparatus 100 by the function of the image projection unit 213 of the glasses type terminal apparatus 200 (hereinafter, this process is referred to as “projection display”). Will be referred to as “processing”).
 図5のフローチャートでは、まず、腕時計型端末装置100で操作部114の操作(アプリケーション120の起動のための操作)が行われたか否かを判断する(ステップST3-1)。その結果、操作部114の操作が行われていない場合(NO)には、操作部114の操作が行われるまで次の処理には進まず待機する。その一方で、操作部114の操作が行われた場合(YES)には、アプリケーションを起動させる(ステップST3-2)。その後、腕時計型端末装置100とメガネ型端末装置200の相対位置情報の取得が行われる(ステップST3-3)。このステップST3-3の相対位置情報の取得は、先の図3のフローチャートにおけるステップST1-5の処理である。これにより、腕時計型端末装置100とメガネ型端末装置200の相対位置情報が把握される。 In the flowchart of FIG. 5, first, it is determined whether or not the operation of the operation unit 114 (operation for starting the application 120) has been performed on the wristwatch type terminal device 100 (step ST3-1). As a result, when the operation of the operation unit 114 is not performed (NO), the process does not proceed to the next process until the operation of the operation unit 114 is performed. On the other hand, when the operation unit 114 is operated (YES), the application is started (step ST3-2). Thereafter, the relative position information of the wristwatch type terminal device 100 and the glasses type terminal device 200 is acquired (step ST3-3). The acquisition of the relative position information in step ST3-3 is the process of step ST1-5 in the flowchart of FIG. Thereby, the relative position information of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 is grasped.
 そして、ステップST3-3で取得した相対位置情報を用いて、アプリケーション120の画面のデータを投影表示処理用のデータに変換する処理を行う(ステップST3-4)。ここでの処理は、アプリケーション120の画面表示用のデータに腕時計型端末装置100とメガネ型端末装置200の相対位置情報を組み込むことで、画面の画像が腕時計型端末装置100に対応する位置に適切な大きさ及び形状等で表示されるようにするための処理である。その後、この変換処理を施した画面のデータをメガネ型端末装置200のデータ送受信部215に向けて送信する(ステップST3-5)。メガネ型端末装置200では、この腕時計型端末装置100から送信された画面のデータを受信し(ステップST4-1)、この受信した画面のデータに基づいて画像投影部213で画面の画像(又は映像)220をレンズ201に向けて投影する(ステップST4-2)。これにより、メガネ型端末装置200の装着者は、レンズ201に投影された画像220によって、アプリケーションの画面の画像5が腕時計型端末装置100の真上位置に投影されているかのように視認することができる。 Then, using the relative position information acquired in step ST3-3, a process for converting screen data of the application 120 into data for projection display processing is performed (step ST3-4). In this process, the relative position information of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 is incorporated into the screen display data of the application 120, so that the image on the screen is suitable for the position corresponding to the wristwatch-type terminal device 100. It is a process for making it display by various sizes and shapes. Thereafter, the screen data subjected to the conversion process is transmitted to the data transmitting / receiving unit 215 of the glasses-type terminal device 200 (step ST3-5). The glasses-type terminal device 200 receives the screen data transmitted from the wristwatch-type terminal device 100 (step ST4-1), and the image projection unit 213 based on the received screen data receives the screen image (or video). ) 220 is projected toward the lens 201 (step ST4-2). Thereby, the wearer of the glasses-type terminal device 200 visually recognizes the image 220 of the application screen as if it is projected directly above the wristwatch-type terminal device 100 by the image 220 projected on the lens 201. Can do.
 その後、腕時計型端末装置100では、操作部114の操作(アプリケーション120の終了のための操作)が行われたか否かを判断する(ステップST3-6)。その結果、操作部114の操作が行われていない場合(NO)には、ステップST3-3に戻って相対位置の取得(把握)の手順から処理を繰り返す。その一方で、操作部114の操作が行われた場合(YES)には、アプリケーションを終了させる(ステップST3-7)。一方、メガネ型端末装置200では、腕時計型端末装置100から送信された表示画面用のデータの受信が終了するまで表示画面用の画像を出力する処理が継続される(ステップST4-3)。 Thereafter, the wristwatch type terminal device 100 determines whether or not the operation of the operation unit 114 (operation for ending the application 120) has been performed (step ST3-6). As a result, when the operation unit 114 is not operated (NO), the process returns to step ST3-3 and the process is repeated from the procedure for acquiring (obtaining) the relative position. On the other hand, if the operation unit 114 is operated (YES), the application is terminated (step ST3-7). On the other hand, in the glasses-type terminal device 200, the process of outputting the display screen image is continued until the reception of the display screen data transmitted from the wristwatch type terminal device 100 is completed (step ST4-3).
 図6は、腕時計型端末装置100からメガネ型端末装置200に送信された表示画面用のデータに基づいて表示された表示画面の画像5を示す図である。同図に示すように、メガネ型端末装置200は、画像投影部213からレンズ201に画像220を投影する(表示させる)ようになっている。これにより、メガネ型端末装置200を装着している装着者は、このレンズ201に投影された画像220が当該レンズ201を通して見える実際の景色の中に存在している(表示されている)かように視認することができる。そしてこの際、腕時計型端末装置100とメガネ型端末装置200の相対位置情報を把握し、この相対位置情報に基づいて、レンズ201を通して見える画像が腕時計型端末装置100の真上位置など常に腕時計型端末装置100に対する同じ位置に表示されるように制御することができる。 FIG. 6 is a diagram showing a display screen image 5 displayed based on the display screen data transmitted from the wristwatch type terminal device 100 to the glasses type terminal device 200. As shown in the figure, the eyeglass-type terminal device 200 projects (displays) an image 220 from an image projection unit 213 onto a lens 201. As a result, the wearer wearing the glasses-type terminal device 200 seems to have the image 220 projected on the lens 201 present (displayed) in the actual scenery seen through the lens 201. Can be visually recognized. At this time, the relative position information of the wristwatch type terminal device 100 and the eyeglass type terminal device 200 is grasped, and based on this relative position information, the image seen through the lens 201 is always the wristwatch type such as the position directly above the wristwatch type terminal device 100. It can be controlled to be displayed at the same position with respect to the terminal device 100.
 以上説明したように、本実施形態の相対位置検出システムによれば、加速度センサ116a,216aと角速度センサ116b,216bの検出のみによって腕時計型端末装置100とメガネ型端末装置200の相対位置を検出するように構成したことで、従来のカメラ(撮像手段)を備える位置検知システムや、GPSなどの外部からの情報に基づく絶対位置検出による相対位置検出を行うシステムと比較して、装置の構成の大幅な簡素化及び小型化・軽量化を図ることができる。また、簡単な処理で相対位置の検出が行えるようになるので、相対位置検出の処理速度を高めることができる。また、データを記憶するためのメモリなどの記憶媒体の容量や演算処理を行うための処理装置の処理能力などを少なく(低く)抑えることが可能となる。 As described above, according to the relative position detection system of the present embodiment, the relative positions of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 are detected only by the detection of the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b. With this configuration, the configuration of the apparatus is significantly larger than that of a conventional position detection system including a camera (imaging means) and a system that performs relative position detection based on absolute position detection based on external information such as GPS. Simplification and reduction in size and weight can be achieved. In addition, since the relative position can be detected by simple processing, the processing speed of relative position detection can be increased. In addition, it is possible to reduce (lower) the capacity of a storage medium such as a memory for storing data and the processing capability of a processing device for performing arithmetic processing.
 また、本実施形態の相対位置検出システムによれば、加速度センサ116a,216aと角速度センサ116b,216bの検出のみによって腕時計型端末装置(第1端末装置)100とメガネ型端末装置(第2端末装置)200の相対位置を検出するように構成したことで、GPSやインターネットなどの外部からの情報を受信する必要がない。したがって、GPSやインターネットなどの外部からの情報を受信することができない環境や装置構成であっても、腕時計型端末装置100とメガネ型端末装置200の相対位置の検出を行うことができる。 Further, according to the relative position detection system of the present embodiment, the wristwatch type terminal device (first terminal device) 100 and the glasses type terminal device (second terminal device) are only detected by the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b. ) Since it is configured to detect the relative position of 200, it is not necessary to receive information from outside such as GPS and the Internet. Therefore, the relative position of the wristwatch type terminal device 100 and the glasses type terminal device 200 can be detected even in an environment or device configuration in which information from outside such as GPS or the Internet cannot be received.
 さらに、本実施形態の相対位置検出システムによれば、加速度センサ116a,216aと角速度センサ116b,216bの検出のみによって腕時計型端末装置100とメガネ型端末装置200の相対位置を検出するように構成したことで、従来のカメラ(撮像手段)を用いた相対位置検出システムのように装置同士が互いに視認できる位置に有る必要が無い。したがって、腕時計型端末装置100とメガネ型端末装置200との間に遮蔽物がある場合など、互いを直接見通せない環境であっても相対位置検出を行うことができるので、腕時計型端末装置100とメガネ型端末装置200が置かれる環境の制限がより少ない相対位置検出システムとなる。 Furthermore, according to the relative position detection system of the present embodiment, the relative positions of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 are detected only by the detection of the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b. Thus, there is no need to be in a position where the devices can be seen from each other unlike a relative position detection system using a conventional camera (imaging means). Accordingly, the relative position can be detected even in an environment where the watch-type terminal device 100 and the glasses-type terminal device 200 are not directly visible, such as when there is a shield between the watch-type terminal device 100 and the glasses-type terminal device 200. This is a relative position detection system with less restrictions on the environment in which the glasses-type terminal device 200 is placed.
 加えて、本実施形態の相対位置検出システムでは、従来のカメラを備える相対位置検出システムのように、街中や電車内などの公共の場での第三者のプライバシーに関わる撮影や、書店や映画館などでの著作権等に問題が生じる可能性のある撮影などを意図せずに行ってしまうおそれが無い。また、撮影した画像などのデータが装置内の記憶部112,212などに保存されることが無い。したがって、当該画像などのデータの漏洩が生じるおそれがないため、プライバシーの保護やセキュリティーの確保に問題が生じずに済む。さらには、撮影した画像のデータを記憶するためのメモリなどの記憶媒体の大容量化や、演算処理を行うための処理装置の処理能力の高度化が必要になるという問題も生じずに済む。 In addition, in the relative position detection system of the present embodiment, like a relative position detection system provided with a conventional camera, shooting related to the privacy of a third party in a public place such as in a city or on a train, a bookstore or a movie There is no risk of unintentionally taking a photo or the like that may cause a problem with copyrights in a hall. In addition, data such as a photographed image is not stored in the storage units 112 and 212 in the apparatus. Accordingly, there is no possibility of leakage of data such as the image, so that there is no problem in protecting privacy and ensuring security. Furthermore, there is no problem that it is necessary to increase the capacity of a storage medium such as a memory for storing captured image data and to increase the processing capability of the processing device for performing arithmetic processing.
 また、本実施形態の相対位置検出システムによれば、腕時計型端末装置100とメガネ型端末装置200の相対位置及び姿勢を座標データとして取得可能であることで、簡単な処理で腕時計型端末装置100とメガネ型端末装置200の相対位置を正確に把握することができる。したがって、腕時計型端末装置100とメガネ型端末装置200における処理の簡素化を図ることができると共に、相対位置情報を迅速かつ確実に取得することが可能となる。 Further, according to the relative position detection system of the present embodiment, the relative position and orientation of the wristwatch type terminal device 100 and the glasses type terminal device 200 can be acquired as coordinate data, so that the wristwatch type terminal device 100 can be obtained with simple processing. And the relative position of the glasses-type terminal device 200 can be accurately grasped. Therefore, it is possible to simplify the processing in the wristwatch type terminal device 100 and the glasses type terminal device 200, and it is possible to acquire the relative position information quickly and reliably.
 また、本実施形態の相対位置検出システムを備える画像表示システム1によれば、上記構成の相対位置検出システムで検出した腕時計型端末装置100とメガネ型端末装置200の相対位置の情報を用いて、レンズ201を通して見える画面の画像5が腕時計型端末装置100の真上位置などに常に位置するように制御することができる。したがって、腕時計型端末装置100とメガネ型端末装置200とを部品点数を少なく抑えた簡単な構成としながらも、腕時計型端末装置100の画面表示の利便性を向上させることができる。 In addition, according to the image display system 1 including the relative position detection system of the present embodiment, information on the relative positions of the wristwatch type terminal device 100 and the glasses type terminal device 200 detected by the relative position detection system having the above configuration is used. It can be controlled so that the image 5 of the screen seen through the lens 201 is always located at a position directly above the wristwatch type terminal device 100 or the like. Therefore, the convenience of the screen display of the wristwatch type terminal device 100 can be improved while the wristwatch type terminal device 100 and the eyeglass type terminal device 200 have a simple configuration with a reduced number of parts.
 なお、本実施形態では、腕時計型端末装置100とメガネ型端末装置200の相対位置の検出を腕時計型端末装置100の機能として行う場合について説明したが、これ以外にも、腕時計型端末装置100とメガネ型端末装置200の相対位置の検出(図3のステップST1-5の処理)をメガネ型端末装置200の機能として行うように構成することも可能である。 In the present embodiment, the case where the detection of the relative position of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 is performed as a function of the wristwatch-type terminal device 100 is described. It is also possible to configure so that the detection of the relative position of the glasses-type terminal device 200 (the process of step ST1-5 in FIG. 3) is performed as a function of the glasses-type terminal device 200.
 また、本実施形態では、メガネ型端末装置200は、図1に示すように、制御部211などの機能構成を備えた本体部205をメガネ部210のフレーム部202に一体に取り付けた構成のものを例示したが、この本体部205は、必ずしもメガネ部分210と一体に構成されている必要はなく、既製品のメガネなどに対して後付けで装着することが可能な別の装置として構成してもよい。すなわち、図1に示す本体部205は、例えば既存のメガネに後から装着することができるような構成であってもよい。 In this embodiment, the glasses-type terminal device 200 has a configuration in which a main body unit 205 having a functional configuration such as a control unit 211 is integrally attached to a frame unit 202 of the glasses unit 210 as shown in FIG. However, the main body 205 does not necessarily have to be configured integrally with the glasses portion 210, and may be configured as another device that can be retrofitted to ready-made glasses. Good. That is, the main body 205 shown in FIG. 1 may be configured to be able to be attached later to, for example, existing glasses.
 また、上記実施形態では、本発明にかかる相対位置検出システムを用いて画像の表示を行う際の表示画面の一例として、アプリケーションの表示画面を例示したが、これに限らず他の表示画面(例えばウェブブラウザの表示画面など)を用いることも可能である。 Moreover, in the said embodiment, although the display screen of the application was illustrated as an example of the display screen at the time of displaying an image using the relative position detection system concerning this invention, not only this but another display screen (for example, It is also possible to use a display screen of a web browser).
 また、上記実施形態の説明及び図面では、腕時計型端末装置100とメガネ型端末装置200の機能構成として、図2に示す構成要素を備える場合を示したが、当該図2に示す構成要素は、本発明にかかる相対位置検出システム及び画像表示システムとしての構成要素のみを示したものである。したがって、腕時計型端末装置100やメガネ型端末装置200は、図2に示す構成要素以外にも、例えば、カメラなどの撮像手段や、GPSによる位置検出を行うための手段や、インターネットなど外部の通信ネットワークに接続するための通信手段などを備えていてもよい。ただし、これらの撮像手段や通信手段は、本発明にかかる相対位置検出システムにおける位置情報の検出のための手段としては用いられず、本発明にかかる相対位置検出システムは、あくまでも図2に示す位置検出部116,216が備える加速度センサ116a,216aと角速度センサ116b、216bのみによる位置検出を行うように構成されているものとする。 Further, in the description and drawings of the above embodiment, the case where the functional components of the wristwatch type terminal device 100 and the glasses type terminal device 200 are provided with the components shown in FIG. 2 is shown, but the components shown in FIG. Only the components as the relative position detection system and the image display system according to the present invention are shown. Therefore, in addition to the components shown in FIG. 2, the wristwatch-type terminal device 100 and the glasses-type terminal device 200 are, for example, imaging means such as a camera, means for performing position detection by GPS, and external communication such as the Internet. Communication means for connecting to a network may be provided. However, these image pickup means and communication means are not used as means for detecting position information in the relative position detection system according to the present invention, and the relative position detection system according to the present invention is merely the position shown in FIG. It is assumed that the position detection is performed only by the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b included in the detection units 116 and 216.
 また、本実施形態の相対位置検出システムでは、位置検出部116,216が備える加速度センサ116a,216aと角速度センサ116b、216bの検出値の精度を高めるために、加速度センサ116a,216aと角速度センサ116b、216bの検出値を補正する補正手段を備えるようにするとよい。この補正手段として、例えば、下記(1)~(5)のようなものが考えられる。 In the relative position detection system according to the present embodiment, the acceleration sensors 116a and 216a and the angular velocity sensor 116b are used to increase the accuracy of the detection values of the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b included in the position detection units 116 and 216. It is preferable to provide correction means for correcting the detection value of 216b. For example, the following correction means (1) to (5) are conceivable.
 (1)上記の充電用の装置(クレードル)に腕時計型端末装置100とメガネ型端末装置200を載せた際にこれら腕時計型端末装置100とメガネ型端末装置200の相対距離がリセット可能な距離(リセット位置)であると判断して、その時点で腕時計型端末装置100とメガネ型端末装置200の位置検出部116,216の測定値を補正(測定値に含まれる誤差を補正する)処理を行うようにすることができる。あるいは、腕時計型端末装置100とメガネ型端末装置200が互いに接触(当接)したことを何らかの手段で検知できるように構成し、これら腕時計型端末装置100とメガネ型端末装置200が互いに接触(当接)したことをもって、その時点で腕時計型端末装置100とメガネ型端末装置200の位置検出部の測定値を補正する処理を行うようにすることもできる。すなわち、これらの場合は、上記のリセット処理に合わせて腕時計型端末装置100とメガネ型端末装置200の位置検出部116,216の測定値を補正する処理を行うようにする。 (1) When the wristwatch-type terminal device 100 and the glasses-type terminal device 200 are placed on the above-described charging device (cradle), the relative distance between the wristwatch-type terminal device 100 and the glasses-type terminal device 200 can be reset ( At that time, the measurement values of the position detection units 116 and 216 of the wristwatch type terminal device 100 and the glasses type terminal device 200 are corrected (the error included in the measurement values is corrected). Can be. Alternatively, the watch-type terminal device 100 and the glasses-type terminal device 200 are configured to detect contact (contact) with each other by some means. As a result, the measurement value of the position detection unit of the wristwatch type terminal device 100 and the glasses type terminal device 200 can be corrected at that time. That is, in these cases, processing for correcting the measurement values of the position detection units 116 and 216 of the wristwatch type terminal device 100 and the glasses type terminal device 200 is performed in accordance with the reset processing.
 (2)腕時計型端末装置100とメガネ型端末装置200のデータ送受信部115,215が受信する電波の強度を判断し、その強度に応じて腕時計型端末装置100とメガネ型端末装置200の相対位置情報を把握し、それに基づいて腕時計型端末装置100とメガネ型端末装置200の位置検出部116,216の測定値の補正(測定値に含まれる誤差を補正する)処理を行うことができる。すなわち、例えば、腕時計型端末装置100とメガネ型端末装置200のデータ送受信部115,215のいずれか一方が他方から受信する電波の強度が所定の閾値以上となった場合に、腕時計型端末装置100とメガネ型端末装置200の相対位置(距離)が所定値以下になったと判断し、その距離の情報に基づいて位置検出部116,216の測定値を補正することができる。 (2) Relative positions of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 are determined according to the strength of radio waves received by the data transmission / reception units 115 and 215 of the wristwatch-type terminal device 100 and the glasses-type terminal device 200. Based on the information, it is possible to correct the measurement values (correct the errors included in the measurement values) of the position detection units 116 and 216 of the wristwatch type terminal device 100 and the glasses type terminal device 200 based on the information. That is, for example, when one of the data transmission / reception units 115 and 215 of the wristwatch-type terminal device 100 and the glasses-type terminal device 200 has received a radio wave having an intensity greater than or equal to a predetermined threshold value, the wristwatch-type terminal device 100. It is possible to determine that the relative position (distance) of the glasses-type terminal device 200 has become equal to or less than a predetermined value, and correct the measured values of the position detectors 116 and 216 based on the information on the distance.
 (3)位置検出部116,216が備える加速度センサ116a,216aと角速度センサ116b,216bの測定値を補正するための補正用のセンサを更に備え、この補正用のセンサで加速度センサ116a,216aと角速度センサ116b,216bの測定値を補正するように構成する。ここでの補正用のセンサとしては、一例として地磁気センサ(電子コンパス)を挙げることができる。さらにこの場合、本発明の実施態様(実施形態)としては、位置検出部116,216として、加速度センサ116a,216aと角速度センサ216b、216bに加えて上記の地磁気センサを一体あるいは別体として備えたチップ型のセンサを設けるようにしてもよい。この場合は、位置検出部116,216の検出値として加速度センサ116a,216aと角速度センサ116b、216bの測定値を地磁気センサの測定値で補正した値を得ることができる。ただし、この場合でも、腕時計型端末装置100又はメガネ型端末装置200の位置検出は、加速度センサ116a,216aと角速度センサ116b,216bのみによって行われており、地磁気センサはこれら加速度センサ116a,216aと角速度センサ116b,216bによる位置検出の測定値を補正するための手段として機能しているものである。 (3) The sensor further includes a correction sensor for correcting the measurement values of the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b included in the position detection units 116 and 216, and the correction sensors include the acceleration sensors 116a and 216a. The measurement values of the angular velocity sensors 116b and 216b are corrected. An example of the correction sensor here is a geomagnetic sensor (electronic compass). Further, in this case, as an embodiment (embodiment) of the present invention, as the position detection units 116 and 216, the above-described geomagnetic sensor is provided as an integral or separate body in addition to the acceleration sensors 116a and 216a and the angular velocity sensors 216b and 216b. A chip-type sensor may be provided. In this case, a value obtained by correcting the measurement values of the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b with the measurement values of the geomagnetic sensor can be obtained as the detection values of the position detection units 116 and 216. However, even in this case, the position detection of the wristwatch-type terminal device 100 or the glasses-type terminal device 200 is performed only by the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b, and the geomagnetic sensor is the acceleration sensor 116a or 216a. It functions as a means for correcting the measurement value of position detection by the angular velocity sensors 116b and 216b.
 (4)位置検出部116,216が備える加速度センサ116a,216aと角速度センサ116b,216bの測定値をデータとして蓄積し、この蓄積したデータを解析することで測定値に生じる誤差の傾向を把握し、この傾向に基づいて測定値の補正を行うようにしてもよい。この場合は、蓄積した測定値のデータ自体を腕時計型端末装置100又はメガネ型端末装置200に蓄えている必要はなく、当該蓄積したデータを用いて得られた補正の仕方を格納した補正プログラムなどを腕時計型端末装置100又はメガネ型端末装置200の記憶部112,212に記憶させておき、この補正プログラムに基づいて制御部111,211が補正を行うようにするとよい。 (4) The measured values of the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b included in the position detectors 116 and 216 are accumulated as data, and by analyzing the accumulated data, the tendency of errors occurring in the measured values can be grasped. The measurement value may be corrected based on this tendency. In this case, it is not necessary to store the accumulated measurement value data itself in the wristwatch-type terminal device 100 or the glasses-type terminal device 200, and a correction program storing the correction method obtained using the accumulated data. May be stored in the storage units 112 and 212 of the wristwatch type terminal device 100 or the glasses type terminal device 200, and the control units 111 and 211 may perform correction based on the correction program.
 (5)腕時計型端末装置100の位置検出部116とメガネ型端末装置200の位置検出部216それぞれの測定値の劣化度を判断し、劣化度のより少ない方の測定値に合わせるように補正を行う。すなわち、リセット処理後の腕時計型端末装置100又はメガネ型端末装置200の移動量が多いほど、それらの位置検出部116又は216の測定値に誤差が累積することで、測定値の劣化が進む傾向がある。そのため、ある時点で腕時計型端末装置100とメガネ型端末装置200それぞれのリセット処理後の移動量を判断し、この移動量がより少ない方の測定値に合わせるように位置検出部116又は216の測定値を補正する処理を行うことができる。 (5) The degree of deterioration of the measured values of the position detection unit 116 of the wristwatch type terminal device 100 and the position detection unit 216 of the glasses type terminal device 200 is determined, and correction is performed so as to match the measurement value with the smaller degree of deterioration. Do. That is, as the movement amount of the wristwatch-type terminal device 100 or the glasses-type terminal device 200 after the reset process is larger, the error is accumulated in the measurement values of the position detection unit 116 or 216, and thus the deterioration of the measurement value tends to progress. There is. Therefore, the movement amount after reset processing of each of the wristwatch type terminal device 100 and the eyeglass type terminal device 200 is determined at a certain point in time, and the position detection unit 116 or 216 measures so as to match the measurement value with the smaller movement amount. Processing for correcting the value can be performed.
 上記(1)~(5)の補正処理は、それぞれを単独で行うように構成してもよいし、いずれかを組み合わせて行うように構成してもよい。これらの補正処理を行うことで、加速度センサ116a,216aと角速度センサ116b,216bのみを備えた位置検出部116,216の測定値に生じる誤差をより少なく抑えることができるので、位置検出部116,216の測定値に基づく相対位置の検出の精度を効果的に高めることができる。 The correction processes (1) to (5) may be configured to be performed independently or may be performed in combination. By performing these correction processes, errors occurring in the measurement values of the position detectors 116 and 216 provided with only the acceleration sensors 116a and 216a and the angular velocity sensors 116b and 216b can be suppressed, and therefore the position detector 116, The accuracy of detection of the relative position based on the measured value of 216 can be effectively increased.
〔第二実施形態〕
 次に、本発明の第二実施形態について説明する。なお、第二実施形態の説明及び対応する図面においては、第一実施形態と同一又は相当する構成部分には同一の符号を付し、以下ではその部分の詳細な説明は省略する。また、以下で説明する事項以外の事項、及び図示する以外の事項については、第一実施形態と同じである。
[Second Embodiment]
Next, a second embodiment of the present invention will be described. In the description of the second embodiment and the corresponding drawings, the same or corresponding components as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted below. Further, matters other than those described below and matters other than those illustrated are the same as those in the first embodiment.
 図7は、本発明の第二実施形態にかかる相対位置検出システムを含む画像表示システム1-2の全体構成例を示す図である。また、図8は、携帯型端末装置300の機能構成を示すブロック図である。本実施形態の画像表示システム1-2は、腕時計型端末装置(第1端末装置)100と、メガネ型端末装置(第2端末装置)200とに加えて、更に他の携帯型端末装置(第3端末装置)300を備えている。携帯型端末装置300は、いわゆるスマートフォンやタブレット型コンピュータといった小型の通信端末装置やコンピュータ装置である。この携帯型端末装置300は、図8に示すように、制御部(制御手段)311、記憶部(記憶手段)312、表示部(表示手段)313、操作部(入力手段)314、データ送受信部315を備えて構成されている。 FIG. 7 is a diagram showing an example of the overall configuration of an image display system 1-2 including a relative position detection system according to the second embodiment of the present invention. FIG. 8 is a block diagram illustrating a functional configuration of the portable terminal device 300. The image display system 1-2 according to this embodiment includes a wristwatch-type terminal device (first terminal device) 100 and a glasses-type terminal device (second terminal device) 200, as well as other portable terminal devices (first devices). 3 terminal device) 300. The portable terminal device 300 is a small communication terminal device or computer device such as a so-called smartphone or tablet computer. As shown in FIG. 8, the portable terminal device 300 includes a control unit (control unit) 311, a storage unit (storage unit) 312, a display unit (display unit) 313, an operation unit (input unit) 314, and a data transmission / reception unit. 315 is provided.
 制御部311は、携帯型端末装置300を動作させるための各種処理を実行するための部分であり、マイクロプロセッサ、各種周辺回路等によって構成される。この制御部311は、記憶部312に記憶されたプログラム(アプリケーション)320を実行するための機能などを備えている。 The control unit 311 is a part for executing various processes for operating the portable terminal device 300, and includes a microprocessor, various peripheral circuits, and the like. The control unit 311 has a function for executing the program (application) 320 stored in the storage unit 312.
 記憶部312は、フラッシュメモリ又はハードディスク等の記憶媒体である。記憶部312には、制御部311によって実行されるアプリケーション320などの各種データが記憶されている。すなわち、記憶部312に記憶されているデータは、必要に応じて制御部311により記憶部312から読み出され、制御部311が実行する様々な処理や制御に利用される。また、制御部311は、記憶部312に新たなデータを記憶したり既に記憶されているデータを更新することもできる。 The storage unit 312 is a storage medium such as a flash memory or a hard disk. The storage unit 312 stores various data such as the application 320 executed by the control unit 311. That is, the data stored in the storage unit 312 is read from the storage unit 312 by the control unit 311 as necessary, and is used for various processes and controls executed by the control unit 311. In addition, the control unit 311 can store new data in the storage unit 312 or update already stored data.
 表示部313は、アプリケーション320の実行内容を表示するための表示画面や操作画面などを表示するほか、様々な画像や映像等を表示するための装置であり、液晶ディスプレイ等が用いられる。 The display unit 313 is a device for displaying various images and videos in addition to displaying a display screen and an operation screen for displaying the execution contents of the application 320, and a liquid crystal display or the like is used.
 操作部314は、携帯型端末装置300の各種機能を用いるために操作者によって入力される各種操作を検出するものであり、各種の入力手段(操作ボタン、タッチパネル、あるいは音声認識装置など)で構成することが可能である。操作者は、操作部314を操作することにより、携帯型端末装置300で行われる後述するアプリケーションの実行などに必要な各種の操作を行うことができる。 The operation unit 314 detects various operations input by the operator in order to use various functions of the portable terminal device 300, and includes various input means (operation buttons, a touch panel, a voice recognition device, or the like). Is possible. The operator can perform various operations necessary for executing an application, which will be described later, performed on the portable terminal device 300 by operating the operation unit 314.
 データ送受信部315は、制御部311や記憶部312から入力した各種データを含むデータ信号等を腕時計型端末装置100又はメガネ型端末装置200のデータ送受信部115,215に向けて送信すると共に、腕時計型端末装置100又はメガネ型端末装置200のデータ送受信部115,215から送信されたデータを受信する機能を備えている。このデータ送受信部315は、メガネ型端末装置200がその位置検出部216で検出した当該メガネ型端末装置200の位置に関するデータをメガネ型端末装置200のデータ送受信部215から受信し、また腕時計型端末装置100がその位置検出部116で検出した当該腕時計型端末装置100の位置に関するデータを腕時計型端末装置100のデータ送受信部115から受信する機能を有する。また、データ送受信部315は、アプリケーション320の表示画面やウェブブラウザの表示画面のデータ(相対位置情報による修正が施されたデータ)など、メガネ型端末装置200で画像表示をするために必要なデータをメガネ型端末装置200のデータ送受信部215に向けて送信する機能を有する。 The data transmission / reception unit 315 transmits data signals including various data input from the control unit 311 and the storage unit 312 to the data transmission / reception units 115 and 215 of the wristwatch-type terminal device 100 or the glasses-type terminal device 200, and The terminal device 100 has a function of receiving data transmitted from the data transmission / reception units 115 and 215 of the glasses-type terminal device 100 or the glasses-type terminal device 200. The data transmission / reception unit 315 receives data relating to the position of the glasses-type terminal device 200 detected by the glasses-type terminal device 200 by the position detection unit 216 from the data transmission / reception unit 215 of the glasses-type terminal device 200, and also a wristwatch-type terminal. The device 100 has a function of receiving data related to the position of the wristwatch type terminal device 100 detected by the position detection unit 116 from the data transmission / reception unit 115 of the wristwatch type terminal device 100. The data transmission / reception unit 315 also includes data necessary for displaying images on the glasses-type terminal device 200, such as display screen data of the application 320 and data of the display screen of the web browser (data corrected by relative position information). Is transmitted to the data transmission / reception unit 215 of the glasses-type terminal device 200.
 そして、本実施形態の画像表示システム1-2が第一実施形態の画像表示システム1と異なる点は、画像表示をするためのアプリケーションの実行を第一実施形態では腕時計型端末装置100で行っていたのに対して、本実施形態では携帯型端末装置300で行うようにした点、及び、腕時計型端末装置100で検出した位置情報とメガネ型端末装置200で検出した位置情報とに基づく腕時計型端末装置100とメガネ型端末装置200の相対位置情報の検出を第一実施形態では腕時計型端末装置100で行っていたのに対して、本実施形態では携帯型端末装置300で行うようにした点である。すなわち、本実施形態では、携帯型端末装置300で実行したアプリケーションの画面に関するデータをメガネ型端末装置200に送信し、画像投影部213から当該メガネ型端末装置200のレンズ201に画面の画像220を投影する。その際に、腕時計型端末装置100で検出した(自身の)位置情報とメガネ型端末装置200で検出した(自身の)位置情報とに基づいて携帯型端末装置300で腕時計型端末装置100とメガネ型端末装置200の相対位置情報の検出を行い、この検出した相対位置情報を携帯型端末装置300からメガネ型端末装置200に送信することで、当該相対位置情報を用いて画面のデータを変換することで、レンズ201を通して見える画面の画像5が腕時計型端末装置100の真上位置などに常に位置するように制御することができる。 The image display system 1-2 of the present embodiment is different from the image display system 1 of the first embodiment in that the application for displaying an image is executed by the wristwatch type terminal device 100 in the first embodiment. In contrast, in the present embodiment, the wristwatch type is based on the point that the portable terminal device 300 performs, and the positional information detected by the wristwatch type terminal device 100 and the positional information detected by the glasses type terminal device 200. The detection of the relative position information of the terminal device 100 and the glasses-type terminal device 200 is performed by the wristwatch-type terminal device 100 in the first embodiment, whereas in the present embodiment, the detection is performed by the portable terminal device 300. It is. That is, in this embodiment, data related to the screen of the application executed on the portable terminal device 300 is transmitted to the glasses-type terminal device 200, and the screen image 220 is displayed on the lens 201 of the glasses-type terminal device 200 from the image projection unit 213. Project. At that time, based on the position information detected by the wristwatch-type terminal device 100 and the position information detected by the glasses-type terminal device 200, the portable terminal device 300 and the glasses The relative position information of the portable terminal device 200 is detected, and the detected relative position information is transmitted from the portable terminal device 300 to the glasses-type terminal device 200, thereby converting the screen data using the relative position information. Thus, it is possible to control so that the image 5 of the screen seen through the lens 201 is always located at a position directly above the wristwatch type terminal device 100 or the like.
 したがって、本実施形態の腕時計型端末装置100は、位置検出部116とデータ送受信部115を備えてさえいればよく、アプリケーションを格納した記憶部112などは必ずしも備えていなくてもよい。また、腕時計型端末装置100のデータ送受信部115とメガネ型端末装置200のデータ送受信部215は、どちらも少なくとも携帯型端末装置300のデータ送受信部315との間でデータの授受(通信)を行う機能を備えてさえいれば、腕時計型端末装置100のデータ送受信部115とメガネ型端末装置200のデータ送受信部215との間で直接的にデータの授受を行う機能は必ずしも備えていなくてもよい。 Therefore, the wristwatch type terminal device 100 of the present embodiment only needs to include the position detection unit 116 and the data transmission / reception unit 115, and does not necessarily include the storage unit 112 that stores the application. Further, the data transmission / reception unit 115 of the wristwatch-type terminal device 100 and the data transmission / reception unit 215 of the glasses-type terminal device 200 both exchange data (communication) with at least the data transmission / reception unit 315 of the portable terminal device 300. As long as it has a function, it does not necessarily have to have a function of directly transferring data between the data transmission / reception unit 115 of the wristwatch type terminal device 100 and the data transmission / reception unit 215 of the glasses-type terminal device 200. .
 本実施形態の画像表示システム1-2によれば、アプリケーションの実行及び相対位置の検出を携帯型端末装置300で行うように構成したことで、腕時計型端末装置100の更なる構成の簡素化、小型化、軽量化を図ることが可能となる。 According to the image display system 1-2 of the present embodiment, the portable terminal device 300 is configured to execute the application and detect the relative position, thereby further simplifying the configuration of the wristwatch type terminal device 100, It becomes possible to reduce the size and weight.
 以上、本発明の実施の形態を説明したが、本発明は上記実施の形態に限定されるものではなく、特許請求の範囲、及び明細書と図面に記載された技術的思想の範囲内において種々の変形が可能である。例えば、本発明は、上記実施形態における下記の点を変更して実施することが可能である。 Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims and the technical idea described in the specification and drawings. Can be modified. For example, the present invention can be implemented by changing the following points in the above embodiment.
 すなわち、上記実施形態では、腕時計型端末装置100とメガネ型端末装置200の二つの端末装置の間で相対位置を検出するシステムを例に説明したが、本発明にかかる相対位置検出システムは、三つ以上の端末装置の相対位置を検出するシステムとして構成することも可能である。したがって、たとえば上記実施形態に示すメガネ型端末装置が複数台あってもよい。その場合は、複数台のメガネ型端末装置それぞれで腕時計型端末装置との相対位置を把握することで、複数台のメガネ型端末装置それぞれで共通の画像を見ることができるように設定することも可能である。 That is, in the above-described embodiment, the system that detects the relative position between the two terminal devices of the wristwatch type terminal device 100 and the glasses type terminal device 200 has been described as an example. However, the relative position detection system according to the present invention includes three systems. It is also possible to configure as a system that detects the relative positions of two or more terminal devices. Therefore, for example, a plurality of glasses-type terminal devices shown in the above embodiment may be provided. In that case, it is possible to set so that a plurality of glasses-type terminal devices can see a common image by grasping the relative position of each of the plurality of glasses-type terminal devices with the wristwatch-type terminal device. Is possible.
 また、上記実施形態では、本発明にかかる相対位置検出システムをメガネ型端末装置200と腕時計型端末装置100の相対位置検出に用いて、メガネ型端末装置200の画像を腕時計型端末装置100の近傍位置に表示させるために用いた場合を示したが、本発明にかかる相対位置検出システムによる相対位置の検出は、他の技術にも適用が可能である。すなわち、本発明の位置検出システムで相対位置を検出する端末装置は、これらに限らず他の構成の端末装置であってもよい。 Moreover, in the said embodiment, the relative position detection system concerning this invention is used for the relative position detection of the glasses-type terminal device 200 and the wristwatch-type terminal device 100, and the image of the glasses-type terminal device 200 is the vicinity of the wristwatch-type terminal device 100. Although the case where it used for displaying on a position was shown, detection of the relative position by the relative position detection system concerning the present invention is applicable also to other techniques. That is, the terminal device that detects the relative position by the position detection system of the present invention is not limited to these, and may be a terminal device having another configuration.
 また、上記実施形態では、表示される画像や映像の位置が腕時計型端末装置100の位置に追従する場合を示したが、これ以外にも、表示される画像の位置を一時的に固定することなども可能である。これにより、例えば、腕時計型端末装置100を装着している腕を下に降ろすなどの動作をしても、腕時計型端末装置100があった場所に画像や映像が表示され続けるようにすることができる。また、腕時計型端末装置の上部に表示された画像又は映像を操作によって拡大又は縮小して表示することができるようにしてもよい。また、本発明にかかる画像表示システムで表示する画像には、2D画像や2D映像だけでなく、3D画像や3D映像などの3次元表示の画像又は映像も含まれる。 Further, in the above-described embodiment, the case where the position of the displayed image or video follows the position of the wristwatch type terminal device 100 has been described. However, in addition to this, the position of the displayed image is temporarily fixed. Etc. are also possible. As a result, for example, even if an operation such as lowering an arm wearing the wristwatch type terminal device 100 is performed, an image or a video can be continuously displayed at the place where the wristwatch type terminal device 100 was present. it can. In addition, an image or video displayed on the upper part of the wristwatch type terminal device may be displayed by being enlarged or reduced by an operation. The images displayed by the image display system according to the present invention include not only 2D images and 2D videos but also 3D display images or videos such as 3D images and 3D videos.
 また、本発明は、上記のような腕時計型端末装置100とメガネ型端末装置200を備えるシステムに代えて、下記のようなシステムに用いることも可能である。 Further, the present invention can be used in the following system in place of the system including the wristwatch type terminal device 100 and the glasses type terminal device 200 as described above.
・車のハンドルの脇に本発明の第1端末装置に相当する端末装置を置いておき、カーナビゲーションの画像(映像)が当該端末装置の上部にメガネ型端末装置を通して見えるように投影する。
・メガネ型端末装置を通して見える画像又は映像として、ペット(例えば猿などの動物)の画像又は映像(3D画像など)を表示することで、ペットがあたかも自分の腕に巻き付いているように見える画像を表示する。
・腕時計型端末装置が美術館などで展示の情報を得られるようにし、メガネ型端末装置を通して当該腕時計型端末装置の上部に表示された3D画像又は映像で展示物などを360度の範囲で見ることができるようにする。
A terminal device corresponding to the first terminal device of the present invention is placed beside the car handle, and a car navigation image (video) is projected on the upper portion of the terminal device so as to be seen through the glasses-type terminal device.
-By displaying an image or video (3D image, etc.) of a pet (eg, an animal such as a monkey) as an image or video that can be seen through a glasses-type terminal device, an image that appears as if the pet is wrapped around its arm indicate.
・ Allow wristwatch-type terminal devices to obtain information about exhibitions at museums, etc., and view exhibits etc. in a 360-degree range with 3D images or video displayed on the top of the wristwatch-type terminal devices through glasses-type terminal devices To be able to.
 また、上記実施形態では、第1端末装置である腕時計型端末装置100と第2端末装置であるメガネ型端末装置200の二つの端末装置間での位置検出を行う場合について説明したが、これ以外にも例えば、第1端末装置と第2端末装置の両者がある時点で相対位置情報をリセットし、それ以降に第2端末装置が自身の位置情報を第1端末装置に送っている場合、さらに、第2端末装置が別の第3端末装置との間で位置情報のリセットを行い、その際、第3端末装置に第1端末装置への情報伝達手段も伝えることができれば、それ以降、第1端末装置は第2端末装置を経由しなくても(第2端末装置のリセット地点がわかれば)第3端末装置の位置も把握することができる。このように二つの端末装置間での位置検出の操作を繰り返していくことで、位置検出ができる端末装置の数を増やしていくことも可能である。 Moreover, although the said embodiment demonstrated the case where the position detection between the two terminal devices of the wristwatch-type terminal device 100 which is a 1st terminal device, and the spectacles-type terminal device 200 which is a 2nd terminal device was performed, other than this For example, if both the first terminal device and the second terminal device reset the relative position information at a certain point, and the second terminal device sends its own position information to the first terminal device thereafter, If the second terminal device resets the position information with another third terminal device, and if the information transmission means to the first terminal device can be transmitted to the third terminal device, then the second terminal device Even if the 1 terminal device does not go through the 2nd terminal device (if the reset point of the 2nd terminal device is known), the position of the 3rd terminal device can also be grasped. In this way, it is possible to increase the number of terminal devices capable of position detection by repeating the position detection operation between the two terminal devices.

Claims (6)

  1.  第1端末装置と第2端末装置の相対位置を検出する相対位置検出システムであって、
     前記第1端末装置と前記第2端末装置のそれぞれに設けた加速度センサ及び角速度センサを含む位置検出部と、
     前記第1端末装置と前記第2端末装置の少なくともいずれか一方に設けたデータ送信部といずれか他方に設けた前記データ送信部からのデータを受信するデータ受信部と、
     前記第1端末装置と前記第2端末装置の少なくともいずれかに設けた相対位置情報を取得する相対位置情報取得部と、を備え、
     前記相対位置情報取得部は、前記加速度センサの測定値と前記角速度センサの測定値のみを用いて前記第1端末装置と前記第2端末装置との相対位置情報を取得するように構成した
    ことを特徴とする相対位置検出システム。
    A relative position detection system for detecting a relative position between a first terminal device and a second terminal device,
    A position detection unit including an acceleration sensor and an angular velocity sensor provided in each of the first terminal device and the second terminal device;
    A data transmitting unit provided in at least one of the first terminal device and the second terminal device, and a data receiving unit that receives data from the data transmitting unit provided in the other;
    A relative position information acquisition unit that acquires relative position information provided in at least one of the first terminal device and the second terminal device;
    The relative position information acquisition unit is configured to acquire relative position information between the first terminal device and the second terminal device using only the measurement value of the acceleration sensor and the measurement value of the angular velocity sensor. Relative position detection system featuring.
  2.  所定の条件が成立した場合に、前記位置検出部における前記加速度センサと前記角速度センサの測定値をリセットするリセット手段を備え、
     前記加速度センサ及び角速度センサの測定値は、前記リセット手段によるリセットが行われた時点からの累積値である
    ことを特徴とする請求項1に記載の相対位置検出システム。
    A reset unit that resets the measured values of the acceleration sensor and the angular velocity sensor in the position detection unit when a predetermined condition is satisfied;
    2. The relative position detection system according to claim 1, wherein the measurement values of the acceleration sensor and the angular velocity sensor are cumulative values from the time when the reset by the reset unit is performed.
  3.  前記相対位置情報取得部は、前記第1端末装置と前記第2端末装置との相対位置を座標データとして取得可能である
    ことを特徴とする請求項1又は2に記載の相対位置検出システム。
    The relative position detection system according to claim 1, wherein the relative position information acquisition unit can acquire a relative position between the first terminal device and the second terminal device as coordinate data.
  4.  前記相対位置情報取得部は、前記第1端末装置及び前記第2端末装置の同一位置における基準角度に対する傾きを座標データとして取得可能である
    ことを特徴とする請求項1乃至3のいずれか1項に記載の相対位置検出システム。
    The relative position information acquisition unit can acquire, as coordinate data, an inclination with respect to a reference angle at the same position of the first terminal device and the second terminal device. The relative position detection system described in.
  5.  請求項1乃至4のいずれか1項に記載の相対位置検出システムを備える画像表示システムであって、
     前記第1端末装置は、画像表示用のデータを生成する画像表示用データ生成手段を備え、
     前記第2端末装置は、前記画像表示用のデータに基づいて画像を表示するための画像表示手段を備え、
     前記第1端末装置の前記画像表示用データ生成手段で生成した画像表示用のデータが前記第2端末装置に送信され、前記画像表示用のデータに基づいて前記第2端末装置の前記画像表示手段で画像の表示が行われ、
     前記画像表示手段は、前記相対位置情報取得手段が取得した前記第1端末装置と前記第2端末装置との相対位置情報に基づいて、少なくとも前記画像表示用データに基づいて表示させる画像の表示位置の決定を行う
    ことを特徴とする画像表示システム。
    An image display system comprising the relative position detection system according to any one of claims 1 to 4,
    The first terminal device includes image display data generation means for generating image display data,
    The second terminal device includes image display means for displaying an image based on the image display data,
    Image display data generated by the image display data generation means of the first terminal device is transmitted to the second terminal device, and the image display means of the second terminal device is based on the image display data. Will display the image,
    The image display means is a display position of an image to be displayed based on at least the image display data based on the relative position information between the first terminal device and the second terminal device acquired by the relative position information acquisition means. An image display system characterized by making a determination.
  6.  前記画像表示手段による画像の表示位置の決定は、前記第2端末装置から見た前記第1端末装置の位置に基づいて行われる
    ことを特徴とする請求項5に記載の画像表示システム。
    6. The image display system according to claim 5, wherein the display position of the image by the image display means is determined based on the position of the first terminal device as viewed from the second terminal device.
PCT/JP2018/003457 2017-02-03 2018-02-01 Relative position detection system and image display system WO2018143360A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2018566093A JPWO2018143360A1 (en) 2017-02-03 2018-02-01 Relative position detection system and image display system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017019140 2017-02-03
JP2017-019140 2017-02-03

Publications (1)

Publication Number Publication Date
WO2018143360A1 true WO2018143360A1 (en) 2018-08-09

Family

ID=63040828

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/003457 WO2018143360A1 (en) 2017-02-03 2018-02-01 Relative position detection system and image display system

Country Status (2)

Country Link
JP (1) JPWO2018143360A1 (en)
WO (1) WO2018143360A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020047235A (en) * 2018-09-20 2020-03-26 未來市股▲ふん▼有限公司 Tracking method and tracking system employing the same
JP2020047239A (en) * 2018-09-19 2020-03-26 未來市股▲ふん▼有限公司 Tracking system and tracking method
WO2023100012A1 (en) * 2021-11-30 2023-06-08 株式会社半導体エネルギー研究所 Display system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080120031A1 (en) * 2006-11-16 2008-05-22 Daniel Rosenfeld Tracking method
JP2011237987A (en) * 2010-05-10 2011-11-24 Olympus Corp Operation input device and manipulator system
WO2014203592A1 (en) * 2013-06-17 2014-12-24 ソニー株式会社 Image processing device, image processing method, and program
JP2015176186A (en) * 2014-03-13 2015-10-05 ソニー株式会社 Information processing apparatus, information processing method and information processing system
JP2015176588A (en) * 2014-03-18 2015-10-05 株式会社東芝 Display device, image display system and information processing method
JP2016026418A (en) * 2009-11-30 2016-02-12 パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America Communication device
JP2017003540A (en) * 2015-06-16 2017-01-05 多摩川精機株式会社 Load monitoring system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080120031A1 (en) * 2006-11-16 2008-05-22 Daniel Rosenfeld Tracking method
JP2016026418A (en) * 2009-11-30 2016-02-12 パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America Communication device
JP2011237987A (en) * 2010-05-10 2011-11-24 Olympus Corp Operation input device and manipulator system
WO2014203592A1 (en) * 2013-06-17 2014-12-24 ソニー株式会社 Image processing device, image processing method, and program
JP2015176186A (en) * 2014-03-13 2015-10-05 ソニー株式会社 Information processing apparatus, information processing method and information processing system
JP2015176588A (en) * 2014-03-18 2015-10-05 株式会社東芝 Display device, image display system and information processing method
JP2017003540A (en) * 2015-06-16 2017-01-05 多摩川精機株式会社 Load monitoring system

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020047239A (en) * 2018-09-19 2020-03-26 未來市股▲ふん▼有限公司 Tracking system and tracking method
US10817047B2 (en) 2018-09-19 2020-10-27 XRSpace CO., LTD. Tracking system and tacking method using the same
JP2020047235A (en) * 2018-09-20 2020-03-26 未來市股▲ふん▼有限公司 Tracking method and tracking system employing the same
WO2023100012A1 (en) * 2021-11-30 2023-06-08 株式会社半導体エネルギー研究所 Display system

Also Published As

Publication number Publication date
JPWO2018143360A1 (en) 2019-12-26

Similar Documents

Publication Publication Date Title
US9311883B2 (en) Recalibration of a flexible mixed reality device
CN109166150B (en) Pose acquisition method and device storage medium
JP6398472B2 (en) Image display system, image display apparatus, image display method, and program
CN114170349A (en) Image generation method, device, electronic device and storage medium
WO2018143360A1 (en) Relative position detection system and image display system
CN111263037B (en) Image processing device, imaging device, video playback system, method, and program
US12075168B2 (en) Portable device
CN107560637B (en) Method for verifying calibration result of head-mounted display device and head-mounted display device
CN108196701B (en) Method and device for determining posture and VR equipment
JP6220992B2 (en) Imaging apparatus and image blur correction method
JP5514062B2 (en) Electronic device, imaging screen display method with information, and program
JP4946914B2 (en) Camera system
CN110443841B (en) Method, device and system for measuring ground depth
CN210716984U (en) Pipeline detection device
JP2015049446A (en) Imaging device
CN112050088A (en) Pipeline detection method and device and computer storage medium
JP6999052B2 (en) Mobile devices and video display methods
KR101583256B1 (en) Image output method using wearable multiple camera system and wearable multiple camera system
JP7169422B2 (en) Portable device and display control method
CN112150554B (en) Picture display method, device, terminal and storage medium
JP2018129720A (en) Photographing apparatus, photographing method and program
KR100711205B1 (en) Biomimetic Visual Processing Device Using Inclinometer
JP2020136850A (en) Imaging apparatus, imaging method, program, and imaging system
JP2014236319A (en) Imaging apparatus, control method therefor and program
JP5822579B2 (en) Orientation acquisition apparatus, control method of orientation acquisition apparatus, and program thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18747105

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2018566093

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18747105

Country of ref document: EP

Kind code of ref document: A1

点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载