WO2015098253A1

WO2015098253A1 - Electronic device

Info

Publication number: WO2015098253A1
Application number: PCT/JP2014/077616
Authority: WO
Inventors: 志賀啓; 内山洋治; 伊三木一皇; 有馬由桂; 降矢雄飛; 関口政一; 關口直樹; 村越雄
Original assignee: 株式会社ニコン
Priority date: 2013-12-26
Filing date: 2014-10-16
Publication date: 2015-07-02

Abstract

An electronic device equipped with a first input unit (18) into which an authentication result for a first part of a user is input, a second input unit (16) into which an authentication result for a second part of the user is input, and a generation unit (17) that, on the basis of the input information from the first and second input units, generates setting information related to a user operation.

Description

Electronics

The present invention relates to an electronic device.

In recent years, information terminals (wearable terminals) that can be worn such as glasses and wristwatches have appeared (see, for example, Patent Document 1).

US Published Patent 2013/0044042

However, in Patent Document 1 and the like, it cannot be said that sufficient consideration has been given to the point of increasing the security of the wearable terminal or the point of increasing the security of other devices using the wearable terminal.

The present invention has been made in view of the above-described problems, and an object thereof is to provide an electronic device capable of improving security.

The electronic device of the present invention includes a first input unit that inputs an authentication result of the first part of the user, a second input unit that inputs an authentication result of the second part of the user, and the first and second input units. And a generating unit that generates setting information related to the user's operation based on the input information.

In this case, a transmission unit that transmits the setting information to an external device may be provided. Further, the transmission unit may transmit the setting information by proximity communication or human body communication via the user.

The electronic apparatus of the present invention may further include a setting unit that performs settings related to the user's operation using the setting information. In this case, the setting unit may set a restriction on the user's operation based on the input results of the first and second input units.

In the electronic device of the present invention, the first input unit may input an authentication result related to the user's eyes. The second input unit may input an authentication result related to the user's hand. Moreover, you may provide the mounting part for mounting | wearing the said user's face vicinity.

The electronic device of the present invention includes an input unit that inputs an authentication result of a part of the user's body, and a transmission unit that transmits input information of the input unit to an external device through human body communication. In this case, when the transmission unit cannot transmit the input information to the external device, a generation unit is provided that generates setting information related to the user operation based on the authentication result input by the input unit. May be.

The electronic apparatus according to the present invention includes a storage unit that stores information, an imaging unit that performs imaging, a determination unit that determines whether the imaging unit captures information related to information stored in the storage unit, and the determination A notification unit that notifies the user according to the determination result of the unit.

In this case, information captured using the imaging unit may be stored in the storage unit. Further, the storage unit stores text data, and the determination unit performs determination based on text data generated based on imaging data captured by the imaging unit and text data stored in the storage unit. It is good. Moreover, you may provide the transmission part which transmits the determination result of the said determination part to an external apparatus. In this case, the transmission unit may transmit the information by proximity communication or human body communication via the user.

The electronic apparatus according to the present invention includes an imaging unit that captures an image regarding character information, a determination unit that determines whether the character information captured by the imaging unit is in communication with an external device, and a determination result of the determination unit And a notification unit for reporting to the user.

The electronic device of the present invention includes an input unit that inputs an authentication result related to the user's eyes, and a generation unit that generates setting information related to the user's operation based on the input information of the input unit. In this case, the generation unit may limit the setting information based on an authentication result input by the input unit.

The electronic device of the present invention includes an input unit that inputs an authentication result related to the user's eyes, and a transmission unit that transmits input information of the input unit to an external device through human body communication. In this case, the transmission unit may transmit information related to use restriction of the external device by the user.

The electronic device of the present invention has an effect that security can be improved.

It is a figure which shows the structure of the electronic device system which concerns on 1st Embodiment. It is a figure which shows the use condition of an electronic device system. It is a perspective view of a spectacles type device. It is a flowchart which shows an example of the authentication instruction | indication transmission process by PC. It is a flowchart which shows an example of a process of a spectacles type device. It is a flowchart which shows an example of a process of a wristwatch type | mold apparatus. It is a flowchart which shows an example of the use restriction information utilization process by PC. FIG. 8A is a diagram showing an example of a user authentication table stored in the storage unit of the eyeglass-type device, and FIG. 8B is a user authentication table stored in the storage unit of the wristwatch-type device. It is a figure which shows an example. It is a figure which shows the structure of the electronic device system which concerns on 2nd Embodiment. It is a flowchart which shows an example of the process of the spectacles type apparatus which concerns on 2nd Embodiment. FIG. 11A and FIG. 11B are diagrams for explaining the processing in step S76 in FIG.

<< First Embodiment >>
Hereinafter, the electronic device system according to the first embodiment will be described in detail with reference to FIGS. 1 to 8B. FIG. 1 is a block diagram showing the configuration of an electronic device system 100 according to the first embodiment.

As shown in FIG. 1, the electronic device system 100 includes (utilizes) a glasses-type device 10, a wristwatch-type device 30, and a PC (Personal Computer) 20. As shown in FIG. 2, the eyeglass-type device 10 is a wearable terminal worn by a user on the face. The wristwatch-type device 30 is a wearable terminal that a user wears on his / her arm. In this embodiment, the user can use the PC 20 without wearing one or both of the eyeglass-type device 10 and the wristwatch-type device 30, but one of the eyeglass-type device 10 and the wristwatch-type device 30 or If both are not installed, use of the website is restricted, and information that can be viewed on the PC 20 is restricted.

(Glasses type device 10)
As shown in FIG. 1, the eyeglass-type device 10 includes an imaging unit 11, a display unit 12, an operation unit 13, a microphone 14, a storage unit 15, a communication unit 16, a retina information acquisition unit 18, an authentication unit 19, a control unit 17, and the like. Is provided. In FIG. 3, the eyeglass-type device 10 is shown in a perspective view. As shown in FIG. 3, the spectacle-type device 10 includes a spectacle-type frame 110. The configuration of the eyeglass-type device 10 illustrated in FIG. 1 and not illustrated in FIG. 3 is provided inside the frame 110 or a part of the frame 110.

The imaging unit 11 includes a lens, an imaging device, an image processing unit, and the like, and captures still images and moving images. As shown in FIG. 3, the imaging unit 11 is provided near the end of the frame 110 (near the user's right eye). For this reason, when the user wears the glasses-type device 10 (the state shown in FIG. 2), it is possible to capture an image in the direction in which the user is facing (looking at).

The display unit 12 includes a projector provided in or near the frame 110, and a prism for guiding a projection image from the projector to the eyes of the user. The display unit 12 displays various information under the instruction of the control unit 17.

The operation unit 13 is a touch pad provided on the frame 110, detects the movement of the user's finger, receives an operation from the user, and transmits the received operation information to the control unit 17.

The details of the imaging unit 11, the display unit 12, and the operation unit 13 are also disclosed in, for example, US Published Patent No. 2013/0044042.

The microphone 14 is provided in the frame 110 and collects voices uttered by the user and voices around the user. The voice collected by the microphone 14 is voice-recognized by a voice recognition unit (not shown), and the voice recognition result is transmitted to the control unit 17. The control unit 17 executes processing based on the voice recognition result (for example, command execution processing). The control unit 17 may perform voice recognition.

The storage unit 15 is a non-volatile semiconductor memory such as a flash memory, for example, image data captured by the imaging unit 11, data used for authentication of the authentication unit 19 (see the user authentication table in FIG. 8A), The display data to be displayed on the display unit 12 and various programs are stored.

The communication unit 16 performs human body communication with other devices. The communication unit 16 includes an electrode unit 16a that is provided on the frame 110 and can contact a user, and a human body communication unit 16b that performs human body communication using the electrode unit 16a. Human body communication includes a current system in which a weak current is passed through the human body and the current is modulated to transmit information, and an electric field system in which information is transmitted by modulating an electric field induced on the surface of the human body. . In this embodiment, it is possible to use either the current method or the electric field method. Note that human body communication is possible not only when the user directly contacts the electrode portion 16a of the eyeglass-type device 10 but also when the electrode portion 16a and the user are not in direct contact. In the present embodiment, the communication unit 16 communicates with the wristwatch type device 30 and the PC 20. Note that the communication unit 16 may perform near field communication such as Bluetooth (registered trademark), RFID (Radio Frequency Identification), Transfer Jet (registered trademark), or the like with other devices.

The retina information acquisition unit 18 includes an infrared irradiation unit and an infrared light receiving unit. The retinal information acquisition unit 18 detects (scans) the path of blood vessels on the retina by irradiating the eyeball with infrared rays from the infrared irradiation unit and receiving the infrared rays reflected by the eyeballs with the infrared light reception unit. Then, the retinal information acquisition unit 18 outputs the detection result to the control unit 17. The retinal information acquisition unit 18 is provided on the back side (face side) of the imaging unit 11 in FIG. 2 as an example.

The authentication unit 19 executes user authentication using the information of the user's retina acquired by the retina information acquisition unit 18. Specifically, the authentication unit 19 uses the retina pattern (m123456.jpg) of the authorized user (user ID = 123456) whose acquired user retina information is registered in the user authentication table shown in FIG. The user authentication is performed by determining whether or not it matches.

The control unit 17 comprehensively controls the entire eyeglass-type device 10. The control unit 17 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. In the present embodiment, the control unit 17 performs control of the imaging unit 11 and the retinal information acquisition unit 18, control of the authentication unit 19 and the display unit 12, and the like.

(Watch type device 30)
As shown in FIG. 1, the wristwatch type device 30 includes a display unit 31, an operation unit 32, a vein information acquisition unit 33, a storage unit 34, an authentication unit 35, a communication unit 36, a control unit 37, and the like.

The display unit 31 includes an organic EL (Electro-Luminescence) display, a liquid crystal display, and the like, and displays various types of information under instructions from the control unit 37. The operation unit 32 includes a touch panel, buttons, and the like, receives user operations, and transmits them to the control unit 37.

The vein information acquisition unit 33 is provided at a position where the user can face the wrist of the user in a state where the user wears the wristwatch type device 30 (the state shown in FIG. 2). The vein information acquisition unit 33 includes an infrared irradiation unit and an infrared light reception unit. The vein information acquisition unit 33 detects (scans) the shape of the vein by irradiating the wrist with infrared rays from the infrared irradiation unit and receiving infrared rays reflected by the veins on the wrist with the infrared light reception unit. The vein information acquisition unit 33 outputs the detection result to the control unit 37.

The storage unit 34 is a non-volatile semiconductor memory such as a flash memory, for example, data used for authentication of the authentication unit 35 (see the user authentication table in FIG. 8B), display data displayed on the display unit 31, And various programs are stored.

The authentication unit 35 performs user authentication using information on the veins of the user's arm acquired by the vein information acquisition unit 33. Specifically, the authentication unit 35 uses the vein pattern (j123456.jpg) of the regular user (user ID = 123456) registered in the user authentication table shown in FIG. The user authentication is performed by determining whether or not it matches.

The communication unit 36 performs human body communication with other devices. Note that the communication unit 36 may perform near field communication with other devices. In the present embodiment, the communication unit 36 communicates with the communication unit 16 of the eyeglass-type device 10 and the first communication unit 24 of the PC 20 using human body communication. Here, the communication unit 36 includes an electrode unit 24a that can be in contact with the user's arm, and a human body communication unit 24b that performs human body communication via the electrode unit 24a. . The communication unit 36 performs human body communication with the communication unit 16 of the glasses-type device 10 described above.

The control unit 37 includes a CPU, a RAM, a ROM, and the like, and comprehensively controls the wristwatch type device 30 as a whole.

(PC20)
As shown in FIG. 1, the PC 20 includes a display unit 21, an operation unit 22, a storage unit 23, a first communication unit 24, a second communication unit 25, a control unit 26, and the like. The PC 20 may be a desktop PC as shown in FIG. 3, or may be a notebook PC, a tablet terminal, or a smartphone.

The display unit 21 includes a liquid crystal display or the like and displays various information. The operation unit 22 includes a keyboard, a mouse, and the like, receives input from the user, and transmits the input to the control unit 26. The storage unit 23 includes an HDD (Hard Disk Drive) and the like, and stores various types of information.

The first communication unit 24 performs human body communication with other devices. Note that the first communication unit 24 may perform near field communication with other devices. In the present embodiment, the first communication unit 24 communicates with the communication unit 16 of the eyeglass-type device 10 and the communication unit 36 of the wristwatch-type device 30 using human body communication. The first communication unit 24 is provided in, for example, a part of the operation unit 22 (keyboard), an electrode unit 24a that can be in contact with a user's hand or arm, and a human body communication unit 24b that performs human body communication via the electrode unit 24a. Have.

The second communication unit 25 communicates with other devices wirelessly or by wire. For example, the second communication unit 25 communicates with a web server (not shown) using the Internet or the like.

The control unit 26 includes a CPU, a RAM, a ROM, and the like, and controls the entire PC 20. In the present embodiment, the control unit 26 controls information communication with the eyeglass-type device 10 and the wristwatch-type device 30. In addition, the control unit 26 exchanges information with a Web server or the like to display a Web site on the display unit 21 or perform various information processing.

Next, processing of each device of the electronic device system 100 will be described. As a premise of processing of electronic device system 100, it is assumed that PC 20 and specific spectacle-type device 10 are paired, and PC 20 and specific watch-type device 30 are paired. In the present embodiment, the pairing is a state in which cooperative processing between a plurality of devices can be executed. Further, when the power supply of one device is off, the power supply of the device that is turned off may be turned on by establishing human body communication or proximity communication with the other device. In the present embodiment, it is assumed that human body communication can be performed between paired devices.

(Authentication instruction transmission processing by PC 20)
FIG. 4 is a flowchart illustrating an example of authentication instruction transmission processing by the PC 20. The process of FIG. 4 is a process executed while the PC 20 is powered on. In the process of FIG. 4, in step S10, the control unit 26 determines whether or not use restriction information is necessary. Here, the use restriction information is necessary when making a transfer at a bank (net banking) site, when making a credit card payment, or when viewing a document file with a set sensitivity. For example, when the user intends to perform transfer at a net banking site, the determination in step S10 is affirmed and the process proceeds to step S12. On the other hand, while the determination in step S10 is negative, step S10 is repeated at predetermined time intervals.

When the determination in step S10 is affirmed and the process proceeds to step S12, the control unit 26 transmits an authentication instruction to the paired glasses-type device 10 and the wristwatch-type device 30. After the process of step S12 is performed, the process returns to step S10.

(Processing by the glasses-type device 10)
FIG. 5 is a flowchart illustrating an example of processing performed by the glasses-type device 10. The process of FIG. 5 is a process executed while the glasses-type device 10 is powered on. In the process of FIG. 5, in step S 20, the control unit 17 stands by until an authentication instruction is received from the PC 20. In this case, the process proceeds to step S22 at the timing when the process of step S12 of FIG. 4 described above is performed.

In step S22, the control unit 17 instructs the retinal information acquisition unit 18 to acquire the user's retinal information.

Next, in step S24, the control unit 17 instructs the authentication unit 19 to execute user authentication of the eyeglass-type device 10 using the acquired retina information. In this case, the authentication unit 19 performs user authentication with reference to the user authentication table (FIG. 8A) stored in the storage unit 15.

Next, in step S26, the control unit 17 determines whether an authentication result has been input from the wristwatch type device 30 or not. The case where the determination in step S26 is negative is a case where the user does not wear the wristwatch type device 30. If the determination is negative, the process proceeds to step S28. If the determination is positive, the process proceeds to step S30. If transfering it to step S28, the control part 17 will determine with the wristwatch type | mold apparatus 30 having failed user authentication. Thereafter, the process proceeds to step S30.

In step S30, the control unit 17 determines whether or not the user authentication result of the eyeglass device 10 matches the user authentication result of the user of the wristwatch device 30. When the determination here is affirmed, the process proceeds to step S32, and the control unit 17 generates use restriction information (none). The usage restriction information (none) is information indicating that the user can make a transfer or the like on the net banking site without restriction on the amount of money, or information indicating that there is no restriction on the amount of money used in credit card payment. Or information indicating that the user can use the document file with the confidentiality set without limitation. After step S32, the process proceeds to step S40, and the control unit 17 transmits use restriction information (none) to the PC 20 via the communication unit 16, and ends the process of FIG.

On the other hand, if the determination in step S30 is negative, that is, if the user authentication results do not match, the process proceeds to step S34. If transfering it to step S34, the control part 17 will judge whether user authentication of any one of the spectacles type apparatus 10 and the wristwatch type apparatus 30 failed.

If the determination in step S34 is affirmative, that is, if user authentication of either the eyeglass-type device 10 or the wristwatch-type device 30 is successful, the process proceeds to step S36, and the control unit 17 uses the usage restriction information ( (Partially limited). Usage restriction information (partial restriction) is information indicating that the user can make transfers, etc. under a certain amount of restrictions on the Internet banking site, and there are restrictions on the amount of money used in credit card payments. This is information indicating that a restriction is provided as compared to the case where there is not, and information indicating that a user can use a document file in which confidentiality is set under a predetermined restriction. After step S36, the control unit 17 transmits use restriction information (partial restriction) to the PC 20 via the communication unit 16 in step S40, and the whole process of FIG.

On the other hand, if the determination in step S34 is negative, that is, if user authentication has failed in both the eyeglass-type device 10 and the wristwatch-type device 30, the process proceeds to step S38, and the control unit 17 uses the use restriction. Generate information (all restrictions). In addition, usage restriction information (all restrictions) is information indicating that the user cannot perform transfers on the Internet banking site, information indicating that credit card payments cannot be made at all, and confidentiality settings. This is information indicating that the user cannot use the document file. After step S38, the control unit 17 transmits use restriction information (all restrictions) to the PC 20 via the communication unit 16 in step S40, and the whole process of FIG.

(Processing by the watch-type device 30)
FIG. 6 is a flowchart illustrating an example of processing by the wristwatch type device 30. The process of FIG. 6 is a process executed while the wristwatch type device 30 is powered on. In the process of FIG. 6, in step S 50, the control unit 37 stands by until an authentication instruction is received from the PC 20. In this case, at the timing when step S12 of FIG. 5 is performed in the PC 20, the control unit 37 proceeds to step S52.

In step S52, the control unit 37 issues an instruction to the vein information acquisition unit 33 to acquire the vein information of the user.

Next, in step S54, the control unit 37 instructs the authentication unit 35 to execute user authentication using the acquired user vein information. In this case, the authentication unit 35 performs user authentication with reference to the user authentication table (FIG. 8B) stored in the storage unit 34.

Next, in step S56, the control unit 37 transmits the authentication result of step S54 to the glasses-type device 10 via the communication unit 36. In addition, the control part 37 transmits the information of authentication success or authentication failure to the spectacles type apparatus 10 as an authentication result.

Next, in step S58, the control unit 37 determines whether or not the authentication result has been transmitted to the glasses-type device 10. If the determination here is affirmed, all the processes in FIG. 6 are terminated. When the authentication result can be transmitted, all the processes in FIG. 6 are terminated by the process using the authentication result (S30 to S40 in FIG. 5) in the glasses-type device 10 as described above. Because.

On the other hand, if the determination in step S58 is negative, that is, if the authentication result cannot be transmitted because the human body communication with the eyeglass-type device 10 is not established, the control unit 37 proceeds to step S60. To do.

When the process proceeds to step S60, the control unit 37 determines whether or not the user authentication is successful in the process of step S54. When the determination in step S60 is affirmed, the process proceeds to step S62, and the control unit 37 generates use restriction information (partial restriction). After step S62, the control unit 37 transmits use restriction information (partial restriction) to the PC 20 via the communication unit 36 in step S66, and the whole process of FIG.

On the other hand, if the determination in step S60 is negative, that is, if user authentication fails, the process proceeds to step S64. In addition, the case where it transfers to step S64 means the case where the user authentication in the spectacles type apparatus 10 is not performed, and the user authentication fails in the wristwatch type apparatus 30. For this reason, in step S64, the control unit 37 generates use restriction information (all restrictions). And the control part 37 transmits use restriction information (all restrictions) to PC20 via the communication part 36 in step S66, and complete | finishes all the processes of FIG.

(Use restriction information use processing by PC 20)
FIG. 7 is a flowchart illustrating an example of usage restriction information utilization processing by the PC 20. In the process of FIG. 7, in step S 14, the control unit 26 stands by until receiving use restriction information. That is, the control unit 26 proceeds to step S16 at the timing when step S40 of FIG. 5 is executed in the eyeglass-type device 10 or when step S66 of FIG. 6 is executed in the wristwatch-type device 30.

When the process proceeds to step S16, the control unit 26 executes a process based on the use restriction information. For example, when the use restriction information (none) is received when the user accesses the net banking site, the control unit 26 transmits the use restriction information (none) to the server that manages the net banking site. To do. In this case, the server removes the restriction on the usage amount of the user based on the usage restriction information (none). As a result, the user can make a transfer or the like on the net banking site without any amount limitation. In addition, when the use restriction information (partial restriction) is received when the user accesses the net banking site, the control unit 26 uses the use restriction information (partial restriction) to the server that manages the net banking site. Limit). In this case, the server sets a limit on the usage amount of the user based on the usage restriction information (partial restriction). As a result, the user can make a transfer or the like at a net banking site under a predetermined amount limit. Further, when the use restriction information (all restrictions) is received when the user accesses the net banking site, the control unit 26 uses the use restriction information (all restrictions) for the server that manages the net banking site. Send. In this case, the server prohibits the use of the user based on the use restriction information (all restrictions). As a result, the user cannot perform transfer or the like on the net banking site. Note that the same processing as described above is performed at the time of credit card settlement.

Further, for example, when the use restriction information (none) is received when the user accesses the document file in which the confidentiality is set, the control unit 26 permits the user to access the document file. In addition, when the use restriction information (partial restriction) is received when the user accesses the document file in which the confidentiality is set, the control unit 26 determines whether the confidentiality level (level) set in the document file is high. ) To allow the user access to the document file. Further, when the use restriction information (all restrictions) is received when the user accesses the document file with the confidentiality set, the control unit 26 accesses the document file with the confidentiality set from the user. Is prohibited.

As described above, in the first embodiment, the control unit 17 of the eyeglass-type device 10 performs the user authentication based on the user authentication result using the user's retina and the user authentication result using the user's vein. Setting information (usage restriction information) related to the operation is generated (S32, S36, S38). Accordingly, it is possible to generate appropriate use restriction information based on two user authentication results, and it is possible to improve the security of the apparatus by using the appropriate use restriction information.

In the first embodiment, the eyeglass-type device 10 includes the communication unit 16 that transmits setting information (usage restriction information) to the PC 20. It is possible to appropriately perform based on the result. For example, when a user who is not an authorized user who uses the PC 20 wears at least one of the eyeglass-type device 10 and the wristwatch-type device 30, the use can be restricted. For example, even if the user who uses the PC 20 is a regular user, use restriction is imposed unless at least one of the eyeglass-type device 10 and the wristwatch-type device 30 is worn. Thus, in this embodiment, if a legitimate user who uses the PC 20 does not wear both the eyeglass-type device 10 and the wristwatch-type device 30, usage restrictions are imposed, and thus security can be improved. For this reason, it is possible to prevent a person who has obtained a personal identification number of the user's account and impersonated the user from stealing a deposit from the user's account.

In the first embodiment, the communication unit 16 of the eyeglass-type device 10 transmits use restriction information to the PC 20 by human body communication or proximity communication, so that the control unit 17 is a user in the vicinity of the PC 20. That is, user authentication information of a user who is likely to actually use the PC 20 can be acquired.

In the present embodiment, the control unit 37 of the wristwatch-type device 30 acquires an authentication result of a part of the user's body (arm vein) and transmits it to the eyeglass-type device 10 by human body communication via the communication unit 36. To do. Thereby, user authentication results can be exchanged between wearing devices.

In the first embodiment, the spectacle-type device 10 and the wristwatch-type device 30 have been described as generating use restriction information for performing user operation settings on the PC 20 based on two user authentication results. It is not limited to. For example, the eyeglass-type device 10 or the wristwatch-type device 30 may generate use restriction information for performing user operation settings in the eyeglass-type device 10 or the wristwatch-type device 30. Thereby, the security in the glasses-type device 10 and the wristwatch-type device 30 can be improved.

In the first embodiment, the user authentication in the eyeglass-type device 10 is performed using the retina information. However, the present invention is not limited to this, and iris information may be used in the authentication related to the user's eyes. . Note that iris authentication is disclosed, for example, in Japanese Patent Application Laid-Open No. 2013-148961 (Patent No. 5360931). In the first embodiment, user authentication in the wristwatch-type device 30 is performed using vein information. However, the present invention is not limited to this, and fingerprint information may be used in authentication related to a user's hand. . Further, the user authentication method is not limited to eyes and hands, and authentication using other parts of the user may be employed.

In the first embodiment, the user authentication process using the eyeglass-type device 10 and the wristwatch-type device 30 may be executed when the user views the display unit 21 of the PC 20. In this case, when the control unit 17 recognizes from the captured image that the screen of the display unit 21 has been captured by the imaging unit 11, the control unit 17 starts the processing of FIG. The control unit 37 of the device 30 may be notified. And the control part 37 of the wristwatch type | mold apparatus 30 should just perform the process of FIG. 6 at the timing which notified. The control unit 17 displays whether or not the screen of the display unit 21 has been captured by the imaging unit 11, whether or not the characteristic portion of the display unit 21 is included in the captured image, or is displayed on the screen of the display unit 21. Judgment may be made based on whether or not a characteristic portion of the image is included.

In the first embodiment, the case where the wristwatch-type device 30 transmits the user authentication result to the eyeglass-type device 10 (S56) has been described. However, the present invention is not limited to this. For example, the eyeglass-type device 10 may transmit a user authentication result to the wristwatch-type device 30.

In the first embodiment, the case where the use restriction information generated based on the user authentication result of the eyeglass-type device 10 and the user authentication result of the wristwatch-type device 30 is transmitted to the PC 20 has been described. It is not limited. For example, the user authentication result of the eyeglass-type device 10 and the user authentication result of the wristwatch-type device 30 may be transmitted to the PC 20. In this case, the control unit 26 of the PC 20 may generate usage restriction information based on both user authentication results.

In the first embodiment, the eyeglass-type device 10 and the wristwatch-type device 30 are adopted as devices worn by a person. However, the present invention is not limited to this, and other devices such as a contact lens type terminal may be used. It may be a device to be mounted.

In the first embodiment, the case where the device that receives the use restriction information is the PC 20 has been described. However, the present invention is not limited to this. For example, other devices such as an imaging device may be used.

<< Second Embodiment >>
Next, the second embodiment will be described in detail with reference to FIGS. 9 to 11B. FIG. 9 is a block diagram showing the configuration of an electronic device system 100 ′ according to the second embodiment.

As can be seen from a comparison between FIG. 9 and FIG. 1, in the electronic device system 100 ′ of the second embodiment, the eyeglass-type device 10 includes an image recognition unit 101 and an OCR (OpticalOptCharacter Recognition) unit 102. It is different from the electronic device system 100 of the first embodiment in that it is provided. Note that at least one of the image recognition unit 101 and the OCR unit 102 may be provided on the PC 20 (which may be a tablet terminal or a smartphone), and the eyeglass device 10 may receive the result by human body communication or proximity communication. .

The image recognition unit 101 extracts feature points of image data captured by the imaging unit 11 of the eyeglass-type device 10 using, for example, a feature amount detection algorithm such as SURF (Speeded Up Up Robust Features) or SIFT (Scale Invariant Feature Up Transform) and stores the feature points. The image is compared with the image stored in the unit 15. In the present embodiment, for example, an image of a website displayed on the display unit 21 of the PC 20 browsed by the user (captured by the imaging unit 11) and a Web browsed in the past (captured by the imaging unit 11 in the past). Compare the images on the site (viewed images).

The OCR unit 102 recognizes characters included in the image data captured by the imaging unit 11 of the glasses-type device 10 and converts them into text data. In the present embodiment, as an example, a URL included in an image of a website imaged by the imaging unit 11 is recognized and converted into text data.

Next, phishing countermeasure processing by the eyeglass-type device 10 of the second embodiment will be described in detail along the flowchart of FIG. 10 with reference to other drawings as appropriate.

The process of FIG. 10 is a process executed when the user instructs execution of a phishing countermeasure process through the operation unit 13. In the process of FIG. 10, in step S 70, the control unit 17 acquires a captured image of the imaging unit 11. Note that the imaging unit 11 captures still images at predetermined time intervals.

Next, in step S72, the control unit 17 issues an instruction to the image recognition unit 101, and determines whether or not the user has viewed the browser on the display unit 21 based on the captured image of the imaging unit 11. In this case, the image recognition unit 101 refers to, for example, the captured image and determines whether the mark attached to the upper left corner of the window (“*” mark in FIG. 11A) is a browser-specific mark. If the mark is unique to the browser, it is determined that the user has viewed the browser.

If the determination in step S72 is negative, the process returns to step S70, but if the determination is positive, the process proceeds to step S74.

When the process proceeds to step S74, the control unit 17 temporarily stores the captured image. Next, in step S 76, the control unit 17 issues an instruction to the image recognition unit 101, and compares the captured image with a past browsing image stored in the storage unit 15. For example, it is assumed that the image captured by the imaging unit 11 this time is the image illustrated in FIG. In this case, the image recognition unit 101 compares the image shown in FIG. 11A with the past browsing images stored in the storage unit 15, and calculates the similarity with each browsing image.

Next, in step S78, the control unit 17 determines whether there is a browse image having a similarity equal to or greater than a threshold value. As the threshold value, for example, a numerical value such as 80% to 90% can be adopted. If the determination in step S78 is negative, that is, if there is no browse image with a similarity equal to or greater than the threshold, the process proceeds to step S80, and the control unit 17 converts the captured image stored temporarily into the past browse image. Is stored in the storage unit 15. Thereafter, the process returns to step S70.

In addition, the image captured this time shown in FIG. 11A has a similarity with a past browsing image as shown in FIG. 11B (an image when browsing the website of “Internet bank”) or more than a threshold value. Suppose that In this case, the determination in step S78 is positive, and the control unit 17 proceeds to step S82.

In step S82, the control unit 17 uses the OCR unit 102 to compare the URL included in the captured image with the URL of the browsing image. It is assumed that the control unit 17 recognizes where the URL of the Web site is written in the browser. Therefore, the control unit 17 extracts the range in which the URL is described from the captured image and the browse image, and causes the OCR unit 102 to convert the text. Then, the control unit 17 compares the URLs converted into text. Note that the control unit 17 may compare the images in the URL portion using the image recognition unit 101.

Next, in step S84, the control unit 17 determines whether or not the URLs are the same as a result of comparing the text URLs. In the case of FIG. 11A and FIG. 11B, since the URLs are different in the portions “.net” and “.jp”, the determination in step S84 is denied and the process proceeds to step S86. When the captured image and the past browsing image are similar, but the URL is different, the Web site included in the captured image (the Web site being browsed by the user) is a Web aimed at phishing It may be a site.

When the process proceeds to step S86, the control unit 17 issues a warning using the display unit 12. For example, the control unit 17 displays “This site may be a phishing site” on the display unit 12. In addition, the control part 17 is good also as issuing a warning using a speaker not shown. Alternatively, the control unit 17 may transmit the warning information to the control unit 26 of the PC 20 or the control unit 37 of the wristwatch type device 30. Thereby, the control part 26 and the control part 37 can issue a warning using the display part 21 of PC20, the display part 31 of the wristwatch-type apparatus 30, etc. FIG. In the case where the glasses-type device 10 or the wristwatch-type device 30 has a vibration part (vibrator), a warning may be issued by vibrating the vibration part. After the process of step S86 is performed, the process returns to step S70.

On the other hand, if the determination in step S84 is affirmative, that is, if the result of comparing the URLs is the same, the process returns to step S70 without passing through step S86.

As described above, according to the second embodiment, the control unit 17 includes the URL included in the captured image captured by the imaging unit 11 and the URL included in the past browsing image stored in the storage unit 15. And whether or not the imaging unit 11 has captured information related to the past browsing image (whether the Web site viewed by the user and the Web site included in the past browsing image are the same) is determined. The user is warned according to the determination result. Thereby, it is possible to prevent the user from accessing a fake website (such as a phishing scam site) similar to a website browsed in the past at first glance.

In the second embodiment, the control unit 17 appropriately stores the captured image captured using the imaging unit 11 in the storage unit 15 (S80). Thereby, it becomes possible to add the captured image used as the past browsing image to the memory | storage part 15. FIG.

In the second embodiment, the control unit 17 transmits to the PC 20 a determination result as to whether or not the Web site viewed by the user is the same as the Web site included in the past browsing image, and the PC 20 To warn the user. Thereby, it is possible to display a warning in an easy-to-understand manner at an appropriate position for the user who uses the PC 20.

In the second embodiment, a case has been described in which URLs included in past browsing images are converted to text at the same timing (S82) as the text conversion of the URL included in the captured image. However, it is not limited to this. For example, the URL may be converted into text at the timing (S80) when the past browsing image is stored in the storage unit 15, and stored in the storage unit 15 in association with the past browsing image.

In the second embodiment, the case where the control unit 17 of the glasses-type device 10 performs image comparison and URL comparison has been described. However, the present invention is not limited to this. For example, the comparison of images and URLs may be performed by the PC 20, the wristwatch type device 30, or a server (cloud server) connected to the PC 20. In this case, the control unit 17 of the glasses-type device 10 may transmit the image captured by the imaging unit 11 to the PC 20, the wristwatch-type device 30, or the server as needed.

In the second embodiment, the control unit 17 of the eyeglass-type device 10 includes the URL included in the captured image captured by the imaging unit 11 and the URL included in the past browsing image stored in the storage unit 15. However, the present invention is not limited to this, but the image capturing unit 11 determines whether the information related to the past browsing image is captured. For example, the control unit 17 of the eyeglass-type device 10 communicates with a predetermined Web server or the like using the Internet or the like, searches for a URL included in the captured image captured by the imaging unit 11, and authenticates the false (false) It may be determined whether the URL is a website URL, and the determination result may be output (notified) to the user. This eliminates the need to store URLs included in past browsing images in the storage unit 15, thereby simplifying the process and reducing the amount of data stored in the storage unit 15.

In the second embodiment, instead of the eyeglass-type device 10, other mounting devices that can be mounted near the head may be employed.

Note that some of the functions of the glasses-type device 10 and the wristwatch-type device 30 may be separated. For example, as a contact lens type terminal provided with a display unit, another function may be given to a spectacle type device or a wristwatch type device.

Note that the above processing functions can be realized by a computer. In that case, a program describing the processing contents of the functions that the processing device (CPU) should have is provided. By executing the program on a computer, the above processing functions are realized on the computer. The program describing the processing contents can be recorded on a computer-readable recording medium (except for a carrier wave).

When the program is distributed, for example, it is sold in the form of a portable recording medium such as a DVD (Digital Versatile Disc) or CD-ROM (Compact Disc Read Only Memory) on which the program is recorded. It is also possible to store the program in a storage device of a server computer and transfer the program from the server computer to another computer via a network.

The computer that executes the program stores, for example, the program recorded on the portable recording medium or the program transferred from the server computer in its own storage device. Then, the computer reads the program from its own storage device and executes processing according to the program. The computer can also read the program directly from the portable recording medium and execute processing according to the program. Further, each time the program is transferred from the server computer, the computer can sequentially execute processing according to the received program.

Each embodiment mentioned above is an example of suitable implementation of the present invention, and can be combined suitably. For example, the authentication technique of the first embodiment may be combined with the phishing countermeasure technique of the second embodiment. However, the present invention is not limited to this, and various modifications can be made without departing from the scope of the present invention. It should be noted that the disclosures of publications and US patent application publications cited in the above description are incorporated herein by reference.

DESCRIPTION OF SYMBOLS 10 Glasses type apparatus 11 Imaging part 15 Storage part 16 Communication part 17 Control part 18 Retina information acquisition part 20 PC
110 frames

Claims

A first input unit for inputting an authentication result of the first part of the user;
A second input unit for inputting an authentication result of the second part of the user;
An electronic apparatus comprising: a generation unit that generates setting information related to the user operation based on input information of the first and second input units.
The electronic device according to claim 1, further comprising a transmission unit that transmits the setting information to an external device.
3. The electronic apparatus according to claim 2, wherein the transmission unit transmits the setting information by proximity communication or human body communication via the user.
The electronic apparatus according to claim 1, further comprising a setting unit configured to perform settings related to the user's operation using the setting information.
The electronic device according to claim 4, wherein the setting unit sets a restriction on the user's operation based on the input results of the first and second input units.
The electronic device according to any one of claims 1 to 5, wherein the first input unit inputs an authentication result related to the eyes of the user.
The electronic device according to any one of claims 1 to 6, wherein the second input unit inputs an authentication result regarding the user's hand.
The electronic device according to any one of claims 1 to 7, further comprising a mounting portion for mounting near the user's face.
An input unit for inputting an authentication result of a part of the user's body;
An electronic device comprising: a transmission unit that transmits input information of the input unit to an external device through human body communication.
10. The generation unit according to claim 9, further comprising: a generation unit configured to generate setting information related to the user operation based on the authentication result input by the input unit when the transmission unit cannot transmit the input information to the external device. The electronic device described.
A storage unit for storing information;
An imaging unit for imaging;
A determination unit that determines whether the imaging unit has captured information related to information stored in the storage unit;
An electronic device comprising: a notification unit that notifies a user according to a determination result of the determination unit.
The electronic device according to claim 11, wherein information captured using the imaging unit is stored in the storage unit.
The storage unit stores text data,
The electronic device according to claim 11 or 12, wherein the determination unit performs determination based on text data generated based on imaging data captured by the imaging unit and text data stored in the storage unit.
14. The electronic device according to claim 11, further comprising a transmission unit that transmits a determination result of the determination unit to an external device.
15. The electronic apparatus according to claim 14, wherein the transmission unit transmits the information by proximity communication or human body communication via the user.
An imaging unit that performs imaging related to character information;
A determination unit that determines the authenticity of the character information captured by the imaging unit by communicating with an external device;
An electronic device comprising: a notification unit that notifies a user according to a determination result of the determination unit.
An input unit for inputting an authentication result related to the user's eyes;
An electronic apparatus comprising: a generation unit that generates setting information related to the user operation based on input information of the input unit.
The electronic device according to claim 17, wherein the generation unit limits the setting information based on an authentication result input by the input unit.
An input unit for inputting an authentication result related to the user's eyes;
An electronic device comprising: a transmission unit that transmits input information of the input unit to an external device through human body communication.
The electronic device according to claim 19, wherein the transmission unit transmits information related to use restriction of the external device by the user.