KR102014410B1 - Portable secure authentication apparatus with improved security for fake fingerprints - Google Patents

Abstract

The present invention detects pulse wave or blood flow change to determine whether the finger is a forgery finger first, imparts the first light from the side of the first side, and detects the first light from the first light receiving unit on the opposite side of the first side. The second light is applied from the side of the second side to detect the second light from the second light receiving unit on the opposite side of the second side, and the detected first light and the second light are used to discriminate whether or not the second finger is a forged finger, If it is determined that the first and second is not a forgery finger, the present invention relates to a portable security authenticator with improved security against fake fingerprints for fingerprint recognition.
Portable security authenticator of the present invention is a pulse wave detection unit for detecting a pulse wave (optical volume pulse wave) signal through the pulse wave sensor unit; A photometric detection unit for detecting an optical signal emitted from the light source unit positioned at one side of the finger through a light receiving unit provided at a position facing the light source unit; A fingerprint sensor unit for detecting a fingerprint image with a fingerprint sensor; First, it is judged whether or not the forgery fingerprint by using the pulse wave signal received from the pulse wave detection unit, and if it is determined that the first is not a forgery fingerprint, and secondly by using the optical signal received from the photometric detector, And, if it is determined that the second fingerprint is not a forgery fingerprint, a fingerprint processor using the fingerprint image received from the fingerprint sensor unit.

Description

Portable secure authentication apparatus with improved security for fake fingerprints}

The present invention detects pulse wave or blood flow change to determine whether the finger is a forgery finger first, imparts the first light from the side of the first side, and detects the first light from the first light receiving unit on the opposite side of the first side. The second light is applied from the side of the second side to detect the second light from the second light receiving unit on the opposite side of the second side, and the detected first light and the second light are used to discriminate whether or not the second finger is a forged finger, If it is determined that the first and second is not a forgery finger, the present invention relates to a portable security authenticator with improved security against fake fingerprints for fingerprint recognition.

Fingerprint biometrics have been widely adopted for access control in places requiring high security levels such as laboratories. By attaching a fingerprint scanner to a mobile device, it can be utilized for mobile phone related security.

Recently, with the rapid development of information and communication infrastructures such as computers, the Internet, and mobile phones, the need for security of personal information and corporate information is urgently required. Internet banking, credit card payment, mobile payment through the Internet or mobile phones As such credit transactions are actively conducted, unique authentication means for individuals are required.

Therefore, the inventors of the present invention provide a fingerprint authentication-based security authentication device that can be conveniently used by an individual, and in particular, a bio-based device using On-Card Match (MOC) for more secure personal information security management using fingerprint information. Regarding the authentication-based portable security authentication device, Korean patent application No. 10-2015-0022976 has been filed.

Recently, the authentication processing method is a form (SOC, System On Card) that performs the entire process of fingerprint capture / feature point extraction / matching in a smart card and a part of authentication processing method (MoC, MatchingOn Card) in the terminal. Developed into.

The SOC smart card has a disadvantage of using a high performance CPU and a large memory because the fingerprint sensor and the fingerprint processing algorithm must be processed in the smart card. On the other hand, the MOC smart card processes only the matching algorithm, so there is an advantage that can be processed by commercial smart cards. The code used for card matching is implemented within 10kbytes and the size of RAM memory is less than 5kbytes, and the processing speed is less than 5 seconds.

Recently, the market for mobile financial services using smartphones is increasing. However, with the concentration of personal information on mobile devices and the use of open wireless networks, the risks of information leakage, forgery and forgery due to loss, theft, eavesdropping and eavesdropping have also increased.

In particular, a case may occur where authentication is performed using a forged fingerprint (forged finger). Silicone, vinyl, rubber, paper, OHP, spider (gelling gelatine aqueous solution, gummy) may be used as the material of the forgery fingerprint. Among them, fake fingerprints of paper, OHP, and rubber are not recognized as commercial fingerprint readers, but silicon and spider are likely to be fingerprint recognition. Spiders are relatively close to the composition of the human epidermis and allow electricity to pass through, making it difficult to detect forgery using capacitive fingerprint sensors or weak field sensors. Generally transparent.

As a prior art, there is a Korean Patent No. 10-1054314, 'Fake fingerprint detection device and method thereof'. The present invention utilizes the difference between the first optical fingerprint brightness, the second optical fingerprint brightness, and the first optical fingerprint brightness and the second optical fingerprint brightness acquired corresponding to the first light and the second light in the visible light region having different wavelengths, respectively. To determine whether a forgery fingerprint is present. That is, in the case of the present invention, the difference between the first optical fingerprint brightness and the previously stored first optical fingerprint brightness standard, or the difference between the second optical fingerprint brightness and the previously stored second optical fingerprint brightness standard, or the first optical fingerprint brightness To determine whether the fingerprint is a difference between the brightness of the second optical fingerprint and a deviation from a preset error range, and the accuracy depends on the value of the error range. Consideration should be given to the margin of error, which is not easy. Therefore, there is a fear that the accuracy is somewhat reduced.

The problem to be solved of the present invention is to detect the pulse wave or blood flow change to determine whether the first finger is a forgery finger, and to give the first light from the side of the first side, the first light from the first light receiving unit on the opposite side of the first side Detects the second light from the second light receiving unit on the opposite side of the second side by applying a second light on the side of the second side, and detects whether the second finger is a second finger using the detected first light and the second light. If it is determined whether the first and the second is not a forgery finger, it is to provide a portable security authenticator with improved security for the forged fingerprint for fingerprint recognition.

In order to solve the above problems, one embodiment of a portable security authenticator of the present invention, the pulse wave detection unit for detecting a pulse wave (optical volume pulse wave) signal through the pulse wave sensor; A photometric detection unit for detecting an optical signal emitted from the light source unit positioned at one side of the finger through a light receiving unit provided at a position facing the light source unit; A fingerprint sensor unit for detecting a fingerprint image with a fingerprint sensor; First, it is judged whether or not the forgery fingerprint by using the pulse wave signal received from the pulse wave detection unit, and if it is determined that the first is not a forgery fingerprint, and secondly by using the optical signal received from the photometric detector, If it is determined that the second fingerprint is not a forgery fingerprint, using the fingerprint image received from the fingerprint sensor to perform a fingerprint recognition, a processing unit; characterized in that it comprises a.

 Another embodiment of the portable security authenticator of the present invention, blood flow detection unit for emitting light from the blood flow detection light source unit and detecting blood vessel images of the finger with a blood flow detection camera; light emitted from the light source unit located on one side of the finger A photometric detection unit for detecting a signal through a light receiving unit provided at a position facing the light source unit; A fingerprint sensor unit for detecting a fingerprint image with a fingerprint sensor; First, it is determined whether or not the fake fingerprint by using the brightness of the blood vessel image received from the blood flow detection unit, and if it is determined that the first is not a fake fingerprint, by using the optical signal received from the photometric detector, secondly whether or not fake fingerprints And, if it is determined that the second fingerprint is not a forgery fingerprint, the arithmetic processing unit is configured to perform fingerprint recognition using the fingerprint image received from the fingerprint sensor unit.

In the first embodiment, the arithmetic processor detects a peak for a predetermined time interval and sets the pulse wave signal received from the pulse wave detector to a heart rate, and detects a subsequent interval of the heart rate signal, and compares the heart rate with a preset heart rate reference range. If the standard range is exceeded, it is considered as a fake fingerprint first.

In the second embodiment, the operation processor receives a blood vessel image received from the blood flow detector, detects a brightness of a predetermined ROI in the blood vessel image, and the brightness of the ROI of the detected blood vessel image is smaller than a preset brightness reference value. If it is a fake fingerprint.

Alternatively, the operation processor may receive two or more blood vessel images received from the blood flow detector, detect brightness of a predetermined ROI in each of the two or more blood vessel images, and preset brightness of each ROI of each detected blood vessel image. If the brightness is lower than the reference value, it is considered as a fake fingerprint.

The pulse wave sensor unit includes an infrared light emitting diode and a photo sensor.

In the first and second embodiments, the light source unit of the photometric detection unit includes a first light source unit and a second light source unit positioned at different positions, and the light receiving unit of the photometric detection unit is provided at a position facing the first light source unit. And a second light receiving unit provided at a position facing the light receiving unit and the second light source unit.

The first light source portion is located at one side of the left and right sides of the finger, and the second light source portion is positioned at the tip of the finger.

Either of the first light source portion or the second light source portion is made of an infrared light emitting diode.

The blood flow detection light source unit is made of an infrared light emitting diode, and the blood flow detection camera is a CMOS-based camera.

Any one of the first light source unit and the second light source unit may be used as the blood flow detection light source unit of the blood flow detection unit.

In addition, either the first light source unit or the second light source unit may be used as an infrared light emitting diode of the pulse wave detection unit.

The operation processor determines whether one of the first light received by the first light receiver and the second light received by the second light receiver exceeds a preset light reference value, and if so, determines that the fingerprint is a fake fingerprint.

 The first light source unit and the second light source unit are provided with light sources of different wavelengths, and the operation processor obtains a difference between the luminous intensity or the light quantity of the first light received from the first light receiving unit and the second light received from the second light receiving unit, and obtains the calculated light intensity. Alternatively, if the difference in the amount of light is smaller than the preset reference value of the standard difference, it is determined as a fake fingerprint.

The first light receiving unit and the second light receiving unit include one or more of the light receiving sensors positioned vertically with the light receiving sensors positioned horizontally.

The portable security authenticator of the present invention detects a pulse wave or blood flow change to determine whether the finger is a forged finger primarily, and gives the first light from the side of the first side to detect the first light from the light receiving unit on the opposite side of the first side. The second light is applied from the side of the second side to detect the second light from the light receiving unit on the opposite side of the second side, and the detected first light and the second light are used to discriminate whether the second finger is a forgery finger, If it is determined that the first and second are not forged fingers, fingerprint recognition is performed to improve security against fake fingerprints.

That is, the portable security authenticator of the present invention primarily checks whether or not a human finger through a pulse wave or blood flow change, and if it is recognized as a human finger, a fake fingerprint that may be missed in some cases may be silicon or spider material. There is a possibility that it is determined to be a fingerprint of a human's finger due to an error. To confirm this, the photometric is secondarily received to determine whether it is a fake fingerprint of silicon or spider material, and then a fake fingerprint of silicon or spider material is detected. If not, the fingerprint recognition is performed, thereby better recognizing the fake fingerprint, thereby increasing the security of the fake fingerprint.

1 is a configuration diagram for schematically illustrating a configuration of a portable security authenticator having improved security against a fake fingerprint of the present invention.
2 is an example of the appearance of the portable security authenticator of FIG.
3 is a schematic diagram for explaining the use of the portable security authenticator of FIG.
4 is a schematic diagram for describing a first light source unit and a first light receiving unit of the photometric detection unit of FIG. 1.
FIG. 5 is a schematic diagram for describing a second light source unit and a second light receiving unit of the photometric detection unit of FIG. 1.
6 is a schematic diagram illustrating a concept of signal detection in the fingerprint sensor of the fingerprint sensor unit of FIG. 1.
FIG. 7 is an explanatory diagram schematically illustrating driving of an arithmetic processing unit of the portable security authenticator of FIG. 1.
8 is a flowchart schematically illustrating a fingerprint recognition step in the portable security authenticator of the present invention.
9 is a flowchart for explaining a feature extraction step of FIG. 7.

 Hereinafter, a portable security authenticator having improved security for a forged fingerprint according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram for schematically illustrating a configuration of a portable security authenticator with improved security against a forged fingerprint of the present invention, Figure 2 is an example of the appearance of the portable security authenticator of Figure 1, Figure 3 1 is a schematic diagram for explaining the use of the portable security authenticator.

The portable security authenticator 10 of the present invention has a fingerprint sensor unit 150 and a MOC smart card 200 embedded inside the security authenticator housing 20, as shown in FIG. 2, the security authenticator housing 20. Through the through (window) of the), the fingerprint sensor of the fingerprint sensor 150 is made to be exposed to the outside. Forgery fingerprint detection unit 160 is provided on one side of the upper and lower fingerprint sensor unit 150. The counterfeit fingerprint detector 160 may include a pulse wave detector 170, a blood flow detector 175, and a photometry detector 180. In some cases, one of the pulse wave detector 170 and the blood flow detector 175 may be omitted.

In FIG. 2, the pulse wave sensor unit 171 is positioned in the middle of the fake fingerprint detection unit 160, and the first light source unit 181 and the second light source unit 182 of the photometric detection unit 180. The first light receiving unit 183, the second light receiving unit 184 is provided on each side of the front, rear, left and right of the counterfeit fingerprint detection unit 160, the first light source 181 and the first light receiving unit 183 is installed to face each other, The second light source 182 and the second light receiver 184 are also provided to face each other. That is, the first light source unit 181 and the first light receiving unit 183 are provided to be located on the left and right sides of the finger, the second light source unit 182 and the second light receiving unit 184 is the tip of the finger and the middle portion of the finger (of the finger First node).

The pulse wave sensor unit 171 includes a light emitting diode (for example, an infrared light emitting diode) and a photosensor, and the light emitting diode may be used by replacing one of the first light source 181 and the second light source 182.

Here, the first light source unit 181 and the second light source unit 182 may be referred to as a light source unit, and the first light receiver 183 and the second light receiver 184 may be referred to as light receivers.

Although not shown in FIG. 2, the blood flow detector 175 includes a blood flow detection light source unit and a blood flow detection camera (CMOS-based camera), and the light source unit may be replaced with one of the first light source unit 181 and the second light source unit 182. The camera may be located at an intermediate portion of the fake fingerprint detector 160.

In addition, although not shown in FIG. 2, the portable security authenticator 10 may further include a switch for starting operation.

The portable security authenticator 10 detects the pulse wave at the pulse wave detection unit 170 of the fake fingerprint detection unit 160 and detects the heartbeat signal from the pulse wave signal, so that the fake fingerprint has a heartbeat signal (that is, human being). Alternatively, the blood flow detection unit 175 of the counterfeit fingerprint detection unit 160 confirms that blood flows, and primarily checks whether the fingerprint is a fake fingerprint, and if it is determined that the first fingerprint is not a counterfeit fingerprint, the metering detection unit 180 Emits light sequentially from the first light source unit 181 and the second light source unit 182, detects the light intensity (or light quantity) of the first light receiving unit 183 and the second light receiving unit 184, and compares it with a preset light reference value. Secondly, it is determined whether it is a fake fingerprint. If it is determined that the fingerprint is not a fake fingerprint, as shown in FIG. 3, the fingerprint image is taken through the fingerprint sensor, feature information is extracted, and the MOC smart card 200 performs user authentication by comparing with previously stored user information. If the user authentication succeeds, access to the data stored in the memory unit 155 allows the predetermined data (for example, data required for authentication (password, password, etc.)) to be wired / wireless communication interface, that is, a blue pitcher communication unit ( 120), through the WiFi (Wireless-Fidelity) communication unit 130, NFC (Near Field Communication (Near Field Communication) communication unit 140, the USB connector 110, the mobile terminal 510, point of sales (POS) By transmitting to the terminal, terminal 530 of the computer, etc., the authentication is performed to perform the necessary tasks, that is, OTP, PKCS, eID, payment, etc. in the mobile terminal 510, POS terminal, terminal 530 of the computer.

As shown in FIG. 1, the portable security authenticator 10 includes an arithmetic processing unit 100, a fingerprint sensor unit 150, a MOC smart card 200, a pulse wave detection unit 170, a blood flow detector 175, and a photometry detector 180. ), A memory unit 155, a battery unit 190, a blue pitcher communication unit 120, WiFi communication unit 130, NFC communication unit 140, USB connector unit 110 is made.

The calculation processing unit 100 is a means for the overall control of the portable security authenticator 10, it may be made of a CPU. As the CPU of the arithmetic processing unit 100, an STTM STM32F4 series processor or an Atmel SAMA5 series can be used.

The operation processing unit 100 receives a pulse wave from a pulse wave sensor unit (not shown) of the pulse wave detection unit 170 and detects a peak for a predetermined time period and sets the heart rate, but detects the interval of consecutive heartbeat signals to set a predetermined heart rate reference. Compared with the range, if the heart rate standard range is exceeded, it is considered as a fake fingerprint.

The calculation processing unit 100 receives two or more images captured with a predetermined time difference from a blood flow detection camera (not shown) of the blood flow detecting unit 175, detects a brightness of a preset ROI, and detects an ROI of each image. If the brightness is less than the preset brightness threshold, it is determined to be a fake fingerprint.

If it is determined that the counterwave fingerprint is not a forgery fingerprint based on the pulse wave signal of the pulse wave detector 170 or the image of the blood flow detector 175, the operation processor 100 of the first light receiver 183 and the second light receiver 184 of the photometric detector 180 is determined. Receives the light intensity (or light quantity), and determines whether one of the light intensity (light quantity) of the light of the first light receiving unit 183 and the second light receiving unit 184 exceeds the preset light reference value, and if so, determines that the fingerprint is a fake fingerprint. .

In some cases, the first light source unit 181 and the second light source unit 182 include light sources having different wavelengths, and the arithmetic processing unit 100 includes the light intensity of the first light receiving unit 183 and the second light receiving unit 184 ( If the difference in the obtained light intensity (light quantity) is smaller than the preset light difference reference value, it is determined as a fake fingerprint.

If it is determined that the counterfeit fingerprint is not a forgery fingerprint from the photometric signal of the photometric detector 180, the operation processor 100 receives a fingerprint image through the fingerprint sensor unit 150, processes the fingerprint image to extract feature information of the fingerprint, The feature information of the extracted fingerprint is transmitted to the MOC smart card 200 and the user authentication result is received from the MOC smart card 200 to determine whether the user authentication is successful, and if the user authentication is successful, the memory unit 155 Allow access to data stored in

The fingerprint sensor unit 150 includes a fingerprint sensor, a fingerprint sensor driver, and the like.

The fingerprint sensor is a means for acquiring image information of a finger fingerprint and detects a fingerprint image and transmits the fingerprint image to the arithmetic processing unit 100. The fingerprint sensor may use a SWIPE sensor. As a sweep sensor, a CMOS sensor that recognizes 128 x 8 pixels can be used.

Generally, the fingerprint sensor is classified into a plane sensor that recognizes the entire fingerprint at once, and a SWIPE sensor that recognizes the fingerprint by moving a finger on the sensor in the form of a line sensor. The sweep sensor is inexpensive and occupies a small area. do.

The fingerprint sensor driver drives the fingerprint sensor according to the fingerprint sensing request signal of the operation processor 100 to detect the fingerprint image.

 The pulse wave detecting unit 170 is a means for detecting a light volume pulse wave (pulse wave), and includes a pulse wave sensor unit 171 and a pulse wave signal preprocessor (not shown).

The pulse wave sensor unit 171 includes a light emitting diode (for example, an infrared light emitting diode) and a photosensor.

The pulse wave signal preprocessor receives the pulse wave signal from the photosensor, amplifies, removes the noise, converts the digital signal into a digital signal, and transmits the signal to the calculation processor 100.

The blood flow detector 175 includes a light source unit (infrared LED) and a camera (CMOS based camera), and captures a blood vessel image of a finger.

In general, the light transmitted through the blood vessels through infrared LEDs is imaged by using a CMOS-based camera, so that blood vessels or blood flow distributed on a finger can be known.

The photometric detector 180 is a means for detecting whether the material is a spider, the first light source 181 and the second light source 182. The first light receiver 183 and the second light receiver 184 are included. The first light source unit 181 and the second light source unit 182 are made of a light emitting diode, at least one of the first light source unit 181 and the second light source unit 182 is made of an infrared light emitting diode, the first light receiving unit 183 And the second light receiving unit 184 is formed of light receiving sensors.

When the first light is emitted from the first light source unit 181, the calculation processing unit 100 receives the output of the first light receiving unit 183 facing the first light source unit 181, and the second light source unit 182 receives the output. When the second light is emitted, the calculation processing unit 100 receives the output of the second light receiving unit 184 facing the second light source unit 182.

The MOC smart card 200 receives the characteristic information of the fingerprint received from the operation processing unit 100, and through the bio matching algorithm (Bio matching algorithm) installed in the MOC smart card 200, in the MOC smart card 200 The user authentication is performed by comparing the user information stored with the password, and the result is transmitted to the operation processing unit 100.

The MOC smart card 200 is equipped with a bio matching algorithm, and in addition to a bio security platform for performing user authentication, the OTP, PKCS, eID, HPTP, Payment, and electronic money (E). Include applets such as Cash.

The memory unit 155 stores data that is accessed after user authentication in the MOC smart card 200. The memory unit 155 is made of an SD memory, that is, a secure uSD, and is a memory accessed after successful user authentication, information for authentication in a mobile terminal 510, a POS terminal, a terminal 530 of a computer, and the like. For example, it stores passwords. After the user authentication is made in the MOC smart card 200, the predetermined information is transmitted to the calculation processing unit 100 at the request of the calculation processing unit 100.

The battery unit 190 is a power supply means in the portable security authenticator 10.

The blue pitcher communication unit 120 transmits the information received from the operation processing unit 100 to a mobile terminal 510, a POS terminal, a terminal 530 of a computer, or the like via Bluetooth.

The WiFi communication unit 130 transmits the information received from the operation processing unit 100 to the mobile terminal 510, the POS terminal, the computer terminal 530, and the like through WiFi.

The NFC communication unit 140 transmits the information received from the operation processing unit 100 to the mobile terminal 510 through NFC communication.

The USB connector 110 includes a USB connector and a USB driver, and transmits and receives data to and from the operation processor 100 and the terminal 530 of an external computer through the USB connector.

FIG. 4 is a schematic diagram for describing a first light source unit and a first light receiver of the photometric detector of FIG. 1, and FIG. 5 is a schematic diagram for explaining a second light source unit and a second light receiver of the photometric detector of FIG. 1.

As shown in FIG. 4, the first light source unit 181 is positioned on one side of the left and right sides of the finger, and the first light receiving unit 183 is positioned on the other side of the left and right sides of the finger. The first light receiving unit 183 may include a plurality of light receiving sensors, and may include a light receiving sensor positioned vertically with the light receiving sensor positioned horizontally. In some cases, any one of the light receiving sensors positioned horizontally and the light receiving sensors positioned vertically may be omitted. In general, when the finger 145 is positioned on the counterfeit fingerprint 149 made of spider, the first light receiving part 183 has a higher brightness (light quantity) than the counterfeit fingerprint 149 is absent.

As shown in FIG. 5, the second light source unit 182 is positioned at one side of the fingertip and the finger node, and the second light receiver 184 is positioned at the other side of the fingertip and the finger node. The second light receiving unit 184 may include a plurality of light receiving sensors, and may include a light receiving sensor positioned vertically with a light receiving sensor positioned horizontally. In some cases, any one of the horizontally positioned light receiving sensor and the vertically located light receiving sensor may be omitted, and preferably the vertically located light receiving sensor may be omitted.

In the present invention, not only the first light source unit and the first light receiving unit, but also the second light source unit and the second light receiving unit to determine whether the forgery fingerprint is a detection of the forgery fingerprint is not easy because the counterfeit fingerprint is biased on either side. This is to prevent.

6 is a schematic diagram illustrating a concept of signal detection in the fingerprint sensor of the fingerprint sensor unit of FIG. 1.

6A illustrates a method of using a sweep sensor as a fingerprint sensor. The finger is moved from the upper side to the lower side of the fingerprint sensor, and the fingerprint sensor acquires a fingerprint image.

FIG. 6 (b) illustrates a process of acquiring a fingerprint image when a finger moves as shown in FIG. 6 (a). The fingerprint image of each instant is multi-layered as the finger moves from the upper side to the lower side of the fingerprint sensor. To be obtained.

Since the present invention needs to process authentication in the MOC smart card 200, fingerprint information, COS (Card Operating System), applications (fingerprint recognition algorithms, etc.) are stored in the MOC smart card 200 and perform user authentication. .

FIG. 7 is an explanatory diagram schematically illustrating driving of an arithmetic processing unit of the portable security authenticator of FIG. 1.

In the heartbeat interval detection step, the calculation processing unit 100 receives a pulse wave signal from the pulse wave detection unit 170 (S410), detects a heartbeat signal from the received pulse wave signal, and detects a heartbeat interval that is an interval of successive heartbeat signals ( S420). That is, the calculation processing unit 100 detects the peak from the received pulse wave signal for a predetermined time period, sets the heart rate, and detects a subsequent interval of the heartbeat signal.

In the comparison step of the heartbeat interval and the heart rate reference range, the operation processing unit 100 compares whether the heartbeat interval is greater than or equal to the lowest heart rate reference of the preset heart rate reference range, and less than or equal to the highest heart rate reference of the heart rate reference range ( S430), if it is not the same, it is determined as a fake fingerprint, and goes to the fake fingerprint notification step (S500).

The heartbeat interval detection step and the heartbeat interval and heartbeat reference range comparison step may be referred to as a heartbeat-based forgery fingerprint discrimination step of determining whether the fingerprint is a fake fingerprint.

In the step of detecting the brightness of the blood vessel image, the operation processor 100 receives blood vessel images photographed at a predetermined time difference from a blood flow detection camera (not shown) of the blood flow detector 175, and the blood vessel image of the predetermined region of interest is received from the blood vessel image. Each brightness is detected (S440).

As a comparison step between the image brightness and the light reference value, the operation processor 100 compares whether the brightness of the ROI of each blood vessel image is smaller than the preset brightness reference value (S45), and if it is not smaller than the brightness reference value, determines that the fingerprint is a fake fingerprint, Go to the fake fingerprint notification step (S500).

The step of detecting the brightness of the blood vessel image and the comparing of the brightness of the blood vessel and the light reference value may be referred to as a blood vessel image-based forgery fingerprint discrimination step that detects the flow of blood by changing the brightness of the region of interest of the blood vessel image.

One of the heartbeat-based forgery fingerprint discrimination step and the blood vessel image-based forgery fingerprint discrimination step may be omitted.

In the first light and the second light receiving step, it is determined that the fingerprint is not a counterfeit fingerprint in the comparison step of the heartbeat interval and the heartbeat reference range (that is, the heartbeat-based counterfeit fingerprint determination step), or the comparison step of the image brightness and the light reference value (that is, If it is determined in the blood vessel image-based forgery fingerprint discrimination step), the first light is received from the first light receiving unit 183 of the metering detection unit 180, and the second light receiving unit 184 of the metering detection unit 180 is received. 2 light is received (S460).

As a comparison step between the first light and the light reference value, it is determined whether the luminous intensity (light quantity) of the first light received in the first light and the second light receiving step is greater than the preset light reference value (S470), It is determined that the forgery fingerprint, go to the fake fingerprint notification step (S500).

In the comparison step between the second light and the light reference value, if it is determined that the fingerprint is not a counterfeit fingerprint in the comparison step between the first light and the light reference value, the brightness (light quantity) of the second light received in the first light and the second light reception step is preset. It is determined whether it is larger than the light reference value (S480), and if it is larger than the light reference value, it is determined that the fingerprint is fake, and the counterfeit fingerprint notification step (S500) is reached.

Here, instead of the comparison step between the first light and the light reference value and the comparison step between the second light and the light reference value, the calculation processing unit 100 obtains a difference between the luminous intensity (light quantity) of the first light and the second light, and obtains the obtained first value. If the difference between the luminous intensity (light quantity) of the light and the second light is smaller than the preset light difference reference value, it is determined that the fingerprint is a fake fingerprint, and the flow goes to the fake fingerprint notification step (S500).

In the fingerprint recognition step, when it is determined that the fingerprint is not a counterfeit fingerprint in the comparison step between the second light and the light reference value, the fingerprint image is received by receiving the fingerprint image from the fingerprint sensor unit 150 (S490). Detailed description of the fingerprint recognition step will be described later.

In the forgery fingerprint notification step, it is determined that the forgery fingerprint is determined in the comparison of the heartbeat interval and the heartbeat reference range, the image brightness and the light reference value, the first light and the light reference value, and the second light and the light reference value. In this case, the calculation processing unit 100 transmits the forgery fingerprint notification signal to the mobile terminal 510, a point of sales (POS) terminal, a terminal 530 of a computer, and the like.

8 is a flowchart schematically illustrating a fingerprint recognition step in the portable security authenticator of the present invention, and FIG. 9 is a flowchart illustrating the feature extraction step of FIG. 7.

Data capture step (S110), the step of storing the user's fingerprint information in the MOC smart card 200 in the initial use, that is, necessary for the initial storage of the user's fingerprint information in the MOC smart card 200 In step, as the finger moves from the upper side to the lower side of the fingerprint sensor, from the fingerprint sensor unit 150, the fingerprint images of each instant are received in multiple layers and images are matched into one image, and the image matched fingerprint images are MOC smart. The card 200 stores it. In some cases, features may be extracted from the matched fingerprint image and stored together.

The subsequent step of the data capture step S110 is processed in the MOC smart card 200 to perform user authentication. The subsequent step of the data capture step S110 is largely subjected to two stages of fingerprint detection and feature extraction step S150 and fingerprint matching step 200.

 In the fingerprint detection and feature extraction step (S150), the feature point (Minutiae) data file to be used in the fingerprint matching step is configured, and the fingerprint image is received in multiple layers from the fingerprint sensor unit 150 in a single image. Image registration and feature extraction from fingerprint images matched with one image.

The feature extraction step is performed in three steps, a pre-processing step S160, a feature point extraction step S155, and a post-processing step S180.

The preprocessing step S160 is a step of thinning the fingerprint image, performing image enhancement, binarizing the image-enhanced fingerprint image, and thinning.

In other words, the preprocessing step (S160) is subjected to the conversion process to the block directional image, binarization image, thinning image. The fingerprint image is divided into blocks of a certain size, and the direction indicative of the flow of the ridges is determined for each block, and the image is converted to the block image. The ridge direction information obtained in this way is used in the binarization and smoothing process. During the binarization process, the fingerprint image is converted into a binary image that is only displayed in black and white, and the binary image is smoothed to remove noise and emphasize the fusion to improve the connectivity of the fusion and convert the fusion into a 1-pixel thick line. Is converted to a thinned image

The feature point extraction step (S155) is a step of extracting candidate feature points from the thinned fingerprint image in the preprocessing step (S160).

Here, the feature point (Minutiae) refers to the point of change in the flow of the ridge, called the disadvantage (the point where the flow of the ridge breaks) and the branch point (the point where one ridge splits into two). The feature amount (T = {m1, m2, ..., mm}) consists of the information of the feature points (mi) present in the fingerprint image. In most cases, the information of the feature points used indicates whether it is a branch point or a disadvantage. There is information about the type of feature point, its location in the fingerprint image, and the direction of the ridge in which the feature point is located.

That is, the feature point extraction step (S155) is a candidate feature point extraction process, and stores the shortcomings and branching point information in which a change occurs in the flow of the ridge from the thinning image. Candidate feature points including pseudo feature points are extracted from the ridge information of the thinning image. In this case, a pseudo feature point may be generated due to an incorrect ridge portion of the thinning image. Pseudo-feature points are fake features that occur during thinning due to noise from fingerprint acquisition. Pseudo-feature points increase the meaningless amount of computation and increase errors, causing the system to degrade performance.

The post-processing step (S180) is a step of removing the fake feature points from the feature points extracted in the feature point extraction step (S155). That is, the post-processing step (S180) extracts the final feature point by removing the pseudo feature point by adding the missing feature point by correcting the ridge portion that causes the pseudo feature point.

In the fingerprint matching step 200, in the matching algorithm of the fingerprint recognition method using the feature points, the similarity between the two fingerprint images is determined using the feature amounts defined from the feature point information extracted by the extraction algorithm. As shown in Fig. 16, the matching algorithm is divided into three stages: Image Alignment, Matching Matching, and Scoring.

The fingerprint matching step 200 is a step of determining similarity between two fingerprint images using a feature amount defined from the extracted feature point information. Image alignment step S210 and nutiae matching step S230. , Score scoring (Scoring) step (S250) comprises three steps.

In the alignment step S210, the alignment reference point of the image is selected by calculating an amount of rotation and transition in which the feature points of the two fingerprint images overlap most. Subsequently, coordinates of the feature points are converted to be aligned with the alignment reference point, and then a corresponding feature point pair is determined. At this time, as many candidate alignments as possible should be performed to find an ideal rotation shift amount.

In the matching step S230, a similarity (Measure Vector) is calculated by using coordinates, types, and angle information of the pair of corresponding feature points determined in the sorting step (S210). In order to realistically reflect the similarity of pairs of corresponding feature points, various statistical techniques can be considered from various angles in the similarity determination method.

In the scoring step S250, the degree of correspondence of the two fingerprint images from the similarity of the corresponding pair of feature points is represented as a score according to preset rule data.

As in the matching step, the rule data is predetermined data using statistical basis and mathematical modeling for decision making of the score calculation rule in order to accurately reflect the degree of matching of the image.

As described above, the present invention relates to a biometric authentication-based portable security authentication technology and a security authentication device using On-Card Match (MOC) for biometric recognition using fingerprint information and secure personal information security management.

The operation processing unit 100 of the present invention first receives a fingerprint image through the fingerprint sensor unit 150 of the portable security authentication terminal, processes the input fingerprint image to extract feature information of the fingerprint, and extracts the feature information of the extracted fingerprint. Is transmitted to the MOC smart card 200 and the final user authentication is performed by comparing the user information stored in the card with an applet of the biometric matching algorithm installed in the MOC smart card 200. In this way, if the user authentication is successful, it allows access to the data stored in the memory unit, and transmits and authenticates the mobile terminal through the wired / wireless communication interface to perform necessary tasks. User authentication also allows access to various service applets (OTP, PKCS, eID, payment, etc.) installed on the MOC smart card.

In the present invention, a new user fingerprint is encrypted and stored in the MOC smart card 200 through the portable security authenticator login manager of the present invention. Thereafter, the user inputs a fingerprint to the fingerprint sensor in order to use the portable security authenticator, and through the fingerprint recognition algorithm provided by the biosecurity platform of the MOC smart card 200 for the input fingerprint information, the MOC smart card 200. User authentication is performed through the matching process with the fingerprint information stored in the. Authorizes the authorized user to use the applet service of the MOC smart card 200 through the biosecurity platform of the MOC smart card 200.

In addition, the present invention provides a function to prepare for theft or loss of the storage device by operating an encryption / decryption algorithm for the stored security data, user fingerprint registration / authentication, applet management, memory management through a portable security authentication program Provide the function.

In the above, the present invention has been illustrated and described with respect to certain preferred embodiments. However, the present invention is not limited only to the above-described embodiments, and those skilled in the art to which the present invention pertains can make various changes without departing from the spirit of the technical idea of the present invention described in the claims below. Could be done.

10: portable security authenticator 20: security authenticator housing
100: arithmetic processing unit 110: USB connector
120: blue pitcher communication unit 130: WiFi communication unit
140: NFC communication unit 150: fingerprint sensor unit
155: memory unit 170: pulse wave detection unit
171: pulse wave sensor unit 175: blood flow detection unit
180: photometric detector 181: first light source
182: second light source unit 183: first light receiving unit
184: second light receiving unit 190: battery unit
200: MOC Smart Card

Claims (15)

A pulse wave detection unit detecting a pulse wave (optical volume pulse wave) signal through a pulse wave sensor unit;
A photometric detection unit for detecting an optical signal emitted from the light source unit positioned at one side of the finger through a light receiving unit provided at a position facing the light source unit;
A fingerprint sensor unit for detecting a fingerprint image with a fingerprint sensor;
First, it is judged whether or not the forgery fingerprint by using the pulse wave signal received from the pulse wave detection unit, and if it is determined that the first is not a forgery fingerprint, and secondly by using the optical signal received from the photometric detector, If it is determined that the second fingerprint is not a forgery fingerprint, the fingerprint processing unit for using the fingerprint image received from the fingerprint sensor, arithmetic processing unit;
Including;
In the photometric detection unit, the light source unit includes a first light source unit and a second light source unit positioned at different positions, and the light receiving unit is provided at a position facing the first light source unit and a position facing the second light source unit. It includes a second light receiving unit,
The first light source is located on one side of the left and right of the finger, the second light source is a portable security authenticator, characterized in that located at the end of the finger. A blood flow detection unit for emitting light from the blood flow detection light source unit to the finger and detecting blood vessel images of the finger with a blood flow detection camera;
A photometric detection unit for detecting an optical signal emitted from the light source unit positioned at one side of the finger through a light receiving unit provided at a position facing the light source unit;
A fingerprint sensor unit for detecting a fingerprint image with a fingerprint sensor;
First, it is determined whether or not the fake fingerprint by using the brightness of the blood vessel image received from the blood flow detection unit, and if it is determined that the first is not a fake fingerprint, by using the optical signal received from the photometric detector, secondly whether or not fake fingerprints If it is determined that the second fingerprint is not a forgery fingerprint, the fingerprint processing unit using the fingerprint image received from the fingerprint sensor unit, arithmetic processing unit;
Including;
In the photometric detection unit, the light source unit includes a first light source unit and a second light source unit positioned at different positions, and the light receiving unit is provided at a position facing the first light source unit and a position facing the second light source unit. It includes a second light receiving unit,
The first light source is located on one side of the left and right of the finger, the second light source is a portable security authenticator, characterized in that located at the end of the finger. The method of claim 1,
The operation processor detects a peak for a predetermined period of time and sets the pulse wave signal received from the pulse wave detector to a heart rate, and detects a subsequent interval of the heartbeat signal, and compares it with a preset heart rate reference range and exceeds the heart rate reference range. A portable security authenticator characterized in that it is determined primarily as a fake fingerprint. The method of claim 2,
The operation processor receives the blood vessel image received from the blood flow detector, detects the brightness of the preset ROI in the blood vessel image, and determines that the fingerprint is a fake fingerprint when the brightness of the ROI of the detected blood vessel image is smaller than the preset brightness reference value. Portable security authenticator, characterized in that. The method of claim 4, wherein
The operation processor receives two or more blood vessel images received from the blood flow detector, detects a brightness of a predetermined ROI in each of the two or more blood vessel images, and sets a brightness reference value of a brightness of the ROI of each detected blood vessel image. Portable security authenticator, characterized in that it is determined to be smaller than the fingerprint. The method of claim 1,
The pulse wave sensor unit is a portable security authenticator comprising an infrared light emitting diode and a photo sensor. The method of claim 1,
Portable security authenticator, characterized in that any one of the first light source portion or the second light source portion made of an infrared light emitting diode. delete delete The method of claim 1,
The blood flow detection light source unit is made of an infrared light emitting diode, the blood flow detection camera is a portable security authenticator, characterized in that the CMOS-based camera. The method of claim 1,
Portable security authenticator, characterized in that any one of the first light source unit or the second light source unit is used as the blood flow detection light source unit of the blood flow detection unit. The method of claim 1,
Portable security authenticator, characterized in that any one of the first light source unit or the second light source unit is used as an infrared light emitting diode of the pulse wave detection unit. The method of claim 1,
The operation processor determines whether any one of the first light received by the first light receiver and the second light received by the second light receiver exceeds a preset light reference value, and if so, determines that the fingerprint is a fake fingerprint. group. The method of claim 1,
The first light source portion and the second light source portion has a light source of different wavelengths,
The calculation processing unit obtains a difference between the luminous intensity or the amount of light of the first light received from the first light receiving unit and the second light received from the second light receiving unit, and determines that the difference is a forged fingerprint if the difference of the obtained luminous intensity or light amount is smaller than the preset light difference reference value. Portable security authenticator characterized by. The method of claim 1,
And a first light receiving unit and a second light receiving unit having at least one of a light receiving sensor positioned vertically and a light receiving sensor positioned vertically.

Images