CN108670259A - Human behavior recognition device and system based on wearable sensor - Google Patents

Abstract

The invention discloses a human body behavior recognition device based on a wearable sensor and a system thereof, and the human body behavior recognition device comprises a data detection module arranged at a human body joint, a data processing module connected to a display device and a data display module used for displaying data, wherein the data detection module, the data processing module and the data display module are sequentially connected. The invention can accurately sense the bending information of the human body joints by flexibly wearing the data detection modules at different joints of the human body, wherein the human body joints comprise the joints which can flexibly move, such as knee joints, wrist joints, elbow joints, ankle joints and the like, the daily behavior and activity information of the human body can be collected by the bending information of the human body joints, and the invention has the advantages of high flexibility, high portability and the like.

Description

A human body behavior recognition device and system based on wearable sensors

technical field

The invention relates to the application field of wearable electronic equipment, in particular to a wearable sensor-based human body behavior recognition device and system thereof.

Background technique

In recent years, wearable devices have received a lot of attention due to their vital role in human health monitoring. Human behavior recognition is an important research direction in health monitoring, which mainly analyzes and recognizes the daily behavior patterns and action categories of the human body. Since the daily behavior of the human body is closely related to the physical and mental health of the individual, human behavior recognition has broad application prospects.

However, most of the existing research directions are based on machine vision or applying rigid sensors to large equipment such as seats. Such recognition devices are often costly, complex in structure, and poor in portability. The method is also easily affected by factors such as lighting and equipment.

Contents of the invention

In order to solve the above problems, the object of the present invention is to provide a human body behavior recognition device and system based on wearable sensors, which can accurately sense the bending information at the joints of the human body, collect the daily behavior information of the human body, and have high ductility, high Advantages such as flexibility, high sensitivity and high portability.

The technical scheme that the present invention solves its problem adopts is:

A human body behavior recognition device based on a wearable sensor, characterized in that: it includes a data detection module for being arranged at the joints of the human body and a data processing module for being connected to a display device, and the output end of the data detection module is connected to Data processing module.

Further, the data detection module includes a resistive sensor that is worn at the joints of the human body and detects bending information at the joints, and the resistive sensor includes a sensing circuit and a resistance strain gauge for flexible deformation following the joint movement of the human body , the resistance strain gauge is connected to the data processing module through the sensing circuit.

Further, the strain gauge includes a substrate and a conductive filler for adding to the substrate, the substrate is a copolyester silicone material, and the conductive filler includes nickel nanochains and nickel-plated carbon fibers.

Further, the sensing circuit is a voltage dividing circuit or a Wheatstone bridge, and the resistance strain gauge and the data processing module are connected through a voltage dividing circuit or a Wheatstone bridge.

Further, the data processing module includes a power supply module, a microcontroller, a storage module and a communication module for connecting to a display device, and the microcontroller is respectively connected to the data detection module, the power supply module, the storage module and the communication module .

Further, the microcontroller is Arduino, RFduino or Simblee.

Further, the storage module is a flash memory or a random access memory, and the flash memory includes an SD card or a memory stick.

Further, the communication module includes a wireless communication module, the wireless communication module is connected to a microcontroller, and the wireless communication module is a Bluetooth module, a Wi-Fi module, a 2G communication module, a 3G communication module, a 4G communication module, ZigBee module or GPRS module.

Further, the communication module includes a wired communication module, and the wired communication module is connected to a microcontroller.

Further, the power module is an alkaline battery or a button battery.

A system applying the above-mentioned human body behavior recognition device based on wearable sensors is characterized in that it further includes a data display module, and the data display module is connected to a data processing module.

Further, the data display module includes a smart terminal, and the smart terminal is a computer, a smart phone, a tablet computer or a smart watch.

The beneficial effects of the present invention are: a human body behavior recognition device based on a wearable sensor and its system adopted in the present invention, including a data detection module for setting at the joints of the human body, a data processing module for connecting to a display device and The data display module for displaying data, the data detection module, the data processing module and the data display module are connected in sequence. The present invention can accurately perceive the bending information of the human body joints through the data detection module flexibly worn at different joints of the human body, wherein the human body joints include knee joints, wrist joints, elbow joints and ankle joints, etc. The bending information at the joints of the human body is used to collect the daily behavior information of the human body, which has the advantages of high flexibility and high portability.

Description of drawings

The present invention will be further described below in conjunction with accompanying drawing and example.

Fig. 1 is a kind of overall circuit principle block diagram of the human body behavior recognition device and its system based on wearable sensor of the present invention;

Fig. 2 is a specific circuit principle block diagram of a human body behavior recognition device and system based on a wearable sensor of the present invention;

Fig. 3 is a schematic diagram of a human body behavior recognition device based on a wearable sensor and its system for detecting human knee bending information according to the present invention;

Fig. 4 is a schematic diagram of the connection relationship between the data detection module and the data processing module when the sensing circuit of a human body behavior recognition device based on a wearable sensor and the system of the present invention adopts a voltage divider circuit;

FIG. 5 is a schematic diagram of the connection relationship between a human body behavior recognition device based on a wearable sensor and a data processing module of the system according to the present invention.

Detailed ways

Referring to Fig. 1-Fig. 5, a human body behavior recognition device and system based on a wearable sensor of the present invention.

With reference to Fig. 1, a kind of human body behavior recognition device based on wearable sensor, comprises the data detection module 100 that is used to be arranged at the joint place of human body and is used for being connected to the data processing module 200 of display device, the output of described data detection module 100 connected to the data processing module 200. In addition, the system applying the above-mentioned wearable sensor-based human behavior recognition device also includes a data display module 300 , and the data display module 300 is connected to the data processing module 200 .

The data detection module 100 can perceive the bending information of the human body joints through a wearable sensor, such as the degree of bending and the corresponding bending time, and send it to the data processing module 200, and the data processing module 200 can convert the received The digital-to-analog conversion is performed on the analog quantities of the bending information of human joints to obtain digital signals, which are sent to the data display module 300 for display.

The present invention can accurately perceive the bending information at the joints of the human body through the data detection module 100 flexibly worn at different joints of the human body, wherein the joints of the human body include knee joints, wrist joints, elbow joints and ankle joints, etc. In Fig. 3, the data detection module 100 is worn at the knee joint of the human body to sense the bending information of the knee joint, thereby obtaining the daily behavior information of the human body; at the same time, the data processing module 200 can be placed in the pocket of the clothes or the belt In addition, the data display module 300 includes a smart terminal, and the smart terminal is a computer, a smart phone, a tablet computer or a smart watch. The communication mode between the data display module 300 and the data processing module 200 can be a wired communication mode or a wireless communication mode. Preferably, the communication mode between the data display module 300 and the data processing module 200 is selected As shown in the wireless communication mode in Figure 3, there is no communication line affecting the normal physical activities of the human body, which is simple and convenient.

Referring to FIG. 2 , further, the data detection module 100 includes a resistive sensor for wearing at the joints of the human body and detecting bending information at the joints. The resistive sensor includes a sensing circuit 120 and is used for following the movement of the joints of the human body to generate A flexibly deformable resistance strain gauge 110 , the resistance strain gauge 110 is connected to the data processing module 200 through the sensing circuit 120 . The data detection module 100 senses the bending information of human joints through resistive sensors.

Further, the strain gauge 110 includes a substrate and a conductive filler for adding to the substrate, the substrate is a copolyester silicone material, and the conductive filler includes nickel nanostrands (Nickel Nanostrands) and plated Nickel Coated Carbon Fiber. The resistivity of the strain gauge 110 decreases with the increase of the deformation, showing the reverse piezoresistive effect. The resistance strain gauge 110 made of silicone-nickel nanocomposite material can sense a large deformation range, while maintaining good conductivity and sensitivity, and the cost is low. The two ends of the strain gauge 110 are fixed on the joints of the human body by using muscle-effect patches, which can accurately sense the bending information of the joints due to its advantages of high sensitivity and high ductility.

Further, the sensing circuit 120 is a voltage dividing circuit or a Wheatstone bridge, and the resistance strain gauge 110 and the data processing module 200 are connected through a voltage dividing circuit or a Wheatstone bridge. As shown in FIG. 4 , the sensing circuit 120 is a voltage divider circuit. Specifically, the resistance strain gauge 110 and the voltage dividing resistor 121 in this embodiment are connected in series, and the resistance value of the voltage dividing resistor 121 is equal to the resistance value of the resistance strain gauge 110 in a steady state.

Further, the data processing module 200 includes a power supply module 220, a microcontroller 210, a storage module 230, and a communication module 240 for connecting to a display device, and the microcontroller 210 is connected to the data detection module 100 and the power supply module 220 respectively. , the storage module 230 and the communication module 240 are connected. The power module 220 provides electric energy for the microcontroller 210 to ensure that the device can work normally. The microcontroller 210 can receive the joint bending analog signal sent by the data detection module 100, and obtain the joint bending digital signal through digital-to-analog conversion. , sent to the data display module 300 for display through the communication module 240, and also sent to the storage module 230 for data storage.

Further, the microcontroller 210 is Arduino, RFduino or Simblee. Arduino is a convenient, flexible, and easy-to-use open source electronic prototyping platform. It mainly includes two main parts: the hardware part (various models of Arduino boards) and the software part (Arduino IDE). The hardware part is the Arduino circuit board that can be used for circuit connection; the software part is the Arduino IDE, the program development environment in the computer. The RFduino is a fingertip-sized electronic prototyping platform equipped with a 32-bit processor, has multiple bus expanders, and is compatible with the Arduino open source platform. Compared with RFduino's Bluetooth transmission, Simblee has a great improvement. In terms of signal processing, Simblee is only delayed by 3 milliseconds. This level can already achieve motion tracking. In terms of network device synchronization, it achieves an accuracy of 10 microseconds. Wearables that do this are not only expensive, but can only be connected to fixed devices. In addition, Simblee has good anti-interference ability and can be used in various environments.

Further, the storage module 230 is a flash memory or a random access memory, and the flash memory includes an SD card 231 or a memory stick. The flash memory (flash EPROM) is a form of electronically erasable programmable read-only memory (EEPROM). Flash memory allows multiple erasing or writing in operation, and is non-volatile, that is, it does not need power consumption just to save data. The difference between flash memory and traditional EEPROM is that it erases data in larger blocks, while traditional EEPROM can only erase and rewrite a single storage location. This gives flash a significant advantage when writing large amounts of data. The random access memory (RAM) is also called "random access memory", which can be read and written at any time, and the speed is very fast. irrelevant memory. This kind of memory will lose its storage content when the power is turned off, so it is mainly used to store short-term use programs.

Further, the communication module 240 includes a wireless communication module, the wireless communication module is connected to the microcontroller 210, and the wireless communication module is a Bluetooth module 241, a Wi-Fi module, a 2G communication module, a 3G communication module, a 4G communication module module, ZigBee module or GPRS module.

Further, the communication module 240 includes a wired communication module, and the wired communication module is connected to the microcontroller 210 .

For the above wireless communication module and wired communication module, preferably, a wireless communication module is used, and no communication wire affects the normal physical activities of the human body, which is simple and convenient.

Further, the power module 220 is an alkaline battery or a button battery. The alkaline battery is also called alkaline dry battery, alkaline zinc-manganese battery, and alkaline-manganese battery. It is the variety with the best performance in the zinc-manganese battery series and is suitable for large discharge and long-term use. The internal resistance of the battery is low, so the current generated is larger than that of ordinary carbon batteries. Since this type of battery does not contain mercury, it can be disposed of with domestic waste without intentional recycling. The button battery is also called a button battery, which refers to a battery whose external dimensions are like a small button. Generally speaking, the diameter is larger and the thickness is thinner. The button battery is divided from the appearance.

Referring to Fig. 4 and Fig. 5, the induction circuit 120 adopts a voltage divider circuit mode, so there is a voltage divider resistor 121, the microcontroller 210 adopts an Arduino Nano211, the power module 220 adopts a polymer lithium battery 221, and the storage The module 230 uses an SD card, and the communication module 240 uses a Bluetooth module 241 . The Arduino Nano 211 is powered by a lithium polymer battery 221 to provide an input voltage of 5V for the data detection module 100 . The resolution of each A/D converter of Arduino Nano211 (that is, the six analog input ports of A0-A5) is 10 bits (that is, the read analog value is between 0-1023), so it is possible to collect the resistive sensor The information on the bending of the joints is converted into voltage distribution values. Specifically, the A0 port of the ArduinoNano211 in this example can obtain a received value between 0-1023, which is used to represent the information about the bending of human joints.

Furthermore, the storage device in this embodiment uses the SD card 231 with the smallest size. This type of storage card can be freely inserted and taken out, which is very convenient to use.

Further, the Bluetooth module 241 whose model is HC-06 is selected as the wireless communication module. The bluetooth module 241 is small in size, and the transmission distance can reach 10 meters, which improves the portability and reliability of the device. Microcontroller 210 in this embodiment provides the working voltage of 5V for bluetooth module 241, can send the bending information of human body joint to user's intelligent terminal through bluetooth module 241, namely data display module 300, meanwhile, can also send information Stored in the storage module 230 for subsequent data analysis. The data display module 300 is used to display basic information such as the duration and degree of various daily behaviors of the human body, and provide users with energy consumption and suggestions according to the activities in a day.

The above descriptions are only preferred embodiments of the present invention, and the present invention is not limited to the above-mentioned embodiments, as long as they achieve the technical effects of the present invention by the same means, they should all belong to the protection scope of the present invention.

Claims (10)

1. The utility model provides a human action recognition device based on wearable sensor which characterized in that: comprises a data detection module (100) arranged at a joint of a human body and a data processing module (200) connected to a display device, wherein the output end of the data detection module (100) is connected to the data processing module (200).

2. The wearable sensor based human behavior recognition device of claim 1, wherein: the data detection module (100) comprises a resistance-type sensor which is worn at a human joint and used for detecting bending information at the joint, the resistance-type sensor comprises a sensing circuit (120) and a resistance strain gauge (110) which is used for flexibly deforming along with the movement of the human joint, and the resistance strain gauge (110) is connected to the data processing module (200) through the sensing circuit (120).

3. The wearable sensor-based human behavior recognition device according to claim 2, wherein: the resistance strain gauge (110) comprises a substrate and a conductive filler added into the substrate, wherein the substrate is a copolyester silicone material, and the conductive filler comprises nickel nanochains and nickel-plated carbon fibers.

4. The wearable sensor-based human behavior recognition device according to claim 2, wherein: the sensing circuit (120) is a voltage division circuit or a Wheatstone bridge, and the resistance strain gauge (110) and the data processing module (200) are connected through the voltage division circuit or the Wheatstone bridge.

5. The wearable sensor based human behavior recognition device of claim 1, wherein: the data processing module (200) comprises a power supply module (220), a microcontroller (210), a storage module (230) and a communication module (240) for connecting to a display device, wherein the microcontroller (210) is respectively connected with the data detection module (100), the power supply module (220), the storage module (230) and the communication module (240).

6. The wearable-sensor-based human behavior recognition device according to claim 5, wherein: the microcontroller (210) is Arduino, RFduino or Simblee.

7. The wearable-sensor-based human behavior recognition device according to claim 5, wherein: the storage module (230) is a flash memory or a random access memory, and the flash memory comprises an SD card (231) or a memory stick.

8. The wearable-sensor-based human behavior recognition device according to claim 5, wherein: the communication module (240) comprises a wireless communication module, the wireless communication module is connected to the microcontroller (210), and the wireless communication module is a Bluetooth module (241), a Wi-Fi module, a 2G communication module, a 3G communication module, a 4G communication module, a ZigBee module or a GPRS module.

9. The wearable-sensor-based human behavior recognition device according to claim 5, wherein: the communication module (240) comprises a wired communication module connected to the microcontroller (210).

10. A system using the wearable sensor based human behavior recognition device of any of claims 1-9, wherein: the device also comprises a data display module (300), wherein the data display module (300) is connected with the data processing module (200).