CN103303224B - Vehicle-mounted equipment gesture control system and usage method thereof - Google Patents

Abstract

The present invention is a vehicle-mounted equipment gesture control system and its use method. The central processor CPU of the vehicle-mounted platform part of the system is connected to the electronic control unit of the vehicle-mounted equipment via CAN, and the CPU is connected to a projector. The digital signal processing of the gesture recognition part of the system The controller DSP is connected with 2 identical infrared cameras arranged in parallel, and the CPU is connected with the DSP. The DSP is connected to the infrared gainer. The method of use is that the CPU obtains the control information of each vehicle-mounted device through CAN to generate a control map, which is projected on the front windshield, the finger moves in front of the camera, the relevant area of the control map changes color/shape to display options, and the finger clicks in the air to confirm. The DSP determines the device to be controlled based on the finger position and motion signals captured by the camera. Based on this, the CPU manipulates the signal to control the state of the corresponding device, or to retrieve information. The driver does not need to shift his sight to the control panel and memorize different gestures to control the electronic equipment of the car. The operation is convenient, simple and safe; it is compatible with CAN of various cars and is easy to install and use.

Description

Gesture control system for in-vehicle equipment and using method thereof

technical field

The invention relates to an electronic control system for automobile equipment, in particular to a gesture control system for vehicle equipment and a method for using the same.

Background technique

With the rapid development of automobile technology, various new devices have been applied in automobiles, such as automobile electronic stability program (ESP), electronic induction brake control system (SBC), electronic brake force distribution (EBD), auxiliary braking system (BAS), airbag (SRS), automotive radar anti-collision system, automotive electronically controlled transmission system including electronically controlled automatic transmission (EAT) and continuously variable transmission (CVT), electronically controlled automatic air conditioning (A/C), cruise control system (CCS), electronically controlled suspension (ECS), electronically controlled power steering system (EPS), central door lock and anti-theft alarm system, vehicle network technology, etc., and other electronic control devices, such as automotive electronic instruments, car navigation systems , car audio system, car travel recorder and tire pressure monitoring system are all electronically controlled.

In order to control many devices on the car, the control unit local area network CAN (Controller Area Network in English, often referred to as CAN) in the car environment is designed to exchange information between the electronic control units (ECU) of each car device, forming a car Electronic control network. For example: CAN is embedded in the engine management system, gearbox controller, instrument equipment, and electronic backbone systems.

The electronic control units of various equipment are mostly concentrated in the cab, and various control buttons are distributed around the central operation panel and steering wheel. While the car has more equipment, the driver's operation is more complicated. In the case of driving with a high degree of concentration and observation of the road ahead, distraction to find the required operation buttons, and the need to touch the controls with hands or feet during operation, will undoubtedly cause great safety hazards for high-speed vehicles.

In order to facilitate the driver to control various equipment, a touch screen with various control buttons has appeared. Although the use of the touch screen is convenient for centralized control, the driver's line of sight still inevitably leaves the road ahead.

For this reason, there have been many schemes of using gestures to control in-vehicle equipment in recent years, such as the Chinese invention patent "gesture switch device" with the patent number of ZL200310102916.X, and the Chinese invention patent application with the application number of 201210312798. Gesture Control Method and Device for Automobile Virtual Center Console", Chinese Invention Patent Application No. 201220433136.8 "A Device for Controlling Automobile Electrical Appliances Using Gesture Recognition Technology", Chinese Invention Patent Application No. 201210197697.7 "A Multi-point Gesture for Vehicle Android Platform Control method", the Chinese invention patent with application number 201120302339.9 "Electronic equipment and vehicle-mounted equipment operated by gestures", etc. These solutions are to set a certain camera area, use different hand shapes or moving directions as recognition gestures, and control corresponding vehicle equipment. Gesture control allows the driver to extend his arms while maintaining his forward-facing driving posture, and input operational information to the control object with the help of gestures. The disadvantage is that the driver needs to memorize the various shapes and movements of gestures for operating different devices. If the gestures are not standard, misoperation will occur.

Contents of the invention

In order to solve the above problems, the present invention provides a vehicle-mounted equipment gesture control system, including a vehicle-mounted platform part and a gesture recognition part, the central processor of the vehicle-mounted platform part is connected to a projector, and the control map of the vehicle-mounted device is generated by projection on the front windshield. The two cameras of the gesture recognition part are connected with the digital signal processor, and the digital signal processor is connected with the central processor of the vehicle platform part.

Another object of the present invention is to provide a method for using the gesture control system of the vehicle-mounted device. The position and direction on the control map corresponding to the finger are obtained through the camera, and the vehicle-mounted platform part transmits the operation information to the corresponding device according to the signal.

The vehicle-mounted equipment gesture control system provided by the present invention includes a vehicle-mounted platform part, the central processor of the vehicle-mounted platform part is connected with the electronic control unit local area network (CAN) of the vehicle-mounted equipment through a network bus, and the electronic control unit LAN of the vehicle-mounted equipment is connected with each door lock , Each window sunroof, left and right rearview mirrors, radio, digital audio player, parking radar image, electronic navigation system, seat height, seat heating and air conditioning and any other electronic control unit. The central processor of the vehicle platform part is connected to the projector. The front windshield of the car is a projection glass, and the projector projects the control map of the vehicle equipment on the front windshield. The system also includes a gesture recognition part, which includes a digital signal processor. With two identical cameras, the signals output by the two cameras are connected to the digital signal processor. The central processor of the vehicle platform part is connected via the I2C bus (two-wire serial bus Inter-Integrated Circuit) or the digital signal processor of the wireless communication and gesture recognition part. The camera is an infrared camera, and two cameras are arranged in parallel with the same lens orientation. The distance between the center points of the lenses of the two cameras is 40mm to 100mm.

The digital signal processor is connected to the output terminals of the two cameras through the serial peripheral interface (SPISerial Peripheral Interface).

The refresh rate of the camera is greater than or equal to 40 frames per second.

In order to enhance the projection effect, the front windshield of the car is pasted with a reflective film.

The digital signal processor is connected with an infrared gainer. The infrared gainer is connected with the infrared emitting lamp of the camera, the infrared rays emitted by the infrared emitting lamp are irradiated on the finger in front of the lens, the camera collects the infrared signal reflected by the finger, and the digital signal processor adjusts the pulse width modulation according to the strength of the infrared signal of the finger collected by the camera (PWM) duty cycle, control the infrared gainer, thereby controlling the intensity of the infrared rays emitted by the infrared emitting lamp, and controlling the strength of the signal collected by the camera.

The central processor of the vehicle-mounted platform part is also connected with a screen, which synchronously displays the control map generated by the projector, which is convenient for adjustment and use.

The gesture recognition part of the vehicle-mounted device gesture control system is installed in the control box, and the control box has lens holes for two cameras and an exit hole for infrared emitting lights. The control box is arranged beside the driver's seat, and the driver's fingers operate above the camera lens hole of the control box. The vehicle platform part is installed under the front windshield.

The usage method of the vehicle-mounted equipment gesture control system of the present invention is as follows:

The central processor of the vehicle-mounted platform part obtains the control information of each vehicle-mounted device from the local area network of the electronic control unit of the vehicle-mounted device to generate a control map, and sends it to the projector to project the control map on the front windshield.

The driver's finger moves in front of the camera lens. With the movement of the finger, the relevant control area of the control map projected on the front windshield of the car changes color and/or deforms to display the current options. When the color change area is the required control device, the finger Air click to confirm this option. Two cameras monitor the position and movement of the finger in front of the camera. The digital signal processor receives the signals from the two cameras and uses triangulation to calculate the trajectory of the finger based on the spatial coordinates of the two cameras at the same time. The specific position and direction on the map determine the device that the driver needs to control, and transmit the relevant control signal to the central processor of the vehicle platform part. The central processor controls the corresponding device to change the operating state according to the control signal, or from the corresponding device. The recalled information is displayed on the windshield.

During regular driving, the vehicle-mounted platform system receives information from various vehicle-mounted devices in the CAN automotive electronic control unit LAN, and the default items displayed in the control map are the main driving status information and the control selection buttons of each vehicle-mounted device.

The driver does not need to lower his head, but only needs to raise one hand and move his fingers to select the relevant control area of the control map projected on the front windshield of the car.

The camera in the gesture recognition part captures the position and direction of the finger, determines the device to be controlled or the relevant information to be searched, and transmits this information to the vehicle platform to control and adjust the operating status of the corresponding equipment, or retrieve relevant information in the front gear. displayed on the windshield. For example, if the driver selects the radio on the control map, the central processor can turn on the car radio and display the FM image of the radio so that the driver can choose a channel; The controller transmits the control instructions to the central processor, and the central processor can control the relevant equipment through the electronic control unit local area network, and retrieve the information of the current fuel gauge and the temperature gauge inside and outside the car to display on the control map.

Compared with the prior art, the beneficial effects of the gesture control system for vehicle-mounted equipment and its use method of the present invention are: 1. The driver does not need to shift his sight to watch or touch the operation panel of the vehicle-mounted equipment, and the gesture control is more convenient and safe without affecting Driving is safe and enables the driver to comfortably experience the convenience and fun of various devices on the car; 2. The control area of each device is obvious on the projected control map, and the driver does not need to memorize various gestures, and the brand-new air operation interaction 3. Compatible with the control area network of existing cars, it is easy to install, debug and use on various cars.

Description of drawings

Fig. 1 is a schematic diagram of the overall structure of an embodiment of the vehicle-mounted device gesture control system;

Fig. 2 is a schematic diagram of the use status of the embodiment of the gesture control system for the vehicle-mounted device.

Detailed ways

Embodiment of Gesture Control System for Vehicle Equipment

The embodiment of the gesture control system for vehicle-mounted equipment is shown in Figure 1, including the vehicle-mounted platform part and the gesture recognition part. The central processor of the vehicle-mounted platform part is connected to the electronic control unit LAN CAN of the vehicle-mounted device via a network bus. In this example, CAN is connected to the door lock. , car windows, sunroofs, left and right rearview mirrors, radios, digital audio playback, reversing radar images, electronic navigators, seat heights, seat heating and air-conditioning electronic control units. The central processor of the vehicle platform part is connected to the projector and the touch screen. The front windshield of the car is a projection glass, and the projector projects the control map of the vehicle equipment on the front windshield. The gesture recognition part includes a digital signal processor DSP and 2 identical cameras A and B. In this example, the digital signal processor is connected with an infrared gainer, and the digital signal processor DSP adjusts the pulse width modulation duty cycle to control the infrared gainer. The video signal output terminals of camera A and camera B are connected to the digital signal processor through the serial peripheral interface.

As shown in Figure 2, two cameras are arranged in parallel with the lens facing upwards, which is convenient for finger operation. The distance between the lens centers of the two cameras is 50mm.

In this example, the central processor of the vehicle platform part is connected to the wireless communication module, the digital signal processor DSP of the gesture recognition part is connected to the DSP wireless module, and the vehicle platform part and the gesture recognition part are connected through wireless communication.

In this example, the refresh rate of the camera is 40 frames per second.

The gesture recognition part of the vehicle gesture control system in this example is installed in the control box. The control box in this example is a cuboid box. The upper shell of the control box has lens holes for two cameras and an exit hole for the infrared emitting lamp. The control box is placed under the steering wheel and next to the gear shift lever, and the driver's fingers operate above the camera lens hole of the control box. In this example, the vehicle-mounted platform is partially installed under the front windshield and on the engine cover.

The front windshield of this example is pasted with reflective film.

Embodiment of the method for using the gesture control system of the vehicle-mounted device

This example adopts the embodiment of the gesture control system for the vehicle-mounted device described above.

The central processor of the vehicle-mounted platform part obtains the control information of each vehicle-mounted device from the local area network of the electronic control unit of the vehicle-mounted device to generate a control map, and sends it to the projector to project the control map on the front windshield. As shown in Figure 2, the driver's finger moves in front of the lens of the camera. With the movement of the finger, the relevant control area of the control map projected on the front windshield of the car changes color sequentially and enlarges the current option. When you need to control the device, click with your finger in the air to confirm this option.

Two cameras monitor the position and movement of the fingers. The digital signal processor receives the signals from the two cameras and uses triangulation to calculate the trajectory of the finger based on the spatial coordinates of the two cameras at the same time. The specific location and direction of the driver, determine the device that the driver needs to control, and transmit the relevant control signal to the central processor of the vehicle platform. The central processor controls the corresponding device to change the operating state according to the control signal, or calls the Information is displayed on the windscreen.

During regular driving, that is, when the driver does not issue a gesture command, the vehicle-mounted platform system receives information from various vehicle-mounted devices in the CAN automotive electronic control unit LAN. And the control selection buttons of each vehicle equipment.

The above-mentioned embodiments are only specific examples for further specifying the purpose, technical solutions and beneficial effects of the present invention, and the present invention is not limited thereto. Any modifications, equivalent replacements, improvements, etc. made within the disclosed scope of the present invention are included in the protection scope of the present invention.

Claims (10)

1. mobile unit gestural control system, comprise vehicular platform part, the center processor of vehicular platform part is connected through network-bus with the electronic control unit local area network of mobile unit, and the electronic control unit local area network of mobile unit to be connected with in each Door Lock, each vehicle window skylight, left and right back mirror, radio receiver, DAB broadcasting, Reverse Sensor image, electronic navigator, height of seat, seat heating and air-conditioning any one or a few electronic control unit; It is characterized in that:

The center processor of described vehicular platform part connects projector, shield glass is projecting glass, projector is at the manipulation figure of front windshield projection mobile unit, native system also comprises gesture identification part, gesture identification part comprises the digital signal processor camera identical with 2, the vision signal incoming digital signal treater that 2 cameras export; The center processor of vehicular platform part is connected with the digital signal processor of gesture identification part through I2C bus or wireless telecommunications, and described camera is infrared pick-up head, and 2 camera parallel arranged, camera lens are towards identical.

2. mobile unit gestural control system according to claim 1, is characterized in that:

The distance of described 2 cam lens center-points is 40mm ~ 100mm.

3. mobile unit gestural control system according to claim 1, is characterized in that:

Described digital signal processor is connected through the mouth of Serial Peripheral Interface (SPI) with 2 cameras.

4. mobile unit gestural control system according to claim 1, is characterized in that:

Described camera refreshing frequency is more than or equal to 40 frames per second.

5. mobile unit gestural control system according to claim 1, is characterized in that:

Described shield glass posts reflective membrane.

6. mobile unit gestural control system according to claim 1, is characterized in that:

Described digital signal processor connects infrared multiplier (-icator).

7. mobile unit gestural control system according to claim 1, is characterized in that:

The center processor of described vehicular platform part is also connected to screen.

8. mobile unit gestural control system according to claim 6, is characterized in that:

The gesture identification part of described mobile unit gestural control system is installed in control capsule, and control capsule has the camera aperture of 2 cameras and the perforation hole of infrared emitting lamp, control capsule is placed in by operator's saddle; Vehicular platform part is arranged on below front windshield.

9. the using method of mobile unit gestural control system according to any one of claim 1 to 8, is characterized in that:

The manipulation information that the center processor of vehicular platform part obtains each mobile unit from the electronic control unit local area network of mobile unit produces manipulation figure, sends into projector and is projected on front windshield by manipulation figure;

Chaufeur finger moves in camera front, with relevant control region variable color and/or the current option of distortion display successively of the movement of finger, the manipulation figure of shield glass projection, when color change interval is required controlling equipment, points aerial click and determine this option;

The position that 2 camera head monitors are pointed before camera and motion, digital signal processor receives the signal of 2 cameras, adopt triangulation, the path of motion of finger is gone out according to the spatial coordinates calculation of 2 camera same times, particular location on the manipulation figure corresponding by finger and sensing, determine that chaufeur needs the equipment of manipulation, relevant manipulation signal is sent to the center processor of vehicular platform part, center processor changes running state by the corresponding equipment of this manipulation signal control, or show from corresponding equipment gathering information at front windshield.

10. the using method of mobile unit gestural control system according to claim 9, is characterized in that:

During conventional driving, vehicular platform system acceptance is from the information of each mobile unit of CAN vehicle electronic control unit local area network, and the item description that default display is schemed in manipulation are the control selection key of main driving states information and each mobile unit.