CN111275874B - Information display method, device and equipment based on face detection and storage medium - Google Patents

Abstract

The embodiment of the application discloses an information display method, device and equipment based on face detection and a storage medium. The technical scheme that this application embodiment provided is through opening at face identification entrance guard with scanning interface mode display scanning interface before, guide user's face scanning, and after face identification entrance guard successfully verified the user account, show information interface through information interface mode, show the information picture, convenience of customers knows the detailed information of information, and leave face identification entrance guard at the user after, resume to scanning interface mode, guide user's face scanning, optimize the bandwagon effect of information, improve user experience.

Description

Information display method, device, device and storage medium based on face detection

technical field

The embodiments of the present application relate to the field of computer technology, and in particular, to an information display method, apparatus, device, and storage medium based on face detection.

Background technique

With the strengthening of people's safety awareness, higher security requirements are put forward for the entry and exit of residential areas, office buildings and other places. In order to distinguish and block strangers, face recognition access control is generally installed at the entrances and exits of these places.

The face recognition access control recognizes and verifies the face at the entrance and exit, and opens the access control for the corresponding personnel to enter and exit after the verification is passed. At present, the face recognition access control is generally equipped with a display screen, and various information, such as advertisements and notifications, are displayed to people through the display screen.

In order to ensure that the user can perform face verification according to the guidance on the scanning interface of the display screen when scanning the face, the information displayed on the display screen is generally superimposed on the scanning interface for display, and for the display effect of the scanning interface, the information is generally Displaying images with smaller sizes affects the display effect of information.

SUMMARY OF THE INVENTION

Embodiments of the present application provide an information display method, device, device, and storage medium based on face detection, so as to improve the display effect of consultation.

In a first aspect, an embodiment of the present application provides an information display method based on face detection, including:

Determine a user account according to the face recognition result, and generate authentication success information based on the user account;

Based on the authentication success information, switching the display mode to the information interface mode;

Generate stay information for instructing the user to stay or leave according to the face recognition result;

Based on the stay information instructing the user to leave, the display mode is switched to the scan interface mode.

Further, before the user account is determined according to the face recognition result and the authentication success information is generated based on the user account, the method further includes:

Establish a binding relationship between user accounts and face verification images;

Determining a user account according to the face recognition result, and generating authentication success information based on the user account, including:

Obtain the face recognition results obtained by the face recognition access control shooting;

retrieving a face verification image that matches the face recognition result;

According to the binding relationship between the face verification image and the user account, determine the user account corresponding to the face recognition result;

Authentication success information is generated based on the user account.

Further, generating the stay information for instructing the user to stay or leave according to the face recognition result includes:

According to the face recognition result, determine whether the user stops at the face recognition access control, and generate the stop judgment result;

Based on the stop judgment result indicating that the user does not stop at the face recognition access control, generating stop information indicating the user to leave;

Based on the stop judgment result indicating the user to stop at the face recognition access control, stop information indicating the user to stop is generated.

Further, according to the face recognition result, determine whether the user stops at the face recognition access control, and generate a stop judgment result, including:

According to the face recognition results obtained in real time, determine whether there is a face at the face recognition access control;

If there is no face, generate a stop judgment result indicating that the user does not stay at the face recognition access control;

If there is a human face, then determine whether the human face corresponds to the user account based on the face recognition result;

If it does not correspond, generate a stop judgment result indicating that the user does not stop at the face recognition access control;

If it corresponds, a stop judgment result indicating that the user stops at the face recognition access control is generated.

Further, the method also includes:

An information image is acquired, and the information image is saved in an information image library, wherein the information image includes a first information image and a second information image, and the size of the first information image is larger than the size of the second information image.

Further, switching the display mode to the information interface mode based on the authentication success information includes:

Based on the authentication success information, switching the display mode to the information interface mode;

Control the face recognition access control based on the information interface mode to display the first information image;

The switching of the display mode to the scanning interface mode based on the stay information indicating the user to leave includes:

switching the display mode to a scan interface mode based on the stay information instructing the user to leave;

Based on the scanning interface mode, the face recognition access control is controlled to display the second information image and the scanning interface.

Further, switching the display mode to the information interface mode based on the authentication success information includes:

Based on the authentication success information, determine the user's first facial expression information according to the face recognition result;

determining a first information image for presentation based on the first facial expression information;

Switch the display mode to the information interface mode to control the face recognition access control to display the first information image.

Further, switching the display mode to the information interface mode based on the authentication success information includes:

Switching the display mode to an information interface mode based on the authentication success information;

Determine the information type of the corresponding user based on the information determination strategy of the user account;

determining a first infographic based on the intent infotype;

The face recognition access control is controlled to display the first information image based on the information interface mode.

Further, after the display mode is switched to the information interface mode based on the authentication success information, the method further includes:

Determine the user's expression change information based on the face recognition results obtained in real time;

The information determination policy of the user account is updated based on the expression change information.

Further, after the display mode is switched to the information interface mode based on the authentication success information, the method further includes:

generating a scan interface display instruction in response to the information withdrawal request;

The display mode is switched to the scan interface mode in response to the scan interface display instruction.

In a second aspect, an embodiment of the present application provides an information display device based on face detection, including an authentication module, an information interface switching module, a monitoring module, and a scanning interface switching module, wherein:

an authentication module, configured to determine a user account according to the face recognition result, and generate authentication success information based on the user account;

an information interface switching module, used for switching the display mode to the information interface mode based on the authentication success information;

a monitoring module, used for generating stay information for instructing the user to stay or leave according to the face recognition result;

The scanning interface switching module is configured to switch the display mode to the scanning interface mode based on the stay information instructing the user to leave.

In a third aspect, an embodiment of the present application provides a computer device, including: a memory and one or more processors;

the memory for storing one or more programs;

When the one or more programs are executed by the one or more processors, the one or more processors implement the method for displaying information based on face detection according to the first aspect.

In a fourth aspect, an embodiment of the present application provides a storage medium containing computer-executable instructions, the computer-executable instructions, when executed by a computer processor, are used to execute the face detection-based method described in the first aspect Information display method.

In the embodiment of the present application, the scanning interface is displayed in the scanning interface mode before the face recognition access control is opened, so as to guide the user's face scanning, and after the face recognition access control successfully verifies the user account, the information interface is displayed in the information interface mode. The information picture is displayed to facilitate users to understand the detailed information of the information, and after the user leaves the face recognition access control, it returns to the scanning interface mode to guide the user's face scan, optimize the display effect of the information, and improve the user experience.

Description of drawings

1 is a flowchart of a method for displaying information based on face detection provided by an embodiment of the present application;

2 is a flowchart of another information display method based on face detection provided by an embodiment of the present application;

3 is a flowchart of another information display method based on face detection provided by an embodiment of the present application;

4 is a flowchart of another information display method based on face detection provided by an embodiment of the present application;

5 is a schematic diagram of an information display device based on face detection provided by an embodiment of the present application;

FIG. 6 is a schematic structural diagram of a computer device provided by an embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present application clearer, the specific embodiments of the present application will be further described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, for the convenience of description, the drawings only show some but not all of the contents related to the present application. Before discussing the exemplary embodiments in greater detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart depicts various operations (or steps) as a sequential process, many of the operations may be performed in parallel, concurrently, or concurrently. Additionally, the order of operations can be rearranged. The process may be terminated when its operation is complete, but may also have additional steps not included in the figures. The processes may correspond to methods, functions, procedures, subroutines, subroutines, and the like.

1 shows a flowchart of a method for displaying information based on face detection provided by an embodiment of the present application. The method for displaying information based on face detection provided by an embodiment of the present application can be displayed by an information display device based on face detection. Execution, the information display device based on face detection can be implemented by means of hardware and/or software, and be integrated in computer equipment.

The following description takes the information display device based on face detection executing the information display method based on face detection as an example for description. 1, the information display method based on face detection includes:

S101: Determine a user account according to the face recognition result, and generate authentication success information based on the user account.

Exemplarily, the face recognition result is obtained by detecting the face by the face recognition access control, and the face recognition access control is provided with a camera for photographing the human face, and when the camera detects the human face, the feature analysis is performed on the face. Extraction to obtain face recognition results.

After receiving the face recognition result, the face recognition result is matched with the face verification image in the face image database. After the matching is successful, the face recognition access control will unlock the access control for the user to enter and exit the face recognition access control . There is a binding relationship between the face verification image and the user account, that is, the user uploads a personal face image as the face verification image when establishing a user account, binds the face verification image to the user account, and authenticates the face. The image is saved to the face image library.

Further, a display screen is provided on the face recognition access control, and when no user performs face scanning in front of the camera to unlock the access control, the display screen is displayed in the display mode of the scanning interface mode. In this embodiment, the display screen in the scanning interface mode displays the scanning interface (shooting screen) of the camera. Optionally, a portrait frame can be superimposed on the scanning interface to guide the user to adjust his posture and improve the appearance of the human face. Verify the recognition effect. In addition, information such as advertisements can also be displayed superimposed on the scanning interface in the form of small images, for example, the information can be displayed in the form of small images at the corners of the scanning interface.

Further, after it is determined that the face recognition access control successfully authenticates the user, the user account corresponding to the user is determined according to the face verification image matching the face recognition result, and authentication success information is generated based on the user account.

S102: Based on the authentication success information, switch the display mode to an information interface mode.

Exemplarily, after the authentication success information is generated, and the user has successfully verified the face at this time, the display mode of the face verification access control display screen can be switched to the information interface mode, so that the scanning interface displayed on the display screen is switched to the information image, And it is displayed on the screen in full screen, which is convenient for users to understand the details of the information.

Among them, the information image used for displaying in the information interface mode may be a picture saved on the face recognition access control, or may be a picture transmitted to the face recognition access control via the Internet, a local area network, or the like. Optionally, the number of information images may be one or more. When there are multiple information images, one information image may be randomly selected for display, or multiple information images may be scrolled and played at a set time interval.

S103: Generate stay information for instructing the user to stay or leave according to the face recognition result.

Exemplarily, when the information image is displayed in the information interface mode, the face recognition result captured by the face recognition access control camera is continuously obtained, and when the face is always detected, it is considered that the user has not left the display of the face recognition access control display screen. area, which can generate stop information that instructs the user to stay, maintain the information interface mode, and continuously display information images.

Further, when it is judged that no face is detected according to the face recognition result, it is considered that the user has left the display area of the face recognition access control display screen, and at this time, stay information instructing the user to leave is generated. Optionally, the stay information instructing the user to leave may be generated after it is judged that no face is detected according to the face judgment result, and lasts for a preset length of time.

S104: Based on the stay information indicating the user to leave, switch the display mode to a scan interface mode.

Exemplarily, after generating the stay information instructing the user to leave, in response to the stay information, the display mode of the face recognition access control display screen is switched to the scanning interface mode, and the information images of the scanning interface and the thumbnail mode are displayed, which is convenient for the user. face recognition for guidance.

Above, by displaying the scanning interface in the scanning interface mode before the face recognition access control is opened, the user's face scanning is guided, and after the face recognition access control successfully verifies the user account, the information interface is displayed through the information interface mode, and the information picture is displayed. It is displayed to facilitate users to understand the detailed information of the information, and after the user leaves the face recognition access control, it will return to the scanning interface mode to guide the user's face scanning, optimize the display effect of the information, and improve the user experience.

FIG. 2 is a flowchart of another information display method based on face detection provided by an embodiment of the present application. The information display method based on face detection is an embodiment of the above-mentioned information display method based on face detection. Referring to Figure 2, the information display method based on face detection includes:

S201: Establish a binding relationship between the user account and the face verification image.

Exemplarily, the establishment of the user account may be performed on a portal website, WeChat, QQ, Weibo and other network platforms. For example, register a user account on a pre-built WeChat applet, WeChat official account or portal website, and upload the user's personal face image as a face verification image by taking a photo or selecting a local storage path. Images are bound to user accounts and stored in the face image library.

S202: Acquire an information image, and save the information image in an information image library.

Wherein, the information image includes a first information image and a second information image, and the size of the first information image is larger than the size of the second information image.

Specifically, the information image can be obtained through the Internet, a local area network, etc. After the information image is obtained, the information image is saved in a pre-built information image library. Wherein, the information image may be an advertisement image, a notification information image, a daily information image, and the like.

In this embodiment, the information image includes a first information image and a second information image. Generally, the size of the first information image is larger than the size of the second information image. In other embodiments, the first information image and the second information image may also be the same picture, but when displayed in the information interface mode and the scanning interface mode, they are divided into the first information according to the size displayed on the display screen image and a second informational image.

Optionally, the received information image may include the first information image and the second information image, or may only include the first information image, and after the first information image is received, the first information image is processed as the second information image. The information image, for example, reducing or taking a screenshot of the first information image. In other embodiments, the second information image may also be a two-dimensional code, and the two-dimensional code may be generated based on link information attached to the first information image after receiving the first information image.

S203: Acquire a face recognition result obtained by photographing a face recognition access control, and retrieve a face verification image matching the face recognition result.

Specifically, a face recognition access control is provided with a camera for photographing a face, and when the camera detects a face, the camera performs feature analysis and extraction on the face to obtain a face recognition result. At the same time, a display screen is provided on the face recognition access control. When no user scans the face in front of the camera to unlock the access control, the display screen is displayed in the display mode of the scanning interface mode. In this embodiment, the display screen in the scanning interface mode displays the scanning interface (shooting screen) of the camera. Optionally, a portrait frame can be superimposed on the scanning interface to guide the user to adjust his posture and improve the appearance of the human face. Verify the recognition effect. In addition, information such as advertisements can also be displayed superimposed on the scanning interface in the form of small images, for example, the information can be displayed in the form of small images at the corners of the scanning interface.

Further, after receiving the face recognition result, the face recognition result is matched with the face verification image in the face image database, and the face verification image matching the face recognition result is determined.

Optionally, after the matching is successful, the face recognition access control unlocks the access control for the user to enter and exit the face recognition access control. In other embodiments, a face image library can also be set in the face recognition access control, and after the face recognition result is generated, the face verification image is matched locally to improve the speed of unlocking the access control.

S204: Determine the user account corresponding to the face recognition result according to the binding relationship between the face verification image and the user account, and generate authentication success information based on the user account.

Specifically, after matching the face verification image corresponding to the face recognition result, the user account bound to the face verification image is determined according to the binding relationship between the face verification image and the user account, and based on the user account Generate authentication success information.

S205: Based on the authentication success information, switch the display mode to the information interface mode, and control the face recognition access control to display the first information image.

Specifically, after the authentication success information is generated, the display mode of the face recognition access control display screen is switched from the scanning interface mode to the information interface mode, and the first information image is obtained from the information image library. Optionally, if there are multiple first information images in the information image library, one or more first information images may be randomly selected, or the newly saved first information image may be selected according to the storage time of the first information image, and the Different preset display times may be set for different information images, and an appropriate first information image may be determined according to the corresponding relationship between the current time and the preset display time.

Further, after the display mode is switched to the information interface mode and the first information image to be displayed is determined, the face recognition access control display screen is controlled to display the first information image. If it is determined that there are multiple first information images, the first information images may be displayed in sequence by means of scrolling playback.

Optionally, the display mode of the first information image may be full-screen display, or a display area for displaying the first information image may be pre-defined on the display interface. Optionally, the size of the first information image can be judged first, and compared with the size of the area used to display the first information image in the display screen, and the first information image can be processed (such as cropping, stretching, scaling, etc.) to fit the first informational image to the size of the area used to display the first informational image.

S206: According to the face recognition result, determine whether the user stops at the face recognition access control, and generate a stop judgment result.

Exemplarily, according to the face recognition result obtained by the face recognition access control camera in real time, it is judged whether the user stays at the face recognition access control place, and the judgment result is generated according to the judgment result. Specifically, it includes steps S2061-S2065:

S2061: Determine whether there is a human face at the face recognition access control according to the face recognition result obtained in real time.

Specifically, after the camera control display screen displays the first information image in the information interface mode, the face recognition access control continuously detects whether there is a human face in the picture captured by the camera according to the face retrieval algorithm.

S2062: If there is no human face, generate a stop judgment result indicating that the user does not stop at the face recognition gate.

Specifically, when the face recognition access control detects that there is no face in the image captured by the camera according to the face recognition algorithm, a stop judgment result indicating that the user does not stay at the face recognition access control is generated.

In other embodiments, the stay judgment indicating that the user does not stay at the face recognition access control is generated only when the face recognition access control detects that there is no human face in the image captured by the camera according to the face recognition algorithm and continues for a preset length of time. result; or only when the face recognition access control detects that there is no face in several consecutive frames of the camera according to the face recognition algorithm, the stop judgment result indicating that the user does not stay at the face recognition access control is generated to ensure that the user The corresponding judgment result is generated only when it leaves the shooting range of the camera.

S2063: If there is a human face, determine whether the human face corresponds to the user account based on the face recognition result.

Specifically, when the face recognition access control detects that there is a face in the picture captured by the camera according to the face recognition algorithm, it retrieves the face verification image corresponding to the user account based on the authentication success information, and according to the face recognition result and the face The verification image is compared for features, so as to determine whether the user corresponding to the face recognition result is the user corresponding to the user account.

S2064: If not corresponding, generate a stop judgment result indicating that the user does not stop at the face recognition access control.

Specifically, if the comparison result between the face recognition result and the face verification image does not correspond, it is considered that the user who triggered the face verification access control has left, and a stop indicating that the user does not stay at the face recognition access control is generated based on the comparison result. critical result.

In other embodiments, a stop judgment result indicating that the user does not stay at the face recognition access control is generated only when the comparison result between the face recognition result and the face verification image does not correspond and continues for a preset length of time; or It is only when the comparison results of the face recognition results corresponding to several consecutive frames of shooting images and the face verification images do not correspond, the stop judgment result indicating that the user does not stay at the face recognition access control is generated to ensure that the user leaves the camera for shooting. range to generate the corresponding judgment result.

S2065: If corresponding, generate a stop judgment result instructing the user to stop at the face recognition access control.

Specifically, if the comparison result between the face recognition result and the face verification image is that the face corresponds to the user account, and it is considered that the user who triggered the face verification access control is still staying at the face verification access control, an instruction is generated based on the comparison result. The stop judgment result of the user staying at the face recognition access control.

S207: Generate stay information for instructing the user to stay or leave based on the stay judgment result.

Exemplarily, based on the stop judgment result indicating that the user does not stop at the face recognition access control, generate stop information indicating the user to leave, and based on the stop judgment result indicating the user to stay at the face recognition access control, generate the stop information indicating the user to stay. .

Specifically, when generating a stop judgment result indicating that the user does not stay at the face recognition access control, it is confirmed that the user has left the shooting range of the face recognition access control camera, or the user has not observed the information image on the display screen. Indicates the stay information that the user left.

Further, when generating a stop judgment result indicating that the user stays at the face recognition access control, it is confirmed that the user is still within the shooting range of the face recognition access control camera, or the user is observing the information image on the display screen, then The stay information indicating the user's stay is generated.

It can be understood that, when the stay information instructing the user to stay is generated, the display mode of the display screen remains in the information interface mode, which is convenient for the user to know the information details.

S208: Based on the stay information instructing the user to leave, switch the display mode to the scan interface mode, and control the face recognition access control to display the second information image and the scan interface.

Exemplarily, when the stay information instructing the user to leave is generated, it is determined that the user who took out the face verification access control unlock has left, and the scanning interface needs to be redisplayed to guide the face unlock operation of the next user.

Specifically, based on the stay information instructing the user to leave, a second information image is obtained from the information image library. Optionally, if there are multiple second information images in the information image library, one or more second information images may be randomly selected. The information image, or the newly saved second information image is selected according to the storage time of the second information image, or different preset display times can be set for different information images, which is determined according to the corresponding relationship between the current time and the preset display time. A suitable second informational image.

Further, after the display mode is switched to the scanning interface mode and the second information image to be displayed is determined, the face recognition access control display screen is controlled to display the second information image. If it is determined that there are multiple second information images, the second information images may be displayed in sequence by scrolling.

Optionally, the display manner of the second information image may be that a display area for displaying the second information image is pre-defined on the scanning interface. Optionally, the size of the second information image can be judged first, and compared with the size of the area used to display the second information image in the display screen, and the second information image can be processed (such as cropping, stretching, scaling, etc.) to adapt the second informational image to the size of the area used to display the second informational image.

Above, by displaying the scanning interface in the scanning interface mode before the face recognition access control is opened, the user's face scanning is guided, and after the face recognition access control successfully verifies the user account, the information interface is displayed through the information interface mode, and the information picture is displayed. It is displayed to facilitate users to understand the detailed information of the information, and after the user leaves the face recognition access control, it will return to the scanning interface mode to guide the user's face scanning, optimize the display effect of the information, and improve the user experience. And according to whether the user stays at the face recognition access control and whether the user who stays at the face recognition access control is the same user who triggered the unlocking, judge the timing of switching to the scanning interface mode, ensure the normal use of the face recognition access control by the user, and optimize the user experience.

FIG. 3 is a flowchart of another information display method based on face detection provided by an embodiment of the present application. The information display method based on face detection is an embodiment of the above-mentioned information display method based on face detection. 3, the information display method based on face detection includes:

S301: Acquire an information image, and save the information image in an information image library.

Wherein, the information image includes a first information image and a second information image, and the size of the first information image is larger than the size of the second information image.

Specifically, the information image can be obtained through the Internet, a local area network, etc. After the information image is obtained, the information image is saved in a pre-built information image library. Wherein, the information image may be an advertisement image, a notification information image, a daily information image, and the like.

In this embodiment, the information image includes a first information image and a second information image. Generally, the size of the first information image is larger than the size of the second information image. In other embodiments, the first information image and the second information image may also be the same picture, but when displayed in the information interface mode and the scanning interface mode, they are divided into the first information according to the size displayed on the display screen image and a second informational image.

Optionally, the received information image may include the first information image and the second information image, or may only include the first information image, and after the first information image is received, the first information image is processed as the second information image. The information image, for example, reducing or taking a screenshot of the first information image. In other embodiments, the second information image may also be a two-dimensional code, and the two-dimensional code may be generated based on link information attached to the first information image after receiving the first information image.

Further, before uploading the information image, the information image can be bound to the corresponding expression features according to the users with different expression states that the information image is expected to face. users, or advertising information such as coffee can be targeted to users under the expression features that represent tired expressions. It can be understood that an information image may be bound with multiple expression features, or may not be bound with expression features.

S302: Determine a user account according to the face recognition result, and generate authentication success information based on the user account.

S303: Based on the authentication success information, determine the first facial expression information of the user according to the face recognition result.

Specifically, after the user account is successfully authenticated and the authentication success information is generated, the facial expression recognition model is invoked, the facial expression recognition result is used as input, and the facial expression recognition model is processed to output the first expression information representing the user's expression state.

Among them, the facial expression recognition model can be built based on the convolutional neural network, and the facial expression recognition model is trained through a large number of user face photos in different expression states, until the training times and recognition accuracy reach the preset requirements, that is, it is completed. Training of Facial Expression Recognition Models. After inputting the face recognition result, the corresponding expression information can be output.

S304: Determine a first information image for display based on the first facial expression information.

Specifically, after the first expression information is generated, an expression feature matching the first expression information is determined based on the first expression information, the first information image corresponding to the expression characteristic is retrieved in the information image database, and the bound expression The first information image whose feature matches the expression feature confirmed based on the first expression information is determined as the first information image for presentation.

In other embodiments, if no matching first information image is retrieved, one or more first information images may be randomly selected from the information image library, or the newly saved first information image may be selected according to the saving time of the first information image. For an information image, different preset display times may also be set for different information images, and an appropriate first information image may be determined according to the corresponding relationship between the current time and the preset display time.

S305: Switch the display mode to the information interface mode, so as to control the face recognition access control to display the first information image.

The display mode of the face recognition access control display screen is switched from the scanning interface mode to the information interface mode, and the first information image is obtained from the information image library. Optionally, if there are multiple first information images in the information image library, one or more first information images may be randomly selected, or the newly saved first information image may be selected according to the storage time of the first information image, and the Different preset display times may be set for different information images, and an appropriate first information image may be determined according to the corresponding relationship between the current time and the preset display time.

Further, after the display mode is switched to the information interface mode and the first information image to be displayed is determined, the face recognition access control display screen is controlled to display the first information image. If it is determined that there are multiple first information images, the first information images may be displayed in sequence by means of scrolling playback.

S306: Generate a scan interface display instruction in response to the information withdrawal request.

Specifically, the information withdrawal request may be generated based on the triggering of the information withdrawal button, or may be generated based on the user's action gesture.

Exemplarily, while the face recognition access control displays the first information image based on the information interface mode, the information withdrawal button can be displayed synchronously on the display screen, and the information withdrawal request can be generated based on the touch operation on the information withdrawal button; A physical button is set as the information withdrawal button on the face recognition access control, and an information withdrawal request is generated in response to the pressing operation of the information withdrawal button, and a scanning interface display instruction is generated in response to the information withdrawal request.

In one embodiment, the action gestures of the user triggering the information withdrawal request are captured in advance, and a withdrawal action template is generated based on these action gestures. The user's video is collected by the face recognition access control camera, and the user's actions are captured based on the user's video to generate the corresponding action gesture. These action gestures are compared in the retraction action template, and when a gesture action whose coincidence degree reaches a preset threshold is successfully matched, an information retraction request is generated, and a scan interface display instruction is generated in response to the information retraction request.

S307: Switch the display mode to the scan interface mode in response to the scan interface display instruction.

Specifically, based on the scan interface display instruction, the display mode is switched to the scan interface mode, the second information image to be displayed is determined, and the face recognition access control display screen is controlled to display the second information image.

S308: Generate stay information for instructing the user to stay or leave according to the face recognition result.

S309: Based on the stay information instructing the user to leave, switch the display mode to the scan interface mode, and control the face recognition access control to display the second information image and the scan interface.

Above, by displaying the scanning interface in the scanning interface mode before the face recognition access control is opened, the user's face scanning is guided, and after the face recognition access control successfully verifies the user account, the information interface is displayed through the information interface mode, and the information picture is displayed. It is displayed to facilitate users to understand the detailed information of the information, and after the user leaves the face recognition access control, it will return to the scanning interface mode to guide the user's face scanning, optimize the display effect of the information, and improve the user experience. And the first information image displayed to the user is determined based on the expression to improve the information display effect. At the same time, according to the information withdrawal request triggered by the user, it is switched back to the scanning interface mode, which is convenient for the user to use the face to verify the access control and optimize the user experience.

FIG. 4 is a flowchart of another information display method based on face detection provided by an embodiment of the present application. The information display method based on face detection is an embodiment of the above-mentioned information display method based on face detection. 4, the information display method based on face detection includes:

S401: Acquire an information image, and save the information image in an information image library.

Wherein, the information image includes a first information image and a second information image, and the size of the first information image is larger than the size of the second information image.

Specifically, the information image can be obtained through the Internet, a local area network, etc. After the information image is obtained, the information image is saved in a pre-built information image library. Wherein, the information image may be an advertisement image, a notification information image, a daily information image, and the like.

In this embodiment, the information image includes a first information image and a second information image. Generally, the size of the first information image is larger than the size of the second information image. In other embodiments, the first information image and the second information image may also be the same picture, but when displayed in the information interface mode and the scanning interface mode, they are divided into the first information according to the size displayed on the display screen image and a second informational image.

Further, before uploading the information image, the information type of the information image can be determined according to the content of the information image, and the information type can be bound with the information image.

S402: Determine a user account according to the face recognition result, and generate authentication success information based on the user account.

S403: Switch the display mode to the information interface mode based on the authentication success information, and determine the policy based on the information of the user account, and determine the type of intention information of the corresponding user.

Specifically, after the authentication success information is generated, the display mode of the face recognition access control display screen is switched from the scanning interface mode to the information interface mode, and the policy is determined based on the information bound to the user account to determine the type of intention information corresponding to the user.

Wherein, when a user account is established, the user account is bound with a preset information determination strategy. Optionally, the information determination policy bound to each user account can be modified according to the needs of the user.

Exemplarily, the information determination strategy may be to set corresponding weights for different information types, and determine the reference score of each information type according to the product of the weight and the preset reference base of the information type, and the highest score may be determined according to the ranking of the reference scores. , and determine the information type as the intended information type of the corresponding user. The reference base can be determined when the corresponding information type is established, and can also be modified adaptively in the subsequent use process.

S404: Determine a first information image based on the intention information type, and control the face recognition access control to display the first information image.

Exemplarily, after the user's intention information type is determined, the information type corresponding to the intention information type is determined, and the first information image bound to the information type is retrieved in the information image library to determine the information image for displaying. The first informational image.

Further, after the display mode is switched to the information interface mode and the first information image to be displayed is determined, the face recognition access control display screen is controlled to display the first information image.

S405: Determine the expression change information of the user based on the face recognition result obtained in real time.

Specifically, when the face recognition access control display screen is controlled to operate in the information interface mode, the user's expression change information is obtained based on the facial expression recognition model.

For example, after the running information interface mode reaches a preset time length, the second expression information of the user is obtained based on the facial expression recognition model, and the second expression information is compared with the first expression information determined by the user in the door unlocking stage, and the User's facial expression change information. Optionally, different score values can be set for different expression information (for example, the score value of the expression information corresponding to happiness is higher than the score value of the expression information corresponding to loss), and the difference between the score values corresponding to the two expression information can be determined. The magnitude and direction of expression change can be judged, and the difference can be used as expression change information.

S406: Update the information determination policy of the user account based on the expression change information.

Specifically, after obtaining the expression change information, the information determination strategy of the user account is updated based on the magnitude and direction of the expression change reflected by the expression change information. For example, perform addition and subtraction operations on the weights of the corresponding information types according to the difference and the positive and negative values of the scores corresponding to the two expressions of information (for example, determine the addition and subtraction operations according to the size of the difference and the range corresponding to the positive and negative values) the corresponding value). Optionally, the endpoint value of the weight of the information type may be set, so that the updated information determination strategy is kept within a reasonable range.

S407: Generate stay information for instructing the user to stay or leave according to the face recognition result.

S408: Based on the stay information instructing the user to leave, switch the display mode to the scan interface mode, and control the face recognition access control to display the second information image and the scan interface.

Above, by displaying the scanning interface in the scanning interface mode before the face recognition access control is opened, the user's face scanning is guided, and after the face recognition access control successfully verifies the user account, the information interface is displayed through the information interface mode, and the information picture is displayed. It is displayed to facilitate users to understand the detailed information of the information, and after the user leaves the face recognition access control, it will return to the scanning interface mode to guide the user's face scanning, optimize the display effect of the information, and improve the user experience. At the same time, the first information image displayed to the user is determined according to the information determination strategy corresponding to the user account, and the information determination strategy is updated based on the change of the user's expression, so as to improve the user experience.

FIG. 5 is a schematic diagram of an information display device based on face detection provided by an embodiment of the present application. Referring to FIG. 5 , the information display device based on face detection includes an authentication module 51 , an information interface switching module 52 , a monitoring module 53 and a scanning interface switching module 54 .

Among them, the authentication module 51 is used to determine the user account according to the face recognition result, and generate authentication success information based on the user account; the information interface switching module 52 is used to switch the display mode to the information interface based on the authentication success information The monitoring module 53 is used to generate stay information for instructing the user to stay or leave according to the face recognition result; the scanning interface switching module 54 is used to switch the display mode to the scanning interface based on the stay information instructing the user to leave model.

Above, by displaying the scanning interface in the scanning interface mode before the face recognition access control is opened, the user's face scanning is guided, and after the face recognition access control successfully verifies the user account, the information interface is displayed through the information interface mode, and the information picture is displayed. It is displayed to facilitate users to understand the detailed information of the information, and after the user leaves the face recognition access control, it will return to the scanning interface mode to guide the user's face scanning, optimize the display effect of the information, and improve the user experience.

The embodiment of the present application further provides a computer device, and the computer device can integrate the information display device based on the face detection provided by the embodiment of the present application. FIG. 6 is a schematic structural diagram of a computer device provided by an embodiment of the present application. 6, the computer device includes: an input device 63, an output device 64, a memory 62, and one or more processors 61; the memory 62 is used to store one or more programs; when the one or more programs Executed by the one or more processors 61, so that the one or more processors 61 implement the information display method based on face detection provided in the above-mentioned embodiments. The input device 63 , the output device 64 , the memory 62 and the processor 61 may be connected through a bus or in other ways, and the connection through a bus is taken as an example in FIG. 6 .

The memory 62, as a readable storage medium for a computing device, can be used to store software programs, computer-executable programs, and modules, such as program instructions/modules (such as program instructions/modules corresponding to the information display method based on face detection described in any embodiment of the present application). , the authentication module 51, the information interface switching module 52, the monitoring module 53 and the scanning interface switching module 54 in the information display device based on face detection). The memory 62 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the device, and the like. Additionally, memory 62 may include high speed random access memory, and may also include nonvolatile memory, such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some examples, memory 62 may further include memory located remotely from processor 61, which may be connected to the device through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The input device 63 may be used to receive input numerical or character information, and to generate key signal input related to user settings and function control of the device. The output device 64 may include a display device such as a display screen.

The processor 61 executes various functional applications and data processing of the device by running the software programs, instructions and modules stored in the memory 62, that is, to implement the above-mentioned information display method based on face detection.

The information display device and computer equipment based on face detection provided above can be used to execute the information display method based on face detection provided by the above embodiments, and have corresponding functions and beneficial effects.

Embodiments of the present application further provide a storage medium containing computer-executable instructions, when the computer-executable instructions are executed by a computer processor, the computer-executable instructions are used to execute the information display method based on face detection provided by the above-mentioned embodiments. An information display method for face detection includes: determining a user account according to a face recognition result, and generating authentication success information based on the user account; switching a display mode to an information interface mode based on the authentication success information; according to the face recognition result Generate stay information for instructing the user to stay or leave; and switch the display mode to the scanning interface mode based on the stay information instructing the user to leave.

storage medium - any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media, such as CD-ROMs, floppy disks, or tape devices; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc. ; non-volatile memory, such as flash memory, magnetic media (eg hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in the first computer system in which the program is executed, or may be located in a second, different computer system connected to the first computer system through a network such as the Internet. The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media that may reside in different locations (eg, in different computer systems connected by a network). The storage medium may store program instructions (eg, embodied as a computer program) executable by one or more processors.

Of course, a storage medium containing computer-executable instructions provided by the embodiments of the present application is not limited to the information display method based on face detection as described above, and the computer-executable instructions of the computer-executable instructions can also be implemented in any embodiment of the present application. The related operations in the information display method based on face detection.

The information display device, equipment and storage medium based on face detection provided in the above-mentioned embodiments can perform the information display method based on face detection provided by any embodiment of the present application, and the technical details not described in detail in the above-mentioned embodiments, Reference may be made to the information display method based on face detection provided by any embodiment of the present application.

The above are only the preferred embodiments of the present application and the applied technical principles. The present application is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions that can be made by those skilled in the art will not depart from the protection scope of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present application. The scope is determined by the scope of the claims.

Claims (11)

1. An information display method based on face detection is characterized by comprising the following steps:

acquiring an information image, and storing the information image in an information image library, wherein the information image comprises a first information image and a second information image, and the size of the first information image is larger than that of the second information image;

determining a user account according to the face recognition result, and generating authentication success information based on the user account;

based on the authentication success information, switching the display mode to an information interface mode;

controlling a face recognition access control to display a first information image based on an information interface mode;

generating stay information for indicating a user to stay or leave according to the face recognition result;

switching a display mode to a scan interface mode based on the stay information indicating that the user leaves;

and controlling the face recognition access control to display a second information image and a scanning interface based on the scanning interface mode.

2. The information display method based on face detection as claimed in claim 1, wherein before determining the user account according to the face recognition result and generating the authentication success information based on the user account, the method further comprises:

establishing a binding relationship between a user account and a face verification image;

the determining a user account according to the face recognition result and generating authentication success information based on the user account includes:

acquiring a face recognition result obtained by face recognition entrance guard shooting;

retrieving a face verification image matched with the face recognition result;

determining the user account corresponding to the face recognition result according to the binding relationship between the face verification image and the user account;

and generating authentication success information based on the user account.

3. The information display method based on face detection as claimed in claim 1, wherein the generating of stay information for indicating a stay or a departure of a user according to a face recognition result comprises:

judging whether the user stays at the face recognition entrance guard or not according to the face recognition result, and generating a stay judgment result;

generating stay information indicating that the user leaves based on a stay judgment result indicating that the user does not stay at the face recognition entrance guard;

and generating stay information indicating that the user stays based on a stay judgment result indicating that the user stays at the face recognition entrance guard.

4. The information display method based on face detection according to claim 3, wherein the determining whether the user stays at the face recognition entrance guard according to the face recognition result to generate a stay determination result comprises:

judging whether a face exists at a face recognition entrance guard or not according to a face recognition result obtained in real time;

if the face does not exist, generating a stopping judgment result indicating that the user does not stop at the face recognition entrance guard;

if the face exists, judging whether the face corresponds to the user account or not based on the face recognition result;

if not, generating a stopping judgment result indicating that the user does not stop at the face recognition entrance guard;

and if so, generating a stopping judgment result indicating that the user stops at the face recognition entrance guard.

5. The information display method based on human face detection as claimed in claim 1, wherein the switching the display mode to the information interface mode based on the authentication success information comprises:

determining first expression information of the user according to the face recognition result based on the authentication success information;

determining a first information image for display based on the first expression information;

and switching the display mode into an information interface mode to control the face recognition access control to display the first information image.

6. The information display method based on human face detection as claimed in claim 1, wherein the switching the display mode to the information interface mode based on the authentication success information comprises:

switching the display mode to an information interface mode based on the authentication success information;

determining the intention information type of the corresponding user based on the information determination strategy of the user account;

determining a first information image based on the intention information type;

and controlling a face recognition entrance guard to display the first information image based on an information interface mode.

7. The information display method based on face detection as claimed in claim 6, wherein after switching the display mode to the information interface mode based on the authentication success information, further comprising:

determining expression change information of a user based on a face recognition result obtained in real time;

and updating the information determination strategy of the user account based on the expression change information.

8. The information display method based on human face detection as claimed in claim 1, wherein after switching the display mode to the information interface mode based on the authentication success information, further comprising:

generating a scanning interface display instruction in response to the information withdrawal request;

and responding to the scanning interface display instruction to switch the display mode into the scanning interface mode.

9. The utility model provides an information display device based on face detection which characterized in that, includes authentication module, information interface switching module, monitoring module and scanning interface switching module, wherein:

the acquisition module is used for acquiring information images and storing the information images in an information image library, wherein the information images comprise a first information image and a second information image, and the size of the first information image is larger than that of the second information image;

the authentication module is used for determining a user account according to a face recognition result and generating authentication success information based on the user account;

the information interface switching module is used for switching the display mode into an information interface mode based on the authentication success information;

the display module is used for controlling the face recognition access control to display a first information image based on the information interface mode;

the monitoring module is used for generating stay information for indicating a user to stay or leave according to the face recognition result;

the scanning interface switching module is used for switching the display mode into the scanning interface mode based on the stopping information indicating that the user leaves;

the display module is also used for controlling the face recognition access control to display a second information image and a scanning interface based on the scanning interface mode.

10. A computer device, comprising: a memory and one or more processors;

the memory for storing one or more programs;

when executed by the one or more processors, cause the one or more processors to implement the method for displaying information based on face detection according to any one of claims 1-8.

11. A storage medium containing computer-executable instructions for performing the method for displaying information based on face detection according to any one of claims 1 to 8 when executed by a computer processor.

Images