+

CN110266994A - Video call method, video call device and terminal - Google Patents

Video call method, video call device and terminal Download PDF

Info

Publication number
CN110266994A
CN110266994A CN201910561823.4A CN201910561823A CN110266994A CN 110266994 A CN110266994 A CN 110266994A CN 201910561823 A CN201910561823 A CN 201910561823A CN 110266994 A CN110266994 A CN 110266994A
Authority
CN
China
Prior art keywords
face
target
face data
image
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910561823.4A
Other languages
Chinese (zh)
Other versions
CN110266994B (en
Inventor
徐潜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dongguan Bubugao Education Software Co ltd
Original Assignee
Guangdong Genius Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Genius Technology Co Ltd filed Critical Guangdong Genius Technology Co Ltd
Priority to CN201910561823.4A priority Critical patent/CN110266994B/en
Publication of CN110266994A publication Critical patent/CN110266994A/en
Application granted granted Critical
Publication of CN110266994B publication Critical patent/CN110266994B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/73Deblurring; Sharpening
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephone Function (AREA)

Abstract

本申请适用于通信技术领域,提供一种视频通话方法、视频通话装置及终端,其中方法包括:获取目标对端发送的视频图像;根据所述视频图像,在确定所述视频图像中包含人脸图像的情况下,从预设人脸数据库中获取与所述人脸图像相匹配的目标人脸数据;基于所述目标人脸数据,对所述视频图像进行人脸清晰度修复,得到目标视频图像;显示所述目标视频图像,提升视频通话过程中的人脸画质,提升画面清晰度,实现高清视频通话。

The present application is applicable to the technical field of communication, and provides a video call method, a video call device, and a terminal, wherein the method includes: acquiring a video image sent by the target peer; determining that the video image contains a human face according to the video image In the case of an image, the target face data matching the face image is obtained from the preset face database; based on the target face data, the video image is carried out to restore the face clarity to obtain the target video Image: displaying the target video image, improving the image quality of the face during the video call, improving the definition of the picture, and realizing the high-definition video call.

Description

一种视频通话方法、视频通话装置及终端A video call method, video call device and terminal

技术领域technical field

本申请属于通信技术领域,尤其涉及一种视频通话方法、视频通话装置及终端。The present application belongs to the technical field of communication, and in particular relates to a video call method, a video call device and a terminal.

背景技术Background technique

随着社会发展,学生及年龄小的孩子的安全受到人们的重视。家长通常会给孩子配备电话手表等电子设备,以便于能够及时与孩子进行视频或电话联系,以及实现孩子丢失时的定位找回。With the development of society, the safety of students and young children is valued by people. Parents usually equip their children with electronic devices such as phones and watches, so that they can make video or telephone contact with their children in time, and realize the positioning and retrieval of children when they are lost.

而当前电话手表等设备通常会受摄像头品质、网络质量、功耗、环境光等因素影响,在视频通话时,对端显示出的人像比较模糊,视频通话体验不是很好。当前通用做法是提高摄像头的像素,但是摄像头像素的提高,仍然无法抵消其他因素对视频清晰度的影响,无法真正实现高清视频通话。However, current devices such as phones and watches are usually affected by factors such as camera quality, network quality, power consumption, and ambient light. During a video call, the portrait displayed on the opposite end is relatively blurred, and the video call experience is not very good. The current common practice is to increase the pixel of the camera, but the improvement of the pixel of the camera still cannot offset the impact of other factors on the video clarity, and cannot truly realize high-definition video calls.

发明内容Contents of the invention

有鉴于此,本申请实施例提供了一种视频通话方法、视频通话装置及终端,以解决现有技术中受摄像头品质、网络质量、功耗、环境光等因素影响,视频通话中人像清晰度不高的问题。In view of this, the embodiment of the present application provides a video call method, a video call device, and a terminal to solve the problems in the prior art that are affected by factors such as camera quality, network quality, power consumption, and ambient light. Not a high question.

本申请实施例的第一方面提供了一种视频通话方法,包括:The first aspect of the embodiments of the present application provides a video call method, including:

获取目标对端发送的视频图像;Obtain the video image sent by the target peer;

根据所述视频图像,在确定所述视频图像中包含人脸图像的情况下,从预设人脸数据库中获取与所述人脸图像相匹配的目标人脸数据;According to the video image, when it is determined that the video image contains a human face image, the target human face data matching the human face image is obtained from a preset human face database;

基于所述目标人脸数据,对所述视频图像进行人脸清晰度修复,得到目标视频图像;Based on the target face data, performing face definition restoration on the video image to obtain the target video image;

显示所述目标视频图像。The target video image is displayed.

本申请实施例的第二方面提供了一种视频通话装置,包括:The second aspect of the embodiment of the present application provides a video call device, including:

第一获取模块,用于获取目标对端发送的视频图像;The first obtaining module is used to obtain the video image sent by the target peer;

第二获取模块,用于根据所述视频图像,在确定所述视频图像中包含人脸图像的情况下,从预设人脸数据库中获取与所述人脸图像相匹配的目标人脸数据;The second acquisition module is configured to acquire target face data matching the face image from a preset face database when it is determined that the video image contains a face image according to the video image;

修复模块,用于基于所述目标人脸数据,对所述视频图像进行人脸清晰度修复,得到目标视频图像;A restoration module, configured to restore the face definition of the video image based on the target face data, to obtain the target video image;

显示模块,用于显示所述目标视频图像。A display module, configured to display the target video image.

本申请实施例的第三方面提供了一种终端,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如第一方面所述方法的步骤。The third aspect of the embodiments of the present application provides a terminal, including a memory, a processor, and a computer program stored in the memory and operable on the processor. When the processor executes the computer program, the The steps of the method as described in the first aspect.

本申请实施例的第四方面提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时实现如第一方面所述方法的步骤。A fourth aspect of the embodiments of the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method described in the first aspect are implemented.

本申请的第五方面提供了一种计算机程序产品,所述计算机程序产品包括计算机程序,所述计算机程序被一个或多个处理器执行时实现如上述第一方面所述方法的步骤。A fifth aspect of the present application provides a computer program product, where the computer program product includes a computer program, and when the computer program is executed by one or more processors, the steps of the method described in the first aspect above are realized.

由上可见,本申请实施例中,通过获取目标对端发送的视频图像,在确定视频图像中包含人脸图像的情况下,从预设人脸数据库中获取与人脸图像相匹配的目标人脸数据;基于该目标人脸数据,对视频图像进行人脸清晰度修复,得到目标视频图像并显示,在不增加对端的流量和功耗及不改变对端硬件设置的前提下,提升视频通话过程中的人脸画质,提升画面清晰度,实现高清视频通话。It can be seen from the above that in the embodiment of the present application, by acquiring the video image sent by the target peer, and in the case of determining that the video image contains a face image, the target person matching the face image is obtained from the preset face database. Face data; based on the target face data, the face definition of the video image is repaired, the target video image is obtained and displayed, and the video call is improved without increasing the traffic and power consumption of the peer end and without changing the hardware settings of the peer end The image quality of the face in the process is improved to improve the clarity of the picture and realize high-definition video calls.

附图说明Description of drawings

为了更清楚地说明本申请实施例中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, the accompanying drawings that need to be used in the descriptions of the embodiments or the prior art will be briefly introduced below. Obviously, the accompanying drawings in the following description are only for the present application For some embodiments, those of ordinary skill in the art can also obtain other drawings based on these drawings without paying creative efforts.

图1是本申请实施例提供的一种视频通话方法的流程图一;FIG. 1 is a flow chart 1 of a video calling method provided by an embodiment of the present application;

图2是本申请实施例提供的一种视频通话方法的流程图二;FIG. 2 is a second flow chart of a video call method provided by an embodiment of the present application;

图3是本申请实施例提供的一种视频通话装置的结构图;FIG. 3 is a structural diagram of a video call device provided by an embodiment of the present application;

图4是本申请实施例提供的一种终端的结构图。FIG. 4 is a structural diagram of a terminal provided by an embodiment of the present application.

具体实施方式Detailed ways

以下描述中,为了说明而不是为了限定,提出了诸如特定系统结构、技术之类的具体细节,以便透彻理解本申请实施例。然而,本领域的技术人员应当清楚,在没有这些具体细节的其它实施例中也可以实现本申请。在其它情况中,省略对众所周知的系统、装置、电路以及方法的详细说明,以免不必要的细节妨碍本申请的描述。In the following description, specific details such as specific system structures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

应当理解,当在本说明书和所附权利要求书中使用时,术语“包括”指示所描述特征、整体、步骤、操作、元素和/或组件的存在,但并不排除一个或多个其它特征、整体、步骤、操作、元素、组件和/或其集合的存在或添加。It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and/or components, but does not exclude one or more other features. , whole, step, operation, element, component and/or the presence or addition of a collection thereof.

还应当理解,在此本申请说明书中所使用的术语仅仅是出于描述特定实施例的目的而并不意在限制本申请。如在本申请说明书和所附权利要求书中所使用的那样,除非上下文清楚地指明其它情况,否则单数形式的“一”、“一个”及“该”意在包括复数形式。It should also be understood that the terminology used in the specification of this application is for the purpose of describing particular embodiments only and is not intended to limit the application. As used in this specification and the appended claims, the singular forms "a", "an" and "the" are intended to include plural referents unless the context clearly dictates otherwise.

还应当进一步理解,在本申请说明书和所附权利要求书中使用的术语“和/或”是指相关联列出的项中的一个或多个的任何组合以及所有可能组合,并且包括这些组合。It should also be further understood that the term "and/or" used in the description of the present application and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations .

如在本说明书和所附权利要求书中所使用的那样,术语“如果”可以依据上下文被解释为“当...时”或“一旦”或“响应于确定”或“响应于检测到”。类似地,短语“如果确定”或“如果检测到[所描述条件或事件]”可以依据上下文被解释为意指“一旦确定”或“响应于确定”或“一旦检测到[所描述条件或事件]”或“响应于检测到[所描述条件或事件]”。As used in this specification and the appended claims, the term "if" may be construed as "when" or "once" or "in response to determining" or "in response to detecting" depending on the context . Similarly, the phrase "if determined" or "if [the described condition or event] is detected" may be construed, depending on the context, to mean "once determined" or "in response to the determination" or "once detected [the described condition or event] ]” or “in response to detection of [described condition or event]”.

具体实现中,本申请实施例中描述的终端包括但不限于诸如具有触摸敏感表面(例如,触摸屏显示器和/或触摸板)的移动电话、膝上型计算机或平板计算机之类的其它便携式设备。还应当理解的是,在某些实施例中,所述设备并非便携式通信设备,而是具有触摸敏感表面(例如,触摸屏显示器和/或触摸板)的台式计算机。In a specific implementation, the terminals described in the embodiments of the present application include but are not limited to other portable devices such as mobile phones, laptop computers or tablet computers with touch-sensitive surfaces (eg, touch screen displays and/or touch pads). It should also be appreciated that in some embodiments, the device is not a portable communication device, but a desktop computer with a touch-sensitive surface (eg, a touchscreen display and/or a touchpad).

在接下来的讨论中,描述了包括显示器和触摸敏感表面的终端。然而,应当理解的是,终端可以包括诸如物理键盘、鼠标和/或控制杆的一个或多个其它物理用户接口设备。In the ensuing discussion, a terminal including a display and a touch-sensitive surface is described. However, it should be understood that a terminal may include one or more other physical user interface devices such as a physical keyboard, mouse and/or joystick.

终端支持各种应用程序,例如以下中的一个或多个:绘图应用程序、演示应用程序、文字处理应用程序、网站创建应用程序、盘刻录应用程序、电子表格应用程序、游戏应用程序、电话应用程序、视频会议应用程序、电子邮件应用程序、即时消息收发应用程序、锻炼支持应用程序、照片管理应用程序、数码相机应用程序、数字摄影机应用程序、web浏览应用程序、数字音乐播放器应用程序和/或数字视频播放器应用程序。The terminal supports various applications such as one or more of the following: drawing application, presentation application, word processing application, website creation application, disk burning application, spreadsheet application, gaming application, telephony application programs, video conferencing applications, email applications, instant messaging applications, exercise support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and and/or digital video player applications.

可以在终端上执行的各种应用程序可以使用诸如触摸敏感表面的至少一个公共物理用户接口设备。可以在应用程序之间和/或相应应用程序内调整和/或改变触摸敏感表面的一个或多个功能以及终端上显示的相应信息。这样,终端的公共物理架构(例如,触摸敏感表面)可以支持具有对用户而言直观且透明的用户界面的各种应用程序。Various applications that can be executed on the terminal can use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the terminal may be adjusted and/or changed between applications and/or within the respective applications. In this way, the common physical architecture (eg, touch-sensitive surface) of the terminal can support various applications with a user interface that is intuitive and transparent to the user.

应理解,本实施例中各步骤的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。It should be understood that the sequence numbers of the steps in this embodiment do not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiment of the present application.

为了说明本申请所述的技术方案,下面通过具体实施例来进行说明。In order to illustrate the technical solutions described in this application, specific examples are used below to illustrate.

参见图1,图1是本申请实施例提供的一种视频通话方法的流程图一。如图1所示,一种视频通话方法,该方法包括以下步骤:Referring to FIG. 1 , FIG. 1 is a flowchart 1 of a video call method provided by an embodiment of the present application. As shown in Figure 1, a video call method, the method includes the following steps:

步骤101,获取目标对端发送的视频图像。Step 101, acquire the video image sent by the target peer.

该视频通话方法的执行主体为具有视频通话功能的电子设备,可以是手机、平板电脑、电话手表等。The execution subject of the video call method is an electronic device with a video call function, which may be a mobile phone, a tablet computer, a phone watch, and the like.

该目标对端为具有视频通话功能的电子设备,同样可以是手机、平板电脑、电话手表等。具体可选地,该执行主体为手机或平板电脑,目标对端为电话手表,但不以此为限。The target peer is an electronic device with a video call function, which may also be a mobile phone, a tablet computer, a phone watch, and the like. Specifically, optionally, the execution subject is a mobile phone or a tablet computer, and the target peer is a phone watch, but not limited thereto.

该步骤中,当执行主体与目标对端之间视频接通后,执行主体开始获取到目标对端传输而来的视频图像,以进行接下来的处理过程。In this step, after the video connection between the execution subject and the target peer end, the execution subject starts to acquire the video image transmitted from the target peer end for the next processing.

步骤102,根据所述视频图像,在确定所述视频图像中包含人脸图像的情况下,从预设人脸数据库中获取与所述人脸图像相匹配的目标人脸数据。Step 102, according to the video image, if it is determined that the video image contains a human face image, acquire target human face data matching the human face image from a preset human face database.

在获取到对端发送的视频图像后,需要先判断视频图像中是否包含人脸图像,如果识别到包含人脸图像,则需要进一步从预设人脸数据库中获取存储的相匹配的目标人脸数据。After obtaining the video image sent by the peer end, it is necessary to judge whether the video image contains a face image. If it is recognized that it contains a face image, it is necessary to further obtain the stored matching target face from the preset face database. data.

其中,从预设人脸数据库中获取与所述人脸图像相匹配的目标人脸数据,包括:从预设人脸数据库中获取与所述人脸图像中的人脸显示特征相匹配的目标人脸数据;或者从预设人脸数据库中获取与所述目标对端对应的目标联系人信息相关联的人脸数据,将该人脸数据确定为与人脸图像相匹配的目标人脸数据;或者从预设人脸数据库中获取与所述人脸图像中的人脸显示特征相匹配的,且与所述目标对端对应的目标联系人信息相关联的人脸数据为目标人脸数据。Wherein, acquiring the target face data matching the face image from the preset face database includes: acquiring target face data matching the face display features in the face image from the preset face database Face data; or obtain face data associated with the target contact information corresponding to the target peer from a preset face database, and determine the face data as target face data matching the face image or obtain from the preset face database the face data that matches the face display features in the face image and is associated with the target contact information corresponding to the target peer as the target face data .

具体地,作为一可选的实施方式,其中,所述从预设人脸数据库中获取与所述人脸图像相匹配的目标人脸数据,包括:Specifically, as an optional implementation manner, wherein the acquiring the target face data matching the face image from the preset face database includes:

判断通讯录中是否存在所述目标对端对应的目标联系人信息;judging whether there is target contact information corresponding to the target peer in the address book;

在所述通讯录中存在所述目标对端对应的目标联系人信息的情况下,从所述预设人脸数据库中,获取与所述目标联系人信息相关联的初始人脸数据;If there is target contact information corresponding to the target peer in the address book, acquiring initial face data associated with the target contact information from the preset face database;

将所述初始人脸数据确定为与所述人脸图像相匹配的目标人脸数据;Determining the initial face data as target face data matching the face image;

其中,所述预设数据库中的人脸数据分别与所述通讯录中的不同联系人信息一一对应。Wherein, the face data in the preset database is in one-to-one correspondence with different contact information in the address book.

该过程中,预设人脸数据库中的人脸数据与通讯录中的联系人信息相关联。一个人脸数据对应于一个联系人信息。During this process, the face data in the preset face database is associated with the contact information in the address book. One face data corresponds to one contact information.

其中,预设人脸数据库可以存储在本地的数据库,或者是存储于在其他设备上或者云端设备上的预设人脸数据库,此处不具体限定。Wherein, the preset face database may be stored in a local database, or a preset face database stored on other devices or cloud devices, which is not specifically limited here.

在具体实现过程中,需要提前对人脸数据进行建模:例如为,通过手机中APP预先采集可以被高清还原的人脸信息,进行高清人脸建模,建模数据存入手机端数据库。In the specific implementation process, it is necessary to model the face data in advance: for example, pre-collect face information that can be restored in high-definition through the APP in the mobile phone, perform high-definition face modeling, and store the modeled data in the mobile phone database.

具体地,可以通过不同的技术手段实现预设人脸数据库的构建。Specifically, the construction of the preset face database can be realized through different technical means.

作为一可选的实施方式,其中,所述根据所述视频图像,在确定所述视频图像中包含人脸图像的情况下,从预设人脸数据库中获取与所述人脸图像相匹配的目标人脸数据之前,还包括:As an optional implementation manner, wherein, according to the video image, if it is determined that the video image contains a human face image, the face image matching the human face image is obtained from a preset face database. Before the target face data, it also includes:

对不同的视频通话中的人脸图像进行采集,得到初步人脸数据;Collect face images in different video calls to obtain preliminary face data;

从所述初步人脸数据中筛选符合清晰度指标要求的筛选人脸数据;Screening the screened face data meeting the requirements of the definition index from the preliminary face data;

确定不同的所述视频通话所对应对端的联系人信息;Determining the contact information of the opposite end corresponding to the different video calls;

将所述筛选人脸数据与所述联系人信息进行关联存储,得到所述预设人脸数据库。The screened face data and the contact information are associated and stored to obtain the preset face database.

该过程,在人脸数据库构建时,需要在与不同对端之间进行的不同视频通话过程中,进行人脸数据的采集。筛选清晰度指标符合要求的人脸数据并与对应对端的联系人信息进行关联存储,实现人脸数据库中数据的生成及人脸数据库的构建,可以省去专门对不同联系人人脸的识别采集的过程,实现过程更便捷,且可以随着视频通话的不断进行,可以实现人脸数据的不断修正与完善。In this process, when the face database is constructed, it is necessary to collect face data during different video calls with different peers. Screen the face data whose clarity index meets the requirements and store it in association with the contact information of the corresponding counterpart to realize the generation of data in the face database and the construction of the face database, which can save the need for special recognition and collection of faces of different contacts The implementation process is more convenient, and with the continuous progress of video calls, the continuous correction and improvement of face data can be realized.

作为另一可选的实施方式,其中,所述根据所述视频图像,在确定所述视频图像中包含人脸图像的情况下,从预设人脸数据库中获取与所述人脸图像相匹配的目标人脸数据之前,还包括:As another optional implementation manner, wherein, according to the video image, if it is determined that the video image contains a human face image, obtain the image matching the human face image from a preset human face database. Before the target face data, it also includes:

输出人脸数据采集界面,所述人脸数据采集界面中显示有不同的联系人信息;Output face data collection interface, different contact information is displayed in the face data collection interface;

在接收到人脸数据的采集触发输入的情况下,通过图像采集设备进行人脸数据采集,其中,一个所述采集触发输入对应于一个所述联系人信息;In the case of receiving a collection trigger input of face data, face data collection is performed by an image collection device, wherein one collection trigger input corresponds to one contact information;

将采集得到的人脸数据与所述联系人信息进行关联存储,得到所述预设人脸数据库。The collected face data is stored in association with the contact information to obtain the preset face database.

该过程,在人脸数据库构建时,需要显示人脸数据采集界面,供用户选择不同的联系人信息,并对对应联系人的人脸数据进行采集,进而将相关联系人的人脸数据与对应对端的联系人信息进行关联存储,实现人脸数据库中数据的生成及人脸数据库的构建,专门的采集过程可以实现更加清晰完整的人脸信息的采集。In this process, when the face database is constructed, it is necessary to display the face data collection interface for the user to select different contact information, and collect the face data of the corresponding contacts, and then combine the face data of the relevant contacts with the corresponding The contact information of the corresponding terminal is stored associatively to realize the generation of data in the face database and the construction of the face database. The special collection process can realize the collection of clearer and complete face information.

具体地,该采集过程,可以在初次使用时,对联系人的人脸信息进行采集,并存储,或者在新增联系人信息时进行,此处不具体限定。Specifically, the collection process can collect and store the face information of the contact during the first use, or it can be performed when the contact information is added, which is not specifically limited here.

步骤103,基于所述目标人脸数据,对所述视频图像进行人脸清晰度修复,得到目标视频图像。Step 103, based on the target face data, perform face definition restoration on the video image to obtain a target video image.

在对视频图像进行人脸清晰度进行修复时,具体为对视频图像中的人脸图像进行清晰度修复,对视频图像中的人脸这一局部区域进行修复,提升整体图像中人脸部分的显示清晰度。When performing face definition restoration on a video image, it is specifically to restore the definition of the face image in the video image, repair the local area of the face in the video image, and improve the accuracy of the face part in the overall image. Display clarity.

在具体实现过程中,以手机和电话手表为例进行说明。当家长手机与学生电话手表之间的视频接通,手机中相应应用APP从通话视频画面中进行人脸提取,将人脸与APP数据库中的建模数据作对比,当存在相匹配的人脸数据时,将高清人脸数据融合进手机中显示的视频图像中,手机端实现人像清晰度的修复,实现高清人像的显示,而当不存在相匹配的人脸数据时,整个过程结束。该过程,在不增加手表端硬件设备和硬件成本的前提下,能够在手机端高清还原视频中的人像,提升视频通话体验。In the specific implementation process, a mobile phone and a phone watch are taken as examples for illustration. When the video between the parent’s mobile phone and the student’s phone watch is connected, the corresponding APP in the mobile phone will extract the face from the call video screen, and compare the face with the modeling data in the APP database. When there is a matching face When processing the data, the high-definition face data is fused into the video image displayed on the mobile phone, and the mobile phone end realizes the restoration of the portrait definition and the display of the high-definition portrait. When there is no matching face data, the whole process ends. This process, without increasing the hardware equipment and hardware costs of the watch, can restore the portraits in the video on the mobile phone in high definition and improve the video call experience.

步骤104,显示所述目标视频图像。Step 104, displaying the target video image.

在对视频图像进行修复后,直接显示目标视频图像即可,实现将对端发送的视频直接在传递过程中进行修复,以在本端显示屏上直接显示出修复后的目标视频图像,提升显示效果。After the video image is repaired, the target video image can be displayed directly, so that the video sent by the peer end can be repaired directly during the transmission process, so that the repaired target video image can be directly displayed on the display screen of the local end, and the display can be improved. Effect.

其中,在对对端发送的视频图像进行处理时,具体为接收到一帧视频图像则处理一帧,并对应显示一帧修复得到的目标视频图像,一帧接一帧的这样处理,实现整个视频通过过程中人像的清晰度的修复及改善。Among them, when processing the video image sent by the opposite end, specifically, when a frame of video image is received, one frame is processed, and the target video image obtained by repairing one frame is displayed correspondingly, and the processing is performed frame by frame to realize the whole Fix and improve the clarity of portraits in the process of video passing.

本申请实施例中,通过获取目标对端发送的视频图像,在确定视频图像中包含人脸图像的情况下,从预设人脸数据库中获取与人脸图像相匹配的目标人脸数据;基于该目标人脸数据,对视频图像进行人脸清晰度修复,得到目标视频图像并显示,在不增加对端的流量和功耗及不改变对端硬件设置的前提下,提升视频通话过程中的人脸画质,提升画面清晰度,实现高清视频通话。In the embodiment of the present application, by acquiring the video image sent by the target peer end, when it is determined that the video image contains a face image, the target face data matching the face image is obtained from the preset face database; based on The target face data is used to repair the face definition of the video image, and the target video image is obtained and displayed. On the premise of not increasing the traffic and power consumption of the peer end and changing the hardware settings of the peer end, the human face during the video call is improved. face quality, improve picture clarity, and realize high-definition video calls.

本申请实施例中还提供了视频通话方法的不同实施方式。The embodiments of the present application also provide different implementation manners of the video call method.

参见图2,图2是本申请实施例提供的一种视频通话方法的流程图二。如图2所示,一种视频通话方法,该方法包括以下步骤:Referring to FIG. 2 , FIG. 2 is a second flowchart of a video call method provided by an embodiment of the present application. As shown in Figure 2, a video call method, the method includes the following steps:

步骤201,获取目标对端发送的视频图像。Step 201, acquire the video image sent by the target peer.

该步骤的实施过程与前述实施方式中步骤101的实施过程相同,此处不再赘述。The implementation process of this step is the same as the implementation process of step 101 in the foregoing embodiments, and will not be repeated here.

步骤202,根据所述视频图像,在确定所述视频图像中包含人脸图像的情况下,从预设人脸数据库中获取与所述人脸图像相匹配的目标人脸数据。Step 202, according to the video image, if it is determined that the video image contains a face image, acquire target face data matching the face image from a preset face database.

在具体实施时,可以是每隔设定时间间隔提取一次视频中的图像,采用视觉库OpenCV的人脸检测工具检测图像中是否有人脸,匹配采集的人脸与预设人脸数据库中保存的人脸数据的相似度,若人脸相似度大于70%,则用预设人脸数据库里的高清人脸替换原来视频中图像的人脸。In specific implementation, the image in the video can be extracted every set time interval, and the face detection tool of the visual library OpenCV is used to detect whether there is a human face in the image, and the collected human face is matched with the preset human face database. The similarity of face data, if the face similarity is greater than 70%, replace the face in the image in the original video with the high-definition face in the preset face database.

作为一可选的实施方式,其中,所述目标人脸数据为三维人脸数据;所述基于所述目标人脸数据,对所述视频图像进行人脸清晰度修复,得到目标视频图像,包括:As an optional implementation manner, wherein, the target face data is three-dimensional face data; based on the target face data, performing face definition restoration on the video image to obtain the target video image includes: :

步骤203,基于所述人脸图像,确定所述视频图像中的人脸显示特征。Step 203, based on the face image, determine the display features of the face in the video image.

其中,该人脸显示特征包括人脸显示角度、人脸显示尺寸、人脸显示比例、人脸显示轮廓、人脸显示区域、人脸五官分布中的至少一项。Wherein, the face display feature includes at least one of face display angle, face display size, face display ratio, face display outline, face display area, and facial features distribution.

通过从人脸图像中解析出的人脸显示特征,以结合三维人脸数据,实现从预设人脸数据库中的目标人脸数据中找出与当前人脸图像相符合的人脸替换部位。By combining the face display features parsed from the face image and combining the three-dimensional face data, a face replacement part matching the current face image can be found from the target face data in the preset face database.

步骤204,基于所述人脸显示特征,从所述三维人脸数据中获取与所述人脸显示特征相匹配的人脸替换部位。Step 204, based on the display feature of the face, obtain a face replacement part matching the display feature of the face from the three-dimensional face data.

其中,该人脸替换部位可以是在不同的人脸显示角度下的人脸显示部位、不同人脸显示尺寸下的人脸显示部位、不同人脸显示比例下的人脸显示部位、不同人脸显示轮廓下的人脸显示部位、不同人脸显示区域下的人脸显示部位和/或不同人脸五官分布下的人脸显示部位。Wherein, the face replacement part may be a face display part under different face display angles, a face display part under different face display sizes, a face display part under different face display ratios, a face display part under different face display Display the face display parts under the outline, the face display parts under different face display areas and/or the face display parts under different facial features distribution.

步骤205,获取与所述人脸替换部位对应的人脸替换图像。Step 205, acquiring a human face replacement image corresponding to the human face replacement part.

基于从三维人脸数据中确定的人脸替换部位,得到对应的人脸替换图像,以进行对应人脸区域的替换,实现图像显示度的提升。Based on the face replacement part determined from the three-dimensional face data, the corresponding face replacement image is obtained, so as to replace the corresponding face area and improve the display degree of the image.

步骤206,根据所述人脸替换图像,将所述视频图像中的所述人脸图像进行替换,得到所述目标视频图像。Step 206: Replace the human face image in the video image according to the human face replacement image to obtain the target video image.

其中,所述三维人脸数据对应的人脸显示清晰度大于所述人脸图像的显示清晰度。Wherein, the display resolution of the face corresponding to the three-dimensional face data is greater than the display resolution of the face image.

该步骤中,实现人脸清晰度提升的方法,是将清晰度更高的人脸区域显示图像直接在对应人脸位置进行替换,以将原始清晰度低的人脸区域替换掉,提升视频图像中的人脸显示清晰度。In this step, the method for improving the definition of the face is to directly replace the display image of the face area with higher definition at the corresponding face position, so as to replace the face area with the original low definition and improve the video image The faces in the display show sharpness.

步骤207,显示所述目标视频图像。Step 207, displaying the target video image.

该步骤的实施过程与前述实施方式中步骤104的实施过程相同,此处不再赘述。The implementation process of this step is the same as the implementation process of step 104 in the foregoing embodiments, and will not be repeated here.

本申请实施例中,通过获取目标对端发送的视频图像,在确定视频图像中包含人脸图像的情况下,从预设人脸数据库中获取与人脸图像相匹配的目标人脸数据;基于该目标人脸数据,对视频图像进行人脸清晰度修复,得到目标视频图像并显示,在不增加对端的流量和功耗及不改变对端硬件设置的前提下,提升视频通话过程中的人脸画质,提升画面清晰度,实现高清视频通话。In the embodiment of the present application, by acquiring the video image sent by the target peer end, when it is determined that the video image contains a face image, the target face data matching the face image is obtained from the preset face database; based on The target face data is used to repair the face definition of the video image, and the target video image is obtained and displayed. On the premise of not increasing the traffic and power consumption of the peer end and changing the hardware settings of the peer end, the human face during the video call is improved. face quality, improve picture clarity, and realize high-definition video calls.

参见图3,图3是本申请实施例提供的一种视频通话装置的结构图,为了便于说明,仅示出了与本申请实施例相关的部分。Referring to FIG. 3 , FIG. 3 is a structural diagram of a video calling device provided by an embodiment of the present application. For ease of description, only parts related to the embodiment of the present application are shown.

所述视频通话装置包括:第一获取模块301、第二获取模块302、修复模块303及显示模块304。The video call device includes: a first acquisition module 301 , a second acquisition module 302 , a repair module 303 and a display module 304 .

第一获取模块301,用于获取目标对端发送的视频图像;The first obtaining module 301 is used to obtain the video image sent by the target peer;

第二获取模块302,用于根据所述视频图像,在确定所述视频图像中包含人脸图像的情况下,从预设人脸数据库中获取与所述人脸图像相匹配的目标人脸数据;The second acquiring module 302 is configured to acquire, according to the video image, target face data matching the face image from a preset face database when it is determined that the video image contains a face image ;

修复模块303,用于基于所述目标人脸数据,对所述视频图像进行人脸清晰度修复,得到目标视频图像;The restoration module 303 is configured to perform face definition restoration on the video image based on the target face data to obtain the target video image;

显示模块304,用于显示所述目标视频图像。The display module 304 is configured to display the target video image.

其中,所述第二获取模块302具体用于:Wherein, the second obtaining module 302 is specifically used for:

判断通讯录中是否存在所述目标对端对应的目标联系人信息;judging whether there is target contact information corresponding to the target peer in the address book;

在所述通讯录中存在所述目标对端对应的目标联系人信息的情况下,从所述预设人脸数据库中,获取与所述目标联系人信息相关联的初始人脸数据;If there is target contact information corresponding to the target peer in the address book, acquiring initial face data associated with the target contact information from the preset face database;

将所述初始人脸数据确定为与所述人脸图像相匹配的目标人脸数据;Determining the initial face data as target face data matching the face image;

其中,所述预设数据库中的人脸数据分别与所述通讯录中的不同联系人信息一一对应。Wherein, the face data in the preset database is in one-to-one correspondence with different contact information in the address book.

所述目标人脸数据为三维人脸数据;所述修复模块303具体用于:The target face data is three-dimensional face data; the repair module 303 is specifically used for:

基于所述人脸图像,确定所述视频图像中的人脸显示特征;Based on the face image, determine the face display features in the video image;

基于所述人脸显示特征,从所述三维人脸数据中获取与所述人脸显示特征相匹配的人脸替换部位;Based on the display features of the human face, obtaining a replacement part of a human face matching the display features of the human face from the three-dimensional human face data;

获取与所述人脸替换部位对应的人脸替换图像;Acquiring a face replacement image corresponding to the face replacement part;

根据所述人脸替换图像,将所述视频图像中的所述人脸图像进行替换,得到所述目标视频图像;replacing the human face image in the video image according to the human face replacement image to obtain the target video image;

其中,所述三维人脸数据对应的人脸显示清晰度大于所述人脸图像的显示清晰度。Wherein, the display resolution of the face corresponding to the three-dimensional face data is greater than the display resolution of the face image.

其中,该装置还包括:Among them, the device also includes:

第一数据库建立模块,用于对不同的视频通话中的人脸图像进行采集,得到初步人脸数据;从所述初步人脸数据中筛选符合清晰度指标要求的筛选人脸数据;确定不同的所述视频通话所对应对端的联系人信息;将所述筛选人脸数据与所述联系人信息进行关联存储,得到所述预设人脸数据库。The first database building module is used to collect face images in different video calls to obtain preliminary face data; screen face data that meets the requirements of the definition index from the preliminary face data; determine different The contact information of the opposite end of the video call; the screened face data and the contact information are associated and stored to obtain the preset face database.

其中,该装置还包括:Among them, the device also includes:

第二数据库建立模块,用于输出人脸数据采集界面,所述人脸数据采集界面中显示有不同的联系人信息;在接收到人脸数据的采集触发输入的情况下,通过图像采集设备进行人脸数据采集,其中,一个所述采集触发输入对应于一个所述联系人信息;将采集得到的人脸数据与所述联系人信息进行关联存储,得到所述预设人脸数据库。The second database building module is used to output the face data collection interface, and different contact information is displayed in the face data collection interface; in the case of receiving the collection trigger input of the face data, the process is performed by the image collection device Face data collection, wherein one collection trigger input corresponds to one contact information; the collected face data and the contact information are associated and stored to obtain the preset face database.

其中,所述目标对端为电话手表。Wherein, the target peer is a phone watch.

本申请实施例提供的视频通话装置能够实现上述视频通话方法的实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。The video call device provided in the embodiment of the present application can realize each process of the above video call method embodiment, and can achieve the same technical effect. To avoid repetition, details are not repeated here.

图4是本申请实施例提供的一种终端的结构图。如该图所示,该实施例的终端4包括:处理器40、存储器41以及存储在所述存储器41中并可在所述处理器40上运行的计算机程序42。FIG. 4 is a structural diagram of a terminal provided by an embodiment of the present application. As shown in the figure, the terminal 4 of this embodiment includes: a processor 40 , a memory 41 and a computer program 42 stored in the memory 41 and executable on the processor 40 .

示例性的,所述计算机程序42可以被分割成一个或多个模块/单元,所述一个或者多个模块/单元被存储在所述存储器41中,并由所述处理器40执行,以完成本申请。所述一个或多个模块/单元可以是能够完成特定功能的一系列计算机程序指令段,该指令段用于描述所述计算机程序42在所述终端4中的执行过程。例如,所述计算机程序42可以被分割成第一获取模块、第二获取模块、修复模块及显示模块,各模块具体功能如下:Exemplarily, the computer program 42 can be divided into one or more modules/units, and the one or more modules/units are stored in the memory 41 and executed by the processor 40 to complete this application. The one or more modules/units may be a series of computer program instruction segments capable of accomplishing specific functions, and the instruction segments are used to describe the execution process of the computer program 42 in the terminal 4 . For example, the computer program 42 can be divided into a first acquisition module, a second acquisition module, a repair module and a display module, and the specific functions of each module are as follows:

第一获取模块,用于获取目标对端发送的视频图像;The first obtaining module is used to obtain the video image sent by the target peer;

第二获取模块,用于根据所述视频图像,在确定所述视频图像中包含人脸图像的情况下,从预设人脸数据库中获取与所述人脸图像相匹配的目标人脸数据;The second acquisition module is configured to acquire target face data matching the face image from a preset face database when it is determined that the video image contains a face image according to the video image;

修复模块,用于基于所述目标人脸数据,对所述视频图像进行人脸清晰度修复,得到目标视频图像;A restoration module, configured to restore the face definition of the video image based on the target face data, to obtain the target video image;

显示模块,用于显示所述目标视频图像。A display module, configured to display the target video image.

其中,所述第二获取模块具体用于:Wherein, the second acquisition module is specifically used for:

判断通讯录中是否存在所述目标对端对应的目标联系人信息;judging whether there is target contact information corresponding to the target peer in the address book;

在所述通讯录中存在所述目标对端对应的目标联系人信息的情况下,从所述预设人脸数据库中,获取与所述目标联系人信息相关联的初始人脸数据;If there is target contact information corresponding to the target peer in the address book, acquiring initial face data associated with the target contact information from the preset face database;

将所述初始人脸数据确定为与所述人脸图像相匹配的目标人脸数据;Determining the initial face data as target face data matching the face image;

其中,所述预设数据库中的人脸数据分别与所述通讯录中的不同联系人信息一一对应。Wherein, the face data in the preset database is in one-to-one correspondence with different contact information in the address book.

所述目标人脸数据为三维人脸数据;所述修复模块具体用于:The target face data is three-dimensional face data; the repair module is specifically used for:

基于所述人脸图像,确定所述视频图像中的人脸显示特征;Based on the face image, determine the face display features in the video image;

基于所述人脸显示特征,从所述三维人脸数据中获取与所述人脸显示特征相匹配的人脸替换部位;Based on the display features of the human face, obtaining a replacement part of a human face matching the display features of the human face from the three-dimensional human face data;

获取与所述人脸替换部位对应的人脸替换图像;Acquiring a face replacement image corresponding to the face replacement part;

根据所述人脸替换图像,将所述视频图像中的所述人脸图像进行替换,得到所述目标视频图像;replacing the human face image in the video image according to the human face replacement image to obtain the target video image;

其中,所述三维人脸数据对应的人脸显示清晰度大于所述人脸图像的显示清晰度。Wherein, the display resolution of the face corresponding to the three-dimensional face data is greater than the display resolution of the face image.

其中,该装置还包括:Among them, the device also includes:

第一数据库建立模块,用于对不同的视频通话中的人脸图像进行采集,得到初步人脸数据;从所述初步人脸数据中筛选符合清晰度指标要求的筛选人脸数据;确定不同的所述视频通话所对应对端的联系人信息;将所述筛选人脸数据与所述联系人信息进行关联存储,得到所述预设人脸数据库。The first database building module is used to collect face images in different video calls to obtain preliminary face data; screen face data that meets the requirements of the definition index from the preliminary face data; determine different The contact information of the opposite end of the video call; the screened face data and the contact information are associated and stored to obtain the preset face database.

其中,该装置还包括:Among them, the device also includes:

第二数据库建立模块,用于输出人脸数据采集界面,所述人脸数据采集界面中显示有不同的联系人信息;在接收到人脸数据的采集触发输入的情况下,通过图像采集设备进行人脸数据采集,其中,一个所述采集触发输入对应于一个所述联系人信息;将采集得到的人脸数据与所述联系人信息进行关联存储,得到所述预设人脸数据库。The second database building module is used to output the face data collection interface, and different contact information is displayed in the face data collection interface; in the case of receiving the collection trigger input of the face data, the process is performed by the image collection device Face data collection, wherein one collection trigger input corresponds to one contact information; the collected face data and the contact information are associated and stored to obtain the preset face database.

其中,所述目标对端为电话手表。Wherein, the target peer is a phone watch.

所述终端4可以是桌上型计算机、笔记本、掌上电脑及云端服务器等计算设备。所述终端4可包括,但不仅限于,处理器40、存储器41。本领域技术人员可以理解,图4仅是终端4的示例,并不构成对终端4的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件,例如所述终端还可以包括输入输出设备、网络接入设备、总线等。The terminal 4 may be a computing device such as a desktop computer, a notebook, a palmtop computer, or a cloud server. The terminal 4 may include, but not limited to, a processor 40 and a memory 41 . Those skilled in the art can understand that FIG. 4 is only an example of the terminal 4, and does not constitute a limitation on the terminal 4. It may include more or less components than shown in the figure, or combine certain components, or different components, such as The terminal may also include an input and output device, a network access device, a bus, and the like.

所称处理器40可以是中央处理单元(Central Processing Unit,CPU),还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。The so-called processor 40 may be a central processing unit (Central Processing Unit, CPU), and may also be other general-purpose processors, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), Off-the-shelf programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, and the like.

所述存储器41可以是所述终端4的内部存储单元,例如终端4的硬盘或内存。所述存储器41也可以是所述终端4的外部存储设备,例如所述终端4上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。进一步地,所述存储器41还可以既包括所述终端4的内部存储单元也包括外部存储设备。所述存储器41用于存储所述计算机程序以及所述终端所需的其他程序和数据。所述存储器41还可以用于暂时地存储已经输出或者将要输出的数据。The memory 41 may be an internal storage unit of the terminal 4 , such as a hard disk or memory of the terminal 4 . The memory 41 can also be an external storage device of the terminal 4, such as a plug-in hard disk equipped on the terminal 4, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, Flash Card (Flash Card), etc. Further, the memory 41 may also include both an internal storage unit of the terminal 4 and an external storage device. The memory 41 is used to store the computer program and other programs and data required by the terminal. The memory 41 can also be used to temporarily store data that has been output or will be output.

所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,仅以上述各功能单元、模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能单元、模块完成,即将所述装置的内部结构划分成不同的功能单元或模块,以完成以上描述的全部或者部分功能。实施例中的各功能单元、模块可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中,上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。另外,各功能单元、模块的具体名称也只是为了便于相互区分,并不用于限制本申请的保护范围。上述系统中单元、模块的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used for illustration. In practical applications, the above-mentioned functions can be assigned to different functional units, Completion of modules means that the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment may be integrated into one processing unit, or each unit may exist separately physically, or two or more units may be integrated into one unit, and the above-mentioned integrated units may adopt hardware It can also be implemented in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the present application. For the specific working process of the units and modules in the above system, reference may be made to the corresponding process in the foregoing method embodiments, and details will not be repeated here.

在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述或记载的部分,可以参见其它实施例的相关描述。In the above-mentioned embodiments, the descriptions of each embodiment have their own emphases, and for parts that are not detailed or recorded in a certain embodiment, refer to the relevant descriptions of other embodiments.

本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。Those skilled in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.

在本申请所提供的实施例中,应该理解到,所揭露的终端和方法,可以通过其它的方式实现。例如,以上所描述的终端实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通讯连接可以是通过一些接口,装置或单元的间接耦合或通讯连接,可以是电性,机械或其它的形式。In the embodiments provided in this application, it should be understood that the disclosed terminal and method may be implemented in other ways. For example, the terminal embodiments described above are only illustrative. For example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units or components can be Incorporation may either be integrated into another system, or some features may be omitted, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

所述集成的模块/单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请实现上述实施例方法中的全部或部分流程,也可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一计算机可读存储介质中,该计算机程序在被处理器执行时,可实现上述各个方法实施例的步骤。其中,所述计算机程序包括计算机程序代码,所述计算机程序代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。所述计算机可读介质可以包括:能够携带所述计算机程序代码的任何实体或装置、记录介质、U盘、移动硬盘、磁碟、光盘、计算机存储器、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、电载波信号、电信信号以及软件分发介质等。需要说明的是,所述计算机可读介质包含的内容可以根据司法管辖区内立法和专利实践的要求进行适当的增减,例如在某些司法管辖区,根据立法和专利实践,计算机可读介质不包括电载波信号和电信信号。If the integrated module/unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments in the present application can also be completed by instructing related hardware through computer programs. The computer programs can be stored in a computer-readable storage medium, and the computer When the program is executed by the processor, the steps in the above-mentioned various method embodiments can be realized. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, and a read-only memory (ROM, Read-Only Memory) , Random Access Memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal, and software distribution medium, etc. It should be noted that the content contained in the computer-readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, computer-readable media Excludes electrical carrier signals and telecommunication signals.

以上所述实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围,均应包含在本申请的保护范围之内。The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still implement the foregoing embodiments Modifications to the technical solutions described in the examples, or equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the application, and should be included in the Within the protection scope of this application.

Claims (10)

1. a kind of video call method characterized by comprising
Obtain the video image that target opposite end is sent;
According to the video image, in the case where in determining the video image comprising facial image, from default human face data The target human face data to match with the facial image is obtained in library;
Based on the target human face data, the reparation of face clarity is carried out to the video image, obtains target video image;
Show the target video image.
2. video call method according to claim 1, which is characterized in that
It is described that the target human face data to match with the facial image is obtained from default face database, comprising:
Judge in address list with the presence or absence of the corresponding object contact person information in the target opposite end;
In the address list in the case where object contact person information corresponding there are the target opposite end, from the default face In database, Initial Face data associated with the object contact person information are obtained;
The Initial Face data are determined as to the target human face data to match with the facial image;
Wherein, the human face data in the presetting database is a pair of from the different contact informations one in the address list respectively It answers.
3. video call method according to claim 1, which is characterized in that the target human face data is three-dimensional face number According to;It is described to be based on the target human face data, the reparation of face clarity is carried out to the video image, obtains target video figure Picture, comprising:
Based on the facial image, determine that the face in the video image shows feature;
Feature is shown based on the face, and the people to match with face display feature is obtained from the three-dimensional face data Face alternative site;
It obtains face corresponding with the face alternative site and replaces image;
Image is replaced according to the face, the facial image in the video image is replaced, the target is obtained Video image;
Wherein, the corresponding face display resolution of the three-dimensional face data is greater than the display resolution of the facial image.
4. video call method according to claim 1, which is characterized in that it is described according to the video image, in determination Comprising obtaining from default face database and matching with the facial image in the case where facial image in the video image Target human face data before, further includes:
Facial image in different video callings is acquired, preliminary human face data is obtained;
Screening meets the screening human face data of articulation index requirement from the preliminary human face data;
Determine the contact information of opposite end corresponding to the different video callings;
The screening human face data and the contact information are associated storage, obtain the default face database.
5. video call method according to claim 1, which is characterized in that it is described according to the video image, in determination Comprising obtaining from default face database and matching with the facial image in the case where facial image in the video image Target human face data before, further includes:
Human face data acquisition interface is exported, shows different contact informations in the human face data acquisition interface;
In the case where the trigger collection for receiving human face data inputs, human face data acquisition is carried out by image capture device, Wherein, a trigger collection input corresponds to a contact information;
The human face data collected and the contact information are associated storage, obtain the default face database.
6. video call method according to claim 1, which is characterized in that the target opposite end is phone wrist-watch.
7. a kind of video conversation apparatus characterized by comprising
First obtains module, for obtaining the video image of target opposite end transmission;
Second obtains module, for according to the video image, the case where in determining the video image including facial image Under, the target human face data to match with the facial image is obtained from default face database;
Repair module carries out the reparation of face clarity to the video image, obtains mesh for being based on the target human face data Mark video image;
Display module, for showing the target video image.
8. video conversation apparatus according to claim 7, which is characterized in that the second acquisition module is specifically used for:
Judge in address list with the presence or absence of the corresponding object contact person information in the target opposite end;
In the address list in the case where object contact person information corresponding there are the target opposite end, from the default face In database, Initial Face data associated with the object contact person information are obtained;
The Initial Face data are determined as to the target human face data to match with the facial image;
Wherein, the human face data in the presetting database is a pair of from the different contact informations one in the address list respectively It answers.
9. a kind of terminal, including memory, processor and storage can be run in the memory and on the processor Computer program, which is characterized in that the processor is realized when executing the computer program as claim 1 to 6 is any The step of item the method.
10. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists In when the computer program is executed by processor the step of any one of such as claim 1 to 6 of realization the method.
CN201910561823.4A 2019-06-26 2019-06-26 A video call method, video call device and terminal Expired - Fee Related CN110266994B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910561823.4A CN110266994B (en) 2019-06-26 2019-06-26 A video call method, video call device and terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910561823.4A CN110266994B (en) 2019-06-26 2019-06-26 A video call method, video call device and terminal

Publications (2)

Publication Number Publication Date
CN110266994A true CN110266994A (en) 2019-09-20
CN110266994B CN110266994B (en) 2021-03-26

Family

ID=67921838

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910561823.4A Expired - Fee Related CN110266994B (en) 2019-06-26 2019-06-26 A video call method, video call device and terminal

Country Status (1)

Country Link
CN (1) CN110266994B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110602403A (en) * 2019-09-23 2019-12-20 华为技术有限公司 Method for taking pictures under dark light and electronic equipment
CN111031241A (en) * 2019-12-09 2020-04-17 Oppo广东移动通信有限公司 Image processing method and device, terminal and computer readable storage medium
CN111432154A (en) * 2020-03-30 2020-07-17 维沃移动通信有限公司 Video playing method, video processing method and electronic equipment
CN111698553A (en) * 2020-05-29 2020-09-22 维沃移动通信有限公司 Video processing method and device, electronic equipment and readable storage medium
WO2021109678A1 (en) * 2019-12-04 2021-06-10 深圳追一科技有限公司 Video generation method and apparatus, electronic device, and storage medium
CN117152030A (en) * 2022-05-23 2023-12-01 华为技术有限公司 Image processing methods and electronic devices
CN118573915A (en) * 2024-05-22 2024-08-30 天翼爱音乐文化科技有限公司 Video high definition processing method, system, equipment and medium
CN118714251A (en) * 2024-07-23 2024-09-27 深圳市有一说一科技有限公司 Video call image optimization method, device, medium and computing device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20100041061A (en) * 2008-10-13 2010-04-22 성균관대학교산학협력단 Video telephony method magnifying the speaker's face and terminal using thereof
CN107566653A (en) * 2017-09-22 2018-01-09 维沃移动通信有限公司 A kind of call interface methods of exhibiting and mobile terminal
CN107623832A (en) * 2017-09-11 2018-01-23 广东欧珀移动通信有限公司 Video background replacement method, device and mobile terminal
CN108174141A (en) * 2017-11-30 2018-06-15 维沃移动通信有限公司 A method of video communication and a mobile device
CN108683872A (en) * 2018-08-30 2018-10-19 Oppo广东移动通信有限公司 Video call method, device, storage medium and mobile terminal
US20190188453A1 (en) * 2017-12-15 2019-06-20 Hyperconnect, Inc. Terminal and server for providing video call service

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20100041061A (en) * 2008-10-13 2010-04-22 성균관대학교산학협력단 Video telephony method magnifying the speaker's face and terminal using thereof
CN107623832A (en) * 2017-09-11 2018-01-23 广东欧珀移动通信有限公司 Video background replacement method, device and mobile terminal
CN107566653A (en) * 2017-09-22 2018-01-09 维沃移动通信有限公司 A kind of call interface methods of exhibiting and mobile terminal
CN108174141A (en) * 2017-11-30 2018-06-15 维沃移动通信有限公司 A method of video communication and a mobile device
US20190188453A1 (en) * 2017-12-15 2019-06-20 Hyperconnect, Inc. Terminal and server for providing video call service
CN108683872A (en) * 2018-08-30 2018-10-19 Oppo广东移动通信有限公司 Video call method, device, storage medium and mobile terminal

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110602403A (en) * 2019-09-23 2019-12-20 华为技术有限公司 Method for taking pictures under dark light and electronic equipment
WO2021057277A1 (en) * 2019-09-23 2021-04-01 华为技术有限公司 Photographing method in dark light and electronic device
WO2021109678A1 (en) * 2019-12-04 2021-06-10 深圳追一科技有限公司 Video generation method and apparatus, electronic device, and storage medium
CN111031241A (en) * 2019-12-09 2020-04-17 Oppo广东移动通信有限公司 Image processing method and device, terminal and computer readable storage medium
CN111031241B (en) * 2019-12-09 2021-08-27 Oppo广东移动通信有限公司 Image processing method and device, terminal and computer readable storage medium
CN111432154A (en) * 2020-03-30 2020-07-17 维沃移动通信有限公司 Video playing method, video processing method and electronic equipment
CN111432154B (en) * 2020-03-30 2022-01-25 维沃移动通信有限公司 Video playing method, video processing method and electronic equipment
CN111698553A (en) * 2020-05-29 2020-09-22 维沃移动通信有限公司 Video processing method and device, electronic equipment and readable storage medium
CN117152030A (en) * 2022-05-23 2023-12-01 华为技术有限公司 Image processing methods and electronic devices
CN118573915A (en) * 2024-05-22 2024-08-30 天翼爱音乐文化科技有限公司 Video high definition processing method, system, equipment and medium
CN118714251A (en) * 2024-07-23 2024-09-27 深圳市有一说一科技有限公司 Video call image optimization method, device, medium and computing device

Also Published As

Publication number Publication date
CN110266994B (en) 2021-03-26

Similar Documents

Publication Publication Date Title
CN110266994A (en) Video call method, video call device and terminal
CN108921806B (en) Image processing method, image processing device and terminal equipment
US11158057B2 (en) Device, method, and graphical user interface for processing document
CN108737739B (en) Preview picture acquisition method, preview picture acquisition device and electronic equipment
CN110457963B (en) Display control method, device, mobile terminal, and computer-readable storage medium
CN108961183B (en) Image processing method, terminal device and computer-readable storage medium
CN109118447B (en) A picture processing method, picture processing device and terminal equipment
CN108564550B (en) Image processing method, device and terminal device
CN108898082A (en) Image processing method, picture processing unit and terminal device
CN111290684A (en) Image display method, image display device and terminal equipment
CN109359582B (en) Information searching method, information searching device and mobile terminal
CN108805095A (en) Picture processing method and device, mobile terminal and computer readable storage medium
CN111784607B (en) Image tone mapping method, device, terminal equipment and storage medium
CN108776959B (en) Image processing method and device and terminal equipment
CN111597009B (en) Application program display method, device and terminal equipment
CN110677586A (en) Image display method, image display device and mobile terminal
CN110705653A (en) Image classification method, image classification device and terminal equipment
CN110263741A (en) Video frame extraction method, apparatus and terminal device
CN112055156B (en) Preview image updating method and device, mobile terminal and storage medium
CN108629767A (en) A kind of method, device and mobile terminal of scene detection
CN108985215A (en) A kind of image processing method, picture processing unit and terminal device
CN110688035B (en) Photo album processing method, photo album processing device and mobile terminal
CN111754411B (en) Image noise reduction method, image noise reduction device and terminal equipment
CN109242763B (en) Image processing method, image processing device, and terminal equipment
CN109783308A (en) A kind of method and terminal device of terminal detection

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20211105

Address after: 523000 room 1301, building 1, No. 28, Chang'an Dongmen Middle Road, Chang'an Town, Dongguan City, Guangdong Province

Patentee after: Dongguan Bubugao Education Software Co.,Ltd.

Address before: 523860 No. 168 Dongmen Middle Road, Xiaobian Community, Chang'an Town, Dongguan City, Guangdong Province

Patentee before: Guangdong GENIUS Technology Co., Ltd.

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20210326

点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载