+

CN117332105A - Method and electronic device for providing product matching information - Google Patents

Method and electronic device for providing product matching information Download PDF

Info

Publication number
CN117332105A
CN117332105A CN202311197783.2A CN202311197783A CN117332105A CN 117332105 A CN117332105 A CN 117332105A CN 202311197783 A CN202311197783 A CN 202311197783A CN 117332105 A CN117332105 A CN 117332105A
Authority
CN
China
Prior art keywords
image
clothing
target
matching
human body
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311197783.2A
Other languages
Chinese (zh)
Inventor
曹铭忆
林苏闽
张沈鹏
孔祥衡
陈梦婷
洪学文
刁睿桦
赵子萱
黄程昱坤
陈金珠
沈云飞
杨根茂
周益琇
张俊胡杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Taobao China Software Co Ltd
Original Assignee
Taobao China Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Taobao China Software Co Ltd filed Critical Taobao China Software Co Ltd
Priority to CN202311197783.2A priority Critical patent/CN117332105A/en
Publication of CN117332105A publication Critical patent/CN117332105A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • G06F16/535Filtering based on additional data, e.g. user or group profiles
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9535Search customisation based on user profiles and personalisation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0641Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping
    • G06Q30/0643Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping graphically representing goods, e.g. 3D product representation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Library & Information Science (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Processing Or Creating Images (AREA)

Abstract

本申请实施例公开了提供商品搭配信息的方法及电子设备,所述方法包括:确定待进行服饰搭配的第一图像;所述第一图像中包括:第一服饰及其在人体穿着状态下相关的第一局部人体部位的第一图像内容;从预置的素材库中,确定可搭配的至少一个第二图像;所述第二图像中包括:第二服饰及其在人体穿着状态下相关的第二局部人体部位的第二图像内容;将所述第一图像内容与所述第二图像内容进行拼接处理;利用人工智能AI大规模参数模型,对所述拼接处理后的图像进行重绘处理,以生成目标图像。通过本申请实施例,能够提供更灵活的服饰搭配推荐信息,且可以使得输出的信息搭配结果更有效地起到参考作用。

Embodiments of the present application disclose a method and an electronic device for providing product matching information. The method includes: determining a first image to be matched with clothing; the first image includes: the first clothing and its related information when the human body is wearing it. The first image content of the first partial human body part; from the preset material library, determine at least one second image that can be matched; the second image includes: the second clothing and its related clothing in the human body wearing state The second image content of the second partial human body part; splicing the first image content and the second image content; using the artificial intelligence AI large-scale parameter model to redraw the spliced image , to generate the target image. Through the embodiments of the present application, more flexible clothing matching recommendation information can be provided, and the output information matching results can serve as a reference more effectively.

Description

提供商品搭配信息的方法及电子设备Method and electronic device for providing product matching information

技术领域Technical field

本申请涉及信息处理技术领域,特别是涉及提供商品搭配信息的方法及电子设备。This application relates to the field of information processing technology, and in particular to methods and electronic devices for providing product matching information.

背景技术Background technique

在商品信息服务系统中,服饰类是一个重要的商品类目,用户在选购服饰类的商品时,基于心仪的服饰再找合适的搭配也是用户生活场景中一个比较常见的需求。例如,用户对某上衣感兴趣,通常还会希望为该上衣搭配一件下装,等等。In the product information service system, clothing is an important product category. When users purchase clothing products, finding a suitable match based on their favorite clothing is also a common need in users' life scenarios. For example, if a user is interested in a top, they usually also want to match the top with a bottom, and so on.

为了满足用户关于服饰搭配购买的需求,一些系统中可以为用户提供穿搭方面的信息,但是,这种穿搭信息通常是由商家基于自己店铺内的服饰预先搭配好,然后在商品的详情页等页面中可以提供推荐的店内服饰搭配方案。或者,还可能提供专门的穿搭频道等,可以对服饰进行跨店的搭配推荐,但是,现有技术中,通常仍然需要预先在线下通过人工的方式搭配好,然后进行发布,消费者用户可以在该频道内浏览具体的搭配方案,等等。总之,上述方案都还不够灵活。In order to meet users' needs for clothing matching purchases, some systems can provide users with clothing information. However, this clothing information is usually pre-matched by merchants based on the clothing in their own stores, and then displayed on the product details page. Recommended in-store clothing matching solutions can be provided on other pages. Alternatively, a special outfit channel may be provided to recommend cross-store matching of clothing. However, in the existing technology, it is usually still necessary to manually match the clothes offline in advance and then publish them. Consumers can Browse specific matching plans in this channel, etc. In short, the above solutions are not flexible enough.

发明内容Contents of the invention

本申请提供了提供商品搭配信息的方法及电子设备,能够提供更灵活的服饰搭配推荐信息,且可以使得输出的信息搭配结果更有效地起到参考作用。This application provides a method and electronic device for providing product matching information, which can provide more flexible clothing matching recommendation information, and can make the output information matching results serve as a reference more effectively.

本申请提供了如下方案:This application provides the following solutions:

一种提供商品搭配信息的方法,包括:A method of providing product matching information, including:

确定待进行服饰搭配的第一图像;所述第一图像中包括:第一服饰及其在人体穿着状态下相关的第一局部人体部位的第一图像内容;Determine the first image to be matched with clothing; the first image includes: the first image content of the first clothing and its related first partial human body part in the human body wearing state;

从预置的素材库中,确定可搭配的至少一个第二图像;所述第二图像中包括:第二服饰及其在人体穿着状态下相关的第二局部人体部位的第二图像内容;Determine at least one second image that can be matched from the preset material library; the second image includes: the second image content of the second garment and its related second partial human body part in the human body wearing state;

将所述第一图像内容与所述第二图像内容进行拼接处理;performing splicing processing on the first image content and the second image content;

利用人工智能AI大规模参数模型,对所述拼接处理后的图像进行重绘处理,以生成目标图像,所述目标图像用于模拟第一服饰与第二服饰在同一人体上进行穿着状态下的搭配效果。The artificial intelligence AI large-scale parameter model is used to redraw the spliced image to generate a target image. The target image is used to simulate the wearing state of the first garment and the second garment on the same human body. Matching effect.

其中,所述素材库中保存的图像与关联的信息服务系统中提供的商品相对应;Wherein, the images stored in the material library correspond to the commodities provided in the associated information service system;

所述确定待进行服饰搭配的第一图像,包括:Determining the first image to be matched with clothing includes:

根据用户提交的商品搜索请求,提供商品搜索结果;Provide product search results based on product search requests submitted by users;

响应于针对所述商品搜索结果中的指定商品发起的服饰搭配请求,将所述素材库中与该指定商品关联的目标图像确定为所述第一图像。In response to a clothing matching request initiated for a designated product in the product search results, a target image associated with the designated product in the material library is determined as the first image.

其中,所述商品搜索请求为:基于用户上传的与服饰相关的图像提交的商品搜索请求,所述商品搜索结果中包括与用户上传的图像中包括的服饰主体属于同款的商品。Wherein, the product search request is: a product search request submitted based on clothing-related images uploaded by the user, and the product search results include products of the same style as the clothing body included in the image uploaded by the user.

其中,所述将所述第一图像内容与所述第二图像内容进行拼接处理,包括:Wherein, the splicing process of the first image content and the second image content includes:

识别所述第一图像内容以及所述第二图像内容中包含的服饰关键点以及人体关键点信息;Identify clothing key points and human body key point information contained in the first image content and the second image content;

根据识别出的服饰关键点以及人体关键点信息,对所述第一图像内容以及所述第二图像内容进行拼接处理。According to the identified clothing key points and human body key point information, the first image content and the second image content are spliced.

其中,通过客户端展示所述目标图像时,还提供用于对所述目标图像中的第二服饰进行同款商品搜索的操作选项,以便在接收到同款商品搜索请求后,提供同款商品搜索结果。Wherein, when the target image is displayed through the client, an operation option for searching for same-style products for the second clothing in the target image is also provided, so that after receiving the same-style product search request, the same-style product is provided. search results.

其中,通过客户端展示所述目标图像时,还提供用于对所述目标图像中的服饰图像进行设计的操作选项;Wherein, when the target image is displayed through the client, operation options for designing the clothing image in the target image are also provided;

所述方法还包括:The method also includes:

接收到对所述目标图像中的服饰图像进行自定义设计的请求后,提供可选的设计元素,以便为所述服饰图像添加目标设计元素;After receiving a request for custom design of the clothing image in the target image, providing optional design elements to add the target design element to the clothing image;

响应于对设计结果进行图像生成的请求,利用AI大规模参数模型对设计完成的目标图像进行重绘处理,以便将所述目标图像中的服饰图像与所述目标设计元素相融合,生成具有真实服饰效果的图像。In response to the request for image generation of the design results, the AI large-scale parameter model is used to redraw the designed target image in order to integrate the clothing image in the target image with the target design elements to generate a realistic image. Costume effect image.

其中,还包括:Among them, it also includes:

响应于对设计完成的服饰图像进行同款商品搜索的请求,提供同款商品搜索结果。In response to a request to perform a same-style product search on the designed clothing image, the same-style product search results are provided.

一种图像处理方法,包括:An image processing method including:

接收到对目标图像中的服饰图像进行设计的请求后,提供用于对所述服饰图像进行设计的候选设计元素,以便为所述服饰图像添加目标设计元素;After receiving a request to design the clothing image in the target image, provide candidate design elements for designing the clothing image, so as to add the target design element to the clothing image;

响应于对设计结果进行图像生成的请求,利用AI大规模参数模型对设计完成的目标图像进行重绘处理,以便将所述目标图像中的服饰图像与所述目标设计元素相融合,生成具有真实服饰效果的图像。In response to the request for image generation of the design results, the AI large-scale parameter model is used to redraw the designed target image in order to integrate the clothing image in the target image with the target design elements to generate a realistic image. Costume effect image.

其中,还包括:Among them, it also includes:

响应于对设计完成的服饰图像进行同款商品搜索的请求,提供同款商品搜索结果。In response to a request to perform a same-style product search on the designed clothing image, the same-style product search results are provided.

一种提供服饰搭配信息的方法,包括:A method of providing clothing matching information, including:

接收服饰搭配请求,所述请求中包括所需的目标着装风格和/或场景信息,以及用于对目标人物的人体特征进行描述的文本和/或图像信息;Receive a clothing matching request, which includes the required target clothing style and/or scene information, as well as text and/or image information used to describe the target person's human characteristics;

确定符合所述目标着装风格和/或场景的需求的服饰搭配方案,并利用AI大规模参数模型生成目标图像,所述目标图像用于表达所述服饰搭配方案在由所述目标人物穿着状态下的搭配效果。Determine a clothing matching scheme that meets the needs of the target dressing style and/or scene, and use an AI large-scale parameter model to generate a target image, the target image being used to express the clothing matching scheme when worn by the target person matching effect.

其中,还包括:Among them, it also includes:

响应于对所述服饰搭配方案中的服饰进行同款商品搜索的请求,提供同款商品搜索结果。In response to a request to search for the same type of products for the clothing in the clothing matching scheme, search results for the same type of products are provided.

一种提供商品搭配信息的装置,包括:A device that provides product matching information, including:

第一图像确定单元,用于确定待进行服饰搭配的第一图像;所述第一图像中包括:第一服饰及其在人体穿着状态下相关的第一局部人体部位的第一图像内容;The first image determination unit is used to determine the first image to be matched with clothing; the first image includes: the first image content of the first clothing and its related first partial human body part in the human body wearing state;

第二图像确定单元,用于从预置的素材库中,确定可搭配的至少一个第二图像;所述第二图像中包括:第二服饰及其在人体穿着状态下相关的第二局部人体部位的第二图像内容;The second image determination unit is used to determine at least one second image that can be matched from the preset material library; the second image includes: the second clothing and its related second partial human body when the human body is wearing it. The second image content of the part;

拼接处理单元,用于将所述第一图像内容与所述第二图像内容进行拼接处理;A splicing processing unit configured to splice the first image content and the second image content;

AI重绘单元,用于利用人工智能AI大规模参数模型,对所述拼接处理后的图像进行重绘处理,以生成目标图像,所述目标图像用于模拟第一服饰与第二服饰在同一人体上进行穿着状态下的搭配效果。The AI redrawing unit is used to use the artificial intelligence AI large-scale parameter model to redraw the spliced image to generate a target image. The target image is used to simulate the first clothing and the second clothing in the same The matching effect is carried out on the human body when worn.

一种图像处理装置,包括:An image processing device, including:

设计元素提供单元,用于接收到对目标图像中的服饰图像进行设计的请求后,提供用于对所述服饰图像进行设计的候选设计元素,以便为所述服饰图像添加目标设计元素;A design element providing unit, configured to provide candidate design elements for designing the clothing image after receiving a request to design the clothing image in the target image, so as to add the target design element to the clothing image;

AI重绘单元,用于响应于对设计结果进行图像生成的请求,利用AI大规模参数模型对设计完成的目标图像进行重绘处理,以便将所述目标图像中的服饰图像与所述目标设计元素相融合,生成具有真实服饰效果的图像。The AI redrawing unit is configured to respond to a request for image generation of the design result and use the AI large-scale parameter model to redraw the designed target image, so as to match the clothing image in the target image with the target design. Elements are merged to generate images with realistic clothing effects.

一种提供服饰搭配信息的装置,包括:A device that provides clothing matching information, including:

请求接收单元,用于接收服饰搭配请求,所述请求中包括所需的目标着装风格和/或场景信息,以及用于对目标人物的人体特征进行描述的文本和/或图像信息;A request receiving unit, configured to receive a clothing matching request, which includes the required target dressing style and/or scene information, as well as text and/or image information used to describe the human body characteristics of the target person;

AI生成单元,用于确定符合所述目标着装风格和/或场景的需求的服饰搭配方案,并利用AI大规模参数模型生成目标图像,所述目标图像用于表达所述服饰搭配方案在由所述目标人物穿着状态下的搭配效果。An AI generation unit is used to determine a clothing matching scheme that meets the needs of the target dressing style and/or scene, and uses an AI large-scale parameter model to generate a target image, where the target image is used to express the clothing matching scheme based on the requirements of the target clothing style and/or scene. Describe the matching effect when the target person is wearing it.

一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现前述任一项所述的方法的步骤。A computer-readable storage medium on which a computer program is stored, which implements the steps of any of the foregoing methods when executed by a processor.

一种电子设备,包括:An electronic device including:

一个或多个处理器;以及one or more processors; and

与所述一个或多个处理器关联的存储器,所述存储器用于存储程序指令,所述程序指令在被所述一个或多个处理器读取执行时,执行前述任一项所述的方法的步骤。A memory associated with the one or more processors, the memory being used to store program instructions that, when read and executed by the one or more processors, perform any of the foregoing methods. A step of.

根据本申请提供的具体实施例,本申请公开了以下技术效果:According to the specific embodiments provided in this application, this application discloses the following technical effects:

通过本申请实施例,可以为用户指定的第一图像,确定出可以与其他的第一服饰进行搭配的第二图像,并且,第一图像以及第二图像中,都可以包括具体服饰的图像内容及其在人体穿着状态下相关的局部人体部位的图像内容。这样,在返回搭配结果时,可以通过将上述图像内容拼接,并通过AI大规模参数模型进行重绘处理后,生成用于模拟第一服饰与第二服饰在同一人体上进行穿着状态下的搭配效果的目标图像。这样,不仅可以为用户推荐搭配对象,还可以提供同一搭配方案中,第一服饰与第二服饰在同一人体上进行穿着状态下的搭配效果,并且,这种搭配效果会更真实自然,可以更有效地起到参考作用。Through the embodiments of the present application, a second image that can be matched with other first clothing can be determined for the first image specified by the user, and both the first image and the second image can include image content of specific clothing. and the image content of relevant local human body parts in the human body wearing state. In this way, when the matching results are returned, the above image content can be spliced and redrawn through the AI large-scale parameter model to generate a model for simulating the matching of the first garment and the second garment when worn on the same human body. The target image for the effect. In this way, it can not only recommend matching objects for the user, but also provide the matching effect of the first clothing and the second clothing in the same matching scheme when worn on the same body. Moreover, this matching effect will be more real and natural, and can be more Effectively serve as a reference.

当然,实施本申请的任一产品并不一定需要同时达到以上所述的所有优点。Of course, implementing any product of this application does not necessarily require achieving all the above-mentioned advantages at the same time.

附图说明Description of drawings

为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly explain the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some of the drawings of the present application. Embodiments, for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without exerting creative efforts.

图1是本申请实施例提供的系统架构的示意图;Figure 1 is a schematic diagram of the system architecture provided by the embodiment of the present application;

图2是本申请实施例提供的第一方法的流程图;Figure 2 is a flow chart of the first method provided by the embodiment of the present application;

图3是本申请实施例提供的AI搭配界面的示意图;Figure 3 is a schematic diagram of the AI matching interface provided by the embodiment of the present application;

图4是本申请实施例提供的AI生成搭配图像的过程示意图;Figure 4 is a schematic diagram of the process of generating matching images by AI provided by the embodiment of the present application;

图5是本申请实施例提供的高级搭配界面的示意图;Figure 5 is a schematic diagram of an advanced matching interface provided by an embodiment of the present application;

图6是本申请实施例提供的“AI画笔”功能界面的示意图;Figure 6 is a schematic diagram of the "AI Brush" functional interface provided by the embodiment of the present application;

图7是本申请实施例提供的“AI画笔”功能另一界面的示意图;Figure 7 is a schematic diagram of another interface of the "AI brush" function provided by the embodiment of the present application;

图8是本申请实施例提供的第二方法的流程图;Figure 8 is a flow chart of the second method provided by the embodiment of the present application;

图9是本申请实施例提供的第三方法的流程图;Figure 9 is a flow chart of the third method provided by the embodiment of the present application;

图10是本申请实施例提供的场景搭配功能界面的示意图;Figure 10 is a schematic diagram of the scene matching function interface provided by the embodiment of the present application;

图11是本申请实施例提供的社区平台界面的示意图;Figure 11 is a schematic diagram of the community platform interface provided by the embodiment of the present application;

图12是本申请实施例提供的电子设备的示意图。Figure 12 is a schematic diagram of an electronic device provided by an embodiment of the present application.

具体实施方式Detailed ways

下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art fall within the scope of protection of this application.

在本申请实施例中,为了便于为用户提供更灵活的服饰搭配方面的信息,提供了相应的解决方案,在该方案中,可以针对用户指定的服饰图像,在更大范围内为该服饰提供推荐搭配,而不限于同一店铺内部。这里需要说明的是,在现有技术的一些方案中,可能存在关于智能搭配的方案,但是,通常是基于给出推荐搭配的服饰列表,供用户进行选择,例如,用户基于某上衣发起智能搭配请求,之后,可以返回一个商品列表页面,其中展示出算法建议的能够与该上衣进行搭配的裤子、裙子等服饰信息。但是,关于该上衣与列表中这些具体裤子、裙子等服饰的具体搭配效果,则依赖于用户的自行想象,显然,这会不利于用户做出进一步的决策。In the embodiments of this application, in order to provide users with more flexible clothing matching information, a corresponding solution is provided. In this solution, for the clothing image specified by the user, the clothing can be provided with a wider range of information. Recommended combinations, not limited to within the same store. It should be noted here that in some solutions in the existing technology, there may be solutions for smart matching, but these are usually based on a list of recommended matching clothing for the user to choose. For example, the user initiates smart matching based on a certain top. After requesting, you can return to a product list page, which displays information about pants, skirts and other clothing recommended by the algorithm that can be matched with the top. However, the specific matching effect of this top with the specific pants, skirts and other clothing in the list depends on the user's own imagination. Obviously, this will not be conducive to the user's further decision-making.

为了帮助用户进行决策,一些方案中还可以在提供推荐搭配方案的同时,提供具体搭配方案在人体上的上身效果,例如,针对某上衣搭配了一条裤子,则可以展示出将该上衣以及裤子“穿”在模特等人物身上时的效果,这样可以使得具体的搭配效果更直观。在该方案中,需要预先为具体的服饰商品准备素材图,这种素材图通常是关于服饰的具有立体展示效果的图片(例如,图片中展示的服饰可以是被撑起的状态下拍摄的照片,而不是平铺等扁平放置状态下拍摄,等等),在确定出某服饰与另一服饰可以搭配之后,可以将两个服饰分别对应的立体图片匹配到一个预先生成的人体模特模型上,从而模拟出具体的上身搭配效果。In order to help users make decisions, some solutions can also provide recommended matching solutions while also providing the upper body effects of specific matching solutions on the human body. For example, if a top is matched with a pair of pants, the top and pants can be displayed. The effect when worn on models and other characters can make the specific matching effect more intuitive. In this solution, material pictures need to be prepared in advance for specific clothing products. This material picture is usually a picture of the clothing with a three-dimensional display effect (for example, the clothing displayed in the picture can be a photo taken in a propped-up state. , instead of shooting in a flat state such as laying flat, etc.), after determining that a certain garment can be matched with another garment, the three-dimensional pictures corresponding to the two garments can be matched to a pre-generated mannequin model. This simulates the specific upper body matching effect.

上述方案虽然能够提供更直观的搭配效果,但是,这种通过将不同服饰的立体图片匹配到一个人体模特身上的实现方式中,由于人体模特是虚拟的,在匹配的过程中,通常只是将服饰的立体图片移动到人体模特的某个位置处,这样生成的图像会显得生硬,不够真实、自然,无法展示出具体服饰在真实人体穿着时的状态,例如,一些面料随重力自然下垂的状态,等等。Although the above solution can provide a more intuitive matching effect, in this implementation of matching three-dimensional pictures of different clothing to a mannequin, since the mannequin is virtual, during the matching process, the clothing is usually just If the three-dimensional picture is moved to a certain position on the human model, the generated image will appear stiff, not realistic and natural enough, and cannot show the state of specific clothing when worn by the real human body. For example, some fabrics naturally droop with gravity. etc.

基于上述情况,在本申请实施例中,提供了改进的方案。在该方案中,仍然可以为用户指定的任意商品提供智能的搭配推荐,并且,可以提供具体搭配方案中的不同服饰在人体穿着状态下的搭配效果图,但是,并不是将服饰的立体图片匹配到预先生成的虚拟人体模特上,而是将具体服饰对应的真实模特图进行抠图、裁剪、拼接,然后再利用AI(Artificial Intelligence,人工智能)大规模参数模型的能力,对拼接后的图像进行重绘,使得图像更加真实、自然。Based on the above situation, in the embodiment of the present application, an improved solution is provided. In this solution, intelligent matching recommendations can still be provided for any product specified by the user, and matching renderings of different garments in the specific matching scheme when worn by the human body can be provided. However, it does not match the three-dimensional images of the garments. to the pre-generated virtual human model, but cut out, crop, and splice the real model images corresponding to the specific clothing, and then use the ability of AI (Artificial Intelligence, artificial intelligence) large-scale parameter model to edit the spliced images. Redraw to make the image more realistic and natural.

具体的,在本申请实施例中,可以预先建立素材库,该素材库主要可以是基于具体服饰商品的真人模特上身图来建立的,当然,这里的真人模特上身图可以是当前商品信息服务系统中的具体商品对应的图像,或者,也可以是通过其他途径收集到的图像,也即,图像中的服饰可能并不是当前商品信息服务系统中在售的商品,但是,只要能够收集到该服饰的真人上身图,即可用来生成本申请实施例中的素材图。例如,在建立该素材库时,可以收集多个服饰在由真人模特穿着状态下拍摄的照片等,然后可以对其进行抠图处理,从中抠取出具体服饰的图像及其在真人模特穿着状态下相关的人体部位,例如,某照片中模特A穿着了一件上衣C1以及一条裤子T1,此时,可以抠取出该上衣的图像,以及该模特的上半身图像,当然,还可以从该图像中抠取出裤子部分的图像,以及模特的下半身图像,这样,素材库中就可以增加以下素材图:上衣C1在该模特A身上穿着状态下的图像,图像中包括模特A的头、手等与上衣穿着相关的身体部位,而不包括腿、脚等与上衣穿着无关的身体部位;另外还可以包括裤子T1在模特B身上穿着状态下的图像,图像中包括模特A的腿、脚等与裤子穿着相关的身体部位,而不包括头、胳膊等与裤子穿着无关的身体部位,等等。通过这种方式,可以使得素材库中保存多个素材图,每个素材图中都可以包括具体服饰在真人模特穿着状态下的图像,以及涉及到的具体真人模特的局部身体部位。或者,除了通过上述对真实服饰的照片等进行处理后生成素材图之外,还可以是通过AI大规模参数模型生成虚拟的素材图,等等。Specifically, in the embodiment of the present application, a material library can be established in advance. The material library can be mainly established based on the upper body pictures of real models of specific clothing products. Of course, the upper body pictures of real models here can be the current product information service system. The image corresponding to the specific product in the image, or it can also be an image collected through other means. That is, the clothing in the image may not be the product currently on sale in the product information service system. However, as long as the clothing can be collected The real-life upper body picture can be used to generate the material picture in the embodiment of this application. For example, when establishing this material library, you can collect photos of multiple garments taken when worn by real models, etc., and then cut them out to extract images of specific garments and their images when worn by real models. Relevant human body parts, for example, in a photo, model A is wearing a top C1 and a pair of pants T1. At this time, you can extract the image of the top and the model's upper body. Of course, you can also extract it from the image. Take out the image of the pants and the model's lower body. In this way, the following material pictures can be added to the material library: the image of top C1 on model A. The image includes model A's head, hands, etc. and the top. Relevant body parts, excluding legs, feet and other body parts that have nothing to do with wearing tops; in addition, it can also include images of pants T1 worn on model B. The image includes legs, feet, etc. of model A that are related to wearing pants. body parts, excluding head, arms and other body parts that have nothing to do with wearing pants, etc. In this way, multiple material pictures can be saved in the material library, and each material picture can include images of specific clothing when worn by real models, as well as partial body parts of the specific real models involved. Or, in addition to generating material pictures through the above-mentioned processing of photos of real clothing, virtual material pictures can also be generated through AI large-scale parameter models, and so on.

这样,在具体基于用户指定的某服饰商品进行搭配推荐时,首先可以通过相关的算法确定出能够与该服饰商品搭配的其他服饰商品,然后从素材库中找到这些服饰商品对应的素材图;或者,也可以利用AI大规模参数模型的能力,通过对素材库中的素材图进行模型理解等方式,确定出具体可以搭配的素材图,等等。之后,可以生成一套或多套搭配方案,对于每套搭配方案,可以将不同服饰分别对应的素材图进行拼接,例如,用户指定为某上衣推荐搭配服饰,则在确定出多个可以与之搭配的裤子、裙子等之后,可以将该上衣对应的素材图与该裤子、裙子等素材图拼接在一起,由于上衣对应的素材图中包括真人模特的上半身等身体部位,裤子、裙子等对应的素材图中包括真人模特的下半身等身体部位,因此,将两个素材图上下拼接在一起,可以组成一个完整的人体,并呈现出在该人体穿着状态下,具体服饰的搭配效果。In this way, when making matching recommendations based on a certain clothing product specified by the user, firstly, relevant algorithms can be used to determine other clothing products that can be matched with the clothing product, and then the material images corresponding to these clothing products can be found from the material library; or , you can also use the ability of AI large-scale parameter models to determine the specific material pictures that can be matched by understanding the material pictures in the material library, etc. After that, one or more sets of matching plans can be generated. For each set of matching plans, the material pictures corresponding to different clothing can be spliced together. For example, if the user specifies the recommended matching clothing for a certain top, then multiple matching items can be determined. After matching the pants, skirts, etc., the material pictures corresponding to the top can be spliced together with the material pictures corresponding to the pants, skirts, etc. Since the material pictures corresponding to the tops include the upper body of the real model and other body parts, the corresponding material pictures of the pants, skirts, etc. The material picture includes the lower body of the real model and other body parts. Therefore, by splicing the two material pictures together, a complete human body can be formed, and the matching effect of specific clothing when the human body is worn is presented.

通过这种方式,由于具体的素材图都是在真人模特穿着状态下的服饰图像,因此,相对于通过立体图片与虚拟人物进行合成的上身效果而言,更能够体现出具体服饰在上身状态下的真实感。其中,为了获得更好的拼接效果,还可以在拼接的过程中对不同素材图进行服饰关键点、人体关键点的识别,然后,通过根据这种关键点信息,在图像拼接可以进行图像的仿射变化,以使得拼接后的图像看上去更真实自然。In this way, since the specific material pictures are all images of clothing in the state of being worn by real models, compared to the upper body effect that is synthesized through three-dimensional pictures and virtual characters, it can better reflect the upper body state of specific clothing. sense of reality. Among them, in order to obtain a better splicing effect, you can also identify key points of clothing and human body key points in different material images during the splicing process. Then, based on this key point information, image simulation can be performed during image splicing. changes in reflection to make the spliced image look more realistic and natural.

另外,由于具体在拼接的过程中,同一搭配方案中不同服饰对应的素材图中可能是不同的模特人物,即使是同一模特人物,也可能是在不同的时间、地点进行的拍摄,因此,即使实现了拼接算法的仿射变化能力,但是,也可能会使得拼接出的图像存在一些不够自然之处。例如,上下装的光线亮度、模特人物皮肤颜色等不统一,使得整体图像看上去不够协调,或者,之前在抠图过程中可能对模特人物的某些身体部位(例如,手部,等等)抠取的不够完整,等等。因此,在本申请实施例中,还可以进一步借助于AI大规模参数模型的绘图能力,在上述拼接出的图像基础上进行重绘,从而使得具体的图像更加美观、真实,更好地模拟出不同服饰在同一人体穿着状态下的搭配效果,等等。In addition, due to the splicing process, the material pictures corresponding to different clothing in the same matching scheme may be different models. Even the same model may be shot at different times and locations. Therefore, even if The affine change ability of the splicing algorithm is achieved, but it may also cause the spliced image to be somewhat unnatural. For example, the brightness of the upper and lower clothes, the color of the model's skin, etc. are not uniform, making the overall image look uncoordinated, or some body parts of the model (for example, hands, etc.) may have been modified during the cutout process. The extraction is not complete enough, etc. Therefore, in the embodiment of the present application, the drawing capability of the AI large-scale parameter model can be further used to redraw on the basis of the above-mentioned spliced images, thereby making the specific images more beautiful and realistic, and better simulating the The matching effects of different clothing on the same human body, etc.

也就是说,在本申请实施例中,可以在服饰搭配能力基础上,通过将服饰的真人模特上身图进行拼接,并借助于AI大规模参数模型的绘图能力,为用户提供更真实更自然的服饰搭配上身效果图,从而更有效地帮助用户进行决策。That is to say, in the embodiment of the present application, on the basis of the clothing matching ability, by splicing the upper body pictures of real models of clothing, and with the help of the drawing ability of the AI large-scale parameter model, users can be provided with a more realistic and natural Clothes are matched with upper body renderings to help users make decisions more effectively.

其中,在实际应用中,可以有多种具体的应用场景,例如,在“以图搜商品”的场景中,用户可以上传一张带有服饰图像的照片等,并发起搜索,此时,可以返回该服饰的同款商品列表。用户在浏览这些同款商品时,可能会对其中某个商品感兴趣,但是,想知道有哪些服饰能够与该商品进行搭配。因此,就可以在商品列表中为各个商品提供“AI搭配”等操作入口,用户可以通过这种操作入口发起搭配请求,相应的,就可以通过前述素材图的拼接、AI重绘等处理,为用户生成多个推荐的搭配方案,并且用户可以查看到具体搭配方案中的不同服饰在人体穿着状态下的搭配效果,等等。Among them, in actual applications, there can be a variety of specific application scenarios. For example, in the scenario of "searching for products by pictures", the user can upload a photo with an image of clothing, etc., and initiate a search. At this time, you can Return to the list of similar products of this clothing. When users browse these products of the same type, they may be interested in one of the products, but want to know what clothing can match the product. Therefore, operation portals such as "AI matching" can be provided for each product in the product list. Users can initiate matching requests through this operation portal. Correspondingly, through the splicing of the aforementioned material images, AI redrawing, etc., the user can The user generates multiple recommended matching plans, and the user can view the matching effects of different clothing in the specific matching plan when the human body is wearing it, and so on.

当然,素材库中的素材图可以是一些具有代表性的服饰对应的素材图,在生成上述搭配方案对应的图像之后,用户如果对其中某个图像中的搭配对象感兴趣,还可以继续发起针对该搭配对象的“找同款”等请求,相应的,可以展示出该搭配对象的同款商品列表等页面,从而便于帮助用户更快速地找到能够与当前感兴趣的服饰进行搭配的其他服饰。Of course, the material pictures in the material library can be material pictures corresponding to some representative clothing. After generating the images corresponding to the above matching scheme, if the user is interested in the matching object in one of the images, he can continue to initiate a target For requests such as "find the same style" of the matching object, corresponding pages such as a list of products of the same style for the matching object can be displayed, thereby helping the user to more quickly find other clothing that can match the clothing of current interest.

另外,在可选的方式下,还可以为用户提供“AI搭配”功能,使得用户可以基于具体的服饰或者其搭配方案进行设计。例如,在前述“AI搭配”功能的基础上,还可以通过这种“AI画笔”功能,使得用户可以在AI生成的图像基础上添加更多的设计元素,包括在服饰上添加一些贴图图案,或者,为服饰涂色,或者,替换搭配对象,等等,之后,还可以通过AI大规模参数模型的绘图能力,对设计后的图像进行重绘,使得生成的图像更真实更自然(否则,可能看上去就是卡通贴纸贴在服饰照片上,显得不像是服饰上实际所具有图案,等等),等等。In addition, in an optional way, the "AI matching" function can also be provided to users, allowing users to design based on specific clothing or matching plans. For example, on the basis of the aforementioned "AI matching" function, the "AI brush" function can also be used to allow users to add more design elements based on the images generated by AI, including adding some stickers and patterns on clothing. Or, color the clothing, or replace the matching objects, etc. After that, you can also use the drawing capabilities of the AI large-scale parameter model to redraw the designed image to make the generated image more realistic and natural (otherwise, It may look like cartoon stickers affixed to the clothing photos, and it may not look like the actual patterns on the clothing, etc.), etc.

再者,还可以提供基于具体场景以及用户指定的人物特征的AI生成服饰搭配图像功能,也即,可以预先提供多种可选的场景供用户选择,选择某个场景后,还可以通过文本和/或上传图像等方式,对所需人物的特征进行描述,之后,可以通过AI大模型生成符合该场景以及该人物特征的服饰搭配图像,等等。Furthermore, it can also provide the function of AI-generated clothing matching images based on specific scenes and user-specified character characteristics. That is, a variety of optional scenes can be provided in advance for users to choose. After selecting a scene, they can also use text and / Or upload images and other methods to describe the characteristics of the desired character. Afterwards, the AI large model can be used to generate clothing matching images that match the scene and the characteristics of the character, etc.

关于上述“AI搭配”、“AI搭配”、场景搭配等功能下,AI生成的图像,还可以通过社区网络平台等进行发布,在该平台中还可以对其他用户发布的图像进行查看,或者发起找同款,等等。Regarding the above-mentioned "AI matching", "AI matching", scene matching and other functions, the images generated by AI can also be published through community network platforms, etc. In this platform, you can also view images posted by other users, or initiate Find the same style, etc.

总之,本申请实施例能够将AI大规模参数模型的能力应用到服饰搭配推荐相关的场景中,通过由AI大规模参数模型“基于图像生成图像”、“基于文本生成图像”、“基于文本+图像生成图像”等方式,为用户提供更丰富、更具有真实上身效果的搭配推荐方案。In short, the embodiments of this application can apply the capabilities of the AI large-scale parameter model to scenarios related to clothing matching recommendations, by using the AI large-scale parameter model to "generate images based on images", "generate images based on text", and "generate images based on text + "Image-generated image" and other methods provide users with richer and more realistic matching recommendations.

其中,AI大规模参数模型也可以简称为AI大模型,可以是指一类基础模型(Foundation Model),具体可以指在使用海量数据下训练出来的参数量巨大的、能适应一系列下游任务的模型。对于AI大模型而言,不仅在参数规模上存在参数量巨大(随着模型的不断迭代,参数量通常也会呈指数级增长,从亿到万亿,再到百万亿,甚至还可以更多)的特点,并且,从模态支持上看,AI大模型也从支持图片、图像、文本、语音、视频等单一模态下的单一任务,逐渐发展为支持多种模态下的多种任务。也即,大型模型通常还具备多种模态信息的高效理解能力、跨模态的感知能力以及跨差异化任务的迁移与执行能力等,甚至可能会具备如人类大脑体现的多模态信息感知能力。Among them, AI large-scale parameter model can also be referred to as AI large model, which can refer to a type of foundation model. Specifically, it can refer to a large number of parameters trained using massive data and capable of adapting to a series of downstream tasks. Model. For large AI models, not only is there a huge number of parameters in terms of parameter scale (as the model continues to iterate, the number of parameters usually increases exponentially, from billions to trillions, to trillions, and even more (Multiple) characteristics, and from the perspective of modal support, AI large models have gradually developed from supporting a single task in a single modality such as pictures, images, text, voice, video, etc., to supporting a variety of tasks in multiple modalities. Task. That is to say, large models usually also have the ability to efficiently understand multi-modal information, cross-modal perception capabilities, and the ability to transfer and execute cross-differentiated tasks, etc., and may even have multi-modal information perception as embodied in the human brain. ability.

从另一角度而言,AI大模型是“人工智能预训练大型模型”的简称,包含了“预训练”和“大模型”两层含义,二者结合产生了一种新的人工智能模式,即模型在大规模数据集上完成了预训练后无需微调,或仅需要少量数据的微调,就能支撑各类下游应用。也就是说,AI大模型得益于其“大规模预训练﹢微调”的范式,可以很好地适应不同下游任务,展现出它强大的通用性。这种具有通用性的AI大模型,在共享参数的情况下,只需在不同下游应用场景中做出相应微调就能得到优越的表现,突破传统AI模型难以泛化到其他任务上的局限性。From another perspective, AI large model is the abbreviation of "artificial intelligence pre-training large model", which includes the two meanings of "pre-training" and "large model". The combination of the two creates a new artificial intelligence model. That is, after the model has completed pre-training on a large-scale data set, it does not require fine-tuning, or only requires fine-tuning with a small amount of data, and can support various downstream applications. In other words, large AI models benefit from its "large-scale pre-training + fine-tuning" paradigm and can adapt well to different downstream tasks, demonstrating its strong versatility. This large, versatile AI model can achieve superior performance by simply making corresponding fine-tuning in different downstream application scenarios when sharing parameters, breaking through the limitations of traditional AI models that are difficult to generalize to other tasks. .

从处理结果的角度而言,上述AI大模型还属于一种生成式模型(GenerativeModel)。这类模型不但能根据特征预测结果,还能“理解”数据是如何产生的,并以此为基础“创造”出新的数据。From the perspective of processing results, the above-mentioned large AI model is also a generative model (GenerativeModel). This type of model can not only predict results based on features, but also "understand" how data is generated and "create" new data based on this.

在AI大模型所具备的上述能力以及已有知识的支持下,可以基于本申请实施例中的场景需求,对基础的AI大模型进行一些预训练,以使得AI大模型具有对商品的多模态信息进行理解,以及内容生产能力。例如,为了使得AI大模型能够对服饰搭配图像进行美化、真实化处理,可以预先收集一些高清的、美观的与服饰搭配的图像,并输入到AI大模型中,由AI大模型按照要求生产出具体的内容;对于模型生产出的内容,还可以进行人工校验,将内容的准确性信息等反馈给AI大模型,以使得AI大模型不断迭代学习,最终使得生产出的内容具有更高的准确性,等等。With the support of the above-mentioned capabilities of the large AI model and the support of existing knowledge, some pre-training can be performed on the basic large AI model based on the scenario requirements in the embodiments of this application, so that the large AI model has multi-modality capabilities for commodities. understanding of dynamic information and content production capabilities. For example, in order to enable the AI large model to beautify and realistically process clothing matching images, some high-definition and beautiful clothing matching images can be collected in advance and input into the AI large model, which will produce the images according to the requirements. Specific content; for the content produced by the model, manual verification can also be carried out, and the accuracy information of the content is fed back to the AI large model, so that the AI large model can continue to iteratively learn, and ultimately make the produced content have higher quality. Accuracy, etc.

从系统架构角度而言,参见图1,本申请实施例可以在商品信息服务系统中提供相应的功能,其中,商品信息服务系统可以包括客户端以及服务端,客户端主要是指面向消费者用户的客户端,主要用于与用户进行进行交互,包括由用户指定需要找搭配的服饰等,另外还可以对AI生成的图像进行展示,等等。服务端则主要用于提供具体的数据支持,包括素材库的保存,另外,AI大模型也可以运行于服务端,由AI大模型在服务端生成具体的图像后,返回给客户端进行展示,等等。From the perspective of system architecture, referring to Figure 1, embodiments of the present application can provide corresponding functions in the product information service system. The product information service system can include a client and a server. The client mainly refers to consumer-oriented users. The client is mainly used to interact with users, including the user specifying the clothes to match, etc. It can also display images generated by AI, etc. The server side is mainly used to provide specific data support, including the storage of material libraries. In addition, the AI large model can also be run on the server side. After the AI large model generates specific images on the server side, it is returned to the client for display. etc.

下面对本申请实施例提供的具体实现方案进行详细介绍。The specific implementation solutions provided by the embodiments of this application are introduced in detail below.

实施例一Embodiment 1

首先,该实施例一针对前述“AI搭配”功能,提供了一种提供商品搭配信息的方法,参见图2,该方法可以包括:First, Embodiment 1 provides a method of providing product matching information for the aforementioned "AI matching" function. See Figure 2. The method may include:

S201:确定待进行服饰搭配的第一图像;所述第一图像中包括:第一服饰及其在人体穿着状态下相关的第一局部人体部位的第一图像内容。S201: Determine the first image to be matched with clothing; the first image includes: the first clothing and the first image content of the first partial human body part related to the human body wearing state.

在“AI搭配”场景中,主要是是基于用户指定的与服饰相关的图像(可以称为第一图像),可以确定出可以与之搭配的其他服饰商品图像,并且可以通过AI大模型生成目标图像,该目标图像用于模拟具有搭配关系的服饰在同一人体上进行穿着状态下的搭配效果。In the "AI matching" scenario, mainly based on the clothing-related image specified by the user (which can be called the first image), other clothing product images that can be matched with it can be determined, and the target can be generated through the AI large model Image, this target image is used to simulate the matching effect of clothing with a matching relationship when worn on the same human body.

其中,待进行服饰搭配的第一图像具体可以由用户指定的,例如,可以在客户端首页等页面中为用户提供“AI搭配”入口,通过该入口,用户可以上传第一图像;或者,还可以是具体服饰类商品的详情页中提供“AI搭配”入口,通过该入口,可以将该商品相关的某图像作为第一图像。Among them, the first image to be matched with clothing can be specified by the user. For example, the user can be provided with an "AI matching" entrance on the client homepage and other pages, through which the user can upload the first image; or, It can be that the details page of a specific clothing product provides an "AI matching" entrance, through which an image related to the product can be used as the first image.

或者,还可以将“AI搭配”功能与商品搜索等功能结合,例如,可以在用户发起关于服饰类商品的搜索请求后,提供商品搜索结果,然后,可以在商品搜索结果列表页面中,为具体商品提供“AI搭配”入口,用户可以通过该入口发起针对商品搜索结果中某商品的“AI搭配”请求,此时,可以将该商品关联的某目标图像确定为第一图像。其中,具体的商品搜索请求可以是通过输入关键词的方式发起,或者,也可以通过上传图片的方式发起,等等。Alternatively, the "AI matching" function can be combined with functions such as product search. For example, product search results can be provided after the user initiates a search request for apparel products, and then the product search results can be displayed on the product search results list page. The product provides an "AI matching" portal, through which users can initiate an "AI matching" request for a certain product in the product search results. At this time, a certain target image associated with the product can be determined as the first image. Among them, a specific product search request can be initiated by entering keywords, or it can also be initiated by uploading a picture, and so on.

例如,如图3(A)所示,其示出了商品搜索结果页面,该页面是在用户上传了某图像并发起搜索后生成的,参见其中的31处所示,可以为具体某个搜索结果提供“一键搭配”选项,用户可以基于该商品发起搭配请求,相应的,就可以将该商品相关的某个目标图像确定为第一图像。For example, as shown in Figure 3(A), it shows a product search result page. This page is generated after the user uploads an image and initiates a search. See point 31, which can be a specific search. As a result, a "one-click matching" option is provided, and the user can initiate a matching request based on the product, and accordingly, a certain target image related to the product can be determined as the first image.

其中,如前文所述,在本申请实施例中,为了能够为用户提供更真实更自然的的搭配效果图,具体的第一图像中可以包括关于服饰商品本身的图像内容,还可以包括该服饰商品在人体穿着状态下相关的第一局部身体部位的图像内容。例如,如图3(A)中所示的图像,其中示出了一件衬衫类的服饰商品,并且是在模特人物穿着该衬衫状态下拍摄的照片,其中还包括了模特人物的头部、手部等,能够体现出模特人物穿着该衬衫时的姿势,以及具体服饰在由模特人物在对应姿势下穿着时所表现出的状态,例如,一些自然出现的褶皱等。As mentioned above, in this embodiment of the present application, in order to provide users with a more realistic and natural matching effect diagram, the specific first image may include image content about the clothing product itself, and may also include the clothing product. The image content of the first partial body part related to the product when it is worn on the human body. For example, the image shown in Figure 3(A) shows a shirt-like clothing product, and is a photo taken with a model wearing the shirt, which also includes the model's head, The hands, etc., can reflect the posture of the model wearing the shirt, as well as the state of the specific clothing when worn by the model in the corresponding posture, for example, some naturally occurring wrinkles, etc.

其中,关于上述第一图像,根据不同的请求发起方式,也可以通过不同的方式来确定,例如,如果是直接基于用户上传的图像进行AI搭配,则可以判断用户上传的图像中是否符合条件,例如,是否为人物穿着具体服饰状态下拍摄的照片等,如果是,则可以对该图像进行抠图,例如,将人体的部分以及服饰的部分抠取出来,去掉背景,另外还可以从中截取出与具体服饰相关的部分,例如,具体服饰是衬衫,则可以将下半身的部分去掉,等等。Among them, the above-mentioned first image can also be determined in different ways according to different request initiation methods. For example, if the AI matching is directly based on the image uploaded by the user, it can be determined whether the image uploaded by the user meets the conditions. For example, is it a photo taken with a person wearing specific clothing? If so, you can cut out the image, for example, cut out the parts of the human body and clothing, remove the background, and also cut out the image. Parts related to specific clothing, for example, if the specific clothing is a shirt, the lower body part can be removed, etc.

或者,在另一种方式下,由于需要预先建立素材库,这种素材库中就可以包括多个具体的图像,这种图像也可以是通过从预先收集到的服饰上身图中进行抠图以及截取等方式得到的。也就是说,素材库中已经保存了很多基于某些商品而生成的素材库,在这种情况下,对于用户首先基于上传的图像或者关键词等发起服饰类商品搜索,然后再从搜索结果中指定某商品进行AI搭配的方式下,对于搜索结果列表页面中展示的商品图,也可以直接展示为具体商品在上述素材库中对应的素材图。例如,在图3(A)所示的例子中,在搜索结果列表页面展示出符合搜索条件的多个商品的信息,其中,每个商品对应着各自的商品图,在本申请实施例中,可以将具体商品在素材库中对应的素材图展示在商品搜索结果页面中,这样,用户在基于这种商品搜索结果中的某商品发起AI搭配时,就可以直接将该商品对应的素材图作为第一图像。对于从商品详情页中发起AI搭配请求的情况也是类似,可以从素材库中确定出具体商品对应的素材图作为第一图像,等等。Or, in another way, since a material library needs to be established in advance, this material library can include multiple specific images. Such images can also be cut out from pre-collected upper body pictures of clothing and Obtained by interception, etc. In other words, the material library has already saved a lot of material libraries generated based on certain products. In this case, the user first initiates a search for clothing products based on uploaded images or keywords, etc., and then searches for them from the search results. When specifying a product for AI matching, the product image displayed on the search results list page can also be directly displayed as the material image corresponding to the specific product in the above material library. For example, in the example shown in Figure 3(A), information about multiple products that meet the search conditions is displayed on the search results list page, where each product corresponds to its own product image. In the embodiment of the present application, The material pictures corresponding to specific products in the material library can be displayed on the product search results page. In this way, when users initiate AI matching based on a product in the product search results, they can directly use the material pictures corresponding to the product as First image. The situation is similar for initiating AI matching requests from the product details page. The material image corresponding to the specific product can be determined from the material library as the first image, and so on.

当然,在具体实现时,素材库中也可以包括基于当前信息服务系统之外的服饰上身图生成的素材图(也即,具体图像中的服饰可能不是当前信息服务系统中在售的商品,但是也可以用于生成具体的素材图),甚至,还可以包括AI大模型生成的一些虚拟的素材图,而不是从真实的服饰商品图中截取出的图像,等等。Of course, during specific implementation, the material library may also include material pictures generated based on upper body pictures of clothing outside the current information service system (that is, the clothing in the specific image may not be a commodity on sale in the current information service system, but It can also be used to generate specific material pictures), and can even include some virtual material pictures generated by AI large models instead of images taken from real clothing product pictures, etc.

S202:从预置的素材库中,确定可搭配的至少一个第二图像;所述第二图像中包括:第二服饰及其在人体穿着状态下相关的第二局部人体部位的第二图像内容。S202: Determine at least one second image that can be matched from the preset material library; the second image includes: the second clothing and the second image content of the second partial human body part related to the human body wearing state. .

在确定出第一图像之后,第一图像中包括的服饰就成为需要进行搭配的第一服饰商品,之后,可以从素材库中确定出能够进行搭配的至少一个第二图像。其中,具体在确定第二图像时,可以有多种不同方式,例如,一种方式下,由于具体素材库中的素材库可能会关联有对应的商品,因此,可以预先建立商品搭配关系库,这样,可以针对第一服饰商品确定出能够与之搭配的第二服饰商品,再从素材库中确定出第二服饰商品对应的第二图像。或者,另一种方式下,还可以充分利用AI大模型等算法模型的计算机视觉能力,通过对素材库中的素材图进行模型理解,然后直接确定出能够与第一图像搭配的第二图像,等等。其中,第二图像中也可以包括第二服饰商品的图像内容及其在人体穿着状态下相关的第二局部人体部位的第二图像内容。例如,假设第二服饰商品是裤子类商品,则第二局部人体部位可以包括腿部、脚部,等等。After the first image is determined, the clothing included in the first image becomes the first clothing product that needs to be matched. After that, at least one second image that can be matched can be determined from the material library. Among them, there can be many different ways to determine the second image. For example, in one way, since the material library in the specific material library may be associated with corresponding products, a product matching relationship library can be established in advance. In this way, the second clothing product that can match the first clothing product can be determined, and then the second image corresponding to the second clothing product can be determined from the material library. Or, in another way, you can also make full use of the computer vision capabilities of algorithm models such as AI large models, and then directly determine the second image that can match the first image by understanding the model of the material images in the material library. etc. The second image may also include the image content of the second clothing product and the second image content of the second partial human body part related to the human body wearing state. For example, assuming that the second clothing product is a pants product, the second partial human body part may include legs, feet, and so on.

S203:将所述第一图像内容与所述第二图像内容进行拼接处理。S203: Splice the first image content and the second image content.

在确定出第一图像以及至少一个第二图像之后,可以对第一图像以及第二图像进行拼接处理,例如,如果第一图像是上衣类服饰相关的图像,第二图像是裤子类服饰相关的图像,则可以将第一图像与第二图像进行上下方向的拼接处理,从而拼接成完整的身体,以及在具体的服饰在该身体上的搭配效果。After the first image and at least one second image are determined, the first image and the second image can be spliced. For example, if the first image is an image related to tops and clothing, and the second image is related to pants and clothing. image, the first image and the second image can be spliced up and down to form a complete body and the matching effect of specific clothing on the body.

具体实现时,由于第一图像内容中包括第一局部人体部位与第二图像内容中包括的第二局部人体部位可能来自不同的人体,即使是同一人体,也可能是在不同的姿势下拍摄的图像,因此,如果直接进行拼接可能会使得拼接后的图像中上半身与下半身的姿势不匹配等情况。因此,在优选的方式下,还可以通过具体的算法识别出第一图像内容以及第二图像内容中包含的服饰关键点以及人体关键点信息,之后,可以根据识别出的服饰关键点以及人体关键点信息,对所述第一图像内容以及所述第二图像内容进行拼接处理。例如,根据人体关键点的识别,对具体的第一图像内容或第二图像内容进行仿射变化处理之后,再进行拼接,使得拼接后的不同局部身体部位的姿势更协调一致。During specific implementation, since the first partial human body part included in the first image content and the second partial human body part included in the second image content may come from different human bodies, even the same human body may be photographed in different postures. Images, therefore, if directly spliced, the poses of the upper body and lower body in the spliced image may not match. Therefore, in a preferred manner, the clothing key points and human body key point information contained in the first image content and the second image content can also be identified through a specific algorithm. After that, the clothing key points and human body key point information can be identified based on the identified clothing key points and human body key point information. point information to perform splicing processing on the first image content and the second image content. For example, based on the identification of key points of the human body, the specific first image content or the second image content is subjected to affine change processing and then spliced, so that the postures of different local body parts after splicing are more coordinated.

S204:利用人工智能AI大规模参数模型,对所述拼接处理后的图像进行重绘处理,以生成目标图像,所述目标图像用于模拟第一服饰与第二服饰在同一人体上进行穿着状态下的搭配效果。S204: Use the artificial intelligence AI large-scale parameter model to redraw the spliced image to generate a target image. The target image is used to simulate the wearing state of the first clothing and the second clothing on the same human body. The matching effect below.

在完成第一图像内容与第二图像内容的拼接后,为了使得最终生成的图像更真实更自然,还可以利用AI大模型对拼接处理后的图像进行重绘处理,该重绘处理主要可以对拼接处理后的图像进行美化,去除拼接处理后的图像中存在的一些瑕疵等。例如,由于第一图像内容可能是人物A的上半身穿着服饰1,第二图像内容可能是人物B的下半身穿着服饰2,而人物A与人物B的身高可能存在差距,此时,直接进行拼接后,可能会出现上下半身的长度不协调等情况,另外,素材库中的素材图本身也可能在抠图等过程中存在一些瑕疵,例如,手部可能抠取的不够自然,等等。这些问题都可以利用AI大模型得以改善,例如,将上下半身的长度比例进行调整,将抠图过程中存在的瑕疵进行修复,还可以对图像连接处进行处理,使得最终生成的目标图像更自然,更真实,更好地体现出第一服饰商品与第二服饰商品在同一人体上进行穿着状态下的搭配效果。另外,还可以通过AI大模型为具体的搭配方案添加背景,等等。After the splicing of the first image content and the second image content is completed, in order to make the final generated image more realistic and natural, the AI large model can also be used to redraw the spliced image. This redrawing process can mainly Beautify the spliced image and remove some defects existing in the spliced image. For example, since the first image content may be the upper body of character A wearing clothing 1, the second image content may be the lower body of character B wearing clothing 2, and there may be a height gap between character A and character B. In this case, after splicing, , the length of the upper and lower body may be inconsistent, etc. In addition, the material pictures in the material library themselves may also have some flaws in the process of cutting out the pictures. For example, the hands may not cut out naturally enough, etc. These problems can be improved by using large AI models. For example, the length ratio of the upper and lower bodies can be adjusted, flaws existing in the cutout process can be repaired, and image joints can be processed to make the final target image more natural. , is more realistic and better reflects the matching effect of the first clothing product and the second clothing product when they are worn on the same human body. In addition, you can also use AI large models to add backgrounds to specific matching plans, and so on.

例如,如图4所示,假设图4(A)、(B)分别为第一图像以及第二图像,在根据服饰关键点、人体关键点等进行拼接后,得到的图像可以如图4(C)所示,而在利用AI大模型进行重绘处理后,得到的图像可以如图4(D)所示。通过对比图4(C)和图4(D)可以看出,经过AI大模型进行重绘之后,图像的美观度以及真实度得以提升,例如,图4(C)中41处所示的人体胳膊的线条边缘存在不够平滑的表现,经过AI大模型重绘后,如图4(D)中的42处所示,对应位置的线条变得平滑,腕部以及手指关节处也更自然;另外,如图4(C)中43处所示的上衣连接处,也存在抠图时留下的抠图线痕迹,经过AI大模型进行处理后,对应的位置可以如图4(D)中的44处所示,抠图线被去掉,衣服的状态显得更自然,等等。For example, as shown in Figure 4, assuming that Figures 4(A) and (B) are the first image and the second image respectively, after splicing according to key points of clothing, key points of the human body, etc., the resulting image can be as shown in Figure 4( C), and after redrawing using the AI large model, the resulting image can be shown in Figure 4(D). By comparing Figure 4(C) and Figure 4(D), we can see that after redrawing the AI large model, the beauty and realism of the image have been improved. For example, the human body shown at 41 in Figure 4(C) The edges of the arm lines are not smooth enough. After redrawing the AI large model, as shown at 42 in Figure 4(D), the lines at the corresponding positions have become smoother, and the wrists and finger joints have become more natural; in addition, , the top connection shown at 43 in Figure 4(C) also has traces of cutout lines left during cutout. After processing with the AI large model, the corresponding position can be found in Figure 4(D) As shown at 44, the cutout lines have been removed, and the condition of the clothes appears more natural, etc.

经过上述处理后,可以将AI大模型生成的目标图像返回给客户端进行展示,例如,针对图3(A)中的第一图像发起AI搭配后,展示出的目标图像可以如图3(B)所示,可以看出,为AI大模型提供了四种搭配方案,分别展示出了对应的上身穿着状态下的搭配效果。当然,还可以生成更多搭配方案,可以通过点击“换一批”等进行查看。After the above processing, the target image generated by the AI large model can be returned to the client for display. For example, after initiating AI matching for the first image in Figure 3(A), the displayed target image can be as shown in Figure 3(B) ), it can be seen that four matching schemes are provided for the AI large model, each showing the corresponding matching effects when the upper body is worn. Of course, more matching plans can also be generated, which can be viewed by clicking "Change Batch" and so on.

具体实现时,除了可以通过“一键搭配”选项,由AI大模型生成具体的搭配方案,还可以提供如图3(B)中32处所示的“高级搭配”选项,通过该选项,用户可以指定具体需要搭配的服饰类型、风格、色调等,以缩短搭配范围。例如,如图5(A)所示,可以提供“选类型”、“选风格”、“选颜色”等选项,用户可以分别在这些选项下进行选择,例如,如图5(A)所示,将类型选择为“阔腿裤”;如图5(B)所示,将风格选择为“都市风”;如图5(C)所示,将颜色选择为“芋泥紫”,之后,通过点击“AI生成穿搭”选项,可以得到AI大模型生成的目标图像。这样,如果用户对搭配对象没有明确的要求,则可以通过“一键搭配”选项,完全由AI大模型生成具体搭配方案,如果用户对搭配对象有一些明确的要求,则可以通过“高级搭配”进行筛选,等等。During specific implementation, in addition to the "one-click matching" option to generate specific matching solutions from the AI large model, the "advanced matching" option shown at 32 in Figure 3(B) can also be provided. Through this option, users You can specify the specific clothing type, style, color tone, etc. that need to be matched to shorten the matching range. For example, as shown in Figure 5(A), options such as "Select Type", "Select Style", and "Select Color" can be provided, and the user can make selections under these options respectively, for example, as shown in Figure 5(A) , select the type as "wide-leg pants"; as shown in Figure 5(B), select the style as "urban style"; as shown in Figure 5(C), select the color as "taro purple", and then, By clicking the "AI generated outfit" option, you can get the target image generated by the AI large model. In this way, if the user does not have clear requirements for the matching objects, he can use the "One-click matching" option to generate a specific matching plan completely by the AI large model. If the user has some clear requirements for the matching objects, he can use the "Advanced Matching" option. Filter, etc.

另外,具体在通过客户端展示所述目标图像时,还可以提供用于对目标图像中的第二服饰商品进行同款商品搜索的操作选项,以便在接收到同款商品搜索请求后,提供同款商品搜索结果。例如,如图3(B)所示,每个目标图像的右下角都可以提供“搜同款”选项,如果用户对某套搭配感兴趣,则可以点击对应的“搜同款”选项,相应的,可以展示出与对应的搭配对象属于同款商品的搜索结果,用户可以对这种同款商品进行购买等后续链路的操作。这样,可以帮助用户快速找到能够与感兴趣的商品进行搭配且符合自己需求的其他商品。通过这种方式,AI大模型生成的目标图像可以起到帮助用户表达其所需要的搭配对象的作用,虽然目标图像中的服饰商品可能无法直接进行购买,甚至可能不是当前信息服务系统中在售的商品,但是,可以通过“搜同款”,在当前的信息服务系统中找到与之属于同款的商品。In addition, when the target image is displayed through the client, an operation option for searching for the same product for the second clothing product in the target image can be provided, so that after receiving the search request for the same product, the same product search request can be provided. product search results. For example, as shown in Figure 3(B), the "Search for the same style" option can be provided in the lower right corner of each target image. If the user is interested in a certain set of matching, he can click the corresponding "Search for the same style" option. , the search results for the same product as the corresponding matching object can be displayed, and the user can perform subsequent link operations such as purchasing the same product. In this way, users can quickly find other products that can match the products they are interested in and meet their needs. In this way, the target image generated by the AI large model can help users express the matching objects they need. Although the clothing products in the target image may not be directly available for purchase, they may not even be on sale in the current information service system. products, however, you can find products of the same style in the current information service system through "Search for the same style".

在可选的实施方式下,在通过客户端展示所述目标图像时,还可以提供用于对所述目标图像中的服饰图像进行设计的操作选项,也即前文所述的“AI画笔”功能。也就是说,在AI大模型生成了目标图像之后,用户还可以利用该“AI画笔”功能,在目标图像基础上进行自定义的设计。在接收到对所述目标图像中的服饰图像进行自定义设计的请求后,可以提供可选的设计元素,以便为所述服饰图像添加目标设计元素。例如,在具体的服饰图像上某位置处添加设计元素,或者,还可以为服饰图像更换搭配对象,或者,通过“涂鸦”方式修改服饰图像的颜色,等等。其中,由于具体的设计元素通常是以贴图等形式存在,因此,在直接添加到目标图像中时,可能出现不够立体、不像是印刷在具体服饰上时的状态,因此,还可以为用户提供用于对设计结果进行AI图像生成的选项,收到AI生成图像请求后,可以利用AI大模型对设计完成的目标图像进行重绘处理,以便将所述目标图像中的服饰图像与所述目标设计元素相融合,生成具有真实服饰效果的图像。In an optional implementation, when the target image is displayed through the client, operation options for designing the clothing image in the target image can also be provided, that is, the "AI brush" function mentioned above . In other words, after the AI large model generates the target image, the user can also use the "AI brush" function to make a customized design based on the target image. After receiving a request for custom design of the clothing image in the target image, optional design elements may be provided to add the target design element to the clothing image. For example, you can add a design element at a certain position on a specific clothing image, or you can change the matching object for the clothing image, or modify the color of the clothing image through "graffiti", etc. Among them, because specific design elements usually exist in the form of stickers, etc., when added directly to the target image, it may not be three-dimensional enough and does not look like it is printed on specific clothing. Therefore, it can also provide users with Option for AI image generation of the design results. After receiving the AI generated image request, the AI large model can be used to redraw the designed target image to match the clothing image in the target image with the target image. Design elements are merged to generate images with realistic clothing effects.

例如,如图6所示,假设目标图像如图6(A)所示,在进行设计过程中,如图6(B)所示,用户向其中的上衣添加了一些“花朵”图案的贴图图片,在点击“去生成”选项后,AI大模型可以对设计结果进行重绘,并生成如图6(C)所示的图像。其中,具体实现时,AI大模型可以提供多种不同重绘程度的图像,例如,如图6(C)所示,提供了四种不同重绘程度下分别生成的图像,其中,重绘程度越低,越接近原图,重绘程度越高,越立体,越接近具体服饰上真实带有对应图案的状态。For example, as shown in Figure 6, assume that the target image is as shown in Figure 6(A). During the design process, as shown in Figure 6(B), the user added some "flower" pattern texture pictures to the top. , after clicking the "Go to Generate" option, the AI large model can redraw the design results and generate the image as shown in Figure 6(C). Among them, during specific implementation, the AI large model can provide a variety of images with different redrawing degrees. For example, as shown in Figure 6(C), four images generated at different redrawing degrees are provided. Among them, the redrawing degree The lower it is, the closer it is to the original image. The higher the degree of redrawing, the more three-dimensional it is, and the closer it is to the actual state of the corresponding pattern on the specific clothing.

又如,如图7所示,假设目标图像如图7(A)所示,在用户进行设计过程中,如图7(B)所示,用户用“涂鸦”的方式进行了修改颜色,但是,明显能看出是涂抹上的颜色,而不是服饰真正具有对应颜色时的状态。在点击“去生成”后,可以生成如图7(C)所示的图像,类似的,同样可以通过多种不同重绘程度下生成的图像,其中,在重绘程度比较高时,如图7(C)中的“V4”图所示,可以呈现出具体的服饰由多片拼接而成,每片具有不同的颜色,从而看上去更真实。As another example, as shown in Figure 7, assume that the target image is as shown in Figure 7(A). During the user's design process, as shown in Figure 7(B), the user modified the color by "graffiti", but , it can be clearly seen that it is the color applied on, rather than the state when the clothing actually has the corresponding color. After clicking "Go to Generate", the image shown in Figure 7(C) can be generated. Similarly, the image can also be generated with a variety of different redrawing degrees. Among them, when the redrawing degree is relatively high, as shown in Figure 7(C) As shown in the "V4" picture in 7(C), it can be seen that the specific clothing is made up of multiple pieces, each piece has a different color, so it looks more real.

另外,还可以提供用于对上述设计后的服饰图像进行同款商品搜索的选项,接收到对设计完成的服饰图像进行同款商品搜索的请求后,还可以提供同款商品搜索结果。也就是说,例如,在原始目标图像中不带有“花朵”图案,如果直接搜同款,则搜索出的结果主要也是不带图案的款式,但是,如果用户需要带有“花朵”图案的款式,则可以通过这种“AI画笔”功能添加“花朵”图案之后,通过AI大模型生成添加了设计元素之后的服饰状态,如果满意,再发起搜同款请求,则可以得到带有“花朵”图案元素的同款商品,等等。In addition, you can also provide an option to search for the same type of products on the above designed clothing images. After receiving a request to search for the same type of products on the designed clothing images, you can also provide search results for the same type of products. That is to say, for example, if the original target image does not have a "flower" pattern, if you directly search for the same style, the search results will mainly be styles without patterns. However, if the user needs a style with a "flower" pattern, Style, you can use this "AI brush" function to add the "flower" pattern, and use the AI large model to generate the clothing state after adding the design elements. If you are satisfied, you can initiate a search request for the same style, and you can get the "flower" pattern with "flower" "Similar products with pattern elements, etc.

总之,通过本申请实施例,可以为用户指定的第一图像,确定出可以与其他的第一服饰进行搭配的第二图像,并且,第一图像以及第二图像中,都可以包括具体服饰的图像内容及其在人体穿着状态下相关的局部人体部位的图像内容。这样,在返回搭配结果时,可以通过将上述图像内容拼接,并通过AI大规模参数模型进行重绘处理后,生成用于模拟第一服饰与第二服饰在同一人体上进行穿着状态下的搭配效果的目标图像。这样,不仅可以为用户推荐搭配对象,还可以提供同一搭配方案中,第一服饰与第二服饰在同一人体上进行穿着状态下的搭配效果,并且,这种搭配效果会更真实自然,可以更有效地起到参考作用。In short, through the embodiments of the present application, a second image that can be matched with other first clothing can be determined for the first image specified by the user, and both the first image and the second image can include specific clothing. The image content and the image content of the relevant local human body parts in the human body wearing state. In this way, when the matching results are returned, the above image content can be spliced and redrawn through the AI large-scale parameter model to generate a model for simulating the matching of the first garment and the second garment when worn on the same human body. The target image for the effect. In this way, it can not only recommend matching objects for the user, but also provide the matching effect of the first clothing and the second clothing in the same matching scheme when worn on the same body. Moreover, this matching effect will be more real and natural, and can be more Effectively serve as a reference.

实施例二Embodiment 2

在前述实施例一中,提及了“AI画笔”功能,在实际应用中,该“AI画笔”功能也可以脱离开“AI搭配”功能而独立存在,例如,用户可以首先进入到“AI画笔”界面,然后上传任意的图像,然后利用该功能中提供的设计元素对图像中的服饰图像进行自定义设计,之后,还可以通过AI大模型进行重绘,以生成更具有真实服饰效果的图像。具体的,该实施例二提供了一种图像处理方法,参见图8,该方法可以包括:In the first embodiment mentioned above, the "AI Brush" function is mentioned. In practical applications, the "AI Brush" function can also exist independently from the "AI Matching" function. For example, the user can first enter the "AI Brush" function. "Interface, then upload any image, and then use the design elements provided in this function to customize the clothing image in the image. After that, it can also be redrawn through the AI large model to generate an image with more realistic clothing effects. . Specifically, Embodiment 2 provides an image processing method. See Figure 8. The method may include:

S801:接收到对目标图像中的服饰图像进行设计的请求后,提供用于对所述服饰图像进行设计的候选设计元素,以便为所述服饰图像添加目标设计元素;S801: After receiving a request to design the clothing image in the target image, provide candidate design elements for designing the clothing image, so as to add the target design element to the clothing image;

S802:响应于对设计结果进行图像生成的请求,利用AI大规模参数模型对设计完成的目标图像进行重绘处理,以便将所述目标图像中的服饰图像与所述目标设计元素相融合,生成具有真实服饰效果的图像。S802: In response to the request for image generation of the design result, use the AI large-scale parameter model to redraw the designed target image so as to integrate the clothing image in the target image with the target design element to generate Images with realistic clothing effects.

具体的,还可以提供用于对设计后的图像发起同款商品搜索的操作选项,使得用户可以在当前系统中搜索同款商品,还可以执行后续的购买等流程。Specifically, an operation option for initiating a search for the same product on the designed image can also be provided, so that the user can search for the same product in the current system, and can also perform subsequent purchase and other processes.

实施例三Embodiment 3

在前述实施例一中,主要是在用户指定了某服饰的第一图像之后,通过算法确定出可以搭配的服饰对应的第二图像,再进行拼接以及AI大模型的美化处理,生成目标图像返回给用户。而在该实施例三中,还可以通过指定风格/场景以及人物特征的方式来发起具体的穿搭请求,然后由AI大模型生成符合该场景、且在具有该人物特征的身上进行试穿的穿搭效果图。具体的,该实施例三中提供了一种提供服饰搭配信息的方法,参见图9,该方法可以包括:In the first embodiment mentioned above, after the user specifies the first image of a certain clothing, the algorithm determines the second image corresponding to the clothing that can be matched, and then performs splicing and beautification of the AI large model to generate the target image and return it. to users. In the third embodiment, you can also initiate a specific outfit request by specifying the style/scene and character characteristics, and then use the AI large model to generate an outfit that matches the scene and is tried on the person with the character characteristics. Outfit renderings. Specifically, the third embodiment provides a method for providing clothing matching information. Referring to Figure 9, the method may include:

S901:接收服饰搭配请求,所述请求中包括所需的目标着装风格和/或场景信息,以及用于对目标人物的特征进行描述的文本和/或图像信息。S901: Receive a clothing matching request, which includes the required target dressing style and/or scene information, as well as text and/or image information used to describe the characteristics of the target person.

在该实施例三中,可以直接基于某风格和/或场景,发起具体的搭配请求,也就是说,无需由用户提前指定某件服饰,而是可以由算法给出整套的搭配方案,但是,用户可以指定人物的人体特征,然后可以通过AI大模型生成具体搭配方案在该特征的人体身上进行试穿时的效果图。其中,用户可以通过文本或上传图像的方式对人体特征进行描述,也可以采用文本+图像的方式来进行描述。例如,用户在进入到场景搭配相关的界面之后,可以对所需的场景等进行选择,假设用户选择了“婚礼风”场景,界面中还可以提供用于输入人物特征的输入控件,例如,可以是文本输入框,还可以是用于上传图像的控件,等等。例如,如图10(A)所示,用户可以输入文本“红发女孩穿着短上衣戴着眼镜”,或者,如图10(B)所示,用户也可以上传照片等图像,用于对自己所需的人体特征进行描述。或者,如图10(C)所示,也可以以文本+图像的方式进行描述,等等。In the third embodiment, a specific matching request can be initiated directly based on a certain style and/or scene. That is to say, the user does not need to specify a certain piece of clothing in advance, but the algorithm can provide a complete matching plan. However, Users can specify the human body characteristics of the character, and then use the AI large model to generate a specific matching plan when trying on the human body with the characteristics. Among them, users can describe human body characteristics through text or uploaded images, or they can also use text + image to describe. For example, after entering the interface related to scene matching, the user can select the required scene, etc. Suppose the user selects the "wedding style" scene, the interface can also provide input controls for inputting character characteristics, for example, It can be a text input box, a control for uploading images, etc. For example, as shown in Figure 10(A), the user can enter the text "Red-haired girl wearing a short top and glasses", or, as shown in Figure 10(B), the user can also upload images such as photos to describe themselves. Desired human characteristics are described. Or, as shown in Figure 10(C), it can also be described in the form of text + image, and so on.

S902:确定符合所述目标着装风格和/或场景的需求的服饰搭配方案,并利用AI大规模参数模型生成目标图像,所述目标图像用于表达所述服饰搭配方案在由所述目标人物穿着状态下的搭配效果。S902: Determine a clothing matching scheme that meets the requirements of the target dressing style and/or scene, and use an AI large-scale parameter model to generate a target image. The target image is used to express the clothing matching scheme when worn by the target person. The matching effect under the state.

在接收到搭配请求后,就可以确定出符合目标着装风格和/或场景的需求的服饰搭配方案,并利用AI大模型生成目标图像,该目标图像就可以表达出服饰搭配方案在由所述目标人物穿着状态下的搭配效果。具体实现时,可以提前设定多种风格和/或场景,分别利用各种风格和/或场景下的高清服饰搭配图像(带有具体人物上身效果)对AI大模型进行训练,使得AI大模型具有生成对应图像的能力。例如,在选择了“婚礼风”场景,并上传了如图10(B)所示的人物图像,则AI大模型生成的目标图像可以如图10(D)所示,可见,目标图像中人物的身形、姿势等与用户上传的图像中保持一致,从而表达出具体场景下的服饰搭配方案在目标人物身上的上身效果。After receiving the matching request, you can determine the clothing matching scheme that meets the needs of the target dressing style and/or scene, and use the AI large model to generate a target image. The target image can express the clothing matching scheme based on the target. The matching effect of the character's clothing. During specific implementation, multiple styles and/or scenes can be set in advance, and high-definition clothing matching images (with specific character upper body effects) in various styles and/or scenes can be used to train the AI large model, so that the AI large model Has the ability to generate corresponding images. For example, after selecting the "wedding style" scene and uploading a character image as shown in Figure 10(B), the target image generated by the AI large model can be as shown in Figure 10(D). It can be seen that the characters in the target image The body shape, posture, etc. are consistent with the images uploaded by the user, thereby expressing the upper body effect of the clothing matching scheme on the target person in the specific scene.

当然,对于这种基于场景以及目标人物的人体特征生成的目标图像,也可以提供用于发起找同款的操作选项,用户可以通过发起同款搜索,获取到同款商品的信息,进而可以执行后续的购买等流程。Of course, for this kind of target image generated based on the scene and the human body characteristics of the target person, the operation option for initiating a search for the same model can also be provided. The user can obtain information about the same product by initiating a search for the same model, and then execute Subsequent purchase and other processes.

需要说明的是,以上所述的“AI搭配”、“AI画笔”、基于风格和/或场景的AI搭配等,可以独立存在,例如,可以是同一功能模块中多个独立的子模块,用户可以分别进入到不同的模块中进行交互,或者,也可以相互结合来使用,例如,前述“AI搭配”可以与“AI画笔”功能结合,基于风格和/或场景的AI搭配也可以与“AI画笔”功能结合,等等。It should be noted that the above-mentioned "AI matching", "AI brush", AI matching based on style and/or scene, etc., can exist independently. For example, they can be multiple independent sub-modules in the same functional module. Users You can enter different modules to interact separately, or you can also use them in combination with each other. For example, the aforementioned "AI matching" can be combined with the "AI brush" function, and AI matching based on style and/or scene can also be combined with the "AI matching" function. Brush” functionality combined, and more.

在实际应用中,还可以为用户提供社区平台服务,通过上述多种交互方式获得了AI大模型生成的目标图像之后,还可以通过这种社区平台进行发布,相应的,还可以查看其他用户通过该社区平台发布的AI生成作品,例如,如图11(A)所示,可以展示出多个用户发布到社区平台中的AI生成作品。如果当前用户对某作品感兴趣,还可以搜索同款商品。或者,对于“AI搭配”方式下生成的AI作品,如图11(B)所示,还可以提供“生成我的搭配”选项,使得当前用户可以重新输入自己的需求,并重新生成新的AI作品;或者,如果是基于场景及人体特征描述信息生成的AI作品,如图11(C),还可以提供“使用当前场景”选项,使得用户可以基于该场景,生成自己所需的AI搭配方案,等等。In practical applications, it can also provide users with community platform services. After obtaining the target image generated by the AI large model through the above-mentioned multiple interaction methods, it can also be published through this community platform. Correspondingly, you can also view other users' through The AI-generated works published by the community platform, for example, as shown in Figure 11(A), can display the AI-generated works published by multiple users on the community platform. If the current user is interested in a certain work, he can also search for the same product. Alternatively, for AI works generated under the "AI collocation" method, as shown in Figure 11(B), the "Generate my collocation" option can also be provided, so that the current user can re-enter his or her needs and regenerate a new AI works; or, if it is an AI work generated based on scene and human body feature description information, as shown in Figure 11(C), the "Use current scene" option can also be provided, allowing users to generate the AI matching solution they need based on the scene. ,etc.

需要说明的是,本申请实施例中可能会涉及到对用户数据的使用,在实际应用中,可以在符合所在国的适用法律法规要求的情况下(例如,用户明确同意,对用户切实通知,等),在适用法律法规允许的范围内在本文描述的方案中使用用户特定的个人数据。It should be noted that the embodiments of this application may involve the use of user data. In actual applications, this can be done in compliance with the applicable laws and regulations of the country where the user is located (for example, the user explicitly agrees, the user is effectively notified, etc.), use user-specific personal data in the scenarios described herein to the extent permitted by applicable laws and regulations.

与实施例一相对应,本申请实施例还提供了一种提供商品搭配信息的装置,该装置可以包括:Corresponding to Embodiment 1, this embodiment of the present application also provides a device for providing product matching information. The device may include:

第一图像确定单元,用于确定待进行服饰搭配的第一图像;所述第一图像中包括:第一服饰及其在人体穿着状态下相关的第一局部人体部位的第一图像内容;The first image determination unit is used to determine the first image to be matched with clothing; the first image includes: the first image content of the first clothing and its related first partial human body part in the human body wearing state;

第二图像确定单元,用于从预置的素材库中,确定可搭配的至少一个第二图像;所述第二图像中包括:第二服饰及其在人体穿着状态下相关的第二局部人体部位的第二图像内容;The second image determination unit is used to determine at least one second image that can be matched from the preset material library; the second image includes: the second clothing and its related second partial human body when the human body is wearing it. The second image content of the part;

拼接处理单元,用于将所述第一图像内容与所述第二图像内容进行拼接处理;A splicing processing unit configured to splice the first image content and the second image content;

AI重绘单元,用于利用人工智能AI大规模参数模型,对所述拼接处理后的图像进行重绘处理,以生成目标图像,所述目标图像用于模拟第一服饰与第二服饰在同一人体上进行穿着状态下的搭配效果。The AI redrawing unit is used to use the artificial intelligence AI large-scale parameter model to redraw the spliced image to generate a target image. The target image is used to simulate the first clothing and the second clothing in the same The matching effect is carried out on the human body when worn.

其中,所述素材库中保存的图像与关联的信息服务系统中提供的商品相对应;Wherein, the images stored in the material library correspond to the commodities provided in the associated information service system;

所述第一图像确定单元具体可以用于:The first image determination unit may be specifically used for:

根据用户提交的商品搜索请求,提供商品搜索结果;Provide product search results based on product search requests submitted by users;

响应于针对所述商品搜索结果中的指定商品发起的服饰搭配请求,将所述素材库中与该指定商品关联的目标图像确定为所述第一图像。In response to a clothing matching request initiated for a designated product in the product search results, a target image associated with the designated product in the material library is determined as the first image.

其中,所述商品搜索请求可以为:基于用户上传的与服饰相关的图像提交的商品搜索请求,所述商品搜索结果中包括与用户上传的图像中包括的服饰主体属于同款的商品。Wherein, the product search request may be: a product search request submitted based on clothing-related images uploaded by the user, and the product search results include products of the same style as the clothing body included in the image uploaded by the user.

具体的,所述拼接处理单元具体可以用于:Specifically, the splicing processing unit can be used for:

识别所述第一图像内容以及所述第二图像内容中包含的服饰关键点以及人体关键点信息;Identify clothing key points and human body key point information contained in the first image content and the second image content;

根据识别出的服饰关键点以及人体关键点信息,对所述第一图像内容以及所述第二图像内容进行拼接处理。According to the identified clothing key points and human body key point information, the first image content and the second image content are spliced.

另外,该装置还可以包括:Additionally, the device may include:

第一同款搜索单元,用于通过客户端展示所述目标图像时,还提供用于对所述目标图像中的第二服饰进行同款商品搜索的操作选项,以便在接收到同款商品搜索请求后,提供同款商品搜索结果。The first same-style search unit is configured to also provide an operation option for searching for same-style products on the second clothing in the target image when displaying the target image through the client, so that when receiving the same-style product search After request, search results for the same product will be provided.

另外,通过客户端展示所述目标图像时,还提供用于对所述目标图像中的服饰图像进行设计的操作选项;In addition, when the target image is displayed through the client, operation options for designing the clothing image in the target image are also provided;

此时,该装置还可以包括:At this time, the device may also include:

设计元素提供单元,用于接收到对所述目标图像中的服饰图像进行自定义设计的请求后,提供可选的设计元素,以便为所述服饰图像添加目标设计元素;A design element providing unit, configured to provide optional design elements after receiving a request for customized design of the clothing image in the target image, so as to add the target design element to the clothing image;

所述AI重绘单元还可以用于:响应于对设计结果进行图像生成的请求,利用AI大规模参数模型对设计完成的目标图像进行重绘处理,以便将所述目标图像中的服饰图像与所述目标设计元素相融合,生成具有真实服饰效果的图像。The AI redrawing unit may also be used to: in response to a request for image generation of the design result, use the AI large-scale parameter model to redraw the designed target image, so as to compare the clothing image in the target image with the The target design elements are combined to generate an image with a realistic clothing effect.

另外,该装置还可以包括:Additionally, the device may include:

第二同款搜索单元,用于响应于对设计完成的服饰图像进行同款商品搜索的请求,提供同款商品搜索结果。The second same-style search unit is configured to provide search results for same-style products in response to a request for searching for same-style products on the designed clothing image.

与实施例二相对应,本申请实施例还提供了一种图像处理装置,该装置可以包括:Corresponding to Embodiment 2, this embodiment of the present application also provides an image processing device, which may include:

设计元素提供单元,用于接收到对目标图像中的服饰图像进行设计的请求后,提供用于对所述服饰图像进行设计的候选设计元素,以便为所述服饰图像添加目标设计元素;A design element providing unit, configured to provide candidate design elements for designing the clothing image after receiving a request to design the clothing image in the target image, so as to add the target design element to the clothing image;

AI重绘单元,用于响应于对设计结果进行图像生成的请求,利用AI大规模参数模型对设计完成的目标图像进行重绘处理,以便将所述目标图像中的服饰图像与所述目标设计元素相融合,生成具有真实服饰效果的图像。The AI redrawing unit is configured to respond to a request for image generation of the design result and use the AI large-scale parameter model to redraw the designed target image, so as to match the clothing image in the target image with the target design. Elements are combined to generate images with realistic clothing effects.

具体的,该装置还可以包括:Specifically, the device may also include:

同款搜索单元,用于响应于对设计完成的服饰图像进行同款商品搜索的请求,提供同款商品搜索结果。A same-style search unit is configured to provide search results for same-style products in response to a request for searching for same-style products on the designed clothing image.

与实施例三相对应,本申请实施例还提供了一种提供服饰搭配信息的装置,该装置可以包括:Corresponding to Embodiment 3, this embodiment of the present application also provides a device for providing clothing matching information. The device may include:

请求接收单元,用于接收服饰搭配请求,所述请求中包括所需的目标着装风格和/或场景信息,以及用于对目标人物的人体特征进行描述的文本和/或图像信息;A request receiving unit, configured to receive a clothing matching request, which includes the required target dressing style and/or scene information, as well as text and/or image information used to describe the human body characteristics of the target person;

AI生成单元,用于确定符合所述目标着装风格和/或场景的需求的服饰搭配方案,并利用AI大规模参数模型生成目标图像,所述目标图像用于表达所述服饰搭配方案在由所述目标人物穿着状态下的搭配效果。An AI generation unit is used to determine a clothing matching scheme that meets the needs of the target dressing style and/or scene, and uses an AI large-scale parameter model to generate a target image, where the target image is used to express the clothing matching scheme based on the requirements of the target clothing style and/or scene. Describe the matching effect when the target person is wearing it.

另外,该装置还可以包括:Additionally, the device may include:

同款搜索单元,用于响应于对所述服饰搭配方案中的服饰进行同款商品搜索的请求,提供同款商品搜索结果。A same-style search unit is configured to provide search results for same-style products in response to a request to search for the same-style products for the clothing in the clothing matching scheme.

另外,本申请实施例还提供了一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现前述方法实施例中任一项所述的方法的步骤。In addition, embodiments of the present application also provide a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of the method described in any one of the foregoing method embodiments are implemented.

以及一种电子设备,包括:and an electronic device including:

一个或多个处理器;以及one or more processors; and

与所述一个或多个处理器关联的存储器,所述存储器用于存储程序指令,所述程序指令在被所述一个或多个处理器读取执行时,执行前述方法实施例中任一项所述的方法的步骤。A memory associated with the one or more processors. The memory is used to store program instructions. When the program instructions are read and executed by the one or more processors, the program instructions execute any one of the foregoing method embodiments. steps of the method.

其中,图12示例性的展示出了电子设备的架构,例如,设备1200可以是移动电话,计算机,数字广播终端,消息收发设备,游戏控制台,平板设备,医疗设备,健身设备,个人数字助理,飞行器等。Among them, Figure 12 exemplarily shows the architecture of an electronic device. For example, the device 1200 can be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant. , aircraft, etc.

参照图12,设备1200可以包括以下一个或多个组件:处理组件1202,存储器1204,电源组件1206,多媒体组件1208,音频组件1210,输入/输出(I/O)的接口1212,传感器组件1214,以及通信组件1216。Referring to Figure 12, device 1200 may include one or more of the following components: processing component 1202, memory 1204, power supply component 1206, multimedia component 1208, audio component 1210, input/output (I/O) interface 1212, sensor component 1214, and communications component 1216.

处理组件1202通常控制设备1200的整体操作,诸如与显示,电话呼叫,数据通信,相机操作和记录操作相关联的操作。处理组件1202可以包括一个或多个处理器1220来执行指令,以完成本公开技术方案提供的方法的全部或部分步骤。此外,处理组件1202可以包括一个或多个模块,便于处理组件1202和其他组件之间的交互。例如,处理组件1202可以包括多媒体模块,以方便多媒体组件1208和处理组件1202之间的交互。Processing component 1202 generally controls the overall operations of device 1200, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 1202 may include one or more processors 1220 to execute instructions to complete all or part of the steps of the method provided by the technical solution of the present disclosure. Additionally, processing component 1202 may include one or more modules that facilitate interaction between processing component 1202 and other components. For example, processing component 1202 may include a multimedia module to facilitate interaction between multimedia component 1208 and processing component 1202.

存储器1204被配置为存储各种类型的数据以支持在设备1200的操作。这些数据的示例包括用于在设备1200上操作的任何应用程序或方法的指令,联系人数据,电话簿数据,消息,图片,视频等。存储器1204可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。Memory 1204 is configured to store various types of data to support operations at device 1200 . Examples of such data include instructions for any application or method operating on device 1200, contact data, phonebook data, messages, pictures, videos, etc. Memory 1204 may be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EEPROM), Programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

电源组件1206为设备1200的各种组件提供电力。电源组件1206可以包括电源管理系统,一个或多个电源,及其他与为设备1200生成、管理和分配电力相关联的组件。Power supply component 1206 provides power to various components of device 1200. Power supply components 1206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to device 1200 .

多媒体组件1208包括在设备1200和用户之间的提供一个输出接口的屏幕。在一些实施例中,屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板,屏幕可以被实现为触摸屏,以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。触摸传感器可以不仅感测触摸或滑动动作的边界,而且还检测与触摸或滑动操作相关的持续时间和压力。在一些实施例中,多媒体组件1208包括一个前置摄像头和/或后置摄像头。当设备1200处于操作模式,如拍摄模式或视频模式时,前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。Multimedia component 1208 includes a screen that provides an output interface between device 1200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. A touch sensor can not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action. In some embodiments, multimedia component 1208 includes a front-facing camera and/or a rear-facing camera. When the device 1200 is in an operating mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front-facing camera and rear-facing camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

音频组件1210被配置为输出和/或输入音频信号。例如,音频组件1210包括一个麦克风(MIC),当设备1200处于操作模式,如呼叫模式、记录模式和语音识别模式时,麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器1204或经由通信组件1216发送。在一些实施例中,音频组件1210还包括一个扬声器,用于输出音频信号。Audio component 1210 is configured to output and/or input audio signals. For example, audio component 1210 includes a microphone (MIC) configured to receive external audio signals when device 1200 is in operating modes, such as call mode, recording mode, and speech recognition mode. The received audio signals may be further stored in memory 1204 or sent via communications component 1216 . In some embodiments, audio component 1210 also includes a speaker for outputting audio signals.

I/O接口1212为处理组件1202和外围接口模块之间提供接口,上述外围接口模块可以是键盘,点击轮,按钮等。这些按钮可包括但不限于:主页按钮、音量按钮、启动按钮和锁定按钮。The I/O interface 1212 provides an interface between the processing component 1202 and a peripheral interface module. The peripheral interface module may be a keyboard, a click wheel, a button, etc. These buttons may include, but are not limited to: Home button, Volume buttons, Start button, and Lock button.

传感器组件1214包括一个或多个传感器,用于为设备1200提供各个方面的状态评估。例如,传感器组件1214可以检测到设备1200的打开/关闭状态,组件的相对定位,例如所述组件为设备1200的显示器和小键盘,传感器组件1214还可以检测设备1200或设备1200一个组件的位置改变,用户与设备1200接触的存在或不存在,设备1200方位或加速/减速和设备1200的温度变化。传感器组件1214可以包括接近传感器,被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件1214还可以包括光传感器,如CMOS或CCD图像传感器,用于在成像应用中使用。在一些实施例中,该传感器组件1214还可以包括加速度传感器,陀螺仪传感器,磁传感器,压力传感器或温度传感器。Sensor component 1214 includes one or more sensors that provide various aspects of status assessment for device 1200 . For example, the sensor component 1214 can detect the open/closed state of the device 1200, the relative positioning of components, such as the display and keypad of the device 1200, and the sensor component 1214 can also detect the position change of the device 1200 or a component of the device 1200. , the presence or absence of user contact with device 1200 , device 1200 orientation or acceleration/deceleration and temperature changes of device 1200 . Sensor assembly 1214 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 1214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 1214 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

通信组件1216被配置为便于设备1200和其他设备之间有线或无线方式的通信。设备1200可以接入基于通信标准的无线网络,如WiFi,或2G、3G、4G/LTE、5G等移动通信网络。在一个示例性实施例中,通信组件1216经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中,所述通信组件1216还包括近场通信(NFC)模块,以促进短程通信。例如,在NFC模块可基于射频识别(RFID)技术,红外数据协会(IrDA)技术,超宽带(UWB)技术,蓝牙(BT)技术和其他技术来实现。Communication component 1216 is configured to facilitate wired or wireless communications between device 1200 and other devices. Device 1200 can access wireless networks based on communication standards, such as WiFi, or mobile communication networks such as 2G, 3G, 4G/LTE, and 5G. In one exemplary embodiment, the communication component 1216 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communications component 1216 also includes a near field communications (NFC) module to facilitate short-range communications. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

在示例性实施例中,设备1200可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现,用于执行上述方法。In an exemplary embodiment, device 1200 may be configured by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable Gate array (FPGA), controller, microcontroller, microprocessor or other electronic components are implemented for executing the above method.

在示例性实施例中,还提供了一种包括指令的非临时性计算机可读存储介质,例如包括指令的存储器1204,上述指令可由设备1200的处理器1220执行以完成本公开技术方案提供的方法。例如,所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions, such as a memory 1204 including instructions, is also provided. The above instructions can be executed by the processor 1220 of the device 1200 to complete the method provided by the technical solution of the present disclosure. . For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

通过以上的实施方式的描述可知,本领域的技术人员可以清楚地了解到本申请可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例或者实施例的某些部分所述的方法。From the above description of the embodiments, those skilled in the art can clearly understand that the present application can be implemented by means of software plus the necessary general hardware platform. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or that contributes to the existing technology. The computer software product can be stored in a storage medium, such as ROM/RAM, disk , optical disk, etc., including a number of instructions to cause a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or certain parts of the embodiments of this application.

本说明书中的各个实施例均采用递进的方式描述,各个实施例之间相同相似的部分互相参见即可,每个实施例重点说明的都是与其他实施例的不同之处。尤其,对于系统或系统实施例而言,由于其基本相似于方法实施例,所以描述得比较简单,相关之处参见方法实施例的部分说明即可。以上所描述的系统及系统实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。Each embodiment in this specification is described in a progressive manner. The same and similar parts between the various embodiments can be referred to each other. Each embodiment focuses on its differences from other embodiments. In particular, for the system or system embodiment, since it is basically similar to the method embodiment, the description is relatively simple. For relevant details, please refer to the partial description of the method embodiment. The system and system embodiments described above are only illustrative, in which the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, It can be located in one place, or it can be distributed over multiple network elements. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Persons of ordinary skill in the art can understand and implement the method without any creative effort.

以上对本申请所提供的提供商品搭配信息的方法及电子设备,进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处。综上所述,本说明书内容不应理解为对本申请的限制。The method and electronic equipment for providing product matching information provided by this application have been introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of this application. The description of the above embodiments is only used to help understand this application. The method of the application and its core idea; at the same time, for those of ordinary skill in the field, there will be changes in the specific implementation and application scope based on the ideas of the application. In summary, the contents of this specification should not be construed as limiting this application.

Claims (13)

1. A method for providing merchandise collocation information, comprising:
determining a first image to be subjected to clothing collocation; the first image includes: a first image content of a first localized human body portion associated with the first garment in a worn state of the human body;
determining at least one collocation second image from a preset material library; the second image includes: a second image content of a second partial human body part associated with the second garment in the worn state of the human body;
splicing the first image content and the second image content;
and redrawing the spliced image by using the artificial intelligence AI large-scale parameter model to generate a target image, wherein the target image is used for simulating the matching effect of the first garment and the second garment in the wearing state of the same human body.
2. The method of claim 1, wherein the step of determining the position of the substrate comprises,
the images stored in the material library correspond to commodities provided in the associated information service system;
the determining a first image to be subjected to clothing collocation includes:
providing commodity searching results according to commodity searching requests submitted by users;
and responding to a clothing collocation request initiated for a specified commodity in the commodity search results, and determining a target image associated with the specified commodity in the material library as the first image.
3. The method of claim 2, wherein the step of determining the position of the substrate comprises,
the commodity search request is: and submitting a commodity search request based on the image related to the clothes uploaded by the user, wherein the commodity search result comprises commodities belonging to the same type as the clothes main body included in the image uploaded by the user.
4. The method of claim 1, wherein the step of determining the position of the substrate comprises,
the splicing processing of the first image content and the second image content comprises the following steps:
identifying clothing key points and human body key point information contained in the first image content and the second image content;
and according to the identified clothing key points and the human body key point information, performing splicing processing on the first image content and the second image content.
5. The method of claim 1, wherein the step of determining the position of the substrate comprises,
and when the target image is displayed through the client, an operation option for searching the same type of commodity for the second clothes in the target image is also provided, so that the same type of commodity searching result is provided after the same type of commodity searching request is received.
6. The method of claim 1, wherein the step of determining the position of the substrate comprises,
when the target image is displayed through the client, operation options for designing the clothing image in the target image are also provided;
the method further comprises the steps of:
providing optional design elements after receiving a request for custom-designing a clothing image in the target image so as to add the target design elements to the clothing image;
and responding to a request for generating an image of a design result, and redrawing the designed target image by utilizing an AI large-scale parameter model so as to fuse the clothing image in the target image with the target design element and generate an image with a real clothing effect.
7. The method as recited in claim 6, further comprising:
and responding to the request of searching the same commodity for the designed clothing image, and providing the same commodity searching result.
8. An image processing method, comprising:
after receiving a request for designing a clothing image in a target image, providing candidate design elements for designing the clothing image so as to add the target design elements to the clothing image;
and responding to a request for generating an image of a design result, and redrawing the designed target image by utilizing an AI large-scale parameter model so as to fuse the clothing image in the target image with the target design element and generate an image with a real clothing effect.
9. The method as recited in claim 8, further comprising:
and responding to the request of searching the same commodity for the designed clothing image, and providing the same commodity searching result.
10. A method of providing apparel collocation information, comprising:
receiving a clothing collocation request, wherein the request comprises required target dressing style and/or scene information and text and/or image information for describing human body characteristics of a target person;
and determining a clothing matching scheme meeting the requirements of the target dressing style and/or scene, and generating a target image by utilizing an AI large-scale parameter model, wherein the target image is used for expressing the matching effect of the clothing matching scheme in the wearing state of the target person.
11. The method as recited in claim 10, further comprising:
and responding to a request for searching the same commodity for the clothes in the clothes collocation scheme, and providing the same commodity searching result.
12. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the steps of the method of any of claims 1 to 11.
13. An electronic device, comprising:
one or more processors; and
a memory associated with the one or more processors for storing program instructions that, when read for execution by the one or more processors, perform the steps of the method of any of claims 1 to 11.
CN202311197783.2A 2023-09-15 2023-09-15 Method and electronic device for providing product matching information Pending CN117332105A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311197783.2A CN117332105A (en) 2023-09-15 2023-09-15 Method and electronic device for providing product matching information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311197783.2A CN117332105A (en) 2023-09-15 2023-09-15 Method and electronic device for providing product matching information

Publications (1)

Publication Number Publication Date
CN117332105A true CN117332105A (en) 2024-01-02

Family

ID=89274683

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311197783.2A Pending CN117332105A (en) 2023-09-15 2023-09-15 Method and electronic device for providing product matching information

Country Status (1)

Country Link
CN (1) CN117332105A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118447042A (en) * 2024-07-05 2024-08-06 杭州阿里巴巴海外互联网产业有限公司 Picture processing method and system, online wearing system and electronic equipment
CN119107144A (en) * 2024-08-13 2024-12-10 杭州流视互动科技有限公司 Method, system and AR glasses for providing product information

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118447042A (en) * 2024-07-05 2024-08-06 杭州阿里巴巴海外互联网产业有限公司 Picture processing method and system, online wearing system and electronic equipment
CN119107144A (en) * 2024-08-13 2024-12-10 杭州流视互动科技有限公司 Method, system and AR glasses for providing product information

Similar Documents

Publication Publication Date Title
KR20230026481A (en) Updating avatar clothing in messaging systems
CN117332105A (en) Method and electronic device for providing product matching information
CN111047379B (en) House decoration information processing method, device and system
CN110021061A (en) Collocation model building method, dress ornament recommended method, device, medium and terminal
KR20230072503A (en) Provides AR-based makeup in a messaging system
US20230067305A1 (en) Conversation guided augmented reality experience
US12307564B2 (en) Applying animated 3D avatar in AR experiences
US12062146B2 (en) Virtual wardrobe AR experience
KR20250088614A (en) Stylizing the whole human body
US20250252644A1 (en) Applying animated 3d avatar in ar experiences
US20240290043A1 (en) Real-time fashion item transfer system
US20240355019A1 (en) Product image generation based on diffusion model
CN116739699A (en) Method for providing commodity recommendation information and electronic equipment
KR20250110876A (en) Real-time fitting using body landmarks
CN111125806A (en) House decoration information processing method, device and system
CN112766406A (en) Article image processing method and device, computer equipment and storage medium
CN114779948B (en) Method, device and equipment for controlling instant interaction of animation characters based on facial recognition
US12354211B2 (en) Ray tracing between AR and real objects
KR20250141768A (en) Augmented reality try-on experience for friends or other users
CN115631321A (en) Information display method, device and electronic equipment
US20240273613A1 (en) Browsing-based augmented reality try-on experience
WO2025001382A1 (en) Makeup scheme generation method and apparatus, device, and storage medium
CN118586985A (en) Element processing method, device, electronic device and storage medium
CN119417545A (en) Method and electronic device for providing product information
CN118587331A (en) Method and electronic device for generating virtual character image

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载