+

WO2018052367A1 - Système et procédé de numérisation et d'essayage de vêtement - Google Patents

Système et procédé de numérisation et d'essayage de vêtement Download PDF

Info

Publication number
WO2018052367A1
WO2018052367A1 PCT/SG2016/050445 SG2016050445W WO2018052367A1 WO 2018052367 A1 WO2018052367 A1 WO 2018052367A1 SG 2016050445 W SG2016050445 W SG 2016050445W WO 2018052367 A1 WO2018052367 A1 WO 2018052367A1
Authority
WO
WIPO (PCT)
Prior art keywords
garment
user
geometric dimensions
template
image
Prior art date
Application number
PCT/SG2016/050445
Other languages
English (en)
Inventor
Farzam Farbiz
Viet Thang Nguyen
Jochen Walter EHNES
Original Assignee
Ayne Pte. Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ayne Pte. Ltd. filed Critical Ayne Pte. Ltd.
Priority to PCT/SG2016/050445 priority Critical patent/WO2018052367A1/fr
Publication of WO2018052367A1 publication Critical patent/WO2018052367A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • A—HUMAN NECESSITIES
    • A41—WEARING APPAREL
    • A41H—APPLIANCES OR METHODS FOR MAKING CLOTHES, e.g. FOR DRESS-MAKING OR FOR TAILORING, NOT OTHERWISE PROVIDED FOR
    • A41H1/00—Measuring aids or methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Shopping interfaces
    • G06Q30/0643—Graphical representation of items or shoppers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/16—Cloth
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2021—Shape modification

Definitions

  • the invention relates to a garment digitization system and method, and also to a garment try-on system and method.
  • Apparel retail is a trillion-dollar industry that is expected to grow to more than double by 2025. Online apparel sales have contributed significantly to the industry and it is expected to grow tremendously. However, despite the growth, conversion rates of online apparel sales are estimated to be only about 2-6%.
  • AR augmented reality
  • a data processing system for obtaining physical attributes from a user image, the system comprising:
  • a template adjustment tool for altering the initial geometric dimensions of the garment template in relation to physical attributes of the user as represented by the user image to form altered geometric dimensions, the altered geometric dimensions of the garment template being regarded as a dimensionally accurate representation of the physical attributes of the user and is stored for subsequent retrieval.
  • the initial geometric dimensions of the template garment known, changes to the initial geometric dimensions to fit the template garment to a profile of the user may then be used to determine physical attributes of the user conveniently.
  • the user image may include four views of the user or any number of views of the user, depending on application and implementation.
  • the image manipulation mechanism may include a rotation tool for rotating the user image to view each of the four views, and the template adjustment tool may be further arranged to alter the initial geometric dimensions of the garment template for each of the four views to form the altered geometric dimensions of the garment template.
  • the user image may be transformed to metric space.
  • the data processing system may further comprise a plurality of user profiles, with each user profile associated with a respective user image. It is possible that the plurality of user profiles is associated with different users, which allows the user to use the profile of other users to try on clothes for example.
  • measurements of the physical attributes of the user may be derived from the altered geometric dimensions.
  • the altered geometric dimensions may be subsequently retrieved for use when the user tries on digital clothes.
  • the first aspect may take the form of a method and according to a second aspect, there is provided a data processing method of obtaining physical attributes from a user image, the method comprising
  • the method of the second aspect may further include capturing the user image using a mobile phone.
  • the user image may include four views of the user, or there may be any number of views based on implementation and application.
  • the method may further comprise rotating the user image to view each of the four views, and altering the initial geometric dimension of the garment template for each of the four views to form the altered geometric dimensions of the garment template.
  • the method may further comprise transforming the user image into metric space.
  • the method may further comprise deriving measurements of the physical attributes of the user from the altered geometric dimensions.
  • the method may further comprise subsequently retrieving the altered geometric dimensions for use when the user tries on digital clothes.
  • a garment try-on system comprising
  • an image manipulation mechanism for receiving a selection of a digital garment from a user, the selected digital garment including metadata defining geometric dimensions of the garment;
  • the image manipulation mechanism is further arranged to display the user image wearing the adjusted digital garment.
  • a garment try-on method comprising
  • the garment try-on system or method of the third and fourth aspect may include the image manipulation mechanism further arranged to display the user image wearing dynamic images of the adjusted digital garment.
  • a fifth aspect may include a computer program product downloadable over the internet, the computer program product storing instructions that when downloaded and executed by a computing device cause the computing device to perform a method for using the computing device to obtain physical attributes from a user image, and the method comprising:
  • a garment digitization system for deriving geometric dimensions of a garment, comprising: (i) a physical mannequin having predetermined geometric dimensions which fit the garment;
  • a digitization module arranged to digitize the garment from the captured image to form a digital representation of the garment
  • a calculation module arranged to derive geometric dimensions of the garment from the predetermined geometric dimensions of the physical mannequin; wherein the derived geometric dimensions is stored in association with the digital representation of the garment.
  • the described embodiment is able to obtained geometric dimensions of the digital representation of the garment quickly and accurately.
  • the physical mannequin may include adjustable spatial configurations to fit the garment to produce altered geometric dimensions of the physical mannequin, and the predetermined geometric dimensions are thus based on the altered geometric dimensions.
  • the garment digitization system may further comprise a plurality of reference mannequins, each with a fixed but different spatial configuration, and wherein the physical mannequin may be selected from one of the plurality of reference mannequins.
  • Metadata for the garment may be created from the geometric dimensions of the garment.
  • the derived geometric dimensions and the digital representations of the garment may be stored in metric space. It should be appreciated that the derived geometric dimensions may be 2- dimensional (2D) or 3-dimensional (3D).
  • the sixth aspect is implemented by way of a system or apparatus, but it may be implemented by way of a method, and thus, according to a seventh aspect there is provided a garment digitization method for deriving geometric dimensions of a digital representation of a garment, comprising:
  • Figure 1 is a schematic diagram of a communications network according to an embodiment of this invention.
  • Figure 2 is a schematic diagram of a computer system suitable for implementing any of the devices of the communication network of Figure 1 ;
  • Figure 3 illustrates a software environment which may be implemented by the computer system of Figure 2
  • Figure 4 illustrates a schematic diagram of a garment display system hosted by one of the servers of Figure 1 and displaying a number of digital garments;
  • Figure 5 illustrates a garment digitization system for digitising garments for the garment display system of Figure 4;
  • Figure 6 is a schematic block diagram of the garment digitization system of Figure 5;
  • Figure 7 is a flow chart depicting a set-up process performed by a communication device of Figure 1 for obtaining physical attributes of a user;
  • Figure 8 is a block diagram of a mobile application for performing the setup process of Figure 7 and in relation to the garment display system of Figure 4;
  • Figure 9 shows four views of a user provided to the mobile application of Figure 8 in accordance with the set-up process of Figure 7;
  • Figure 10 is a digital template garment having top and bottom template clothes which are used by the mobile application of Figure 8 for obtaining physical attributes of the user;
  • FIGS 11a to 11e illustrate fitting the template garment of Figure 10 on each of the views illustrated in Figure 9;
  • Figure 12 shows a graphical user interface (GUI) of the mobile application of Figure 8 installed on a mobile device to allow users to try- on garments from the garment display system of Figure 4;
  • GUI graphical user interface
  • Figure 13 shows respective views of the user trying on a jacket from the garment display system of Figure 4;
  • Figure 14 shows a front view of Figure 13 and with the user wearing a pair of pants selected from the garment display system of Figure 4;
  • Figure 15 show the GUI of Figure 12 illustrating a user image of another user wearing another garment from the garment display system of Figure 4;
  • Figures 16a to 16c show different images of the GUI of Figure 15 illustrating the user wearing the same garment as in Figure 15 but in different sizes.
  • FIG. 1 shows a communications network or apparatus 100 comprising "n" number of computing devices such as servers 200 hosting web contents and in this embodiment, there is a first server 202 hosting a garment display system 400 and a second server 204 hosting an online sales or e-commerce platform such as eBayTM which sells clothes from various merchants.
  • the communications network 100 further includes "m" number of communication devices 300 configured to communicate with the servers 202,204...n over the internet 102 or over communication links.
  • These communication devices 300 may include laptops, personal computers (PC), mobile phones, personal digital assistants (PDAs), gaming devices, media players, tablets, wearable computers, headset computers, in-vehicle computers etc.
  • the communication devices 300 include a first mobile phone 302, second mobile phone 304, a PC 306 and up to "m" communication devices.
  • Figure 2 is a schematic diagram of a computer system 310 suitable for implementing one or more of the computing devices 200 and the communication devices 300.
  • the computer system 310 may include a processor 312 (which may be commonly referred to as a central processor unit (CPU)) that is in communication with memory devices including secondary storage 314 (such as a Hard Disk Drive or micro Secure Digital (SD) card), read only memory (ROM) 316, random access memory (RAM) 318, input/output (I/O) device 320, and network connectivity device 322 so that the computer system 310 may communicate with other computer systems.
  • the processor 312 may be implemented as one or more CPU chips.
  • the network connectivity device 322 may include an antenna or RF transceiver for wireless communications.
  • the network connectivity device 322 may enable the processor 312 to communicate with the Internet 102 or one or more intranets and in particular with the other communication devices 300 and the computing devices 200. With such a network connection over the communication network 100, it is contemplated that the processor 312 might receive information from the communication network 100, or might output information to the network 100.
  • the secondary storage 314, the RAM 318, and/or the ROM 316 may be referred to in some contexts as computer readable storage media and/or non- transitory computer readable media.
  • the processor 312 may execute a computer program or application.
  • the processor 312 may execute software or firmware stored in the ROM 316 or stored in the RAM 318.
  • the processor 312 may copy the application or portions of the application (or application modules) from the secondary storage 314 to the RAM 318 or to memory space within the processor 312 itself, and the processor 312 may then execute instructions of the computer application.
  • the processor 312 may copy the application or portions of the application from memory accessed via the network connectivity devices 322 or via the I/O devices 320 to the RAM 318 or to memory space within the processor 312, and the processor 312 may then execute instructions of the computer application.
  • an application may load instructions into the processor 312, for example load some of the instructions of the application into a cache of the processor 312.
  • an application that is executed may be said to configure the processor 312 to do something, e.g., to configure the processor 312 to perform the function or functions defined by the instructions of the application.
  • the processor 312 becomes a specific purpose computer or a specific purpose machine.
  • the I/O device 320 may include printers, video monitors, liquid crystal displays (LCDs), plasma displays, touch screen displays, keyboards, keypads, switches, dials, mice, track balls, voice recognizers, card readers, paper tape readers, or other known input and output devices which allows a user to interact with or provides inputs to or obtain outputs from the computer system 310.
  • LCDs liquid crystal displays
  • plasma displays touch screen displays
  • keyboards keypads
  • switches dials
  • mice track balls
  • voice recognizers card readers, paper tape readers, or other known input and output devices which allows a user to interact with or provides inputs to or obtain outputs from the computer system 310.
  • the I/O device 320 it is common for the I/O device 320 to include
  • the computer program product may comprise one or more computer readable storage medium having computer usable program code or application software embodied therein to implement the functionality disclosed above.
  • the computer program product may comprise data structures, executable instructions, and other computer usable program code.
  • the computer program product may be embodied in removable computer storage media and/or non-removable computer storage media.
  • the removable computer readable storage medium may comprise, without limitation, a paper tape, a magnetic tape, magnetic disk, an optical disk, a solid state memory chip, for example analog magnetic tape, compact disk read only memory (CD-ROM) disks, flash memory, jump drives, digital cards, multimedia cards, and others.
  • the computer program product may be suitable for loading, by the computer system 310, at least portions of the contents of the computer program product to the secondary storage 314, to the ROM 316, to the RAM 318, and/or to other non-volatile memory and volatile memory of the computer system 310.
  • the processor 312 may process the executable instructions and/or data structures in part by directly accessing the computer program product, for example by reading from a CD-ROM disk inserted into a disk drive peripheral of the computer system 310 with the disk drive peripheral as an example of the I/O device 320.
  • the processor 312 may process the executable instructions and/or data structures by remotely accessing the computer program product, for example by downloading the executable instructions and/or data structures from a remote server through the network connectivity device 312.
  • the computer program product may comprise instructions that enable the loading and/or copying of data, data structures, files, and/or executable instructions to the secondary storage 314, to the ROM 316, to the RAM 318, and/or to other non-volatile memory and volatile memory of the computer system 310.
  • Figure 3 illustrates a software environment 330 that may be implemented by the processor 312 of the computer system 310.
  • the processor 312 executes operating system software 334 which may be stored in the secondary storage 314 and that provides a platform from which the rest of the software operates.
  • the operating system software 334 may provide a variety of drivers in order for hardware of the computer system 310 to work with the operating system software 334.
  • the operating system software 334 may be coupled to and interact with application management services (AMS) 336 that transfer control between applications running on the computer system 310.
  • applications running on the computer system 310 are a web browser application 338, a media player application 340, JAVA applets 342, and application software (App) such as various application modules for implementing the described embodiment which will be elaborated later.
  • the web browser application 338 may be executed by the processor 312 (or more generally the computer system 310) to browse content and/or the Internet 102, for example, to access the web content provided by one of the servers 202, 204 via the internet 102.
  • the web browser application 338 may permit a user to enter information into forms, select links to retrieve and view web pages, download information from the internet (or from other communication devices 300 or computing devices 200) and for storage in the RAM 318 or to upload information from the RAM 318 to the internet 102 or when requested by other communication devices 300 or computing devices 200.
  • the communication network 100 includes devices 200,300 which interact or communicate with each other, and in particular, exchange data.
  • the garment display system 400 carries digital images of items of garments 402 for trying by users such as a user 302a of the first mobile phone 302.
  • the items of garment 402 include a number of different digitized clothes (or digital representations of actual clothes) 404,406,408,410,412,414 for selection and trying by the user 302a.
  • each digital image of the garments 402 may be in 2- dimensional (2D) or 3-dimensional (3D), although a 3D image is preferred as it will be apparent later.
  • a 3D scanner may be used to scan the actual physical garments in order to create corresponding 3D models (eg. OBJ format).
  • a camera may be used to take a series of photographs or videos of the physical garments from different angles or perspectives to form corresponding 3D representations of the garments 402.
  • the first server 202 is associated with a metadata database 430 with metadata created for each digital image of the garment 402.
  • the metadata database 430 is shown separated from the first server 202 but it should be appreciated that the metadata database 430 may be located within the first server 202.
  • the metadata includes information about the garment such as size information and dimensions or garment measurements in metric, skeletal information of the clothes in metric, as well as dressing information (e.g. this is a top or bottom piece). In terms of the garment measurements, data such as width of the garment (eg. shoulder-to-shoulder width) and height of the garment (eg. from neckline to lower end of the garment) might be useful.
  • the metadata can be saved in XML or other formats. Some of the metadata can be manually filled for the clothes and some can be calculated automatically through known image processing or 3D tools.
  • a garment digitization system or apparatus 450 shown in Figure 5 is used for deriving geometric dimensions of the items of garment 402, more specifically, but not exclusively, 3D geometric dimensions of the garments 402.
  • the garment digitization system includes a physical mannequin 452 and an image capturing device 454 such as a video camera or still image camera.
  • the image capturing device 454 is communicatively linked to a computing device 456 similar to the computing system 310 of Figure 2.
  • the garment digitization system 450 further includes a digitization module 458 and a calculation module 460 configured to be run or implemented by the computing device 456 and Figure 6 illustrates a schematic diagram of the garment digitization system 450.
  • geometric dimensions of the physical mannequin 452 are known and spatial configuration of the physical mannequin 452 is adjustable for example, shoulder-shoulder width 452a may be extended by expanding the shoulders further apart and length of upper body 452b may be extended etc. Similarly, size of body parts such as arms, thighs, legs etc may be replaced, extended or padded to increase the size to change the spatial configuration of the physical mannequin 452 to form an altered spatial configuration and consequently, adjusted geometric dimensions of the reconfigured physical mannequin 452 are also obtained.
  • a reference 452c on the physical mannequin 452 is identified and in this embodiment, the reference 452c is at a centre point of the chest of the physical mannequin 452.
  • an actual jacket 404a of a particular size such as "Large” is worn by the physical mannequin 452.
  • the spatial configuration of the physical mannequin 452 is then adjusted to fit or match the jacket 404a and this forms a reconfigured mannequin (not shown) with altered geometric dimensions.
  • the image capturing device 454 then takes at least one image of the reconfigured mannequin wearing the jacket 404a and in this embodiment, the image capturing device 454 captures images comprising front, back and two side views of the reconfigured mannequin wearing the jacket 404a by rotating the reconfigured mannequin and uploads the images to the computing device 456.
  • the digitization module 458 creates a digital model 404 of the jacket 404a (or digitized jacket 404) with corresponding views of the actual jacket 404a and it should be appreciated that the digitization module 458 may take reference from the reference point 452c to determine the orientation of the digitized jacket 404 in particular the four views of the digitized jacket 404.
  • the calculation module 460 further derives the geometric dimensions of the jacket 404. Since the altered geometric dimensions of the reconfigured mannequin are known, the calculation module 460 can thus derive the geometric dimensions of the jacket 404, in particular 3D geometric dimensions of the digitized jacket 404 or the 2D geometric dimensions. The geometric dimensions of the digitized jacket 404 are stored in association with the digital representation of the jacket 404. In this way, a fast and efficient way of deriving measurements of the garment 402 is achieved.
  • the physical mannequin 452 may be selected from a series or set of reference mannequins (not shown) to fit the actual jacket 404a.
  • Each one of the reference mannequins has known geometric dimensions and body shapes and has a fixed spatial configuration which is different from another reference mannequin.
  • a suitable reference mannequin may be selected as the physical mannequin 452 which fits the jacket 404a (or any garment to be digitized).
  • each of the reference mannequins and/or turntable which rotates the physical mannequin 452 to aid the calculation module 460 in determining which reference mannequin out of the set of reference mannequins is used as the physical mannequin 452, as well as the size and orientation of the selected mannequin and hence the clothes in the image.
  • relevant metadata of the digitized jacket 404 may then be extracted and saved as part of the metadata database 430.
  • the geometric dimensions and digital versions of the clothes 404,406,408,410,412,414 may be obtained, and metadata created for each of the clothes.
  • the digitized jacket 404 (similar to the rest of the garments 402) may be saved in metric space together with the associated geometric dimensions.
  • the garments 402 are ready to be used for trying on via the garment display system 400.
  • the user 302a downloads and installs a garment try-on mobile app 480 (similar to the App 344 of Figure 3) on the mobile phone 302, and starts the mobile app 480 to perform a setup process 800 as illustrated in Figure 7.
  • the garment try-on mobile app 480 includes an image manipulation mechanism 482, a 3D template garment 484, a template adjustment tool 486 and a simulation module 488.
  • the user's actual profile is obtained.
  • the image manipulation mechanism 482 prompts the user 302a to provide four images 500 to obtain the user's actual profile and the four images 500 may be captured using the mobile phone's camera.
  • Figure 9 illustrates the images 500 comprising a front view 502, a right side view 504, a back view 506 and a left side view 508 captured using the mobile phone's camera and associated with the mobile app 480.
  • the image manipulation mechanism 482 includes transitional arrows 510 which allow the user 302a to switch between the four views 500.
  • each view 500 need not have the same perspective/scale which illustrates the versatility of the garment try-on mobile app 480 (for example, the user's image in the right side view 504 of Figure 10 appears bigger than the front view 502). While this embodiment uses four views of the user 302a, it should be appreciated that only at least one view of the user 302a is needed. For example, in other embodiments, only the front view 502 of the user 302a may be provided and thus, the user's actual profile would be based on the front profile of the user or perhaps, only the front view 502 and the right side view 504 are provided.
  • FIG. 10 illustrates a pictorial view of the template garment 484 in four views - front, two side and back views.
  • the template garment 484 comprises a top clothing template TCi and a bottom clothing template TC2.
  • the top and bottom clothing templates TCi,TC 2 have specific geometric dimensions or measurements which are already known or predetermined as defined by respective outlines 514,516.
  • specific geometric dimensions may include width of the top clothing template TCi such as shoulder-to-shoulder width 514a, and length of the top clothing template TC 2 such as upper body length 514b from the neckline to the lower end, for each of the four views relative to the reference 452c of the physical mannequin 452.
  • Additional geometric dimensions or information may include sleeve and leg length, belly size, chest size, hip and neck size etc.
  • Figure 11a shows the top clothing template TCi "worn” by or perspectively projected onto the user's upper body using the front view 502
  • Figure 11 b shows the bottom clothing template TC 2 being "worn” by or perspectively projected onto the user's lower body in addition to the top clothing, similarly using the front view 502, to form a combined image 518.
  • the template adjustment tool 486 is activated to allow the user 302a to adjust or manipulate the top clothing template TCi and also the bottom clothing template TC 2 (for example, moving the templates TC-i, TC 2 up/down, scaling of the templates TCi,TC2 by altering the outlines 514,516 etc) to form adjusted front view top and bottom clothing templates AFVTC-i, AFVTC2 (not shown) which match or fit the corresponding upper and lower bodies of the user's front view profile.
  • the AFVTC1 and AFVTC2 values are then saved in relation to the front view profile of the user 302a at step 808.
  • the combined image 518 is next rotated by an adjustment angle of 90° to the right side view 504 (by clicking on the appropriate transitional arrows 510 of the image manipulation mechanism 482) and the corresponding view of the clothing templates TC1 C2 is similarly projected by the template adjustment tool 486 to be worn by the side view 504 of the user 302a.
  • This is illustrated in Figure 11c.
  • the corresponding view of the clothing templates TCi,TC-2 is the original unadjusted clothing templates TCi,TC 2 but it is also envisaged that corresponding side view templates of the adjusted front view top and bottom templates AFVTC-i, AFVTC2 may be used.
  • the clothing templates TCi,TC2 are adjusted to fit or match the side profile of the user 302a to form adjusted side view top and bottom templates ASVTCi,ASVTC 2 (not shown).
  • the ASVTC1 ,ASVTC 2 values are saved in relation to the right side view of the user 302a at step 808.
  • the digital model of template clothes (TCi and TC 2 ) in the 180, and 270 degrees are shown to the user and similar steps performed to obtain adjusted back view top and bottom clothing templates AB VTCi ,ABVTC 2 and adjusted other side view top and bottom clothing templates AOSVTCi,AOSVTC 2 .
  • the top and bottom templates TCi,TC2 are adjusted for each view independently and adjustment results (i.e. the adjusted template clothing) saved in relation for that view.
  • each view of the user 302a need not have the same perspective.
  • each clothing template TC1 and TC2 are saved at step 808.
  • the clothing templates TCi and TC 2 may be generally represented by TQ;
  • conversion of the original top and bottom clothing template TCi into an adjusted clothing model which fits or matches the user's profile may be represented by a transformation function:
  • a function g/TC; , m(TCi)] transfers the template clothes 7 ⁇ C, into metric space, using the clothes metadata m(TCi), then the function that converts each view of the user profile to the metric space may be represented by: g[F 1 ( . ,9), m(Ue)] , where F 1 (.) is the inverse of the function F(.) , and m(Ue) is the metadata of user's profile image at angle ⁇ .
  • the digitized garments 402 may alternatively be transferred to the user's image space U e , so the user 302a may still visually see the effect of trying different clothes and different size.
  • the adjusted clothing templates (AFVTC 1 , AFVTC2 , ASVTC-i, ASVTC2, ABVTd, ABVTC 2 , AOSVTd, AOSVTC 2 ), it is possible to derive physical attributes of the user 302a.
  • the adjusted clothing template is then saved in association with the user profile by the mobile app 480 and this completes the setup process 800 as indicated in step 812.
  • the user 302a is thus ready to try on the clothes 404,406,408,410,412,424 of Figure 4 of the garment display system 400 of the first server 202.
  • the user 302a accesses the first server 202 via the mobile app 480 to visit the garment display system 400 and the mobile app 480 would carry the user's image similar to what is illustrated in Figure 9 together with the clothes 404,406,408,410,412,424 for selection.
  • An example of a display of the mobile app 480 is shown in Figure 12 which includes a main section 520 showing the user's profile and in this case, the front view 502 is shown, and a side panel 522 displaying the garments of Figure 4 from the first server 202 for trying or selection.
  • the user 302a selects the jacket 404 to try, and this selection is received by the image manipulation mechanism 482, and the mobile app 480 (specifically the simulation module 488) retrieves the stored adjusted clothing template (specifically the adjusted top clothing template) of the user 302a and compares the stored adjusted clothing template against the metadata of the jacket 404 (saved in the database of metadata for the garments 402). Based on this comparison, the simulation module 488 next automatically determines a suitable spatial configuration of the digital garment including a correct perspective which would match or fit the user's physical attributes to produce an adjusted image of the jacket 404 and dress the front view 502 of the user profile with the adjusted image of the jacket 404 (which has the correct perspective and metric information).
  • the jacket 404 presented for trying by the user 302a would have the correct size to match or fit the physical attributes of the user 302a based on the saved adjusted clothing template (as derived from the user profile during the setup process of Figure 8) and thus, no further adjustment by the user may be needed.
  • Figure 13 shows the result of displaying the user image wearing the adjusted digital image of the jacket 404 as shown in the mobile device 302, and selecting each of the four views 502,504,506,508 in turn to view how the jacket 404 looks on the user 302a. It should be appreciated that during the digitization process to obtain the digital model of the jacket 404, corresponding views of the jacket 404 were obtained, and similarly corresponding adjusted clothing templates TCi,TC2 were also obtained for the user 302a.
  • the user 302a may also select a piece of clothing for his lower body and in this embodiment, the user 302a selects a pair of pants 416 from the garment display system 400. Similar to the jacket 404, the mobile app 480 retrieves the stored adjusted clothing template (specifically the adjusted bottom clothing template) of the user 302a, compares the stored adjusted clothing template with the metadata of the pants 416 and dress the front view 502 of the user profile with the pair of pants 416 of a correct perspective and metric information, and this is shown in Figure 14. As explained earlier, no further manual adjustment by the user is necessary.
  • the stored adjusted clothing template specifically the adjusted bottom clothing template
  • this embodiment allows the user 302a to try different types of clothes and the user 302a has an option of mixing & matching different clothes from the garment display system 400.
  • the user 302a is able to visualize the jacket 404 with the clothes he worn during the setup process in step 802.
  • the user 302a can try-on the jacket 404 with the black pants he has to see if they match before deciding whether to buy the jacket 404.
  • the mobile app 480 allows the user 302a to have multiple user profiles and this allows the user 302a to have the flexibility of wearing different clothes for each setup process 800 so that the user 302a may match his clothes he already have with the clothes from the garment display system 400 which he has interest to buy. Since the user 302a may have multiple profiles, this also allows other user profiles to be used. For example, the user 302a may wish to purchase a gift for another person such as a second user 302b, and the user 302a may use an image of the second user 302b to set up a second user profile for the second user 302b according to Figure 8.
  • the user 302a may use the second user's profile to try on garments as shown in Figure 15 which shows the second user's profile being used to try on one of the garments 402 from the garment display system 400 which is a dress 414. Again, the dress 414 would be worn by the second user 302b with a correct perspective and metric information. However, it is also possible for the user 302a to deactivate this function and select different size clothes to see how they look on the second user 302b.
  • Figure 16a illustrates the second user 302b wearing the dress 414 in a small size which is the selected size based on the user's profile proposed by the mobile app (i.e. as illustrated in Figure 15).
  • Figure 16b shows the second user's profile being used to try on the dress 414 in a medium size
  • Figure 16c shows the second user's profile being used to try on the dress 414 in a large size. Needless to say, this feature may also be used by the user 302a on his profile.
  • the user 302a may only perform a one-time setup process 800 to derive his physical attributes and the user 302a may then try-on digital clothes from the garment display system 400 subsequently without a need for further adjustments.
  • the embodiment also offers the flexibility that the user 302a may have multiple user profiles on his mobile app 480. In each profile, the user can wear different clothes so he can mix and match the real clothes worn in the profile with the digital clothes from the garment display system 400 (as that illustrated in Figure 13) and this may create a more personalized experience for the user 302a.
  • the template garment 484 much more accurate geometric dimensions of the physical attributes of the user 302a (or the second user 302b) may be obtained since actual profiles (eg.
  • photographs) of the user 302a,302b are used as starting points for the step-up process 800.
  • a true-to-life try on experience may be achieved and may also assist to improve customer experience resulting in higher conversion rates for online users.
  • the described embodiment may be used to derive or estimate the user's body measurement.
  • M is the vector which represents elements such as body size information (e.g. height, arm length, neck size, hip size, inseam length,...) of the physical mannequin 452 used for creating the template clothes model T
  • F(T , ⁇ ) is the conversion function.
  • the user's body measurement data can be obtained from a.F(M,Q) , where a is a scaling factor proportional to the user's height in metre.
  • a is a scaling factor proportional to the user's height in metre.
  • the feature points of clothes would be mapped to the user's feature points.
  • the user's feature points in the image can be determined to obtain the body size information (height, arm, length, neck, size, hip size, inseam length etc).
  • the user 302a may then be able to purchase tailored or customized clothes online. For example, it is envisaged that after trying on the garments 402, instead of purchasing ready-made clothes, the user 302a may opt to have clothes tailored made according to the his body dimensions. Of course, the user's body dimension may also be obtained for the purposes of general profiling of the user.
  • the images 500 to derive the user's physical attributes in Figure 8 comprise still images to show the four views 502,504,506,508, only one view may be used (such as the front view 502), although this may not be preferred. Indeed, any number of views may be used depending on the implementation and type of garments 402.
  • the garments 402 for selection by the user 302a to try on are illustrated in Figures 4 and 12 as front view images.
  • the garments 402 may be represented in other formats, such as:
  • the garments 402 may be subjected to animation to simulate how the clothing 404,406,408,410,412,414,416 may look when worn by the users 302a,302b.
  • the dress 414 worn by the second user 302b may be subjected to animation using an animated 3D model to show how the dress 414 may move when there is wind.
  • videos may be used to show how the dress 414 may move. Then based on the second user's pose and view in the image, either the right video file, or the transformed animated 3D model, both with the correct perspective view and adjusted scale and position, are overlaid on the user's profile picture.
  • the template garment 484 includes the top clothing template T ⁇ and the bottom clothing template TC 2 . It should be appreciated that the template garment 484 may comprise any number of template items. For example, the template garment 484 may also comprise a hat template which may be used for measuring size of the user's head. Likewise, the template garment 484 may also include templates for other parts of the body, such as feet for socks, hands for gloves etc. Thus, the template garment 484 may include 'n' templates TC n .
  • the user 302a may save the image that shows his profile augmented by the selected clothes 404 either as a single image or a video that shows different views and clothes animation, if any, and share it to social networks such as FacebookTM or SnapchatTM to check friends' opinion on "How do I look?" and whether the clothes is good to buy. It is like SnapchatTM for fashion and apparel.
  • the user 302a may have profile data of not only himself, but also of other people (e.g. spouse, kids, friends, ...) in his mobile device/ account such as the second user 302b and these other people are also considered as a "user". This allows the user 302a to try different virtual clothes on the other people's profile which may be useful for buying gifts for others. For instance, a husband can virtually try different apparels on his wife's profile on his mobile device 302 before making the purchase.
  • other people e.g. spouse, kids, friends, .
  • the garment display system 400 residing on the first server 202 may be an intermediary offering users a service to try-on garments 402 being sold by third party retailers. If the user 302a intends to purchase any of the garments, the mobile app 480 would direct the user 302a to an online platform of the third party retailer selling the garments 402. It is also envisaged that the garment display system 400 may be implemented directly by a garment retailer as part of its online outlet, or an e-commerce business-to-consumer sales portal hosted at the second server 204. Either way, the retailer would have to digitize its clothes as explained above in order for users 302a,302b to try on the clothes using the garment try-on mobile app 480.
  • the digitization of garments may be performed by a third party, which is not the garment retailer. If that's the case, there might be an intermediary (such as an intermediate server with appropriate online services) that may help clothes merchants or the garment retailer to find the third party service providers and help to mediate between them.
  • an intermediary such as an intermediate server with appropriate online services
  • the intermediary may also assist to mediate between the clothes shops which need to digitize their clothes and the third party digitization service providers (which may be located at a different physical location as the clothes shops/garment retailers).
  • the user 302a is the one who activates the template adjustment tool 486 to adjust the template garment 484 during the setup process 800 but it is possible that the user's profile image is sent to the first server 202 and the adjustment of the template garment 484 to match the user's profile is performed by a third party.
  • the described embodiment uses the mobile device 302 as an example of a communication device installed with the garment try-on mobile app 480 but other communication devices may also be used, such as the PC 306 or other forms of communication devices.
  • the garment try-on mobile app 480 may not be a mobile application but broadly, a garment try-on application or system which is installed in the communication devices.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Marketing (AREA)
  • Computer Hardware Design (AREA)
  • Strategic Management (AREA)
  • Economics (AREA)
  • Development Economics (AREA)
  • Architecture (AREA)
  • Computer Graphics (AREA)
  • General Business, Economics & Management (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biophysics (AREA)
  • Textile Engineering (AREA)
  • Processing Or Creating Images (AREA)

Abstract

L'invention concerne un système et un procédé de numérisation de vêtement pour dériver des dimensions géométriques d'une représentation numérique d'un vêtement. Dans un mode de réalisation de la présente invention, le système (450) comprend (i) un mannequin physique (452) ayant une configuration spatiale réglable pour s'adapter au vêtement (404a) pour former un mannequin reconfiguré ayant des dimensions géométriques modifiées ; (ii) un dispositif de capture d'image (454) pour capturer une image du mannequin reconfiguré portant le vêtement (404a) ; (iii) un module de numérisation (458) agencé pour numériser le vêtement (404a) à partir de l'image capturée pour former une représentation numérique du vêtement (404a) ; et un module de calcul agencé pour dériver des dimensions géométriques du vêtement (404a) à partir des dimensions modifiées du mannequin reconfiguré ; et les dimensions géométriques dérivées sont stockées en association avec la représentation numérique du vêtement (404a). L'invention concerne également un système et un procédé d'essayage de vêtement.
PCT/SG2016/050445 2016-09-14 2016-09-14 Système et procédé de numérisation et d'essayage de vêtement WO2018052367A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/SG2016/050445 WO2018052367A1 (fr) 2016-09-14 2016-09-14 Système et procédé de numérisation et d'essayage de vêtement

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/SG2016/050445 WO2018052367A1 (fr) 2016-09-14 2016-09-14 Système et procédé de numérisation et d'essayage de vêtement

Publications (1)

Publication Number Publication Date
WO2018052367A1 true WO2018052367A1 (fr) 2018-03-22

Family

ID=61619715

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SG2016/050445 WO2018052367A1 (fr) 2016-09-14 2016-09-14 Système et procédé de numérisation et d'essayage de vêtement

Country Status (1)

Country Link
WO (1) WO2018052367A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023043959A1 (fr) * 2021-09-20 2023-03-23 Meta Platforms Technologies, Llc Génération de vêtement numérique
IT202100028277A1 (it) * 2021-11-05 2023-05-05 Bf Oz Eretikos Iki Srl Cabina di mappatura per capi di abbigliamento e corpi di utenti, e procedimento per la fornitura richiesta di capi di abbigliamento a noleggio
US11915380B2 (en) 2018-10-19 2024-02-27 Perfitly, Llc. Method for animating clothes fitting

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6307568B1 (en) * 1998-10-28 2001-10-23 Imaginarix Ltd. Virtual dressing over the internet
CA2359513A1 (fr) * 2001-10-19 2003-04-19 Virtually Yours Inc. Methode virtuelle d'ajustement, de selection et de creation de vetements
US20040049309A1 (en) * 2001-01-19 2004-03-11 Gardner James Holden Patrick Production and visualisation of garments
US8525828B1 (en) * 2010-05-05 2013-09-03 Amazon Technologies, Inc. Visualization of fit, flow, and texture of clothing items by online consumers
WO2014081394A1 (fr) * 2012-11-22 2014-05-30 Agency For Science, Technology And Research Procédé, appareil et système pour la modélisation virtuelle de vêtements
US20140201023A1 (en) * 2013-01-11 2014-07-17 Xiaofan Tang System and Method for Virtual Fitting and Consumer Interaction
US20150287242A1 (en) * 2014-04-03 2015-10-08 Electronics And Telecommunications Research Institute Apparatus and method of reconstructing 3d clothing model
US20150302597A1 (en) * 2014-04-18 2015-10-22 Avyn, Inc. Systems and methods for preparing custom clothing patterns
US20160155186A1 (en) * 2014-12-01 2016-06-02 Ebay Inc. Digital wardrobe

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6307568B1 (en) * 1998-10-28 2001-10-23 Imaginarix Ltd. Virtual dressing over the internet
US20040049309A1 (en) * 2001-01-19 2004-03-11 Gardner James Holden Patrick Production and visualisation of garments
CA2359513A1 (fr) * 2001-10-19 2003-04-19 Virtually Yours Inc. Methode virtuelle d'ajustement, de selection et de creation de vetements
US8525828B1 (en) * 2010-05-05 2013-09-03 Amazon Technologies, Inc. Visualization of fit, flow, and texture of clothing items by online consumers
WO2014081394A1 (fr) * 2012-11-22 2014-05-30 Agency For Science, Technology And Research Procédé, appareil et système pour la modélisation virtuelle de vêtements
US20140201023A1 (en) * 2013-01-11 2014-07-17 Xiaofan Tang System and Method for Virtual Fitting and Consumer Interaction
US20150287242A1 (en) * 2014-04-03 2015-10-08 Electronics And Telecommunications Research Institute Apparatus and method of reconstructing 3d clothing model
US20150302597A1 (en) * 2014-04-18 2015-10-22 Avyn, Inc. Systems and methods for preparing custom clothing patterns
US20160155186A1 (en) * 2014-12-01 2016-06-02 Ebay Inc. Digital wardrobe

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11915380B2 (en) 2018-10-19 2024-02-27 Perfitly, Llc. Method for animating clothes fitting
WO2023043959A1 (fr) * 2021-09-20 2023-03-23 Meta Platforms Technologies, Llc Génération de vêtement numérique
US11640695B2 (en) 2021-09-20 2023-05-02 Meta Platforms Technologies, Llc Digital garment generation
US12039668B2 (en) 2021-09-20 2024-07-16 Meta Platforms Technologies, Llc Digital garment generation
IT202100028277A1 (it) * 2021-11-05 2023-05-05 Bf Oz Eretikos Iki Srl Cabina di mappatura per capi di abbigliamento e corpi di utenti, e procedimento per la fornitura richiesta di capi di abbigliamento a noleggio

Similar Documents

Publication Publication Date Title
US11164381B2 (en) Clothing model generation and display system
US11244223B2 (en) Online garment design and collaboration system and method
US7016824B2 (en) Interactive try-on platform for eyeglasses
EP1240623B1 (fr) Systeme et procede permettant de visualiser l'aspect physique d'une personne
US20190311488A1 (en) Method and system for wireless ultra-low footprint body scanning
US20170352091A1 (en) Methods for generating a 3d virtual body model of a person combined with a 3d garment image, and related devices, systems and computer program products
US20150134496A1 (en) Method for providing for the remote fitting and/or selection of clothing
US20120136755A1 (en) System and Method for Providing Virtual Fitting Experience
KR102649617B1 (ko) 자동화된 쇼핑 어시스턴트를 사용하는 개인화된 쇼핑을 위한 시스템, 플랫폼 및 방법
US11948057B2 (en) Online garment design and collaboration system and method
US20190026809A1 (en) Highly Custom and Scalable Design System and Method for Articles of Manufacture
US12198265B2 (en) Technologies for rendering items within a user interface using various rendering effects
Masri et al. Virtual dressing room application
WO2018052367A1 (fr) Système et procédé de numérisation et d'essayage de vêtement
CN106779774A (zh) 虚拟试衣系统及虚拟试衣方法
Shams et al. Towards 3D virtual dressing room based user-friendly metaverse strategy
WO2022081745A1 (fr) Rendu en temps réel d'articles 3d pouvant être portés sur des corps humains pour des dispositifs informatiques assistés par caméra
US20080030516A1 (en) Electronic presentation system and method
KR102143439B1 (ko) 의류 공유 및 코디네이션 방법
WO2018182938A1 (fr) Procédé et système de balayage de corps sans fil à ultra faible encombrement
JP2018163031A (ja) 体型情報解析システム
WO2016081984A1 (fr) Contextes et méthodologies configurés pour permettre la génération et l'utilisation de données de balayage de corps en trois dimensions
WO2020215133A1 (fr) Système virtuel d'essai d'habits et d'accessoires permettant de reproduire la réalité
KR20010088702A (ko) 3차원 신체모형 생성시스템 및 생성방법
US20240355138A1 (en) Method and system for wireless ultra-low footprint body scanning

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16916334

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 10.07.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 16916334

Country of ref document: EP

Kind code of ref document: A1

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载