+

WO2018164327A1 - Procédé et système d'estimation de couche anatomatique d'un visage, et support d'enregistrement lisible par ordinateur non transitoire - Google Patents

Procédé et système d'estimation de couche anatomatique d'un visage, et support d'enregistrement lisible par ordinateur non transitoire Download PDF

Info

Publication number
WO2018164327A1
WO2018164327A1 PCT/KR2017/008503 KR2017008503W WO2018164327A1 WO 2018164327 A1 WO2018164327 A1 WO 2018164327A1 KR 2017008503 W KR2017008503 W KR 2017008503W WO 2018164327 A1 WO2018164327 A1 WO 2018164327A1
Authority
WO
WIPO (PCT)
Prior art keywords
face
user
anatomical
shape
measurement data
Prior art date
Application number
PCT/KR2017/008503
Other languages
English (en)
Korean (ko)
Inventor
김진수
최흥산
김희진
최종우
허창훈
Original Assignee
주식회사 모르페우스
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020170050034A external-priority patent/KR101918119B1/ko
Application filed by 주식회사 모르페우스 filed Critical 주식회사 모르페우스
Publication of WO2018164327A1 publication Critical patent/WO2018164327A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration

Definitions

  • the present invention relates to a method, system and non-transitory computer readable recording medium for estimating an anatomical layer on a face.
  • a face image is obtained from a user, an outline of a face component such as an eye, a nose, a mouth, and a chin is extracted from the acquired face image, and based on each feature point of the component
  • a method of generating a user's face and performing a virtual shaping simulation on the user's face generated through a mesh warping technique has been introduced.
  • the whole face of the user is estimated or only the face or bone of the user is imaged based on a local feature obtained from the image of the face or bone of the user. Based on this, only the simulation service such as virtual molding was provided, so there was no difference between the actual result and the virtual result.
  • the present invention aims to solve all of the above-mentioned problems of the prior art.
  • another object of the present invention is to estimate the shape and position of at least one type of anatomical layer included in soft tissue of a user's face based on user information.
  • a method for estimating an anatomical layer of a face comprising: acquiring three-dimensional measurement data of a shape of a user's face; Estimating the shape and location of at least one type of anatomical layer included in the soft tissue of the user's face by analyzing it relative to at least one associated anatomical face model, wherein the anatomical face model includes: A method is provided that includes modeled data regarding the shape and location of at least one type of anatomical layer included in soft tissues of the face.
  • the measurement data acquisition unit for obtaining the three-dimensional measurement data about the shape of the user's face, and the obtained three-dimensional measurement data
  • a layer estimator for estimating the shape and position of at least one kind of anatomical layer included in the soft tissue of the user's face by analyzing the at least one anatomical face model associated with user information.
  • the face model is provided with a system that includes modeled data regarding the shape and location of at least one type of anatomical layer included in soft tissues of the face.
  • non-transitory computer readable recording medium for recording another method for implementing the present invention, another system, and a computer program for executing the method.
  • the present invention it is possible to estimate the shape and position of at least one kind of anatomical layer included in the soft tissue of the user's face based on the user information.
  • the present invention it is possible to provide a simulation service for at least one of plastic surgery, skin treatment, growth, aging and obesity to the user based on the estimated anatomical layer.
  • FIG. 1 is a diagram illustrating a schematic configuration of an entire system for estimating an anatomical layer about a face according to an embodiment of the present invention.
  • FIG. 2 is a diagram showing in detail the internal configuration of the estimation system according to an embodiment of the present invention.
  • FIG. 3 is a diagram exemplarily illustrating a process of estimating an anatomical layer included in soft tissue of a user's face according to one embodiment of the present invention.
  • FIG. 1 is a diagram illustrating a schematic configuration of an entire system for estimating an anatomical layer about a face according to an embodiment of the present invention.
  • an entire system may include a communication network 100, an estimation system 200, and a device 300.
  • the communication network 100 may be configured regardless of a communication mode such as wired communication or wireless communication, and includes a local area network (LAN) and a metropolitan area network (MAN). ), And various communication networks such as a wide area network (WAN).
  • LAN local area network
  • MAN metropolitan area network
  • WAN wide area network
  • the communication network 100 as used herein may be a known Internet or World Wide Web (WWW).
  • WWW World Wide Web
  • the communication network 100 may include, at least in part, a known wired / wireless data communication network, a known telephone network, or a known wired / wireless television communication network without being limited thereto.
  • the communication network 100 is a wireless data communication network, and includes Wi-Fi communication, Wi-Fi Direct communication, Long Term Evolution (LTE) communication, Bluetooth communication (for example, low power Bluetooth BLE (Bluetooth Low Energy), infrared communication, ultrasonic communication, etc. may be implemented at least in part.
  • Wi-Fi communication Wi-Fi Direct communication
  • Wi-Fi Direct communication Wi-Fi Direct communication
  • LTE Long Term Evolution
  • Bluetooth communication for example, low power Bluetooth BLE (Bluetooth Low Energy), infrared communication, ultrasonic communication, etc. may be implemented at least in part.
  • the estimation system 200 may perform communication with the device 300, which will be described later, through the communication network 100, and obtain 3D measurement data regarding the shape of the face of the user. And analyzing the obtained three-dimensional measurement data by comparing the obtained three-dimensional measurement data with at least one anatomical face model associated with the user information, thereby obtaining at least one kind of anatomical layer included in the soft tissue of the user's face. The function of estimating the shape and the position can be performed.
  • the estimation system 200 refers to the shape and location of at least one type of anatomical layer included in the soft tissue of the user's face, which may include cosmetic surgery, skin treatment, and growth to the user. It may also perform a function of providing a simulation service relating to at least one of aging, obesity, and the like.
  • the configuration and function of the estimation system 200 according to the present invention will be described in detail through the following detailed description.
  • this description is exemplary, and at least some of the functions or components required for the estimation system 200 will be described later as necessary, the device 300 or an external system It will be apparent to those skilled in the art that they may be implemented within (not shown) or incorporated into device 300 or an external system (not shown).
  • the device 300 is a digital device including a function of enabling communication after connecting to the estimation system 200 through the communication network 100, such as a smartphone, tablet PC, etc.
  • a portable digital device having a memory means and a microprocessor equipped with arithmetic capability can be adopted as the device 300 according to the present invention.
  • the device 300 may include an application for estimating an anatomical layer of a face and supporting a function according to the present invention in which a simulation service is provided to a user. have.
  • Such an application may be downloaded from the estimation system 200 or an external application distribution server (not shown).
  • FIG. 2 is a diagram showing in detail the internal configuration of the estimation system 200 according to an embodiment of the present invention.
  • Estimating system 200 may be a digital device having a computing capability by mounting a microprocessor and a memory means. Such estimation system 200 may be a server system. As shown in FIG. 2, the estimation system 200 may include a measurement data acquisition unit 210, a layer estimator 220, a service provider 230, a communication unit 240, and a controller 250. Can be. According to an embodiment of the present invention, the measurement data acquisition unit 210, the layer estimator 220, the service provider 230, the communication unit 240 and the control unit 250 is at least a part of the external system and It may be a program module that communicates.
  • Such program modules may be included in the estimation system 200 in the form of operating systems, application modules or other program modules, and may be physically stored in various known storage devices. Such program modules may also be stored in a remote storage device capable of communicating with the estimation system 200.
  • program modules include, but are not limited to, routines, subroutines, programs, objects, components, data structures, etc. that perform particular tasks or execute particular abstract data types, described below, in accordance with the present invention.
  • the measurement data acquisition unit 210 may perform a function of acquiring three-dimensional measurement data regarding a shape of a user's face.
  • the three-dimensional measurement data may include at least one of three-dimensional scanning data of the user's face and three-dimensional imaging data of the hard tissue of the user's face, such three-dimensional scanning
  • the imaging data may include x-rays, ultrasound waves, computer tomography (CT), magnetic resonance images (MRI), and positron emission tomography (PET). And a three-dimensional scanner.
  • the layer estimator 220 at least one anatomy associated with the user information, the three-dimensional measurement data about the shape of the user's face obtained from the measurement data acquisition unit 210 By comparing with the enemy face model, a function of estimating the shape and position of at least one kind of anatomical layer included in the soft tissue of the user's face may be performed.
  • the anatomical face model is obtained by scanning the peeled (or unpeeled) layer while peeling off the anatomical layers of the soft tissue of the face of the dead human body (ie, the dead body).
  • the position and shape of a layer and data obtained by transmitting at least one of ultrasonic waves, radiation, a magnetic field, and a positron to a living human facial soft tissue (for example, data regarding the position and shape of a layer).
  • a living human facial soft tissue for example, data regarding the position and shape of a layer.
  • the modeled data may be included.
  • the above-described obtained data is supported by a support vector machine (SVM) algorithm, a multivariate adaptive regression spline (MARS) algorithm, a nearest neighbor (KNN) algorithm, a neural network (NN) algorithm, and the like.
  • SVM support vector machine
  • MARS multivariate adaptive regression spline
  • KNN nearest neighbor
  • NN neural network
  • an anatomical face model may be obtained that patterns the anatomical layers of the face according to demographic indicators.
  • the above-described anatomical layer may include layers relating to at least one of muscle, fat, blood vessels, nerves and lymphatic vessels, and the user information may include race, ethnicity, gender, and age of the user. Information may be included.
  • the type of the anatomical layer and the user information according to an embodiment of the present invention is not necessarily limited to those listed above, periosteum, fascia (faiocia) within the scope that can achieve the object of the present invention , Anatomic layers such as ligaments, or user information, such as a country or a residential area.
  • the layer estimator 220 may include at least one feature related to the face of the user, which is extracted from the 3D measurement data regarding the shape of the face of the user, associated with the corresponding user information.
  • the user's face by matching or transforming the shape and position of at least one type of anatomical layer included in the anatomical face model to conform to three-dimensional measurement data about the shape of the user's face It is possible to estimate the shape or position of at least one type of anatomical layer included in the soft tissue of.
  • the layer estimator 220 is active to compare and analyze three-dimensional measurement data regarding the shape of the user's face and at least one anatomical face model associated with the user information.
  • Active appearance model (AAM) algorithms active shape model (ASM) algorithms, composite constraint AAM (Composite Constraint AAM) algorithms, iterative closest points (ICP) algorithms, and non-rigid matching
  • AAM Active appearance model
  • ASM active shape model
  • composite constraint AAM Composite Constraint AAM
  • ICP iterative closest points
  • non-rigid matching At least one of an algorithm (non-rigid registration) may be used.
  • the layer estimator 220 may extract an active appearance model (AAM) to extract features of the face of the user from three-dimensional measurement data regarding the shape of the user's face.
  • AAM active appearance model
  • At least one of an algorithm, an active shape model (ASM) algorithm, and a composite constraint active expression model (Composite Constraint AAM) algorithm may be used, and iterative closest points (ICP) algorithms and non-rigid matching algorithms ( by matching or transforming the shape and position of at least one type of anatomical layer included in the anatomical face model with at least one of non-rigid registration to conform to three-dimensional measurement data about the shape of the user's face, The shape or position of at least one type of anatomical layer included in the soft tissue of the face may be estimated.
  • ICP iterative closest points
  • non-rigid matching algorithms by matching or transforming the shape and position of at least one type of anatomical layer included in the anatomical face model with at least one of non-rigid registration to conform to three
  • an algorithm for comparing and analyzing three-dimensional measurement data about a shape of a face and at least one anatomical face model associated with user information is not necessarily limited to those listed above. It is noted that other algorithms may be utilized within the scope of the object of the present invention.
  • the service provider 230 refers to the shape and position of at least one type of anatomical layer included in the soft tissue of the face of the user estimated by the layer estimator 220.
  • the layer estimator 220 To provide a user with a simulation service relating to at least one of plastic surgery, skin treatment, growth, aging and obesity.
  • the layer estimator 220 virtually deforms, injects, and extracts the user's face according to a simulation service regarding at least one of plastic surgery, skin treatment, growth, aging, and obesity.
  • the shape and position of at least one type of anatomical layer included in the soft tissue of the user's face may be reestimated.
  • the service provider 230 is determined to inject a virtual implant or drug to the face of the user for plastic surgery or skin treatment during the above-described simulation service
  • the service provider 230 With reference to the shape and position of the layer and the other layer that changes (ie, re-estimated) depending on which one of the at least one anatomical layer included in the soft tissue of the user's face is located the implant or drug, A virtual simulation service about a user's face that changes after implantation or drug injection can be provided to the user. That is, according to an embodiment of the present invention, it is possible to accurately predict and provide a face of a user expected to change according to a plastic surgery or a skin procedure based on an anatomical layer.
  • the service provider 230 when it is determined that the service provider 230 provides a simulation service according to growth or aging among simulation services, the service provider 230 is included in the soft tissue of the face of the estimated user.
  • Virtual simulation service for a user's face that changes due to growth or aging referring to the shape and location that changes (ie, reestimated) as at least one type of anatomical layer grows or ages. Can be provided. That is, according to an embodiment of the present invention, it is possible to accurately predict and provide a face of a user expected to change due to growth or aging based on an anatomical layer.
  • the shape and position that is changed (ie, re-estimated) as the anatomical layer included in the soft tissue of the user's face is grown or aged are obtained from the above-described anatomical face model. It may be obtained from the modeled data with respect to the average shape and position of the anatomical layer by age.
  • the communication unit 240 performs a function to enable data transmission and reception from and to the measurement data acquisition unit 210, the layer estimator 220, and the service provider 230. can do.
  • the controller 250 controls the flow of data between the measurement data acquisition unit 210, the layer estimator 220, the service provider 230, and the communication unit 240. Can be performed. That is, the controller 250 according to the present invention controls the data flow from / to the outside of the estimation system 200 or the data flow between each component of the estimation system 200, thereby measuring the measurement data acquisition unit 210 and the layer.
  • the estimator 220, the service provider 230, and the communicator 240 may control each to perform a unique function.
  • FIG. 3 is a diagram exemplarily illustrating a process of estimating an anatomical layer included in soft tissue of a user's face according to one embodiment of the present invention.
  • the estimation system 200 may acquire 3D computed tomography data of hard tissue of a user's face or 3D scanning data of a user's face (301).
  • At least one anatomical face model associated with at least one of the race, gender and age of the user is selected 302 and at least included in the selected anatomical face model according to one embodiment of the invention.
  • At least one type of anatomy included in the soft tissue of the user's face by matching or transforming the shape or position of one type of anatomical layer to match three-dimensional data about the shape of the user's face using a non-rigid registration algorithm.
  • the shape or position of the enemy layer may be estimated (303).
  • the estimation system 200 refers to the shape and location of the estimated at least one type of anatomical layer, and to the user through the device 200, a plastic surgery, skin treatment It may provide a simulation service (304) regarding at least one of growth, aging and obesity.
  • the present invention in providing a simulation service for at least one of plastic surgery, skin surgery, growth, aging and obesity, the shape of the various anatomical layers included in the soft tissue of the user's face according to the simulation service And re-estimating the change in position can provide more accurate results than estimating the simulation results of at least one of cosmetic surgery, skin treatment, growth, aging and obesity based solely on facial appearance.
  • Embodiments according to the present invention described above can be implemented in the form of program instructions that can be executed by various computer components and recorded in a computer-readable recording medium.
  • the computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination.
  • Program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the computer software arts.
  • Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floptical disks. medium) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like.
  • Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.
  • the hardware device may be modified with one or more software modules to perform the processing according to the present invention, and vice versa.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

L'invention concerne un procédé et un système permettant d'estimer une couche anatomique d'un visage, ainsi qu'un support d'enregistrement lisible par ordinateur non transitoire. Un aspect de l'invention concerne un procédé permettant d'estimer une couche anatomique d'un visage, ledit procédé consistant à : acquérir les données de mesure tridimensionnelles de la forme d'un visage d'un utilisateur ;et analyser les données de mesure tridimensionnelles acquises en les comparant à au moins un modèle de visage anatomique associé aux données utilisateur, ce qui permet d'estimer la forme et l'emplacement d'au moins un type d'une couche anatomique incluse dans un tissu mou du visage de l'utilisateur, le modèle de visage anatomique comprenant les données modélisées de la forme et de l'emplacement du ou des types de la couche anatomique incluses dans le tissu mou du visage.
PCT/KR2017/008503 2017-03-10 2017-08-07 Procédé et système d'estimation de couche anatomatique d'un visage, et support d'enregistrement lisible par ordinateur non transitoire WO2018164327A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2017-0030745 2017-03-10
KR20170030745 2017-03-10
KR1020170050034A KR101918119B1 (ko) 2017-03-10 2017-04-18 얼굴에 관한 해부학적 레이어를 추정하는 방법, 시스템 및 비일시성의 컴퓨터 판독 가능 기록 매체
KR10-2017-0050034 2017-04-18

Publications (1)

Publication Number Publication Date
WO2018164327A1 true WO2018164327A1 (fr) 2018-09-13

Family

ID=63448804

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2017/008503 WO2018164327A1 (fr) 2017-03-10 2017-08-07 Procédé et système d'estimation de couche anatomatique d'un visage, et support d'enregistrement lisible par ordinateur non transitoire

Country Status (1)

Country Link
WO (1) WO2018164327A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012048649A (ja) * 2010-08-30 2012-03-08 Citizen Holdings Co Ltd 体形変化予測装置
KR20120096238A (ko) * 2011-02-22 2012-08-30 주식회사 모르페우스 안면보정 이미지 제공방법 및 그 시스템
JP2014147566A (ja) * 2013-02-01 2014-08-21 Nikon Corp 体型変化予測装置およびプログラム
US20160005106A1 (en) * 2013-02-07 2016-01-07 Crisalix Sa 3d platform for aesthetic simulation
KR20170025162A (ko) * 2015-08-27 2017-03-08 연세대학교 산학협력단 얼굴 영상의 얼굴 나이 변환 방법 및 그 장치

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012048649A (ja) * 2010-08-30 2012-03-08 Citizen Holdings Co Ltd 体形変化予測装置
KR20120096238A (ko) * 2011-02-22 2012-08-30 주식회사 모르페우스 안면보정 이미지 제공방법 및 그 시스템
JP2014147566A (ja) * 2013-02-01 2014-08-21 Nikon Corp 体型変化予測装置およびプログラム
US20160005106A1 (en) * 2013-02-07 2016-01-07 Crisalix Sa 3d platform for aesthetic simulation
KR20170025162A (ko) * 2015-08-27 2017-03-08 연세대학교 산학협력단 얼굴 영상의 얼굴 나이 변환 방법 및 그 장치

Similar Documents

Publication Publication Date Title
KR101918119B1 (ko) 얼굴에 관한 해부학적 레이어를 추정하는 방법, 시스템 및 비일시성의 컴퓨터 판독 가능 기록 매체
EP3123443B1 (fr) Procédé et dispositif permettant de générer une ou plusieurs images de tomographie par ordinateur sur la base des images par résonance magnétique à l'aide de séparation de classe de tissu
JP6947759B2 (ja) 解剖学的対象物を自動的に検出、位置特定、及びセマンティックセグメンテーションするシステム及び方法
CN107669273B (zh) 磁共振设备扫描系统、扫描方法及计算机可读存储介质
US20110007959A1 (en) Ct surrogate by auto-segmentation of magnetic resonance images
CN108701170A (zh) 用于产生解剖部分的三维(3d)视图的图像处理系统和方法
CN111096835A (zh) 一种矫形器设计方法和系统
Wu et al. Estimating the 4D respiratory lung motion by spatiotemporal registration and super‐resolution image reconstruction
CN111462139A (zh) 医学图像显示方法、装置、计算机设备和可读存储介质
EP3500171B1 (fr) Reconstruction d'une image médicale à compensation de mouvement régularisée par un modèle
WO2018164327A1 (fr) Procédé et système d'estimation de couche anatomatique d'un visage, et support d'enregistrement lisible par ordinateur non transitoire
Mukherjee et al. Automatic segmentation of spinal cord MRI using symmetric boundary tracing
Von Siebenthal Analysis and modelling of respiratory liver motion using 4DMRI
WO2018164329A1 (fr) Procédé et système de fourniture d'informations concernant un visage à l'aide d'une couche anatomique et support d'enregistrement non transitoire lisible par ordinateur
WO2018164328A1 (fr) Procédé et système d'estimation de visage au moyen d'une couche anatomique, et support d'enregistrement non transitoire lisible par ordinateur
US20240070857A1 (en) Method for correcting image, electronic device, and storage medium
CN112669405B (zh) 图像重建方法、系统、可读存储介质和设备
Popuri et al. FEM-based automatic segmentation of muscle and fat tissues from thoracic CT images
WO2018164394A1 (fr) Procédé et système permettant de procurer des informations sur le résultat de procédure, support d'enregistrement lisible par ordinateur non transitoire
US11004220B2 (en) Method and device for segmenting images by automatic propagation into an (N+1 )-th dimension of an image segmentation initialized in dimension N
WO2022220318A1 (fr) Méthode de planification de traitement non invasif à l'aide d'une image de tomodensitométrie générée à partir d'une image cérébrale par irm à base d'intelligence artificielle, appareil associé et programme informatique associé
Siebenthal Analysis and modelling of respiratory liver motion using 4DMRI
CN109414233B (zh) 统计乳房模型的生成和个性化
Brioso et al. ARTInp: CBCT-to-CT Image Inpainting and Image Translation in Radiotherapy
Popp et al. Adaptive Contrast Enhancement for Digital Radiographic Images using Image-to-Image Translation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17899691

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 05.12.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 17899691

Country of ref document: EP

Kind code of ref document: A1

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载