+

WO2002009038A3 - Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image - Google Patents

Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image Download PDF

Info

Publication number
WO2002009038A3
WO2002009038A3 PCT/US2001/023337 US0123337W WO0209038A3 WO 2002009038 A3 WO2002009038 A3 WO 2002009038A3 US 0123337 W US0123337 W US 0123337W WO 0209038 A3 WO0209038 A3 WO 0209038A3
Authority
WO
WIPO (PCT)
Prior art keywords
face image
facial feature
feature tracking
neutral face
customizing
Prior art date
Application number
PCT/US2001/023337
Other languages
French (fr)
Other versions
WO2002009038A2 (en
Inventor
Ulrich F Buddenmeier
Hartmut Neven
Original Assignee
Eyematic Interfaces Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eyematic Interfaces Inc filed Critical Eyematic Interfaces Inc
Priority to AU7714801A priority Critical patent/AU7714801A/en
Priority to JP2002514665A priority patent/JP2004505353A/en
Priority to EP01954934A priority patent/EP1303842A2/en
Priority to AU2001277148A priority patent/AU2001277148B2/en
Priority to KR1020037001107A priority patent/KR100827939B1/en
Publication of WO2002009038A2 publication Critical patent/WO2002009038A2/en
Publication of WO2002009038A3 publication Critical patent/WO2002009038A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/97—Determining parameters from multiple pictures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/42—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
    • G06V10/422—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation for representing the structure of the pattern or shape of an object therefor
    • G06V10/426—Graphical representations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20048—Transform domain processing
    • G06T2207/20064—Wavelet transform [DWT]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

The present invention is embodied in a method and system for customizing a visual sensor for facial feature tracking using a neutral face image of an actor. The method may include generating a corrector graph to improve the sensor's performance in tracking an actor's facial features.
PCT/US2001/023337 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image WO2002009038A2 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
AU7714801A AU7714801A (en) 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmarkfinding on a neutral face image
JP2002514665A JP2004505353A (en) 2000-07-24 2001-07-24 Facial feature special method and device by accurate landmark detection on expressionless facial image
EP01954934A EP1303842A2 (en) 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image
AU2001277148A AU2001277148B2 (en) 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image
KR1020037001107A KR100827939B1 (en) 2000-07-24 2001-07-24 Methods and systems for customizing facial feature tracking using precision landmark discovery on expressionless face images

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US22028800P 2000-07-24 2000-07-24
US60/220,288 2000-07-24

Publications (2)

Publication Number Publication Date
WO2002009038A2 WO2002009038A2 (en) 2002-01-31
WO2002009038A3 true WO2002009038A3 (en) 2002-06-27

Family

ID=22822939

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/023337 WO2002009038A2 (en) 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image

Country Status (5)

Country Link
EP (1) EP1303842A2 (en)
JP (1) JP2004505353A (en)
KR (1) KR100827939B1 (en)
AU (2) AU7714801A (en)
WO (1) WO2002009038A2 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101783453B1 (en) 2015-10-05 2017-09-29 (주)감성과학연구센터 Method and Apparatus for extracting information of facial movement based on Action Unit
KR101823611B1 (en) 2015-10-05 2018-01-31 주식회사 감성과학연구센터 Method for extracting Emotional Expression information based on Action Unit
KR20250062029A (en) 2023-10-30 2025-05-08 광운대학교 산학협력단 Method of detecting image frames of facial expression and expressionless state in dynamic video, diagnostic evaluation method and system for grading facial paralysis using the same
KR20250062030A (en) 2023-10-30 2025-05-08 광운대학교 산학협력단 Method of evaluating facial symmetry using landmark vectors in dynamic video, diagnostic evaluation method for grading facial paralysis using the same

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999053443A1 (en) * 1998-04-13 1999-10-21 Eyematic Interfaces, Inc. Wavelet-based facial motion capture for avatar animation
US6031539A (en) * 1997-03-10 2000-02-29 Digital Equipment Corporation Facial image method and apparatus for semi-automatically mapping a face on to a wireframe topology

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6031539A (en) * 1997-03-10 2000-02-29 Digital Equipment Corporation Facial image method and apparatus for semi-automatically mapping a face on to a wireframe topology
WO1999053443A1 (en) * 1998-04-13 1999-10-21 Eyematic Interfaces, Inc. Wavelet-based facial motion capture for avatar animation

Also Published As

Publication number Publication date
JP2004505353A (en) 2004-02-19
EP1303842A2 (en) 2003-04-23
AU2001277148B2 (en) 2007-09-20
KR20030041131A (en) 2003-05-23
KR100827939B1 (en) 2008-05-13
WO2002009038A2 (en) 2002-01-31
AU7714801A (en) 2002-02-05

Similar Documents

Publication Publication Date Title
EP1221673A3 (en) Method and device for generating a person's portrait and communications terminal using the same
AU5997200A (en) Head tracker system
WO2004023783A3 (en) Single-camera tracking of an object
MX9710303A (en) A system for enhancing the television presentation of an object at a sporting event.
EP1416002A3 (en) Method of separating fluoropolymer from a solution therof and carbon dioxide
EP1130907A3 (en) Infrared sensor temperature compensated response and offset correction
BR9909611B1 (en) Method and apparatus for detecting facial features in a sequence of image frames comprising an image of a face.
CA2398704A1 (en) Attitude estimation in tiltable body using modified quaternion data representation
WO2001022872A3 (en) A system and method for estimating the orientation of an object
WO2004072681A3 (en) Locating object using stereo vision
WO1998043105A3 (en) Object tracking system using statistical modeling and geometric relationship
WO2001069535A3 (en) Method and apparatus for performing geo-spatial registration of imagery
AU5162498A (en) Infrastructure independent position determining system
AU2124297A (en) Method and system for the creation of and navigation through a multidimensional space using encoded digital video
WO2002005013A3 (en) Impaired vision assist system and method
WO2001031570A3 (en) Tracking motion of a writing instrument
EP1304866A3 (en) Digital image sequence display system and method
WO1999014936A3 (en) A method and system for digital image stamp positioning
WO1999006950A3 (en) Scanning apparatus and methods
EP0913810A3 (en) Feature extraction and pattern recognition
EP1206118A3 (en) Image processing apparatus, image processing method and recording medium
WO2002032107A3 (en) Method for the graphical representation of motion in video in still images
EP0786907A3 (en) Video encoder
EP0818928A3 (en) Method and apparatus for encoding a contour of an object in a video signal
WO2002009038A3 (en) Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWE Wipo information: entry into national phase

Ref document number: 2001277148

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 1020037001107

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 2001954934

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2001954934

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1020037001107

Country of ref document: KR

WWW Wipo information: withdrawn in national office

Ref document number: 2001954934

Country of ref document: EP

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载