+

WO2002039371A3 - Estimation of facial expression intensity using a bidirectional star topology hidden markov model - Google Patents

Estimation of facial expression intensity using a bidirectional star topology hidden markov model Download PDF

Info

Publication number
WO2002039371A3
WO2002039371A3 PCT/EP2001/012346 EP0112346W WO0239371A3 WO 2002039371 A3 WO2002039371 A3 WO 2002039371A3 EP 0112346 W EP0112346 W EP 0112346W WO 0239371 A3 WO0239371 A3 WO 0239371A3
Authority
WO
WIPO (PCT)
Prior art keywords
expression
state
facial expression
hidden markov
markov model
Prior art date
Application number
PCT/EP2001/012346
Other languages
French (fr)
Other versions
WO2002039371A2 (en
Inventor
Antonio J Colmenarez
Srinivas Gutta
Original Assignee
Koninkl Philips Electronics Nv
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninkl Philips Electronics Nv filed Critical Koninkl Philips Electronics Nv
Priority to JP2002541616A priority Critical patent/JP2004513462A/en
Priority to EP01993900A priority patent/EP1342206A2/en
Publication of WO2002039371A2 publication Critical patent/WO2002039371A2/en
Publication of WO2002039371A3 publication Critical patent/WO2002039371A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/29—Graphical models, e.g. Bayesian networks
    • G06F18/295—Markov models or related models, e.g. semi-Markov models; Markov random fields; Networks embedding Markov models

Landscapes

  • Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Image Analysis (AREA)
  • Processing Or Creating Images (AREA)

Abstract

An image processing system processes a sequence of images using a bidirectional star topology hidden Markov model (HMM) to estimate facial expression intensity or other characteristics. The HMM has at least one neutral expression state and a plurality of expression paths emanating from the neutral expression state. Each of the expression paths includes a number of states associated with a corresponding facial expression, such as sad, happy, anger, fear, disgust and surprise. A given expression path may include an initial state coupled to the neutral state and a final state associated with an apex of the corresponding expression. The given path further includes a forward path from the initial state to the final state, associated with an onset of the expression, and a return path from the final state to the initial state, associated with an offset of the expression. Control of one or more actions in the image processing system may be based at least in part on which of the facial expressions supported by the model is determined to be present in the sequence of images and/or the intensity or other characteristic of that facial expression.
PCT/EP2001/012346 2000-11-03 2001-10-23 Estimation of facial expression intensity using a bidirectional star topology hidden markov model WO2002039371A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2002541616A JP2004513462A (en) 2000-11-03 2001-10-23 Method and apparatus for estimating facial expression strength using hidden Markov model with bidirectional star topology
EP01993900A EP1342206A2 (en) 2000-11-03 2001-10-23 Estimation of facial expression intensity using a bidirectional star topology hidden markov model

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US70566600A 2000-11-03 2000-11-03
US09/705,666 2000-11-03

Publications (2)

Publication Number Publication Date
WO2002039371A2 WO2002039371A2 (en) 2002-05-16
WO2002039371A3 true WO2002039371A3 (en) 2002-08-01

Family

ID=24834448

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2001/012346 WO2002039371A2 (en) 2000-11-03 2001-10-23 Estimation of facial expression intensity using a bidirectional star topology hidden markov model

Country Status (3)

Country Link
EP (1) EP1342206A2 (en)
JP (1) JP2004513462A (en)
WO (1) WO2002039371A2 (en)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004042539A2 (en) * 2002-11-07 2004-05-21 Honda Motor Co., Ltd. Video-based face recognition using probabilistic appearance manifolds
FR2856079B1 (en) * 2003-06-11 2006-07-14 Pechiney Rhenalu SURFACE TREATMENT METHOD FOR ALUMINUM ALLOY TILES AND BANDS
JP4571628B2 (en) * 2003-06-30 2010-10-27 本田技研工業株式会社 Face recognition system and method
WO2005006278A2 (en) 2003-06-30 2005-01-20 Honda Motor Co., Ltd. Systems and methods for training component-based object identification systems
US7607097B2 (en) 2003-09-25 2009-10-20 International Business Machines Corporation Translating emotion to braille, emoticons and other special symbols
US20070060830A1 (en) * 2005-09-12 2007-03-15 Le Tan Thi T Method and system for detecting and classifying facial muscle movements
US8478711B2 (en) 2011-02-18 2013-07-02 Larus Technologies Corporation System and method for data fusion with adaptive learning
KR101901591B1 (en) * 2011-11-01 2018-09-28 삼성전자주식회사 Face recognition apparatus and control method for the same
TWI457872B (en) * 2011-11-15 2014-10-21 Univ Nat Taiwan Normal Testing system and method having face expressions recognizing auxiliary
KR101309954B1 (en) 2012-07-20 2013-09-17 고려대학교 산학협력단 Apparatus and method for recognizing conversational expression, recording medium thereof
CN103971131A (en) * 2014-05-13 2014-08-06 华为技术有限公司 Preset facial expression recognition method and device
US9269374B1 (en) 2014-10-27 2016-02-23 Mattersight Corporation Predictive video analytics system and methods
KR102520627B1 (en) * 2017-02-01 2023-04-12 삼성전자주식회사 Apparatus and method and for recommending products
CN112862936B (en) * 2021-03-16 2023-08-08 网易（杭州）网络有限公司 Expression model processing method and device, electronic equipment and storage medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
CUZZOLIN, F. ET AL: "Towards Unsupervised Detection of Actions in Clutter", TECH. REPORT UCLA, 4 December 2000 (2000-12-04), XP002198616, Retrieved from the Internet <URL:http://www.vision.cs.ucla.edu/papers/action.pdf> [retrieved on 20020510] *
IRA COHEN: "Automatic facial expression recognition from video sequences using temporal information", MASTER THESIS, May 2000 (2000-05-01), Urbana, USA, XP002198614, Retrieved from the Internet <URL:http://www.ifp.uiuc.edu/~iracohen/publications/thesismain.pdf> [retrieved on 20020510] *
MATTHEW BRAND: "Learningg Consise Models of HumanActivity from Ambient Video ia a Structure-Inducing M-Step Estimator", MITSUBISHI ELECTRIC RESEARCH LABORATORY TECHNICAL REPORT, November 1997 (1997-11-01), Cambridge, MA, USA, XP002198615, Retrieved from the Internet <URL:http://www.merl.com/papers/docs/TR97-25.pdf> [retrieved on 20020510] *

Also Published As

Publication number Publication date
WO2002039371A2 (en) 2002-05-16
JP2004513462A (en) 2004-04-30
EP1342206A2 (en) 2003-09-10

Similar Documents

Publication Publication Date Title
WO2002039371A3 (en) Estimation of facial expression intensity using a bidirectional star topology hidden markov model
US6889117B2 (en) Robot apparatus and method and system for controlling the action of the robot apparatus
CN110013671A (en) Movement executes method and apparatus, storage medium and electronic device
WO2002065219A3 (en) A system for motion control, method of using the system for motion control, and computer-readable instructions for use with the system for motion control
GB9602431D0 (en) Interactive audio entertainment apparatus
WO1999021172A3 (en) Pattern recognition enrolment in a distributed system
WO2006127670A3 (en) Virtual reality movement system
WO2004015908A3 (en) Control systems and methods using a partially-observable markov decision process (po-mdp)
CN110201387A (en) Object control method and apparatus, storage medium and electronic device
WO2003021788A3 (en) Component-based, adaptive stroke-order system
WO2002004110A3 (en) Method for preparing an acid catalyst based on mass sulphated zirconium, catalyst obtainable by said method and uses thereof
EP2233255A2 (en) Data transformation network apparatus and robot controlling system and method using the same
WO2002013400A3 (en) Flexible preamble processing
WO2000079381A3 (en) Indefinite-size variables within an intermediate language
ATE333679T1 (en) CROSSBAR EXCHANGE, ASSOCIATED OPERATION CONTROL METHOD AND PROGRAM
EP1089501A3 (en) Arbitration mechanism for packet transmission
Koropeckyj et al. Ukraine in Blackface: Performance and Representation in Gogol'’s Dikan'ka Tales, Book 1
WO2005086602A3 (en) Online game method and online game system
CN113262507B (en) Weapon toy
CN108127664A (en) Interactive game NPC robots
Ekman Happy, sad, angry, disgusted.
JP2022142369A5 (en)
CN210786208U (en) Handle touch device of VR all-in-one of shutter release driven
JP2022148674A5 (en)
JP2022148672A5 (en)

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): JP

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

ENP Entry into the national phase

Ref country code: JP

Ref document number: 2002 541616

Kind code of ref document: A

Format of ref document f/p: F

AK Designated states

Kind code of ref document: A3

Designated state(s): JP

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

WWE Wipo information: entry into national phase

Ref document number: 2001993900

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWP Wipo information: published in national office

Ref document number: 2001993900

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 2001993900

Country of ref document: EP

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载