EP1256937A3 - Emotion recognition method and device - Google Patents

Emotion recognition method and device Download PDF

Info

Publication number
EP1256937A3
EP1256937A3 EP01401879A EP01401879A EP1256937A3 EP 1256937 A3 EP1256937 A3 EP 1256937A3 EP 01401879 A EP01401879 A EP 01401879A EP 01401879 A EP01401879 A EP 01401879A EP 1256937 A3 EP1256937 A3 EP 1256937A3
Authority
EP
European Patent Office
Prior art keywords
feature
emotion recognition
signal
recognition method
pass filtering
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP01401879A
Other languages
German (de)
French (fr)
Other versions
EP1256937A2 (en
EP1256937B1 (en
Inventor
Pierre-Yves c/o Sony France S.A. Oudeyer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony France SA
Original Assignee
Sony France SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from EP01401203A external-priority patent/EP1256931A1/en
Application filed by Sony France SA filed Critical Sony France SA
Priority to EP01401879A priority Critical patent/EP1256937B1/en
Priority to US10/194,848 priority patent/US7451079B2/en
Priority to JP2002206011A priority patent/JP4458321B2/en
Publication of EP1256937A2 publication Critical patent/EP1256937A2/en
Publication of EP1256937A3 publication Critical patent/EP1256937A3/en
Application granted granted Critical
Publication of EP1256937B1 publication Critical patent/EP1256937B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00—Speech synthesis; Text to speech systems
    • G10L13/02—Methods for producing synthetic speech; Speech synthesisers
    • G10L13/033—Voice editing, e.g. manipulating the voice of the synthesiser
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00—Speech synthesis; Text to speech systems
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00—Speech synthesis; Text to speech systems
    • G10L13/08—Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
    • G10L13/10—Prosody rules derived from text; Stress or intonation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00—Speaker identification or verification
    • G10L17/26—Recognition of special voice characteristics, e.g. for use in lie detectors; Recognition of animal voices
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00—Speech synthesis; Text to speech systems
    • G10L13/02—Methods for producing synthetic speech; Speech synthesisers
    • G10L13/04—Details of speech synthesis systems, e.g. synthesiser structure or memory management

Abstract

The emotion recognition is performed by :
  • extracting (70) a set comprising at least one feature derived from said signal, and
  • processing (84, 90) the set of extracted feature(s) to detect an emotion therefrom.
There is further provided a step of low-pass filtering (74) the voice signal prior to extracting therefrom at least one feature of the set. The cut-off frequency for the low pass filtering is typically centred around 250 Hz.
The features are e.g. statistical quantities extracted from sampling a signal of the intensity or pitch of the voice signal.
EP01401879A 2001-05-11 2001-07-13 Emotion recognition method and device Expired - Lifetime EP1256937B1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP01401879A EP1256937B1 (en) 2001-05-11 2001-07-13 Emotion recognition method and device
US10/194,848 US7451079B2 (en) 2001-07-13 2002-07-12 Emotion recognition method and device
JP2002206011A JP4458321B2 (en) 2001-07-13 2002-07-15 Emotion recognition method and emotion recognition device

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP01401203 2001-05-11
EP01401203A EP1256931A1 (en) 2001-05-11 2001-05-11 Method and apparatus for voice synthesis and robot apparatus
EP01401879A EP1256937B1 (en) 2001-05-11 2001-07-13 Emotion recognition method and device

Publications (3)

Publication Number Publication Date
EP1256937A2 EP1256937A2 (en) 2002-11-13
EP1256937A3 true EP1256937A3 (en) 2004-09-29
EP1256937B1 EP1256937B1 (en) 2006-11-02

Family

ID=8182804

Family Applications (1)

Application Number Title Priority Date Filing Date
EP01401879A Expired - Lifetime EP1256937B1 (en) 2001-05-11 2001-07-13 Emotion recognition method and device

Country Status (3)

Country Link
US (1) US7451079B2 (en)
EP (1) EP1256937B1 (en)
JP (1) JP4458321B2 (en)

Families Citing this family (123)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7925492B2 (en) 2004-01-06 2011-04-12 Neuric Technologies, L.L.C. Method for determining relationships through use of an ordered list between processing nodes in an emulated human brain
US8001067B2 (en) * 2004-01-06 2011-08-16 Neuric Technologies, Llc Method for substituting an electronic emulation of the human brain into an application to replace a human
US20070156625A1 (en) * 2004-01-06 2007-07-05 Neuric Technologies, Llc Method for movie animation
US7089218B1 (en) * 2004-01-06 2006-08-08 Neuric Technologies, Llc Method for inclusion of psychological temperament in an electronic emulation of the human brain
US7113636B2 (en) * 2002-08-30 2006-09-26 Lockheed Martin Corporation Method and computer program product for generating training data for a new class in a pattern recognition classifier
JP4204839B2 (en) * 2002-10-04 2009-01-07 株式会社エイ・ジー・アイ Idea model device, spontaneous emotion model device, idea simulation method, spontaneous emotion simulation method, and program
DE10254612A1 (en) * 2002-11-22 2004-06-17 Humboldt-Universität Zu Berlin Method for determining specifically relevant acoustic characteristics of sound signals for the analysis of unknown sound signals from a sound generation
US7260519B2 (en) * 2003-03-13 2007-08-21 Fuji Xerox Co., Ltd. Systems and methods for dynamically determining the attitude of a natural language speaker
US7013005B2 (en) 2004-02-11 2006-03-14 Hewlett-Packard Development Company, L.P. System and method for prioritizing contacts
DE102004011426B3 (en) * 2004-03-09 2005-05-25 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Device for detecting emotion in voice signal for man-machine interface has first function block using fixed processing script that is emotion recognition standard, second function block for supplying output from input using adapted script
EP1582965A1 (en) 2004-04-01 2005-10-05 Sony Deutschland Gmbh Emotion controlled system for processing multimedia data
US8687792B2 (en) 2004-04-22 2014-04-01 Hewlett-Packard Development Company, L.P. System and method for dialog management within a call handling system
JP4641389B2 (en) * 2004-06-03 2011-03-02 キヤノン株式会社 Information processing method and information processing apparatus
US20050289582A1 (en) * 2004-06-24 2005-12-29 Hitachi, Ltd. System and method for capturing and using biometrics to review a product, service, creative work or thing
US7788104B2 (en) * 2004-09-10 2010-08-31 Panasonic Corporation Information processing terminal for notification of emotion
US7914468B2 (en) * 2004-09-22 2011-03-29 Svip 4 Llc Systems and methods for monitoring and modifying behavior
US20060122834A1 (en) * 2004-12-03 2006-06-08 Bennett Ian M Emotion detection device & method for use in distributed systems
US8473449B2 (en) * 2005-01-06 2013-06-25 Neuric Technologies, Llc Process of dialogue and discussion
WO2006132159A1 (en) * 2005-06-09 2006-12-14 A.G.I. Inc. Speech analyzer detecting pitch frequency, speech analyzing method, and speech analyzing program
US7912720B1 (en) * 2005-07-20 2011-03-22 At&T Intellectual Property Ii, L.P. System and method for building emotional machines
US20080040110A1 (en) * 2005-08-08 2008-02-14 Nice Systems Ltd. Apparatus and Methods for the Detection of Emotions in Audio Interactions
WO2007072485A1 (en) * 2005-12-22 2007-06-28 Exaudios Technologies Ltd. System for indicating emotional attitudes through intonation analysis and methods thereof
US8032375B2 (en) * 2006-03-17 2011-10-04 Microsoft Corporation Using generic predictive models for slot values in language modeling
US7571101B2 (en) * 2006-05-25 2009-08-04 Charles Humble Quantifying psychological stress levels using voice patterns
WO2007138944A1 (en) * 2006-05-26 2007-12-06 Nec Corporation Information giving system, information giving method, information giving program, and information giving program recording medium
CN101346758B (en) * 2006-06-23 2011-07-27 松下电器产业株式会社 Emotion recognizer
US7587260B2 (en) * 2006-07-05 2009-09-08 Battelle Energy Alliance, Llc Autonomous navigation system and method
US7974738B2 (en) * 2006-07-05 2011-07-05 Battelle Energy Alliance, Llc Robotics virtual rail system and method
US7801644B2 (en) * 2006-07-05 2010-09-21 Battelle Energy Alliance, Llc Generic robot architecture
US8271132B2 (en) * 2008-03-13 2012-09-18 Battelle Energy Alliance, Llc System and method for seamless task-directed autonomy for robots
US8965578B2 (en) 2006-07-05 2015-02-24 Battelle Energy Alliance, Llc Real time explosive hazard information sensing, processing, and communication for autonomous operation
US7584020B2 (en) * 2006-07-05 2009-09-01 Battelle Energy Alliance, Llc Occupancy change detection system and method
US7668621B2 (en) * 2006-07-05 2010-02-23 The United States Of America As Represented By The United States Department Of Energy Robotic guarded motion system and method
US7620477B2 (en) * 2006-07-05 2009-11-17 Battelle Energy Alliance, Llc Robotic intelligence kernel
US8073564B2 (en) * 2006-07-05 2011-12-06 Battelle Energy Alliance, Llc Multi-robot control interface
US8355818B2 (en) 2009-09-03 2013-01-15 Battelle Energy Alliance, Llc Robots, systems, and methods for hazard evaluation and visualization
KR101029786B1 (en) * 2006-09-13 2011-04-19 니뽄 덴신 덴와 가부시키가이샤 Emotion detecting method, emotion detecting apparatus, emotion detecting program that implements the same method, and storage medium that stores the same program
US7752043B2 (en) 2006-09-29 2010-07-06 Verint Americas Inc. Multi-pass speech analytics
US20080096532A1 (en) * 2006-10-24 2008-04-24 International Business Machines Corporation Emotional state integrated messaging
US20080115063A1 (en) * 2006-11-13 2008-05-15 Flagpath Venture Vii, Llc Media assembly
US8571853B2 (en) * 2007-02-11 2013-10-29 Nice Systems Ltd. Method and system for laughter detection
US20080249764A1 (en) * 2007-03-01 2008-10-09 Microsoft Corporation Smart Sentiment Classifier for Product Reviews
US8166109B2 (en) * 2007-06-21 2012-04-24 Cisco Technology, Inc. Linking recognized emotions to non-visual representations
US7953279B2 (en) 2007-06-28 2011-05-31 Microsoft Corporation Combining online and offline recognizers in a handwriting recognition system
WO2009009722A2 (en) 2007-07-12 2009-01-15 University Of Florida Research Foundation, Inc. Random body movement cancellation for non-contact vital sign detection
US8180780B2 (en) * 2007-12-06 2012-05-15 International Business Machines Corporation Collaborative program development method and system
US8195460B2 (en) * 2008-06-17 2012-06-05 Voicesense Ltd. Speaker characterization through speech analysis
KR101560833B1 (en) * 2009-01-30 2015-10-15 삼성전자주식회사 Apparatus and method for recognizing emotion using a voice signal
KR101560834B1 (en) * 2009-02-18 2015-10-15 삼성전자주식회사 Apparatus and method for recognizing emotion using a voice signal
US8719016B1 (en) 2009-04-07 2014-05-06 Verint Americas Inc. Speech analytics system and system and method for determining structured speech
WO2011011413A2 (en) * 2009-07-20 2011-01-27 University Of Florida Research Foundation, Inc. Method and apparatus for evaluation of a subject's emotional, physiological and/or physical state with the subject's physiological and/or acoustic data
TWI396105B (en) * 2009-07-21 2013-05-11 Univ Nat Taiwan Digital data processing method for personalized information retrieval and computer readable storage medium and information retrieval system thereof
JP5834449B2 (en) 2010-04-22 2015-12-24 富士通株式会社 Utterance state detection device, utterance state detection program, and utterance state detection method
US8595005B2 (en) 2010-05-31 2013-11-26 Simple Emotion, Inc. System and method for recognizing emotional state from a speech signal
US11393133B2 (en) * 2010-06-07 2022-07-19 Affectiva, Inc. Emoji manipulation using machine learning
AU2010357179A1 (en) 2010-07-06 2013-02-14 Rmit University Emotional and/or psychiatric state detection
GB2481992A (en) * 2010-07-13 2012-01-18 Sony Europe Ltd Updating text-to-speech converter for broadcast signal receiver
US8731932B2 (en) * 2010-08-06 2014-05-20 At&T Intellectual Property I, L.P. System and method for synthetic voice generation and modification
EP2418643A1 (en) * 2010-08-11 2012-02-15 Software AG Computer-implemented method and system for analysing digital speech data
CN102479291A (en) * 2010-11-30 2012-05-30 国际商业机器公司 Methods and devices for generating and experiencing emotion description, and emotion interactive system
EP2659486B1 (en) * 2010-12-30 2016-03-23 Nokia Technologies Oy Method, apparatus and computer program for emotion detection
CN102637433B (en) * 2011-02-09 2015-11-25 富士通株式会社 The method and system of the affective state carried in recognition of speech signals
JP5803125B2 (en) * 2011-02-10 2015-11-04 富士通株式会社 Suppression state detection device and program by voice
US9491537B2 (en) * 2011-07-26 2016-11-08 Harman Becker Automotive Systems Gmbh Noise reducing sound reproduction system
EP2551846B1 (en) * 2011-07-26 2022-01-19 AKG Acoustics GmbH Noise reducing sound reproduction
GB2494104A (en) * 2011-08-19 2013-03-06 Simon Mark Adam Bell Recognizing the emotional effect a speaker is having on a listener by analyzing the sound of his or her voice
KR101901417B1 (en) * 2011-08-29 2018-09-27 한국전자통신연구원 System of safe driving car emotion cognitive-based and method for controlling the same
US20130174018A1 (en) * 2011-09-13 2013-07-04 Cellpy Com. Ltd. Pyramid representation over a network
KR20130055429A (en) * 2011-11-18 2013-05-28 삼성전자주식회사 Apparatus and method for emotion recognition based on emotion segment
TWI473080B (en) * 2012-04-10 2015-02-11 Nat Univ Chung Cheng The use of phonological emotions or excitement to assist in resolving the gender or age of speech signals
US9002768B2 (en) * 2012-05-12 2015-04-07 Mikhail Fedorov Human-computer interface system
CN102779510B (en) * 2012-07-19 2013-12-18 东南大学 Speech emotion recognition method based on feature space self-adaptive projection
US8984065B2 (en) 2012-08-01 2015-03-17 Eharmony, Inc. Systems and methods for online matching using non-self-identified data
US20140188552A1 (en) * 2013-01-02 2014-07-03 Lap Chan Methods and systems to reach target customers at the right time via personal and professional mood analysis
TWI573129B (en) * 2013-02-05 2017-03-01 國立交通大學 Streaming encoder, prosody information encoding device, prosody-analyzing device, and device and method for speech-synthesizing
US9472207B2 (en) 2013-06-20 2016-10-18 Suhas Gondi Portable assistive device for combating autism spectrum disorders
IN2013CH04602A (en) * 2013-10-10 2015-10-09 3Gs Wellness Pvt Ltd
EP3057493B1 (en) * 2013-10-20 2020-06-24 Massachusetts Institute Of Technology Using correlation structure of speech dynamics to detect neurological changes
CN103531198B (en) * 2013-11-01 2016-03-23 东南大学 A kind of speech emotion feature normalization method based on pseudo-speaker clustering
KR102191306B1 (en) * 2014-01-22 2020-12-15 삼성전자주식회사 System and method for recognition of voice emotion
WO2015116678A1 (en) 2014-01-28 2015-08-06 Simple Emotion, Inc. Methods for adaptive voice interaction
US10939175B2 (en) 2014-03-11 2021-03-02 Amazon Technologies, Inc. Generating new video content from pre-recorded video
US9747727B2 (en) 2014-03-11 2017-08-29 Amazon Technologies, Inc. Object customization and accessorization in video content
US9894405B2 (en) 2014-03-11 2018-02-13 Amazon Technologies, Inc. Object discovery and exploration in video content
US10375434B2 (en) 2014-03-11 2019-08-06 Amazon Technologies, Inc. Real-time rendering of targeted video content
US9892556B2 (en) 2014-03-11 2018-02-13 Amazon Technologies, Inc. Real-time exploration of video content
US9697843B2 (en) 2014-04-30 2017-07-04 Qualcomm Incorporated High band excitation signal generation
US9393486B2 (en) 2014-06-27 2016-07-19 Amazon Technologies, Inc. Character simulation and playback notification in game session replay
US10092833B2 (en) 2014-06-27 2018-10-09 Amazon Technologies, Inc. Game session sharing
US9409083B2 (en) 2014-06-27 2016-08-09 Amazon Technologies, Inc. Spawning new timelines during game session replay
WO2016047494A1 (en) * 2014-09-22 2016-03-31 株式会社 東芝 Device and system for measuring biological information
US9667786B1 (en) 2014-10-07 2017-05-30 Ipsoft, Inc. Distributed coordinated system and process which transforms data into useful information to help a user with resolving issues
WO2016057781A1 (en) 2014-10-08 2016-04-14 The University Of Florida Research Foundation, Inc. Method and apparatus for non-contact fast vital sign acquisition based on radar signal
US9269374B1 (en) 2014-10-27 2016-02-23 Mattersight Corporation Predictive video analytics system and methods
US9589107B2 (en) 2014-11-17 2017-03-07 Elwha Llc Monitoring treatment compliance using speech patterns passively captured from a patient environment
US10430557B2 (en) 2014-11-17 2019-10-01 Elwha Llc Monitoring treatment compliance using patient activity patterns
US9585616B2 (en) 2014-11-17 2017-03-07 Elwha Llc Determining treatment compliance using speech patterns passively captured from a patient environment
US9786299B2 (en) 2014-12-04 2017-10-10 Microsoft Technology Licensing, Llc Emotion type classification for interactive dialog system
US9833200B2 (en) 2015-05-14 2017-12-05 University Of Florida Research Foundation, Inc. Low IF architectures for noncontact vital sign detection
US10300394B1 (en) 2015-06-05 2019-05-28 Amazon Technologies, Inc. Spectator audio analysis in online gaming environments
US10293260B1 (en) 2015-06-05 2019-05-21 Amazon Technologies, Inc. Player audio analysis in online gaming environments
CN104851422A (en) * 2015-06-09 2015-08-19 张维秀 Voice signal processing method and system
US10970843B1 (en) 2015-06-24 2021-04-06 Amazon Technologies, Inc. Generating interactive content using a media universe database
US10864447B1 (en) 2015-06-29 2020-12-15 Amazon Technologies, Inc. Highlight presentation interface in a game spectating system
US10363488B1 (en) 2015-06-29 2019-07-30 Amazon Technologies, Inc. Determining highlights in a game spectating system
US10484439B2 (en) 2015-06-30 2019-11-19 Amazon Technologies, Inc. Spectating data service for a spectating system
US11071919B2 (en) 2015-06-30 2021-07-27 Amazon Technologies, Inc. Joining games from a spectating system
US10390064B2 (en) 2015-06-30 2019-08-20 Amazon Technologies, Inc. Participant rewards in a spectating system
US10345897B2 (en) 2015-06-30 2019-07-09 Amazon Technologies, Inc. Spectator interactions with games in a specatating system
US10632372B2 (en) 2015-06-30 2020-04-28 Amazon Technologies, Inc. Game content interface in a spectating system
US10376795B2 (en) 2015-06-30 2019-08-13 Amazon Technologies, Inc. Game effects from spectating community inputs
KR102437689B1 (en) 2015-09-16 2022-08-30 삼성전자주식회사 Voice recognition sever and control method thereof
CN105575404A (en) * 2016-01-25 2016-05-11 薛明博 Psychological testing method and psychological testing system based on speed recognition
JP6726388B2 (en) * 2016-03-16 2020-07-22 富士ゼロックス株式会社 Robot control system
US10244113B2 (en) * 2016-04-26 2019-03-26 Fmr Llc Determining customer service quality through digitized voice characteristic measurement and filtering
US10176793B2 (en) * 2017-02-14 2019-01-08 Mediatek Inc. Method, active noise control circuit, and portable electronic device for adaptively performing active noise control operation upon target zone
CN108806667B (en) * 2018-05-29 2020-04-17 重庆大学 Synchronous recognition method of voice and emotion based on neural network
JP7159655B2 (en) * 2018-07-09 2022-10-25 富士フイルムビジネスイノベーション株式会社 Emotion estimation system and program
CN110826358B (en) * 2018-08-08 2022-12-06 杭州海康威视数字技术股份有限公司 Animal emotion recognition method and device and storage medium
JP2020056918A (en) * 2018-10-02 2020-04-09 パナソニックＩｐマネジメント株式会社 Sound data learning system, sound data learning method and sound data learning device
TWI704555B (en) * 2018-11-27 2020-09-11 誠屏科技股份有限公司 Emotion recognition apparatus and method
CN111179965A (en) * 2020-03-20 2020-05-19 万不知 Pet emotion recognition method and system
CN112837702A (en) * 2020-12-31 2021-05-25 萨孚凯信息系统(无锡)有限公司 Voice emotion distributed system and voice signal processing method

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3855416A (en) * 1972-12-01 1974-12-17 F Fuller Method and apparatus for phonation analysis leading to valid truth/lie decisions by fundamental speech-energy weighted vibratto component assessment
US4142067A (en) * 1977-06-14 1979-02-27 Williamson John D Speech analyzer for analyzing frequency perturbations in a speech pattern to determine the emotional state of a person

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3070698D1 (en) * 1979-05-28 1985-07-04 Univ Melbourne Speech processor
US4532930A (en) * 1983-04-11 1985-08-06 Commonwealth Of Australia, Dept. Of Science & Technology Cochlear implant system for an auditory prosthesis
US5918222A (en) * 1995-03-17 1999-06-29 Kabushiki Kaisha Toshiba Information disclosing apparatus and multi-modal information input/output system
US6109923A (en) * 1995-05-24 2000-08-29 Syracuase Language Systems Method and apparatus for teaching prosodic features of speech
US6577998B1 (en) * 1998-09-01 2003-06-10 Image Link Co., Ltd Systems and methods for communicating through computer animated images
US6006188A (en) * 1997-03-19 1999-12-21 Dendrite, Inc. Speech signal processing for determining psychological or physiological characteristics using a knowledge base
KR100291584B1 (en) * 1997-12-12 2001-06-01 이봉훈 Speech waveform compressing method by similarity of fundamental frequency/first formant frequency ratio per pitch interval
US7590538B2 (en) * 1999-08-31 2009-09-15 Accenture Llp Voice recognition system for navigating on the internet
US6275806B1 (en) * 1999-08-31 2001-08-14 Andersen Consulting, Llp System method and article of manufacture for detecting emotion in voice signals by utilizing statistics for voice signal parameters
US6697457B2 (en) * 1999-08-31 2004-02-24 Accenture Llp Voice messaging system that organizes voice messages based on detected emotion
JP2001154681A (en) * 1999-11-30 2001-06-08 Sony Corp Device and method for voice processing and recording medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3855416A (en) * 1972-12-01 1974-12-17 F Fuller Method and apparatus for phonation analysis leading to valid truth/lie decisions by fundamental speech-energy weighted vibratto component assessment
US4142067A (en) * 1977-06-14 1979-02-27 Williamson John D Speech analyzer for analyzing frequency perturbations in a speech pattern to determine the emotional state of a person

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
DATABASE BIOSIS [online] BIOSCIENCES INFORMATION SERVICE, PHILADELPHIA, PA, US; 1986, VAN BEZOOIJEN R ET AL: "THE EFFECTS OF LOW-PASS FILTERING AND RANDOM SPLICING ON THE PERCEPTION OF SPEECH", XP002289963, Database accession no. PREV198783009008 *
GUDRUN KLASMEYER: "AN AUTOMATIC DESCRIPTION TOOL FOR TIME CONTOURS AND LONG-TERM AVERAGE VOICE FEATURES IN LARGE EMOTIONAL SPEECH DATABASES", ISCA WORKSHOP ON SPEECH AND EMOTION, 5 September 2000 (2000-09-05) - 7 September 2000 (2000-09-07), BELFAST, pages 1 - 6, XP007005767 *
JOURNAL OF PSYCHOLINGUISTIC RESEARCH, vol. 15, no. 5, 1986, pages 403 - 418, ISSN: 0090-6905 *
K.R. SCHERER, T. JOHNSTONE, J. SANGSUE: "L'état émotionnel du locuteur: facteur négligé mais non négligeable pour la technologie de la parole", ACTES DES XXIIIÈMES JOURNÉES D'ÉTUDES SUR LA PAROLE, 1998, MARTIGNY, SWITZERLAND, pages 1 - 9, XP002289960 *
MCNALLY RICHARD J ET AL: "The voice of emotional memory: Content-filtered speech in panic disorder, social phobia, and major depressive disorder", BEHAVIOUR RESEARCH AND THERAPY, vol. 39, no. 11, November 2001 (2001-11-01), pages 1329 - 1337, XP002289962, ISSN: 0005-7967 *
SINÉAD MCGILLOWAY, RODDY COWIE, ELLEN DOUGLAS-COWIE, STAN GIELEN, MACHIEL WESTERDIJK, SYBERT STROEVE: "Approaching Automatic Recognition of Emotion from Voice: a Rough Benchmark", ISCA WORKSHOP ON SPEECH AND EMOTION, PROCEEDINGS ONLINE, 5 September 2000 (2000-09-05) - 7 September 2000 (2000-09-07), BELFAST, pages 1 - 8, XP002289961, Retrieved from the Internet <URL:http://www.qub.ac.uk/en/tsca/proceedings/pdfs/mcilloway.pdf> [retrieved on 20040723] *

Also Published As

Publication number Publication date
JP4458321B2 (en) 2010-04-28
US20030055654A1 (en) 2003-03-20
EP1256937A2 (en) 2002-11-13
JP2003099084A (en) 2003-04-04
EP1256937B1 (en) 2006-11-02
US7451079B2 (en) 2008-11-11

Similar Documents

Publication Publication Date Title
EP1256937A3 (en) Emotion recognition method and device
WO2001020965A3 (en) Method for determining a current acoustic environment, use of said method and a hearing-aid
EP1843324A3 (en) Speech signal pre-processing system and method of extracting characteristic information of speech signal
EP0871036A3 (en) Front-end architecture for a measurement instrument
DE69920461D1 (en) Method and device for robust feature extraction for speech recognition
WO2002043613A3 (en) Method and apparatus for monitoring eye tremor
EP2068308A3 (en) Signal separation method, signal separation device, and signal separation program
EP1271355A3 (en) Auto-index method
EP1471767A3 (en) Method and system for acoustic shock protection
EP1488861A3 (en) Vibration source driving device
WO2003013336A3 (en) Devices and method for extraction of bone marrow
DE60033549D1 (en) METHOD AND DEVICES FOR ANALYZING SIGNALS
SG140445A1 (en) Method and apparatus for automatically recognizing audio data
EP0831456A3 (en) Speech recognition method and apparatus therefor
EP1403783A3 (en) Audio signal feature extraction
EP1267590A3 (en) Contents presenting system and method
EP1160768A3 (en) Robust features extraction for speech processing
EP2404875A3 (en) System and method for conversion of molybdenite to one or more molybdenum oxides
EP1028390A3 (en) Data processing method and apparatus
WO2002037525A3 (en) A probe assembly for detecting an ion in a plasma generated in an ion source
WO2003085109A3 (en) Method and apparatus for extracting nucleic acids from a complex mixture
EP1310916A3 (en) Method and apparatus generating analysis mesh data
EP1258894A3 (en) Capacitor grade powders
AU2284399A (en) Method for transforming plasma and implementing device
ATE273552T1 (en) DEVICE AND METHOD FOR ANALYZING A VOICE SIGNAL

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

AX Request for extension of the european patent

Free format text: AL;LT;LV;MK;RO;SI

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

RIC1 Information provided on ipc code assigned before grant

Ipc: 7G 10L 17/00 A

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

AX Request for extension of the european patent

Extension state: AL LT LV MK RO SI

17P Request for examination filed

Effective date: 20050222

17Q First examination report despatched

Effective date: 20050412

AKX Designation fees paid

Designated state(s): DE FR GB

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: G10L 17/00 20060101ALI20060214BHEP

Ipc: G10L 15/18 20060101AFI20060214BHEP

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE FR GB

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 60124225

Country of ref document: DE

Date of ref document: 20061214

Kind code of ref document: P

ET Fr: translation filed
PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20070803

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20120719

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20120806

Year of fee payment: 12

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20130713

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20140331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130713

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130731

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20140721

Year of fee payment: 14

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 60124225

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160202