EP1256932A3 - Method and apparatus for synthesising an emotion conveyed on a sound - Google Patents

Method and apparatus for synthesising an emotion conveyed on a sound Download PDF

Info

Publication number
EP1256932A3
EP1256932A3 EP01401880A EP01401880A EP1256932A3 EP 1256932 A3 EP1256932 A3 EP 1256932A3 EP 01401880 A EP01401880 A EP 01401880A EP 01401880 A EP01401880 A EP 01401880A EP 1256932 A3 EP1256932 A3 EP 1256932A3
Authority
EP
European Patent Office
Prior art keywords
operator
sound
elementary
elementary sound
pitch
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP01401880A
Other languages
German (de)
French (fr)
Other versions
EP1256932B1 (en
EP1256932A2 (en
Inventor
Pierre-Yves c/o Sony France S.A. Oudeyer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony France SA
Original Assignee
Sony France SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from EP01401203A external-priority patent/EP1256931A1/en
Application filed by Sony France SA filed Critical Sony France SA
Priority to EP20010401880 priority Critical patent/EP1256932B1/en
Priority to EP20010402176 priority patent/EP1256933B1/en
Priority to DE2001631521 priority patent/DE60131521T2/en
Priority to US10/192,974 priority patent/US20030093280A1/en
Priority to JP2002206012A priority patent/JP2003084800A/en
Priority to JP2002206013A priority patent/JP2003177772A/en
Publication of EP1256932A2 publication Critical patent/EP1256932A2/en
Publication of EP1256932A3 publication Critical patent/EP1256932A3/en
Publication of EP1256932B1 publication Critical patent/EP1256932B1/en
Application granted granted Critical
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00—Speech synthesis; Text to speech systems
    • G10L13/02—Methods for producing synthetic speech; Speech synthesisers
    • G10L13/033—Voice editing, e.g. manipulating the voice of the synthesiser
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00—Speech synthesis; Text to speech systems
    • G10L13/08—Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
    • G10L13/10—Prosody rules derived from text; Stress or intonation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00—Speech synthesis; Text to speech systems
    • G10L13/02—Methods for producing synthetic speech; Speech synthesisers
    • G10L13/04—Details of speech synthesis systems, e.g. synthesiser structure or memory management

Abstract

An emotion conveyed on a sound is synthesised by selectively modifying elementary sound portions (S) thereof prior to delivering the sound through an operator application step (S10, S16, S20) in which at least one operator (OP, OD; OI) is selectively applied to the elementary sound portions (S) to impose a specific modification in a characteristic, such as pitch and/or duration in accordance with an emotion to be synthesised.
This can be achieved by applying at least one operator (OIrs, OIfs, OIsu, OIsd) to modify an intensity characteristic of an elementary sound portion, and/or an operator (OPrs, OPfs) for selectively causing the time evolution of the pitch of an elementary sound portion (S) to rise or fall according to an imposed slope characteristic (Prs, Pfs), and/or an operator (OPsu, OPsd) for selectively causing the time evolution of the pitch of an elementary sound portion (S) to rise or fall uniformly by a determined value (Psu, Psd), and/or an operator (ODd, ODc) for selectively causing the duration (tl) of an elementary sound portion (S) to increase or decrease by a determined value (D).
Figure 00000001
EP20010401880 2001-05-11 2001-07-13 Method and apparatus for synthesising an emotion conveyed on a sound Expired - Lifetime EP1256932B1 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
EP20010401880 EP1256932B1 (en) 2001-05-11 2001-07-13 Method and apparatus for synthesising an emotion conveyed on a sound
EP20010402176 EP1256933B1 (en) 2001-05-11 2001-08-14 Method and apparatus for controlling the operation of an emotion synthesising device
DE2001631521 DE60131521T2 (en) 2001-05-11 2001-08-14 Method and device for controlling the operation of a device or a system, and system having such a device and computer program for carrying out the method
US10/192,974 US20030093280A1 (en) 2001-07-13 2002-07-11 Method and apparatus for synthesising an emotion conveyed on a sound
JP2002206012A JP2003084800A (en) 2001-07-13 2002-07-15 Method and apparatus for synthesizing emotion conveyed on sound
JP2002206013A JP2003177772A (en) 2001-07-13 2002-07-15 Method and apparatus for controlling operation of emotion synthesizing device

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP01401203 2001-05-11
EP01401203A EP1256931A1 (en) 2001-05-11 2001-05-11 Method and apparatus for voice synthesis and robot apparatus
EP20010401880 EP1256932B1 (en) 2001-05-11 2001-07-13 Method and apparatus for synthesising an emotion conveyed on a sound

Publications (3)

Publication Number Publication Date
EP1256932A2 EP1256932A2 (en) 2002-11-13
EP1256932A3 true EP1256932A3 (en) 2004-10-13
EP1256932B1 EP1256932B1 (en) 2006-05-10

Family

ID=26077240

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20010401880 Expired - Lifetime EP1256932B1 (en) 2001-05-11 2001-07-13 Method and apparatus for synthesising an emotion conveyed on a sound

Country Status (2)

Country Link
EP (1) EP1256932B1 (en)
DE (1) DE60131521T2 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7809572B2 (en) 2005-07-20 2010-10-05 Panasonic Corporation Voice quality change portion locating apparatus
CN101901598A (en) * 2010-06-30 2010-12-01 北京捷通华声语音技术有限公司 Humming synthesis method and system
CN111816158B (en) * 2019-09-17 2023-08-04 北京京东尚科信息技术有限公司 Speech synthesis method and device and storage medium
CN113611326B (en) * 2021-08-26 2023-05-12 中国地质大学（武汉） Real-time voice emotion recognition method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5860064A (en) * 1993-05-13 1999-01-12 Apple Computer, Inc. Method and apparatus for automatic generation of vocal emotion in a synthetic text-to-speech system
US6212502B1 (en) * 1998-03-23 2001-04-03 Microsoft Corporation Modeling and projecting emotion and personality from a computer user interface
EP1107227A2 (en) * 1999-11-30 2001-06-13 Sony Corporation Voice processing

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5860064A (en) * 1993-05-13 1999-01-12 Apple Computer, Inc. Method and apparatus for automatic generation of vocal emotion in a synthetic text-to-speech system
US6212502B1 (en) * 1998-03-23 2001-04-03 Microsoft Corporation Modeling and projecting emotion and personality from a computer user interface
EP1107227A2 (en) * 1999-11-30 2001-06-13 Sony Corporation Voice processing

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
GALANIS D ET AL: "Investigating emotional speech parameters for speech synthesis", ELECTRONICS, CIRCUITS, AND SYSTEMS, 1996. ICECS '96., PROCEEDINGS OF THE THIRD IEEE INTERNATIONAL CONFERENCE ON RODOS, GREECE 13-16 OCT. 1996, NEW YORK, NY, USA,IEEE, US, 13 October 1996 (1996-10-13), pages 1227 - 1230, XP010217293, ISBN: 0-7803-3650-X *
IGNASI IRIONDO ET AL: "VALIDATION OF AN ACOUSTICAL MODELLING OF EMOTIONAL EXPRESSION IN SPANISH USING SPEECH SYNTHESIS TECHNIQUES", PROCEEDINGS OF THE ISCA WORKSHOP ON SPEECH AND EMOTION, September 2000 (2000-09-01), BELFAST, NORTHERN IRELAND, pages 1 - 6, XP007005765 *

Also Published As

Publication number Publication date
EP1256932B1 (en) 2006-05-10
EP1256932A2 (en) 2002-11-13
DE60131521T2 (en) 2008-10-23
DE60131521D1 (en) 2008-01-03

Similar Documents

Publication Publication Date Title
DE60334826D1 (en) PROCESS FOR WORKPIECE STRUCTURE MODIFICATION
DE60212468D1 (en) Method and device for adjusting a mounting arrangement for radar, as well as radar adjusted by this method or apparatus
IL132847A0 (en) Method and apparatus for software engineering
EP1473700A3 (en) Enumeration method for the link clock rate and the pixel/audio clock rate
EP0838755A3 (en) Binary program conversion apparatus and method
EP0821303A3 (en) Method and apparatus for performing microprocessor integer division operations using floating point hardware
GB0302291D0 (en) Control of software via bundling
EP1720062A3 (en) Apparatus, method and computer program product for performing a model based optical proximity correction factoring neighbour influence
DE69932537D1 (en) DEVICE FOR TREATING A TARGET VOLUME BY A PARTICLE BEAM
EP1496424A3 (en) Controller for information processing apparatus
EP1387290A3 (en) System and method for constraint-based document generation
DE60137689D1 (en) METHOD AND DEVICE FOR FLEXIBLE MANUFACTURE OF CROPPED SINGLE ITEMS
EP0953944A3 (en) Sketch-based editing of curves
ATE489796T1 (en) APPARATUS AND METHOD FOR A POWER-EFFICIENT LINE DRIVER
EP0924629A3 (en) Virtual navigation
EP2386946A3 (en) Code generation techniques using components in a distributed system
DE602005025300D1 (en) Method for repairing a workpiece
DE502005008125D1 (en) Method for producing and mounting a body with an angle scaling
EP1256932A3 (en) Method and apparatus for synthesising an emotion conveyed on a sound
EP0851405A3 (en) Method and apparatus of speech synthesis by means of concatenation of waveforms
ATE250250T1 (en) TRAINING METHOD AND DEVICE FOR ADJUSTING A NEURON
ATE239937T1 (en) COMPONENT BASED SOURCE CODE GENERATOR METHOD
EP1389766A3 (en) Method for Internet downloading files encapsulated in graphic files
EP1498885A3 (en) Information recording method and information recording apparatus
EP1274042A3 (en) A system and method for selecting an image processing path using estimated appearance of noise

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

AX Request for extension of the european patent

Free format text: AL;LT;LV;MK;RO;SI

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

AX Request for extension of the european patent

Extension state: AL LT LV MK RO SI

RIC1 Information provided on ipc code assigned before grant

Ipc: 7G 10L 13/08 A

Ipc: 7G 10L 13/02 B

17P Request for examination filed

Effective date: 20050317

17Q First examination report despatched

Effective date: 20050429

AKX Designation fees paid

Designated state(s): DE FR GB

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE FR GB

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 60119496

Country of ref document: DE

Date of ref document: 20060614

Kind code of ref document: P

ET Fr: translation filed
PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20070213

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20110729

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20110721

Year of fee payment: 11

Ref country code: DE

Payment date: 20110722

Year of fee payment: 11

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20120713

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20130329

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120713

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130201

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120731

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 60119496

Country of ref document: DE

Effective date: 20130201