Speaking issues Coqui TTS Tacotron2 DDC model: Difference between revisions

From Voice Technology Wiki
Jump to navigation Jump to search
mNo edit summary
m (Just an edit for demo)
Tags: Reverted Visual edit
Line 17: Line 17:
* Nelson Mandela
* Nelson Mandela
* pergola
* pergola
*Demo


==== Mitigation ====
==== Mitigation ====

Revision as of 23:44, 12 November 2021


General

Most models are trained with a dot, exclamation or question mark at the end. So always end a sentence to avoid model synthesizing weird output.

  • TTS model: tts_models/en/ljspeech/tacotron2-DDC
  • Vocoder model: vocoder_models/en/ljspeech/hifigan_v2

Input string formatting

Phrases ending in "ah"

"ah" at end of sentence generally produces strange results. Short names produce a 12 second clip.

Examples:

  • Nelson Mandela
  • pergola
  • Demo

Mitigation

If at the end of the input, adding punctuation to the end synthesizes correctly:

Example "Nelson Mandela" > "Nelson Mandela."

Acronyms

To speak acronyms as letters it needs to be formatted as:

"A. B. C. news"

Not:

"ABC news" "A.B.C. news"

Mispronounced Words

  • video