Larynx is a neural text to speech system built entirely on open source libraries.
https://github.com/rhasspy/larynx