|
1 | 1 | # Parakeet |
2 | | -Parakeet aims to provide a flexible, efficient and state-of-the-art text-to-speech toolkit for the open-source community. It is built on PaddlePaddle Fluid dynamic graph and includes many influential TTS models proposed by [Baidu Research](http://research.baidu.com) and other research groups. |
| 2 | +Parakeet aims to provide a flexible, efficient and state-of-the-art text-to-speech toolkit for the open-source community. It is built on PaddlePaddle dynamic graph and includes many influential TTS models. |
3 | 3 |
|
4 | 4 | <div align="center"> |
5 | | - <img src="images/logo.png" width=300 /> <br> |
| 5 | + <img src="docs/images/logo.png" width=300 /> <br> |
6 | 6 | </div> |
7 | 7 |
|
8 | | -In particular, it features the latest [WaveFlow](https://arxiv.org/abs/1912.01219) model proposed by Baidu Research. |
| 8 | +## News <img src="./docs/images/news_icon.png" width="40"/> |
9 | 9 |
|
10 | | -- WaveFlow can synthesize 22.05 kHz high-fidelity speech around 40x faster than real-time on a Nvidia V100 GPU without engineered inference kernels, which is faster than [WaveGlow](https://github.com/NVIDIA/waveglow) and serveral orders of magnitude faster than WaveNet. |
11 | | -- WaveFlow is a small-footprint flow-based model for raw audio. It has only 5.9M parameters, which is 15x smalller than WaveGlow (87.9M). |
12 | | -- WaveFlow is directly trained with maximum likelihood without probability density distillation and auxiliary losses as used in Parallel WaveNet and ClariNet, which simplifies the training pipeline and reduces the cost of development. |
| 10 | +- Aug-31-2021, Chinese Text Frontend. Check [examples/text_frontend](./examples/text_frontend). |
| 11 | +- Aug-23-2021, FastSpeech2 with AISHELL-3. Check [fastspeech2/aishell3](./examples/fastspeech2/aishell3). |
| 12 | +- Aug-3-2021, FastSpeech2 with CSMSC. Check [fastspeech2/baker](./examples/fastspeech2/baker). |
| 13 | +- Jul-19-2021, SpeedySpeech with CSMSC. Check [speedyspeech/baker](./examples/speedyspeech/baker). |
| 14 | +- Jul-01-2021, Parallel WaveGAN with CSMSC. Check [parallelwave_gan/baker](./examples/parallelwave_gan/baker). |
| 15 | +- Jul-01-2021, Montreal-Forced-Aligner. Check [examples/use_mfa](./examples/use_mfa). |
| 16 | +- May-07-2021, voice cloning in Chinese. Check [examples/tacotron2_aishell3](./examples/tacotron2_aishell3). |
13 | 17 |
|
14 | 18 | ## Overview |
15 | | -In order to facilitate exploiting the existing TTS models directly and developing the new ones, Parakeet selects typical models and provides their reference implementations in PaddlePaddle. Further more, Parakeet abstracts the TTS pipeline and standardizes the procedure of data preprocessing, common modules sharing, model configuration, and the process of training and synthesis. The models supported here include Vocoders and end-to-end Acoustic models: |
16 | 19 |
|
17 | | -- Vocoders |
18 | | - - [【Parallel WaveGAN】Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogram](https://arxiv.org/abs/1910.11480) |
19 | | - - [【WaveFlow】WaveFlow: A Compact Flow-based Model for Raw Audio](https://arxiv.org/abs/1912.01219) |
| 20 | +In order to facilitate exploiting the existing TTS models directly and developing the new ones, Parakeet selects typical models and provides their reference implementations in PaddlePaddle. Further more, Parakeet abstracts the TTS pipeline and standardizes the procedure of data preprocessing, common modules sharing, model configuration, and the process of training and synthesis. The models supported here include Text FrontEnd, end-to-end Acoustic models and Vocoders: |
20 | 21 |
|
21 | | -- Acoustic models |
| 22 | +* Text FrontEnd |
| 23 | + * Rule based frontend. |
| 24 | + |
| 25 | +- Acoustic Models |
22 | 26 | - [【FastSpeech2】FastSpeech 2: Fast and High-Quality End-to-End Text to Speech](https://arxiv.org/abs/2006.04558) |
23 | 27 | - [【SpeedySpeech】SpeedySpeech: Efficient Neural Speech Synthesis](https://arxiv.org/abs/2008.03802) |
24 | 28 | - [【Transformer TTS】Neural Speech Synthesis with Transformer Network](https://arxiv.org/abs/1809.08895) |
25 | 29 | - [【Tacotron2】Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions](https://arxiv.org/abs/1712.05884) |
26 | | - |
27 | | -- Voice Conversion |
| 30 | +- Vocoders |
| 31 | + - [【Parallel WaveGAN】Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogram](https://arxiv.org/abs/1910.11480) |
| 32 | + - [【WaveFlow】WaveFlow: A Compact Flow-based Model for Raw Audio](https://arxiv.org/abs/1912.01219) |
| 33 | +- Voice Cloning |
| 34 | + - [Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis](https://arxiv.org/pdf/1806.04558v4.pdf) |
28 | 35 | - [【GE2E】Generalized End-to-End Loss for Speaker Verification](https://arxiv.org/abs/1710.10467) |
29 | 36 |
|
30 | | -## Updates |
31 | | -- Aug-31-2021, Add an example for Chinese Text Frontend. Check [examples/text_frontend](./examples/text_frontend). |
32 | | -- Aug-23-2021, Add an example for FastSpeech2 with AISHELL-3. Check [fastspeech2/aishell3](./examples/fastspeech2/aishell3). |
33 | | -- Aug-3-2021, Add an example for FastSpeech2 with CSMSC. Check [fastspeech2/baker](./examples/fastspeech2/baker). |
34 | | -- Jul-19-2021, Add an example for SpeedySpeech with CSMSC. Check [speedyspeech/baker](./examples/speedyspeech/baker). |
35 | | -- Jul-01-2021, Add an example for Parallel WaveGAN with CSMSC. Check [parallelwave_gan/baker](./examples/parallelwave_gan/baker). |
36 | | -- Jul-01-2021, Add an example for usage of Montreal-Forced-Aligner. Check [examples/use_mfa](./examples/use_mfa). |
37 | | -- May-07-2021, Add an example for voice cloning in Chinese. Check [examples/tacotron2_aishell3](./examples/tacotron2_aishell3). |
38 | | - |
39 | 37 | ## Setup |
40 | 38 | It's difficult to install some dependent libraries for this repo in Windows system, we recommend that you **DO NOT** use Windows system, please use `Linux`. |
41 | 39 |
|
@@ -85,33 +83,46 @@ Entries to the introduction, and the launch of training and synthsis for differe |
85 | 83 | ### TTS models (Acoustic Model + Neural Vocoder) |
86 | 84 | Check our [website](https://paddle-parakeet.readthedocs.io/en/latest/demo.html) for audio sampels. |
87 | 85 |
|
88 | | -## Checkpoints |
89 | | -### FastSpeech2 |
| 86 | +## Released Model |
| 87 | + |
| 88 | +### AM |
| 89 | + |
| 90 | +#### FastSpeech2 |
90 | 91 | 1. [fastspeech2_nosil_baker_ckpt_0.4.zip](https://paddlespeech.bj.bcebos.com/Parakeet/fastspeech2_nosil_baker_ckpt_0.4.zip) |
91 | 92 | 2. [fastspeech2_nosil_aishell3_ckpt_0.4.zip](https://paddlespeech.bj.bcebos.com/Parakeet/fastspeech2_nosil_aishell3_ckpt_0.4.zip) |
92 | 93 |
|
93 | | -### Parallel WaveGAN |
94 | | -1. [pwg_baker_ckpt_0.4.zip](https://paddlespeech.bj.bcebos.com/Parakeet/pwg_baker_ckpt_0.4.zip) |
95 | | - |
96 | | -### SpeedySpeech |
| 94 | +#### SpeedySpeech |
97 | 95 | 1. [speedyspeech_baker_ckpt_0.4.zip](https://paddlespeech.bj.bcebos.com/Parakeet/speedyspeech_baker_ckpt_0.4.zip) |
98 | 96 |
|
99 | | -### Tacotron2_AISHELL3 |
100 | | -1. [tacotron2_aishell3_ckpt_0.3.zip](https://paddlespeech.bj.bcebos.com/Parakeet/tacotron2_aishell3_ckpt_0.3.zip) |
101 | | - |
102 | | -### GE2E |
103 | | -1. [ge2e_ckpt_0.3.zip](https://paddlespeech.bj.bcebos.com/Parakeet/ge2e_ckpt_0.3.zip) |
| 97 | +#### TransformerTTS |
104 | 98 |
|
105 | | -### WaveFlow |
106 | | -1. [waveflow_ljspeech_ckpt_0.3.zip](https://paddlespeech.bj.bcebos.com/Parakeet/waveflow_ljspeech_ckpt_0.3.zip) |
107 | | - |
108 | | -### TransformerTTS |
109 | 99 | 1. [transformer_tts_ljspeech_ckpt_0.3.zip](https://paddlespeech.bj.bcebos.com/Parakeet/transformer_tts_ljspeech_ckpt_0.3.zip) |
110 | 100 |
|
111 | | -### Tacotron2 |
| 101 | +#### Tacotron2 |
| 102 | + |
112 | 103 | 1. [tacotron2_ljspeech_ckpt_0.3.zip](https://paddlespeech.bj.bcebos.com/Parakeet/tacotron2_ljspeech_ckpt_0.3.zip) |
113 | 104 | 2. [tacotron2_ljspeech_ckpt_0.3_alternative.zip](https://paddlespeech.bj.bcebos.com/Parakeet/tacotron2_ljspeech_ckpt_0.3_alternative.zip) |
114 | 105 |
|
115 | | -## Copyright and License |
| 106 | +### Vocoder |
| 107 | + |
| 108 | +#### WaveFlow |
| 109 | + |
| 110 | +1. [waveflow_ljspeech_ckpt_0.3.zip](https://paddlespeech.bj.bcebos.com/Parakeet/waveflow_ljspeech_ckpt_0.3.zip) |
| 111 | + |
| 112 | +#### Parallel WaveGAN |
| 113 | + |
| 114 | +1. [pwg_baker_ckpt_0.4.zip](https://paddlespeech.bj.bcebos.com/Parakeet/pwg_baker_ckpt_0.4.zip) |
| 115 | + |
| 116 | +### Voice Cloning |
| 117 | + |
| 118 | +#### Tacotron2_AISHELL3 |
| 119 | + |
| 120 | +1. [tacotron2_aishell3_ckpt_0.3.zip](https://paddlespeech.bj.bcebos.com/Parakeet/tacotron2_aishell3_ckpt_0.3.zip) |
| 121 | + |
| 122 | +#### GE2E |
| 123 | + |
| 124 | +1. [ge2e_ckpt_0.3.zip](https://paddlespeech.bj.bcebos.com/Parakeet/ge2e_ckpt_0.3.zip) |
| 125 | + |
| 126 | +## License |
116 | 127 |
|
117 | 128 | Parakeet is provided under the [Apache-2.0 license](LICENSE). |
0 commit comments