Grad-TTS

[patrickvonplaten]

Model/Pipeline/Scheduler description

Grad TTS model: https://github.com/huawei-noah/Speech-Backbones/blob/main/Grad-TTS/README.md

Open source status

• The model implementation is available
• The model weights are available (Only relevant if addition is not a scheduler).

Provide useful links for the implementation

@patrickvonplaten has already added the model in a past version. Please leave a message below and I'd be more than happy to re-implement the model with you again!

Note that adding Grad-TTS will require some bigger changes in resnet.py and a new unet1D class.

[Vaibhavs10]

Hey @patrickvonplaten - I'd like to take this up.

I'm currently working through the Grad-TTS codebase to understand inference fully. I'll start a PR to take the discussion further.

[patrickvonplaten]

Very cool!

[345ishaan]

Hi, I will be happy to contribute / collaborate on this :)

[Vaibhavs10]

Working on this here: #569
Feel free to peek in @345ishaan <3

[345ishaan]

Thanks, @Vaibhavs10. I will checkout soon. Given you already have a headstart, happy to sync if you need any help on any task.