whisperspeech 英文TTS的实现
以下代码成功运行在 colab 中，需要修改运行时类型为 T4 GPU。
!pip install -Uqq WhisperSpeech
def is_colab():try: import google.colab; return Trueexcept: return Falseimport torch
# if not torch.cuda.is_available():
# if is_colab(): raise BaseException("Please change the runtime type to GPU. In the menu: Runtime -> Change runtime type (the free T4 instance is enough)")
# else: raise BaseException("Currently the example notebook requires CUDA, make sure you are running this on a machine with a GPU.")# %load_ext autoreload
# %autoreload 2import torch
import torch.nn.functional as Ffrom IPython.display import Markdown, HTML# check "7. Pipeline.ipynb"
from whisperspeech.pipeline import Pipelinepipe = Pipeline(s2a_ref='collabora/whisperspeech:s2a-q4-tiny-en+pl.model')# pipe.generate_to_notebook("""
# This is the first demo of Whisper Speech, a fully open source text-to-speech model trained by Collabora and Lion on the Juwels supercomputer.
# """)pipe.generate_to_notebook("""
History will not look kindly on House Republicans for their blatant act of unconstitutional partisanship
that has targeted an honorable public servant in order to play petty political games. Homeland Security Secretary Mayorkas,
a Cuban immigrant who came to the United States with his family as political refugees, has spent more than two decades serving America
with integrity in a decorated career in law enforcement and public service.
""")#也可以保存到文件：
# pipe.generate_to_file("output.wav", "This is the first demo of Whisper Speech, a fully open source text-to-speech model # trained by Collabora and Lion on the Juwels supercomputer")