Check out our latest project ✨ OpenChapter.io: free ebooks the way its meant to be 📖

Neural Speech Engine with NVIDIA NeMo and ONNX Runtime

An asset by kaiida
The page banner background of a mountain and forest

Install Asset

Install via Godot

To maintain one source of truth, Godot Asset Library is just a mirror of the old asset library so you can download directly on Godot via the integrated asset library browser

Install Manually

You could also download the zip archive of the asset and manually install it into your addons/ folder

Report comment

Reason for reporting:
Character limit is 200 characters

Delete Comment

Are you sure you want to delete this Comment? This action can't be undone.

Neural Speech Engine with NVIDIA NeMo and ONNX Runtime hero image

Quick Information

0 ratings
Neural Speech Engine with NVIDIA NeMo and ONNX Runtime icon image
kaiida
Neural Speech Engine with NVIDIA NeMo and ONNX Runtime

A sample Godot project of using NeMoOnnxSharp. NeMoOnnxSharp is a neural speech engine which is based on NVIDIA NeMo and ONNX Runtime written purely in C#. This project supports VAD (voice activation detection), speech recognition and speech synthesis.

Supported Engine Version
4.1
Version String
0.1
License Version
Apache-2.0
Support Level
community
Modified Date
1 year ago
Git URL
Link to Git URL
Issue URL
Link to Issues URL

NeMoOnnxGodot

A sample application of using NeMoOnnxSharp with Godot. This supports VAD (voice activation detection), speech recognition and speech synthesis.

README screen shot

Requirement

  • Visual Studio 2022
  • Godot 4.1.2
  • Windows 11 (or versions for which Godot supports)

Building

  • Open the directory with Godot Editor
  • Open the solution with Visual Studio 2022
  • From menu Build -> Build Solution
  • Then run with debugger (F5) from Godot Editor or export to Windows exe.

Running

English and German are supported.

The applicatin needs model files downloaded from GitHub. Click "Download models" button to download them.

Click Transcribe button to start VAD and speech recognition using a microphone. Click Speak to generate audio from the text.

Importing to your project

NeMoOnnxSharp needs ONNX Runtime NuGet package. Add these to your .csproj file.

  <ItemGroup>
    <PackageReference Include="Microsoft.ML.OnnxRuntime" Version="1.16.1" />
    <PackageReference Include="NeMoOnnxSharp" Version="1.3.0" />
  </ItemGroup>

Script.cs is the main script to use. Attach it to a Godot node in the inspector.

README screen shot

A sample Godot project of using NeMoOnnxSharp. NeMoOnnxSharp is a neural speech engine which is based on NVIDIA NeMo and ONNX Runtime written purely in C#. This project supports VAD (voice activation detection), speech recognition and speech synthesis.

Reviews

0 ratings

Your Rating

Headline must be at least 3 characters but not more than 50
Review must be at least 5 characters but not more than 500
Please sign in to add a review

Quick Information

0 ratings
Neural Speech Engine with NVIDIA NeMo and ONNX Runtime icon image
kaiida
Neural Speech Engine with NVIDIA NeMo and ONNX Runtime

A sample Godot project of using NeMoOnnxSharp. NeMoOnnxSharp is a neural speech engine which is based on NVIDIA NeMo and ONNX Runtime written purely in C#. This project supports VAD (voice activation detection), speech recognition and speech synthesis.

Supported Engine Version
4.1
Version String
0.1
License Version
Apache-2.0
Support Level
community
Modified Date
1 year ago
Git URL
Link to Git URL
Issue URL
Link to Issues URL

Open Source

Released under the AGPLv3 license

Plug and Play

Browse assets directly from Godot

Community Driven

Created by developers for developers