• This repository has been archived on 20/Feb/2024
  • Stars
    star
    118
  • Rank 298,644 (Top 6 %)
  • Language
    C#
  • License
    Apache License 2.0
  • Created about 3 years ago
  • Updated about 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Text to Speech in Unity.

Text to Speech In Unity

Important! The current model (fastspeech) does not work well with short phrases. (e.g. "hi", "how are you", etc.)

This package provides a fully functional cross platform Text To Speech engine using deep learning models integrated in Unity with C#!

You can find the example repository here.

Text To Speech

The model that we use for TTS is FastSpeech. The TFLite model that we used is converted from a pre-trained model found in the TensorflowTTS repository.

To prevent Unity from freezing when inferencing the TFLite model, we run the inference process in a new thread and play the audio in the main thread once it is ready.

Installation

External dependencies:

  1. Clone the UnityUtil repository into your Packages folder.
  2. Add TFLite package via "add package from git URL" selection in the package manager using this link: https://github.com/asus4/tf-lite-unity-sample.git?path=/Packages/com.github.asus4.tflite
  3. Clone this repository into your Packages folder.
  4. Download the TFLite models from Google Drive and import them into Unity (place them inside the Assets/StreamingAssets folder).
  5. And you are ready to go!

Support the project!

patreon kofi

Join the community!

discord discord

License

This repository as a whole is licensed under the GNU Public License, Version 3. Individual files may have a different, but compatible license.

See license file for details.

References

  1. Fastspeech
  2. MelGAN
  3. All TFLite model inferencing will not be possible without the help of the Unity TFLite repository.

More Repositories

1

GPUClothSimulationInUnity

Trying to replicate what this legend did: https://youtu.be/kCGHXlLR3l8
C#
163
star
2

URPVolumetricLighting

Volumetric Lighting in URP
C#
139
star
3

UnityAudioVisualizer

Audio Visualizer in Unity.
ShaderLab
75
star
4

UnityNLP

Natural Language Processing in Unity.
C#
62
star
5

UnityGPUVectorGraphics

Rendering vector graphics in Unity with the power of GPU.
C#
44
star
6

UnityUtil

Utilities for Unity.
C#
34
star
7

UnityASR

Automatic Speech Recognition in Unity.
C#
32
star
8

UnityKinematicaX

A next-generation character animation system built on top of Unity's Kinematica.
C#
22
star
9

UnityAI

AI in Unity.
C#
19
star
10

UnityTTSExamples

Text to speech examples in Unity.
ShaderLab
12
star
11

BlenderMeshToJSON

Addon for Blender to export mesh data as a JSON file.
Python
11
star
12

TransformerChatbot

Training a chatbot using a transformer.
Python
10
star
13

UnityAnimaticExamples

Animation system (motion matching and more) examples in Unity.
C#
10
star
14

bevy_radiance_cascades

Radiance cascade global illumination implementation in Bevy.
Rust
9
star
15

UnityASRExamples

Examples of Automatic Speech Recognition in Unity
ShaderLab
6
star
16

UnityMotionGraphics

Motion graphics creation tool.
C#
5
star
17

UnityGPUVectorGraphicsExamples

GPU accelerated vector graphics examples in Unity.
ShaderLab
5
star
18

boomboom

A physics based explosion game made almost entirely using Unity's ECS.
C#
5
star
19

bevy_vello_renderer

A minimal integration for rendering Vello graphics in Bevy.
Rust
5
star
20

parallel_programming_tutorial

Parallel programming tutorial.
Rust
5
star
21

UnityRasa

Rasa Tree Flow Graph in Unity.
C#
4
star
22

OmniTwin

OmniTwin is a digital twin made in Unity for the Rescue AI project for disaster awareness and disaster prediction.
C#
4
star
23

SmartAssistant

A smart personal assistant to make your life easier.
ShaderLab
2
star
24

unity_pbd_pendulum

C#
2
star
25

galacticguardian

A 2D ship building strategy game made in Unity.
C#
2
star
26

KinematicaTest

Testing Unity KinematicaX on the latest Unity LTS version.
C#
2
star
27

beauty-of-shaders

Beauty of shaders talk presentation via motion canvas.
TypeScript
1
star
28

bevy_motion_matching

Rust
1
star
29

PETS.CO

Online Pet Shop demo that only sells dog.
PHP
1
star
30

UnityNLPExamples

UnityNLP examples.
C#
1
star
31

nixon_resume

Nixon's resume. Created via Typst.
Typst
1
star
32

ggj2024

A game made in global game jam 2024.
Rust
1
star
33

FieryDash

SDP project
C#
1
star
34

LessIsMore

GameJam for BTP #3
C#
1
star
35

OxygenNotEnough

Level 99 Game Jam
C#
1
star