• Stars
    star
    235
  • Rank 165,803 (Top 4 %)
  • Language
  • License
    MIT License
  • Created over 4 years ago
  • Updated over 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Open Vtuber project containing all sub projects

OpenVTuberProject

This repository aims at providing a wide range of toolkits that support you to become a VTuber at a very low cost.

One webcam and one decent PC, then you can become a VTuber!

1. Prerequistes

  • A windows 10 PC (recommended to be equipped with a decent GPU)
  • A webcam
  • (Optional) Some knowledge of Unity and python if you want to customize your character

2. Toolkits

To be a VTuber and take videos, basically everyone follows these steps:

  1. Design and create a virtual character (and background) in 3D.
  2. Synchronize your face with the character.
  3. Take video of the character.
  4. Do some post-processing, e.g. subtitles/effects...
  5. Upload to video site, e.g. YouTube/Twitch...

Here are the toolkits that allow you to do the above:

  1. Create a character: VRoid Studio
  2. Synchronize the face: OpenSeeFace
  3. Take video: OBS Studio
  4. Post-processing:
  5. Upload: YouTube

3. Useful unity plugins to allow for more possibilities

  1. uDesktopDuplication that shows your screen in unity
  2. Mixamo where you can download many free 3D motions

More Repositories

1

nerf_pl

NeRF (Neural Radiance Fields) and NeRF in the Wild using pytorch-lightning
Jupyter Notebook
2,642
star
2

ngp_pl

Instant-ngp in pytorch+cuda trained with pytorch-lightning (high quality with high speed, with only few lines of legible code)
Jupyter Notebook
1,220
star
3

VTuber_Unity

Use Unity 3D character and Python deep learning algorithms to stream as a VTuber!
Python
770
star
4

gaussian_splatting_notes

A detailed formulae explanation on gaussian splatting
433
star
5

pytorch-cppcuda-tutorial

tutorial for writing custom pytorch cpp+cuda kernel, applied on volume rendering (NeRF)
Cuda
333
star
6

CasMVSNet_pl

Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matching using pytorch-lightning
Jupyter Notebook
268
star
7

nsff_pl

Neural Scene Flow Fields using pytorch-lightning, with potential improvements
Jupyter Notebook
220
star
8

nerf_Unity

Unity project for nerf_pl (Neural Radiance Fields)
C#
216
star
9

fish_detection

Fish detection using Open Images Dataset and Tensorflow Object Detection
Jupyter Notebook
123
star
10

Coordinate-MLPs

Experiments of coordinate MLPs
Python
91
star
11

RL

Jupyter Notebook
79
star
12

MVSNet_pl

MVSNet: Depth Inference for Unstructured Multi-view Stereo using pytorch-lightning
Jupyter Notebook
67
star
13

MINER_pl

Unofficial implementation (replicates paper results!) of MINER: Multiscale Implicit Neural Representations in pytorch-lightning
Jupyter Notebook
60
star
14

BlendedMVS_scenes

Quick lookup for BlendedMVS scenes
Python
48
star
15

ROS_notes

Personal notes of ROS usage
Jupyter Notebook
47
star
16

Unity_live_caption

Use Google Speech-to-Text API to do real-time live stream caption on Unity! Best when combined with your virtual character!
Python
36
star
17

pytorch-lightning-tutorial

Pytorch lightning tutorial using MNIST
Python
32
star
18

python-ray-tracing-with-cuda-example

An example of cuda ray tracing in pure python syntax.
Python
30
star
19

pytorch_cppcuda_practice

Practice to write cpp/cuda extension for pytorch
Cuda
26
star
20

hindsight_experience_replay

A tensorflow implementation of hindsight experience replay
Jupyter Notebook
16
star
21

kwea123

7
star
22

dino_pl

Reimplementation of Self-Supervised Vision Transformers with DINO in pytorch-lightning
Python
6
star
23

python-ray-tracing-with-numpy-example

Example of ray tracing with numpy in pure python syntax
4
star
24

bookkeeping

網頁語音記帳程式 - 利用Google Cloud Speech API 實現快速語音記帳
Python
4
star
25

kitti_bev_detection

Jupyter Notebook
3
star
26

facebook-bot

Python
2
star
27

cpp_data_algo

C++
1
star
28

raspberry_pi3

Jupyter Notebook
1
star
29

frustum-pointnets-work

Jupyter Notebook
1
star
30

cifar-10-cnn

Jupyter Notebook
1
star
31

kwea123.github.io

CSS
1
star
32

line-bot

Python
1
star
33

acoustic-indices

Jupyter Notebook
1
star