• Stars
    star
    185
  • Rank 208,271 (Top 5 %)
  • Language
    Python
  • License
    MIT License
  • Created over 6 years ago
  • Updated over 5 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Neural scene representation and rendering (GQN)

🚧 Work in Progress 🚧

Neural scene representation and rendering

https://deepmind.com/blog/neural-scene-representation-and-rendering/

Requirements

  • Python 3
  • h5py
  • Chainer
    • pip3 install chainer
  • CuPy
    • pip3 install cupy-cuda100 for CUDA 10.0
    • pip3 install cupy-cuda91 for CUDA 9.1

Also you need the followings for visualization:

  • ffmpeg
    • sudo apt install ffmpeg
  • imagemagick
    • sudo apt install imagemagick

Current training progress

figure

figure

Network Architecture

gqn_conv_draw

gqn_representation

Dataset

deepmind/gqn-datasets

Datasets used to train GQN in the paper are available to download.

https://github.com/deepmind/gqn-datasets

You need to convert .tfrecord files to HDF5 .h5 format before starting training.

https://github.com/musyoku/gqn-datasets-translator

gqn-dataset-renderer

I am working on a OpenGL/CUDA renderer for rendering GQN dataset.

https://github.com/musyoku/gqn-dataset-renderer

  • Shepard-Metzler

shepard_matzler

  • Rooms

rooms_rotate_object

  • MNIST Dice

mnist_dice

More Repositories

1

adversarial-autoencoder

Chainer implementation of adversarial autoencoder (AAE)
Python
251
star
2

wavenet

Chainer implementation of Deepmind's WaveNet
Python
96
star
3

wasserstein-gan

Chainer implementation of Wasserstein GAN
Python
95
star
4

chainer-glow

Glow: Generative Flow with Invertible 1×1 Convolutions
Python
77
star
5

LSGAN

Chainer implementation of Least Squares GAN (LSGAN)
Python
53
star
6

improved-gan

Chainer implementation of GAN / Deep Convolutional GAN (DCGAN) based on "Improved Techniques for Training GANs"
Python
33
star
7

python-rtx

GPU Raytracer with CUDA
C++
32
star
8

python-npylm

ベイズ階層言語モデルによる教師なし形態素解析
C++
32
star
9

chainer-sru

Training RNNs as Fast as CNNs (Simple Recurrent Unit)
Python
30
star
10

gqn-dataset-renderer

Python
27
star
11

double-dqn

Chainer implementation of Double Deep Q-Network (Double DQN)
Python
27
star
12

self-normalizing-networks

Chainer implementation of Self-Normalizing Networks (SNN)
Python
25
star
13

variational-autoencoder

Chainer implementation of Variational AutoEncoder (VAE) M1 / M2 / M1+M2
Python
23
star
14

face-alignment-at-3000fps

Face Alignment at 3000 FPS via Regressing Local Binary Features
C++
18
star
15

grpc-speech-recognition

Python code samples that uses Google Cloud Speech Streaming gRPC API
Python
17
star
16

unsupervised-pos-tagging

教師なし品詞タグ推定
C++
16
star
17

chainer-qrnn

Chainer implementation of Q-RNN (Quasi-Reccurent Neural Networks)
Python
14
star
18

chainer-glow-mnist

Glow: Generative Flow with Invertible 1×1 Convolutions
Python
14
star
19

chainer-stream

chainer.Chain
Python
12
star
20

chainer-gram-ctc

Python
12
star
21

python-npycrf

条件付確率場とベイズ階層言語モデルの統合による半教師あり形態素解析
C++
11
star
22

chainer-sequential

Keras like network builder for Chainer
Python
11
star
23

recurrent-batch-normalization

Chainer implementation of batch-normalizing LSTM
Python
11
star
24

papers

実装するリスト
10
star
25

chainer-nn

Python
10
star
26

hpylm

HPYLMのC++実装
C++
10
star
27

equilibrium-propagation

Generalization of Equilibrium Propagation to Vector Field Dynamics
Python
10
star
28

chainer-speech-recognition

character level speech recognition
Python
9
star
29

weight-normalization

Chainer implementation of Weight Normalization
Python
9
star
30

unrolled-gan

Chainer implementation of Unrolled GAN
Python
8
star
31

vat

Chainer implementation of Virtual Adversarial Training (VAT)
Python
8
star
32

began

Chainer implementation of Boundary Equilibrium GAN
Python
7
star
33

dueling-network

Chainer implementation of Double DQN + Dueling Network
Python
7
star
34

python-cstm

ガウス過程に基づく連続空間トピックモデル
C++
7
star
35

lstm

Chainer implementation of LSTM
Python
7
star
36

self-driving-cars

Simulation of self-driving cars using DQN
Python
7
star
37

chainer-ctc-example

Connectionist Temporal Classification (CTC)
Python
7
star
38

adgm

Chainer implementation of Auxiliary Deep Generative Models (ADGM) and Skip Deep Generative Model (SDGM)
Python
6
star
39

cv-animeface

OpenCVでアニメ画像から顔領域を切り出す
Python
6
star
40

deep-q-network

Chainer implementation of Deep Q-Network(DQN)
Python
5
star
41

IMSAT

Chainer implementation of Information Maximizing Self Augmented Training
Python
5
star
42

vpylm

VPYLMのC++実装
C++
5
star
43

neural-3d-mesh-renderer

C++
4
star
44

voynich-transcription

v101 transcription by Glen Claston
4
star
45

chainer-sequential-chain

chainer.Chain
Python
4
star
46

convolutional-draw

Towards Conceptual Compression
Python
4
star
47

gradient-based-mesh-editing

Implementation of Gradient-based 3D Mesh Editing from "Neural 3D Mesh Renderer" (https://arxiv.org/abs/1711.07566)
C++
4
star
48

chainer-cuda-ctc

CUDA Optimized CTC & Gram-CTC
Python
4
star
49

mnist-oneshot

MNISTのワンショット学習をChainerで試す
Python
3
star
50

vpylm-python

3
star
51

gqn-datasets-translator

Python
3
star
52

unsupervised-wordcloud

WordCloudを教師なし形態素解析で作る
C++
3
star
53

reinforcement-learning

Python
2
star
54

embedded-hmm

A simple demonstration of Embedded HMM
C++
2
star
55

tomasi-kanade-factorization

Python
2
star
56

chainer-glu

Chainer implementation of Gated Convolutional Networks
Python
2
star
57

ddgm

Chainer implementation of Deep Directed Generative Models with Energy-Based Probability Estimation
Python
2
star
58

rl-tippy

Is the order Reinforcement Learning?
Python
1
star
59

uniform_random_point_in_triangle

Python
1
star
60

csj-preprocesser

Python
1
star
61

smm-forward-backward-normalization

Semi Markov Modelの前向き後向き確率の正規化
C++
1
star
62

musyoku.github.io

SCSS
1
star
63

NLP

Chainerの自然言語処理系の実装
Python
1
star
64

python-poincare-embeddings

1
star
65

negative-binomial-glm

負の二項分布の一般化線形モデルによる単語長の予測の実験コード
C++
1
star
66

embed-id-extended

EmbedID with cosine distance
Python
1
star
67

wikipedia-to-text

Extract .txt from wikipedia
Python
1
star