• Stars
    star
    131
  • Rank 275,867 (Top 6 %)
  • Language
    Jupyter Notebook
  • License
    MIT License
  • Created about 6 years ago
  • Updated almost 5 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Understanding normalizing flows

Normalizing Flows

Note: There are some bugs in the implementation of VAE+PF. For an updated Pytorch implementation, please check: abdulfatir/planar-flow-pytorch.

Accompanying documentation

  1. Normalizing Flows: Planar and Radial Flows
  2. Technical Report

Results

Variational Inference with Normalizing Flows (Rezende and Mohamed)

The function that planar flow uses doesn't have analytic inverse which makes it unsuitable for direct likelihood estimation using the data. It can work well in VAEs though because inversion isn't required. However, for cases when the analytic target density is available, KL-divergence can be minimized explicitly (excluding constant terms). Following are the results for two complex 2D densities similar to the ones in the paper. The second column shows samples obtained using MCMC (See notebooks/Metropolis-Hastings.ipynb). The third and fourth columns show results using planar flows of different lengths (see notebooks/PlanarFlow-Example1.ipynb and notebooks/PlanarFlow-Example2.ipynb). During the experiments I found that minimizing KL is not always stable and doesn't always reach a good solution (especially for density 2).

True Density Samples (using Metropolis-Hastings) Samples (using Planar Flow; K = 4) Samples (using Planar Flow; K = 16)

VAE with Planar Flow

[REMOVED]

There are some bugs in the implementation of VAE+PF. For an updated Pytorch implementation, please check: abdulfatir/planar-flow-pytorch.

Note

Originally, this repository contained notes and code on normalizing flows which we did as a part of a course project (CS6202 @ NUS). Some ideas are borrowed from this repo.

More Repositories

1

twitter-sentiment-analysis

Sentiment analysis on tweets using Naive Bayes, SVM, CNN, LSTM, etc.
Python
1,506
star
2

ZipBomb

A simple implementation of ZipBomb in Python
Python
325
star
3

prototypical-networks-tensorflow

Tensorflow implementation of NIPS 2017 Paper "Prototypical Networks for Few-shot Learning"
Jupyter Notebook
132
star
4

pyANPD

Automatic Number Plate Detection for Python using OpenCV
Python
66
star
5

sampling-methods-numpy

This repository contains implementations of some basic sampling methods in numpy.
Jupyter Notebook
63
star
6

langevin-monte-carlo

A simple pytorch implementation of Langevin Monte Carlo algorithms.
Jupyter Notebook
40
star
7

REDSDS

Pytorch implementation of RED-SDS (NeurIPS 2021).
Python
18
star
8

jcomplexnumber

A library which implements the complex number data type in Java.
Java
18
star
9

planar-flow-pytorch

Pytorch implementation of Planar Flow
Jupyter Notebook
18
star
10

Youtube-via-FB

A tool to control YouTube using Facebook messenger by browser automation using selenium.
Python
14
star
11

pyBlur

Soft Blurring in Python using OpenCV
Python
10
star
12

IWAE-tensorflow

Tensorflow implementation of Importance Weighted Auto Encoder
Python
5
star
13

fb-mosaic

Create a mosaic using profiles pictures from Facebook.
Python
4
star
14

SimulatedAnnealing-TSP

Simulated Annealing heuristic to solve the travelling salesman problem written in JavaScript.
JavaScript
4
star
15

blood-analysis-app

Android Source for GSoC '16 project Mobile Based Blood Analysis with Computational Biology @ UNL.
Java
4
star
16

JEvoLisa

Java reimplementation of Roger Alsing's EvoLisa
Java
3
star
17

capsule-networks-pytorch

PyTorch implementation of Capsule Networks
Python
2
star
18

subKmeans

Numpy and pyCUDA implementation of subKmeans
Python
1
star
19

learn-jax

Learning JAX as a PyTorch User
Jupyter Notebook
1
star
20

blood-analysis-app-ios

iOS Source for GSoC '17 project Mobile Based Blood Analysis-iOS with Computational Biology @ UNL.
Swift
1
star
21

learning2learn-pytorch

Jupyter Notebook
1
star
22

neural-ode

Jupyter Notebook
1
star
23

Blood-Analysis

TeX
1
star
24

vae-tensorflow

Variational Auto-Encoder based on DC-GAN-like architecture
Jupyter Notebook
1
star
25

disentanglement-metrics

A list of different disentanglement metrics proposed in literature.
1
star