• Stars
    star
    283
  • Rank 146,066 (Top 3 %)
  • Language
    Python
  • License
    BSD 3-Clause "New...
  • Created over 9 years ago
  • Updated over 4 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Predict facial landmarks with Deep CNNs powered by Caffe.

deep-landmark

Predict facial landmarks with Deep CNNs powered by Caffe.

This project is a reimplementation of the paper Deep Convolutional Network Cascade for Facial Point Detection.

Data

All training data can be downloaded from here.

Download the images and extract to dataset with train and test.

modify level1.py, level2.py, level3.py under dataset to change to training datasets.

Train

./bootstrap.sh

This will first generate prototxt files for caffe models and convert training data(images and landmarks) into h5 files. Then We will train the level-1 CNNs and use the result to generate training data for level-2. And for level-2 and level-3 goes the same way.

I strongly suggest you to train every CNN seperately. It's every important to view the loss at first to see if it is stable, if not, stop the training and restart.

View Trainging Logs

I have modified Caffe source code to log the test loss over every test, and I write view_loss.py to plot the loss, all log file are under log so as plot. If the loss plot is unusual, retraining the CNN model is needed.

Caffe will log all stuffs during the network training, you can find the log file under /tmp or you can give Caffe a hit where to save the log file. If you want to see the training loss curve, you should write a program to parse the log file yourself.

Models

All model files are under model, we can modify *.template file to change the caffe network structure for every level.

Results

I have created a web page to test the project, all code are under webapp.

error of every landmark in Level-3

some test

video test

https://youtu.be/oNiAtu0erEk

References

  1. Caffe
  2. Deep Convolutional Network Cascade for Facial Point Detection

More Repositories

1

mini-caffe

Minimal runtime core of Caffe, Forward only, GPU support and Memory efficiency.
C++
375
star
2

face-alignment-at-3000fps

C++ implementation of Face Alignment at 3000 FPS via Regressing Local Binary Features
C++
197
star
3

JDA

C++ implementation of Joint Cascade Face Detection and Alignment.
C++
185
star
4

mx-lsoftmax

mxnet version of Large-Margin Softmax Loss for Convolutional Neural Networks.
Python
175
star
5

Joint-Face-Detection-and-Alignment

Caffe and Python implementation of Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks
Python
101
star
6

OrdinalRegression

Caffe Loss Layer for Ordinal Regression with Multiple Output CNN for Age Estimation.
C++
45
star
7

mini-caffe-example

detect facial landmark with mini-caffe
C++
18
star
8

FashionAI.KPS

My solution to FashionAI Key Points Detection of Apparel.
Python
13
star
9

Apriori

a simple implementation of Apriori algorithm in Python.
Python
12
star
10

WGAN

Play with Wasserstein GAN on MXNet.
Python
10
star
11

jsmnpp

jsmn++ is a tiny json parser embedded in your C++ project for configuration.
C++
8
star
12

QMIBBrowser

a mib browser based on snmp++ and Qt
C
5
star
13

face-alignment-presentation

All materials used in Face Alignment Presentation for MultiMedia Course.
4
star
14

rcpr-annotated

RCPR ไปฃ็ ๆณจ่งฃ
MATLAB
3
star
15

luoyetx.github.io

Resume
CSS
2
star
16

installers

scripts for installing open source tools and libraries from source code. Currently On CentOS
Shell
2
star
17

spider-event

a simple workflow for web crawling
JavaScript
1
star
18

CourseraHW

Homework Code on Coursera
MATLAB
1
star