CaffeJS
This repo is a proof of concept for porting Caffe models to the browser using a modified version of ConvNetJS (by Andrej Karpathy). It aims to help beginners to dive into Deep Neural Networks by using only a browser. Try out the ImageNet Classification using GoogleNet or the DeepDream entirely in your browser!
This work is pre-alpha and based on ConvNetJS (which is alpha), so you can imagine how much I need your help!
What's possible with CaffeJS
- Playing around with Convolutional Neural Nets in the browser
- Loading pretrained Deep Neural Nets entirely in JavaScript
- Running forward and backward passes through Deep Neural Nets
- Visualize model structure, activations and filters
- All of this without installing any software (also running on your mobile devices)
How to run CaffeJS
Check out the project page hosted on Github which includes samples with a pretrained GoogLeNet. To run other Nets (like AlexNet, VGG or ResNet) one has to clone the repo on the local machine and download the additional model weights.
- Getting Started
- User Guide
- Development Guide
- Many cool examples and demos, like ImageNet Classification, DeepDream, etc.
What's left to do
- Debug and fix remaining issues with SoftMax layer
- Implement AVE pooling backward pass
- Implement more layers (Eltwise, Scale, BatchNorm) for ResNet
- Evaluate weight extraction directly from *.caffemodel file (without converting to intermediate binary format)
- Nice documentation
- More samples (Selfie Net, Gender- and AgeNet, Facial Expression Recognition, Segmentation, etc.)
- Write unit tests
- Implement FilterDrawer to visualize filters
- Auto-scale the filters and activations in the visualizations to a meaningful output dimension (seriously, 1x1 px filters are super small)
License
The software is provided under MIT license.