• Stars
    star
    442
  • Rank 95,261 (Top 2 %)
  • Language
    Swift
  • Created about 7 years ago
  • Updated about 7 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Source code for my blog post "Getting started with TensorFlow on iOS"

TensorFlow on iOS demo

This is the code that accompanies my blog post Getting started with TensorFlow on iOS.

It uses TensorFlow to train a basic binary classifier on the Gender Recognition by Voice and Speech Analysis dataset.

This project includes the following:

  • The dataset in the file voice.csv.
  • Python scripts to train the model with TensorFlow on your Mac.
  • An iOS app that uses the TensorFlow C++ API to do inference.
  • An iOS app that uses Metal to do inference using the trained model.

Training the model

To train the model, do the following:

  1. Make sure these are installed: python3, numpy, pandas, scikit-learn, tensorflow.
  2. Run the split_data.py script to divide the dataset into a training set and a test set. This creates 4 new files: X_train.npy, y_train.npy, X_test.npy, and y_test.npy.
  3. Run the train.py script. This trains the logistic classifier and saves the model to /tmp/voice every 10,000 training steps. Training happens in an infinite loop and goes on forever, so press Ctrl+C when you're happy with the training set accuracy and the loss no longer becomes any lower.
  4. Run the test.py script to compute the accuracy on the test set. This also prints out a report with precision / recall / f1-score and a confusion matrix.

Using the model with the iOS TensorFlow app

To run the model on the iOS TensorFlow app, do the following:

  1. Clone TensorFlow and build the iOS library.
  2. Open the VoiceTensorFlow Xcode project. In Build Settings, Other Linker Flags and Header Search Paths, change the paths to your local installation of TensorFlow.

The model is already included in the app as inference.pb. If you train the model with different settings, you need to run the freeze_graph and optimize_for_inference tools to create a new inference.pb.

Using the model with the iOS Metal app

To run the model on the iOS Metal app, do the following:

  1. Run the export_weights.py script. This creates two new files that contain the model's learned parameters: W.bin for the weights and b.bin for the bias.
  2. Copy W.bin and b.bin into the VoiceMetal Xcode project and build the app.

You need to run the Metal app on a device, it won't work in the simulator.

More Repositories

1

neural-engine

Everything we actually know about the Apple Neural Engine (ANE)
1,865
star
2

CoreMLHelpers

Types and functions that make it a little easier to work with Core ML in Swift.
Swift
1,331
star
3

Forge

A neural network toolkit for Metal
Swift
1,267
star
4

YOLO-CoreML-MPSNNGraph

Tiny YOLO for iOS implemented using CoreML but also using the new MPS graph API.
Swift
925
star
5

MobileNet-CoreML

The MobileNet neural network using Apple's new CoreML framework
Swift
702
star
6

MHTabBarController

A custom tab bar controller for iOS 5
Objective-C
490
star
7

BlazeFace-PyTorch

The BlazeFace face detector model implemented in PyTorch
Jupyter Notebook
405
star
8

coreml-survival-guide

Source code for the book Core ML Survival Guide
Python
240
star
9

MHRotaryKnob

UIControl for iOS that acts like a rotary knob
Objective-C
196
star
10

VGGNet-Metal

iPhone version of the VGGNet convolutional neural network for image recognition
Swift
182
star
11

Swift-3D-Demo

Shows how to draw a 3D object without using shaders
Swift
177
star
12

synth-plugin-book

Source code for the book Code Your Own Synth Plug-Ins With C++ and JUCE
C++
164
star
13

MHLazyTableImages

This project is now deprecated.
Objective-C
157
star
14

SoundBankPlayer

Sample-based audio player for iOS that uses OpenAL.
Objective-C
156
star
15

MHPagingScrollView

A UIScrollView subclass that shows previews of the pages on the left and right.
Objective-C
132
star
16

reliability-diagrams

Reliability diagrams visualize whether a classifier model needs calibration
Jupyter Notebook
128
star
17

mda-plugins-juce

JUCE implementations of the classic MDA audio plug-ins
C
110
star
18

coreml-training

Source code for my blog post series "On-device training with Core ML"
Jupyter Notebook
97
star
19

Inception-CoreML

Running Inception-v3 on Core ML
Swift
97
star
20

metal-gpgpu

Collection of notes on how to use Apple’s Metal API for compute tasks
96
star
21

Matrix

A fast matrix type for Swift
Swift
93
star
22

AudioBufferPlayer

Class for doing simple iOS sound synthesis using Audio Queues.
Objective-C
85
star
23

MHNibTableViewCell

This code is now deprecated.
Objective-C
80
star
24

CoreML-Custom-Layers

Source code for the blog post "Custom Layers in Core ML"
Swift
72
star
25

InsideCoreML

Python script to examine Core ML's mlmodel files
Python
64
star
26

BNNS-vs-MPSCNN

Compares the speed of Apple's two deep learning frameworks: BNNS and Metal Performance Shaders
Swift
60
star
27

TransparentJPEG

Allows you to combine a JPEG with a second image to give it transparency.
Objective-C
59
star
28

TheKissOfShame

DSP Magnetic Tape Emulation
C++
47
star
29

synth-recipes

Code snippets of sound synthesis algorithms in C++
C++
46
star
30

TinyML-HelloWorld-ArduinoUno

The TinyML "Hello World" sine wave model on Arduino Uno v3
Jupyter Notebook
43
star
31

WashedOut

Color theme for Xcode 8 based on the colors from the WWDC 2016 slides
42
star
32

RNN-Drummer-Swift

Using a recurrent neural network to teach the iPhone to play drums
Python
42
star
33

BuildYourOwnLispInSwift

A simple LISP interpreter written in Swift
Swift
34
star
34

SemanticSegmentationMetalDemo

Drawing semantic segmentation masks with Metal
Swift
33
star
35

MHSemiModal

Category on UIViewController that makes it easy to present modal view controllers that only partially cover the screen.
Objective-C
32
star
36

Deepfish

Live visualization of convolutional neural network using the iPhone's camera
Swift
24
star
37

MHPopoverManager

A simple class for managing the lifecycle of your UIPopoverControllers
Objective-C
23
star
38

MPS-Matrix-Multiplication

Playing with the Metal Performance Shaders matrix multiplication kernel
Swift
23
star
39

sefr-swift

The SEFR classifier implemented in Swift
Swift
21
star
40

Railroad-Diagrams-Swift

Library for making railroad diagrams in Swift
Swift
19
star
41

AVBufferPlayer

Shows how to use AVAudioPlayer to play a buffer of waveform data that you give it.
Objective-C
16
star
42

GalaxyApocalypse

My January 2013 game for #OneGameADay (iPhone). The galaxy is falling apart and it's your job to move all the planets back to where they belong. Lots of swiping involved.
Objective-C++
15
star
43

fft-juce

Example code for my blog post FFT Processing in JUCE
C++
12
star
44

MHTintHelper

Tool that quickly lets you pick tint colors for navigation bars etc.
Objective-C
12
star
45

MHDatabase

A simple Objective-C wrapper around the sqlite3 functions.
Objective-C
11
star
46

Ignition

PyTorch helper code
Python
10
star
47

Logistic-Regression-Swift

A basic example of how to implement logistic regression in Swift
Swift
9
star
48

ShrinkPng

Simple tool for shrinking images 50% by averaging the color (and alpha) of each 2x2 pixel block.
Objective-C
9
star
49

airwindows-juce

JUCE versions of selected Airwindows plug-ins
C++
8
star
50

MHOverlayWindow

A simple example of how to make a UIWindow that appears on top of everything else, including the status bar.
Objective-C
7
star
51

pumpkin

Everything must bounce!
Swift
7
star
52

MHOverride

Category on NSObject that lets you override methods on existing objects using blocks, without having to make a subclass.
Objective-C
7
star
53

levels

Basic digital level meter plug-in.
C++
5
star
54

ThreeBandEQ

Simple bass/mids/treble equalizer plugin written in JUCE
C++
3
star
55

RWDevCon-App-Architecture

Source code for my RWDevCon talk on app architecture.
Swift
3
star
56

MHMetaColors

Category that allows you to write, for example, [UIColor xFF3399] to make a new UIColor object with values #FF3399.
Objective-C
3
star
57

RWDevCon-Swift-Closures-Generics

Source code for my RWDevCon talk on Swift closures and generics.
Swift
2
star
58

hollance

1
star
59

hollance.github.io

CSS
1
star