• Stars
    star
    465
  • Rank 94,287 (Top 2 %)
  • Language
    Haskell
  • License
    Apache License 2.0
  • Created about 8 years ago
  • Updated over 6 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A Programming Language for Deep Learning

DEPRECATED.

DeepDarkFantasy

Hackage Join the chat at https://gitter.im/ThoughtWorksInc/DeepDarkFantasy Build Status Coverage Status

What if we combine Functional Programming and Deep Learning?

As we all know, a neural network is just a computable math expression (and hence a program).

Can we add 'ordinary' programming construct to a 'neural network', like branch, loop, pair, sum, list, and function?

Of course, I must still be able to train the network.

Yes! I had add all the above construct, and I am planning to add more.

They all had their own special gradient structure to propagate loss accordingly.

However, in the end of the day, what is updated is only container of double (or other representation of real). Having those construct only make you write networks easier, but does not offer fundamentally different learning capability.


Can we make the language typed so we can detect error before we train the network?

Sort of. I am able to type most stuff, but I am having trouble adding higher kinded type/generic type. However, they can be written as Haskell function (macro in DDF).


Can we make the language modular and extensible so all people can write all sorts of Chuck Norris move into the language?

Yes Yes Yes! The whole language is structured in finally tagless style, so, it is possible to add new operation/constructor, and still retain type safety.

In fact, there isn't even a core language! All feature(function, double, back propagation, pretty printing) is added as ordinary plugin so you can extend/subset the language as you can wish.

Patchouli Go!

You should read the blog before anything.

We have a few example on using DDF:

Hello world

Solving polynomial equation

Training XOR Network

If you want to look into the code base, it is necessary to understand Finally Tagless.

FA Q

Q: How is the speed?

A: Unoptimized. This is more of a proof of concept that we can use function in neural network, than something that can get you good kaggle score right off the shelf. We are working on Partial Evaluation.

Q: Why does this work theoretically?

A: See DDFADC

Q: What does this have to do with Yang Bo's DeepLearning.scala?

A: We work on a prototype for 2-3 months, and split apart.

Q: You seems to have a space in FAQ.

A: I like it that way.

Q: What are you currently working on?

A: I am trying to add a neural network demo.

Thank You Sir

This is heavily inspired by Neural Networks, Types, and Functional Programming, and my colleague, Yang Bo.

Also, I'd like to thanks dram for getting it to work without Incoherent Instances, and fixing it on stack, cabal & travis.

And izgzhen helps with the initial version of Partial Evaluation.

You can be the next contributor!

I Want You image courtesy of Milk Mage aquired here

Please look at This Issue and help solve it.

More Repositories

1

Binding.scala

Reactive data-binding for Scala
Scala
1,579
star
2

DeepLearning.scala

A simple library for creating complex neural networks
Scala
766
star
3

cd4ml-workshop

Repository with sample code and instructions for "Continuous Intelligence" and "Continuous Delivery for Machine Learning: CD4ML" workshops
Jupyter Notebook
316
star
4

Dsl.scala

A framework to create embedded Domain-Specific Languages in Scala
Scala
255
star
5

each

A macro library that converts native imperative syntax to scalaz's monadic expressions
Scala
253
star
6

guia-de-desenvolvimento-tecnico

JavaScript
206
star
7

Compute.scala

Scientific computing with N-dimensional arrays
Scala
199
star
8

CD4ML-Scenarios

Repository with sample code and instructions for "Continuous Intelligence" and "Continuous Delivery for Machine Learning: CD4ML" workshops
Python
138
star
9

microbuilder

A toolset that helps you build system across multiple micro-services and multiple languages.
HTML
93
star
10

sbt-api-mappings

An Sbt plugin that fills apiMappings for common Scala libraries.
Scala
88
star
11

enableIf.scala

A library that toggles Scala code at compile-time, like #if in C/C++
Scala
65
star
12

todo

Binding.scala • TodoMVC
Scala
60
star
13

sinais

🔣 Desenvolvimento passo a passo do exemplo `sinais` em Go.
Go
59
star
14

sbt-best-practice

Configure common build settings for a Scala project
Scala
56
star
15

TWU101-TDDIntro

Java
46
star
16

template.scala

C++ Flavored Template Metaprogramming in Scala
Scala
40
star
17

future.scala

Stack-safe asynchronous programming
Scala
39
star
18

ml-app-template

An ML project template with sensible defaults
Python
37
star
19

sbt-scala-js-map

A Sbt plugin that configures source mapping for Scala.js projects hosted on Github
Scala
36
star
20

aws_role_credentials

Generates AWS credentials for roles using STS
Python
34
star
21

transervicos

Ruby
33
star
22

RAII.scala

Resource Acquisition Is Initialization
Scala
32
star
23

sbt-example

Run Scaladoc as unit tests
Scala
31
star
24

feature.scala

Access Scala language features on the type-level
Scala
31
star
25

sbt-ammonite-classpath

Export the classpath for Ammonite and Almond
Scala
27
star
26

Import.scala

A Scala compiler plugin for magic imports
Scala
26
star
27

JS-Monthly-Chengdu

CSS
23
star
28

infra-problem

resources for the infrastructure as code practical assessment
Clojure
23
star
29

bindable.scala

User-friendly Binding.scala components
Scala
23
star
30

implicit-dependent-type

Scala
22
star
31

Extractor.scala

Make PartialFunction and extractors composable
Scala
22
star
32

ml-cd-starter-kit

Set up cross-cutting services (e.g. CI server, monitoring) for ML projects using kubernetes and helm
Smarty
22
star
33

objective8

For the most up to date version of this project, see https://github.com/d-cent/objective8
Clojure
21
star
34

oktaauth

Module and CLI client to handle Okta authentication
Python
20
star
35

js-test-project

JavaScript
18
star
36

tryt.scala

Monad transformers for exception handling
Scala
18
star
37

lein-s3-static-deploy

Lein task to deploy static website to s3 bucket.
Clojure
17
star
38

DesignPattern.scala

Functional Programming Design Patterns
Scala
17
star
39

daffy

Function decorators for Pandas Dataframe column name and data type validation
Python
15
star
40

TWTraining

Open source ThoughtWorks training materials
HTML
15
star
41

dsl-domains-cats

Scala
12
star
42

Q.scala

Convert any value to code
Scala
12
star
43

ZeroCost.scala

Zero-cost Abstractions in Scala
Scala
10
star
44

Constructor.scala

Mixin classes and traits dynamically
Scala
10
star
45

dataclouds

Blog for dataclouds@thoughtworks.
CSS
10
star
46

tf-image-interpreter

Object detection and text spotting from images of any size. Based on TensorFlow.
Python
10
star
47

WorkingEffectivelyWithLegacyCode

Java
10
star
48

Binding.scala-website

Scala
9
star
49

voter-service

The Voter Spring Boot RESTful Web Service, backed by MongoDB, is used for DevOps-related training and testing.
Java
9
star
50

OpenStack-EC2-Driver

OpenStack-EC2-Driver
9
star
51

stonecutter

[Main repo found at https://github.com/d-cent/stonecutter] A D-CENT project: an easily deployable oauth server for small organisations.
Clojure
9
star
52

streaming-data-pipeline

Streaming pipeline repo for data engineering training program
Scala
9
star
53

JavaBootcamp

Java
8
star
54

java-test-project

Java
7
star
55

infra-code-workshop

TechRadar Academy em PoA - Cloud
7
star
56

twseleniumworkshop

Workshop Selenium Belo Horizonte - Setembro 2014
Java
7
star
57

DeepLearning.scala-website

The website of DeepLearning.scala
CSS
7
star
58

AS101-4-workshop

Python
7
star
59

skadoosh

Here we have the building blocks of a virtual entity in the making (in crude words, a chat bot - but don't call it that. It gets offended).
Python
7
star
60

json-stream-core

Universal Serialization Framework for JSON
Haxe
6
star
61

ScaleWorks_YUMChina

Ruby
6
star
62

microbuilder-core

Haxe
6
star
63

clj-http-s3

Middleware to allow cli-http to authenticate with s3
Clojure
6
star
64

lein-filegen

A leiningen plugin to generate files
Clojure
6
star
65

expend-rs

Internal application to submit certain expenses to ThoughtWorks' system
Rust
6
star
66

LatestEvent.scala

bidirectional data-binding and routing for Scala.js
Scala
6
star
67

sbt-jdeps

an sbt plugin to run JDeps
Scala
5
star
68

modularizer

Scala
5
star
69

twu-toolkit

Calendar generator for TWU
Ruby
5
star
70

twcss

CSS Coding Guidelines
5
star
71

loans-lah-tdd-workshop

JavaScript
5
star
72

Binding.scala-play-template

Scala
5
star
73

TypeOf.scala

Create types from expressions
Scala
4
star
74

SG-ObjectBootcamp

Java
4
star
75

sbt-delombok

an sbt plug-in to delombok Java sources files that contain Lombok annotations
Scala
4
star
76

zeratul

a wrapper for JPA
Java
4
star
77

CSharpTestProject

C#
4
star
78

HashRoute.scala

Scala
4
star
79

Tensor.scala

A totally functional DSL for general purpose GPU programming
4
star
80

akka-http-rpc

Turn akka-http to a RPC server
Scala
4
star
81

monadic-deep-learning

TeX
4
star
82

wxapp-workshop

3
star
83

sde

Scala
3
star
84

clojuregoat

A goat, in Clojure
Clojure
3
star
85

go-maven-poller

Go plugin that polls Maven (Nexus) repositories
3
star
86

sonic

React UI Components
JavaScript
3
star
87

mooncake

A D-CENT project: Secure notifications combined with w3 activity streams
Clojure
3
star
88

Binding.scala-activator-template

Scala
3
star
89

offnet

The Unified Neural Network
Jupyter Notebook
3
star
90

akka-http-webjars

Serve static assets from WebJars
Scala
3
star
91

scala-project-template

3
star
92

aem-training-2016

Code repo for AEM training in August 2016.
Java
3
star
93

helsinki

[Main repo found at https://github.com/d-cent/decisionsproto] Spike for indexing data from the Open Ahjo API in elasticsearch
Python
3
star
94

hackerbrasileiro

Java
3
star
95

FallbackLookupStrategy.java

Java
2
star
96

cep-conference

Core Engineering Practices "Conference" exercise
Java
2
star
97

Cifar10.scala

Scala
2
star
98

infra-code-devopslabs01

TechRadar Academy - Cloud Workshop - IaC
Python
2
star
99

Kaleidoscopez

JavaScript
2
star
100

android-test-project

Kotlin
2
star