petewarden/dstk

Stars
1,125
Rank 41,364 (Top 0.9 %)
Language
Ruby
Created over 13 years ago
Updated about 8 years ago

petewarden/dstk

petewarden

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

A collection of the best open data sets and open-source tools for data science

Data Science Toolkit

Data Science Toolkit

By Pete Warden <[email protected]>

A collection of the best open data sets and open-source tools for data science, wrapped in an easy-to-use REST/JSON API with command line, Python and Javascript interfaces. Available as a self-contained VM or EC2 AMI that you can deploy yourself.

See www.datasciencetoolkit.org/developerdocs for full documentation.

Server code dual-licensed under the MIT and GPL licenses, see mit.txt and gpl.txt for details.

iPhoneTracker

c_hashmap

A simple string hashmap in C

spchcat

Speech recognition tool to convert audio to text transcripts, for Linux and Raspberry Pi.

open-speech-recording

Web application to record speech for an open data set

ParallelCurl

A PHP class providing an easy interface for running multiple concurrent CURL requests

dstkdata

The (large) data files needed for the Data Science Toolkit project

geodict

A simple Python library/tool for pulling location information from unstructured text

findbyemail

A PHP module that incorporates all known APIs that map an email address to user information

openheatmap

A web renderer for geographic heat maps, using OpenStreetMap compatible file formats

extract_loudest_section

Trims .wav audio files to the loudest section of a given length

buzzprofilecrawl

A simple script to crawl Google Profile pages and extract their information as structured data

tensorflow_makefile

catdoc

Command-line utility for converting Microsoft Word documents to text

stm32_bare_lib

Simple examples and utilities for the STM32 "Blue Pill"

picoproto

Abominably Tiny Protobuf File Parser in C++

ble_file_transfer

Example of transferring file data over BLE using an Arduino Nano Sense and WebBLE

crunchcrawl

A project to gather, analyze and visualized the data in Crunchbase

salesforce_restphp_example

A minimal example showing how to handle the OAuth login process and make API calls using the Salesforce REST interface in PHP

pyparallelcurl

A simple Python class for running multiple URL fetches in parallel

handmadeimap

An implementation of IMAP and POP3 in PHP using raw sockets rather than the php-imap extension

common_crawl_types

A simple Ruby example of how to process Common Crawl files using Elastic MapReduce

pagerankgraph

Visualizes search engine ranking algorithms for a given domain

magic_wand

Magic Wand example for TensorFlow Lite Micro

Jupyter Notebook

genderfromname

A PHP port of the Perl Text::GenderFromName module

tensorflow_ios

openwordcloud

Renders word clouds using HTML5's Canvas element

linkedinoauthexample

A minimal example showing how to handle the OAuth login process for LinkedIn using PHP

MLloWorld

Shows how to write a simple data contest entry for Kaggle, using scikit-learn for machine learning algorithms

geoip_example

A simple example showing how to use the GeoIP API in PHP with the free database from http://maxmind.com

boilerpipe

A branch of the boilerpipe project

arduino_nano_ble_write_flash

An example of modifying flash memory on the Arduino Nano BLE Sense 33 from a sketch, using Mbed.

postgis2gmap

A small collection of PL/PGSQL functions for converting to and from Google's map tile coordinates

delicious_tags

A demonstration showing how to use the Delicious API to retrieve the top tags for a URL

simpledb_loader

A Java project exploring the fastest way to upload data to Amazon's SimpleDB

hellosocialworld

A minimal but complete example of a site relying on authentication and sharing through Twitter and Facebook

cruftstripper

Pulls strings that statistically look like valid sentences from unstructured text

GeocodeFile

A PHP script to turn a file of addresses into latitude, longitude coordinates

cc2text

An example job that converts Common Crawl archived web pages into text

memory_planner

Prototype for a memory planner for TensorFlow Lite Micro

ml_memory_analyser

Runtime memory usage analysis utilities for ML models

tf_ios_makefile_example

A simple iOS example showing how to use the iOS library produced by TensorFlow's makefile.

twitteroauthexample

An example of how to implement the UI workflow for Twitter's oAuth process in PHP

flxjs

A javascript library emulating the Flex 3 Matrix, Point and Rectangle classes

schoolcrawl

Crawls the value-added school effectiveness data from the LA Times website

copyoptimizer

An example of using KissMetrics to measure and optimize your landing page copy

cuda-convnet

stt_standalone_client

Copy of the example program from Coqui's open-source library with just the files needed to compile against a binary release.

osm2pgsql

A fork of the importer for OpenStreetMap format files in PostGIS

invite_example

Sample code for the InvitesDoneRight service

stitchingbug

A demonstration of a polygon stitching problem with the HTML5 Canvas element

magic_wand_digit_data

Digit gesture training data for the Arduino BLE Nano Sense magic wand

pico_colabs

Colab notebooks for building Raspberry Pi Pico examples on the web

Jupyter Notebook

minimalprofiler

A super-simple profiler for Ruby

geocodetest

Measures the quality of address to coordinate results across multiple services

parec

Standalone version of the Pulse Audio pacat example

datathon

Support code for the ASA Datathon

magic_wand_capture

v4l2_opengl

Minimal example of using Video for Linux 2 together with OpenGL to display a live camera feed

pico_multicore_coherence_test

Minimal repro example for a memory coherence problem I encountered when running on the RP2040's dual cores

petesplugins

My old open-source video effects

cliargs_py

A utility module to make handling command line arguments in Python easier

mbed-hello-world

Starter program for the mbed IDE for ARM M-class microcontrollers

sinatraperftoolsexample

A minimal example of how to use Perftools in Sinatra

cliargs

Easily get command-line arguments for PHP scripts, with error-checking and built-in usage help

tensorflow_apq8009

invitesdoneright

BitBrain_C_Code

GitHub version of BitBrain code repository

bookiewatcher

Ruby script for analyzing the voting patterns on the bookie poll

person_sensor_blues_web

Web frontend for the Blues/Person Sensor integration

streaming_speech_metrics

Python library for analyzing the latency and accuracy of streaming speech to text systems