infochimps-labs/swineherd-fs

Stars
5
Rank 2,861,937 (Top 57 %)
Language
Ruby
License
Apache License 2.0
Created almost 13 years ago
Updated over 12 years ago

infochimps-labs/swineherd-fs

infochimps-labs

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Filesystem Abstraction for S3, HDFS and normal filesystem

ironfan

Chef orchestration layer -- your system diagram come to life. Provision EC2, OpenStack or Vagrant without changes to cookbooks or configuration

wukong

Ruby on Hadoop: Efficient, effective Hadoop streaming & bulk data processing. Write micro scripts for terabyte-scale data

wonderdog

Bulk loading for elastic search

big_data_for_chimps

A Seriously Fun guide to Big Data Analytics in Practice

configliere

Wise, discreet configuration for ruby scripts: integrate config files, environment variables and command line with no fuss

ironfan-pantry

Battle-hardened Ironfan-ready big data chef cookbooks, laden with best practices and love from your friends at Infochimps

ironfan-homebase

Skeleton homebase for Ironfan and Chef -- use this to hold your clusters, cookbooks and stacks

data_science_fun_pack

Meta-repository of big data tools -- source and essential plugins for hadoop, pig, wukong, storm, kafka etc.

gorillib

Gorillib: infochimps lightweight subset of ruby convenience methods

ironfan-ci

Continuous Integration testing of ironfan clusters and chef cookbooks. Pass your system diagram into iron law,

wukong-hadoop

Execute Wukong code within the Hadoop framework.

ironfan-repoman

Rake tasks to syndicate out 50 cookbooks from ironfan-pantry into distinct isolated repos. Don't look in the trunk, repo man.

chimpstation-homebase

it's like rocket fuel for cookbook development

icss

Infochimps Stupid Schema library: an avro-compatible data description standard. ICSS completely describes a collection of data (and associated assets) in a way that is expressive, scalable and sufficient to drive remarkably complex downstream processes.

vayacondios

Data goes in. The right thing happens.

senor_armando

Skeleton Goliath (http://goliath.io) App layout

wukong-storm

Storm plugin for Wukong

iron_cuke

Integration tests for the cloud, done right.

wukong-load

Plugin that makes it easy to load, dump, and sync data between Wukong and various data stores

community-pantry

Ironfan cookbooks not currently maintained by Infochimps

wukong-deploy

Deploy pack framework for the Infochimps Platform

dotfiles

dotfiles (.zshrc, .emacs.d, etc) for an infochimps standard workstation

infochimps-labs.github.com

infochimps open source reference pages

pigsy

UDFs and Loaders for Apache Pig -- geodata and more on hadoop

dark_siphon

A Goliath web app for duplicating production traffic to another system.

bare-pantry

An empty Ironfan pantry

goliath-chimp

Collection of Chimp-inspired Goliath/Rack utility classes

wukong_for_r

How to use Wukong to run R scripts in Hadoop as well as locally

kibana-es-plugin