• Stars
    star
    501
  • Rank 88,002 (Top 2 %)
  • Language
    Ruby
  • License
    Other
  • Created over 14 years ago
  • Updated over 10 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Chef orchestration layer -- your system diagram come to life. Provision EC2, OpenStack or Vagrant without changes to cookbooks or configuration

Ironfan Core: Knife Tools and Core Models

Ironfan, the foundation of The Infochimps Platform, is an expressive toolset for constructing scalable, resilient architectures. It works in the cloud, in the data center, and on your laptop, and it makes your system diagram visible and inevitable. Inevitable systems coordinate automatically to interconnect, removing the hassle of manual configuration of connection points (and the associated danger of human error). For more information about Ironfan and the Infochimps Platform, visit infochimps.com.

This repo implements:

  • Core models to describe your system diagram with a clean, expressive domain-specific language
  • Knife plugins to orchestrate clusters of machines using simple commands like knife cluster launch
  • Logic to coordinate truth among chef server and cloud providers

Getting Started

To jump right into using Ironfan, follow our Installation Instructions. For an explanatory tour, check out our Web Walkthrough. Please file all issues on Ironfan issues.

Tools

Ironfan consists of the following Toolset:

  • ironfan-homebase: centralizes the cookbooks, roles and clusters. A solid foundation for any chef user.
  • ironfan gem:
    • core models to describe your system diagram with a clean, expressive domain-specific language
    • knife plugins to orchestrate clusters of machines using simple commands like knife cluster launch
    • logic to coordinate truth among chef server and cloud providers.
  • ironfan-pantry: Our collection of industrial-strength, cloud-ready recipes for Hadoop, HBase, Cassandra, Elasticsearch, Zabbix and more.
  • silverware cookbook: coordinate discovery of services ("list all the machines for awesome_webapp, that I might load balance them") and aspects ("list all components that write logs, that I might logrotate them, or that I might monitor the free space on their volumes".

Documentation

Note: Ironfan is not compatible with Ruby 1.8. All versions later than 1.9.2-p136 should work fine.

The Ironfan Way

  • Core Concepts -- Components, Announcements, Amenities and more.
  • Philosophy -- Best practices and lessons learned
  • Style Guide -- Common attribute names, how and when to include other cookbooks, and more
  • Homebase Layout -- How this homebase is organized, and why

Getting Help

More Repositories

1

wukong

Ruby on Hadoop: Efficient, effective Hadoop streaming & bulk data processing. Write micro scripts for terabyte-scale data
Ruby
497
star
2

wonderdog

Bulk loading for elastic search
Java
186
star
3

big_data_for_chimps

A Seriously Fun guide to Big Data Analytics in Practice
Ruby
169
star
4

configliere

Wise, discreet configuration for ruby scripts: integrate config files, environment variables and command line with no fuss
Ruby
122
star
5

ironfan-pantry

Battle-hardened Ironfan-ready big data chef cookbooks, laden with best practices and love from your friends at Infochimps
Python
99
star
6

ironfan-homebase

Skeleton homebase for Ironfan and Chef -- use this to hold your clusters, cookbooks and stacks
Ruby
34
star
7

data_science_fun_pack

Meta-repository of big data tools -- source and essential plugins for hadoop, pig, wukong, storm, kafka etc.
Java
29
star
8

gorillib

Gorillib: infochimps lightweight subset of ruby convenience methods
Ruby
17
star
9

ironfan-ci

Continuous Integration testing of ironfan clusters and chef cookbooks. Pass your system diagram into iron law,
Ruby
17
star
10

wukong-hadoop

Execute Wukong code within the Hadoop framework.
Ruby
13
star
11

ironfan-repoman

Rake tasks to syndicate out 50 cookbooks from ironfan-pantry into distinct isolated repos. Don't look in the trunk, repo man.
Ruby
13
star
12

chimpstation-homebase

it's like rocket fuel for cookbook development
Ruby
10
star
13

icss

Infochimps Stupid Schema library: an avro-compatible data description standard. ICSS completely describes a collection of data (and associated assets) in a way that is expressive, scalable and sufficient to drive remarkably complex downstream processes.
Ruby
9
star
14

vayacondios

Data goes in. The right thing happens.
Ruby
8
star
15

swineherd-fs

Filesystem Abstraction for S3, HDFS and normal filesystem
Ruby
5
star
16

senor_armando

Skeleton Goliath (http://goliath.io) App layout
Ruby
5
star
17

wukong-storm

Storm plugin for Wukong
Java
5
star
18

iron_cuke

Integration tests for the cloud, done right.
Ruby
4
star
19

wukong-load

Plugin that makes it easy to load, dump, and sync data between Wukong and various data stores
Ruby
4
star
20

community-pantry

Ironfan cookbooks not currently maintained by Infochimps
Ruby
3
star
21

wukong-deploy

Deploy pack framework for the Infochimps Platform
Ruby
2
star
22

dotfiles

dotfiles (.zshrc, .emacs.d, etc) for an infochimps standard workstation
Ruby
2
star
23

infochimps-labs.github.com

infochimps open source reference pages
JavaScript
2
star
24

pigsy

UDFs and Loaders for Apache Pig -- geodata and more on hadoop
Java
2
star
25

dark_siphon

A Goliath web app for duplicating production traffic to another system.
Ruby
2
star
26

bare-pantry

An empty Ironfan pantry
Ruby
1
star
27

goliath-chimp

Collection of Chimp-inspired Goliath/Rack utility classes
Ruby
1
star
28

wukong_for_r

How to use Wukong to run R scripts in Hadoop as well as locally
R
1
star
29

kibana-es-plugin

CSS
1
star