• Stars
    star
    124
  • Rank 282,379 (Top 6 %)
  • Language
    Clojure
  • License
    Other
  • Created over 12 years ago
  • Updated over 12 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Automated deploy for Kafka on AWS

Automated deploy for a Kafka cluster on AWS. Can be used with Storm or standalone.

The deploy provisions and configures both Zookeeper and Kafka.

Usage

Install leiningen.

Set up your ~/.pallet/config.clj as described here

Start a cluster:

lein deps
lein run :deploy --start --name mykafkacluster --kn 8 --zn 2

This creates a cluster called "mykafkacluster" with 8 kafka nodes and 2 zookeeper nodes.

Stop a cluster:

lein run :deploy --stop --name mykafkacluster

More Repositories

1

storm

Distributed and fault-tolerant realtime computation: stream processing, continuous computation, distributed RPC, and more
Java
8,849
star
2

cascalog

Data processing on Hadoop without the hassle.
Clojure
1,374
star
3

storm-starter

Learn to use Storm!
Java
942
star
4

storm-contrib

A collection of spouts, bolts, serializers, DSLs, and other goodies to use with Storm
Java
580
star
5

elephantdb

Distributed database specialized in exporting key/value data from Hadoop
Java
557
star
6

storm-deploy

One click deploy for Storm clusters on AWS
Clojure
517
star
7

dfs-datastores

Dead-simple vertical partitioning, compression, appends, and consolidation of data on a distributed filesystem.
Java
216
star
8

storm-kestrel

Library to use Kestrel as a spout within Storm
Java
134
star
9

storm-mesos

Run Storm on top of the Mesos cluster resource manager
Java
68
star
10

nanny

A simple dependency management system for your projects.
Python
46
star
11

cascalog-contrib

Java
45
star
12

trident-memcached

Trident state implementation for Memcached
Java
41
star
13

cascalog-demo

A short Cascalog program that produces a simplified version of a Facebook-like news feed.
Clojure
26
star
14

basic-specter

Implementation of core of Specter without any optimizations – a reference to understand the basics of how Specter works
Clojure
23
star
15

cascading-batch-query

Optimized joins using bloom filters on Hadoop via Cascading.
Java
21
star
16

cascalog-workshop

Materials for Cascalog workshop
Clojure
18
star
17

elephantdb-cascalog

Seamless integration of ElephantDB with Cascalog
Clojure
18
star
18

trident-kafka

NOTE: This project has been moved into storm-kafka in storm-contrib
Java
15
star
19

elephantdb-cascading

Adapters to write to ElephantDB using Cascading
Java
13
star
20

specter-demo

Code for Strange Loop talk on Specter
Clojure
13
star
21

cascalog-conj

Code from my presentation of Cascalog at Clojure/conj 2011
Clojure
10
star
22

storm-website

Source for storm-project.net
CSS
7
star
23

thrift-dev

Apache Thrift + additional patches that I need
C++
6
star
24

specter-clojure-west

Clojure
6
star
25

swarm

Intense Space Invaders-like game with "terminal graphics"
C++
5
star
26

warzone

Turn based strategy game
Java
4
star
27

formula-inverse

A high-speed 3D racing game where the track can curve any which way and your car is bound to the track
C
4
star
28

specter-wiki

Repository for wiki of https://github.com/redplanetlabs/specter
4
star
29

cascalog-workshop-starter

Starter code for Cascalog workshop
Clojure
2
star
30

specter-presentation

Clojure
2
star