crowdmob/kafka-s3-consumer

Stars
15
Rank 1,371,379 (Top 28 %)
Language
Go
License
Other
Created over 11 years ago
Updated about 11 years ago

crowdmob/kafka-s3-consumer

crowdmob

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Consumes Kafka topics specified in the config, and outputs them in chunks as desired in an S3 Bucket. Keeps track of offsets via S3.

chef-golang-web-server-cookbook

Chef Cookbook that downloads a custom Go webserver repository from GitHub, builds, and runs it using monit. Confirmed working with Amazon OpsWorks.

redshift-tracking-copy-from-s3

An executable that polls S3 for added files, and runs a COPY command in Amazon Redshift for the new file.

chef-sinatra

Configures and deploys a sinatra app. Confirmed to work with Amazon OpsWorks

chef-opsworks-elb

Chef cookbook to dynamically register and unregister an instance from ELB

chef-kafka-s3-consumer-cookbook

Chef Cookbook that downloads the crowdmob/kafka-s3-consumer repository from GitHub, builds, and runs it using monit. Confirmed working with Amazon OpsWorks.

nutty

An opinionated web framework in go (golang) that is built to work with Kafka, DynamoDB, and SNS.

mobdeals-ui

Common assets for mobdeals apps in a single place

integrate-server

Server to server installs tracking integration.

lib-ios

chef-monit

Chef cookbook to install monit, confirmed to be working with Amazon OpsWorks.

integrate-ios

integrate-android

routes-client

Loads routes for all CrowdMob Apps into an app.

hpricotscape

A browser for master web scrapers. It saves cookies, has a decent user agent, sends referer urls, and let's you (the scraper) easily submit forms on the page. It *doesn't* run the page's javascript yet, however.