Yelp/Tron

Stars
340
Rank 124,317 (Top 3 %)
Language
Python
License
Other
Created about 14 years ago
Updated over 1 year ago

Yelp/Tron

Yelp

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Next generation batch process scheduling and management

Tron - Batch Scheduling System

Tron is a centralized system for managing periodic batch processes across a cluster. If you find cron or fcron to be insufficient for managing complex work flows across multiple computers, Tron might be for you.

Install with:

> sudo pip install tron

Or look at the tutorial.

The full documentation is available on ReadTheDocs.

Versions / Roadmap

Tron is changing and under active development.

It is being transformed from an ssh-based execution engine to a Mesos framework.

Tron development is specifically targeting Yelp's needs and not designed to be a general solution for other companies.

<= v0.6.2 - Stable version, recommended for non-Yelp installations.
= v1.0.0 - Stable mesos-based version

Contributing

Read Working on Tron and start sending pull requests!

Any issues should be posted on Github.

BerkeleyDB on Mac OS X

$ brew install berkeley-db
$ export BERKELEYDB_DIR=$(brew --cellar)/berkeley-db/<installed version>
$ export YES_I_HAVE_THE_RIGHT_TO_USE_THIS_BERKELEY_DB_VERSION=1

elastalert

Easy & Flexible Alerting With ElasticSearch

dumb-init

A minimal init system for Linux containers

detect-secrets

An enterprise friendly way of detecting and preventing secrets in code.

mrjob

Run MapReduce jobs on Hadoop or Amazon Web Services

osxcollector

A forensic evidence collection & analysis toolkit for OS X

paasta

An open, distributed platform as a service

undebt

A fast, straightforward, reliable tool for performing massive, automated code refactoring

MOE

A global, black box optimization engine for real world metric optimization.

dockersh

A shell which places users into individual docker containers

dataset-examples

Samples for users of the Yelp Academic Dataset

yelp.github.io

A showcase of projects we've open sourced and open source projects we use

bravado

Bravado is a python client library for Swagger 2.0 services

yelp-api

Examples of code using our v2 API

service-principles

A guide to service principles at Yelp for our service oriented architecture

swagger-gradle-codegen

💫 A Gradle Plugin to generate your networking code from Swagger

mysql_streamer

MySQLStreamer is a database change data capture and publish system.

pyleus

Pyleus is a Python framework for developing and launching Storm topologies.

yelp-fusion

Yelp Fusion API

docker-custodian

Keep docker hosts tidy

android-school

The best videos from the Android community and beyond

kafka-utils

bento

DEPRECATED - A delicious framework for building modularized Android user interfaces, by Yelp.

Testify

A more pythonic testing framework.

clusterman

Cluster Autoscaler for Kubernetes and Mesos

kotlin-android-workshop

A Kotlin Workshop for engineers familiar with Java and Android development.

threat_intel

Threat Intelligence APIs

nrtsearch

A high performance gRPC server on top of Apache Lucene

python-gearman

Gearman API - Client, worker, and admin client interfaces

py_zipkin

Provides utilities to facilitate the usage of Zipkin in Python

fuzz-lightyear

A pytest-inspired, DAST framework, capable of identifying vulnerabilities in a distributed, micro-service ecosystem through chaos engineering testing and stateful, Swagger fuzzing.

yelp-python

A Python library for the Yelp API

venv-update

Synchronize your virtualenv quickly and exactly.

firefly

Firefly is a web application aimed at powerful, flexible time series graphing for web developers.

amira

AMIRA: Automated Malware Incident Response & Analysis

aactivator

Automatically source and unsource a project's environment

YLTableView

love

A system to share your appreciation

lemon-reset

Consistent, cross-browser React DOM tags, powered by CSS Modules. 🍋

dataloader-codegen

🤖 dataloader-codegen is an opinionated JavaScript library for automatically generating DataLoaders over a set of resources (e.g. HTTP endpoints).

bravado-core

data_pipeline

Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.

detect-secrets-server

yelp-ruby

A Ruby gem for communicating with the Yelp REST API

swagger_spec_validator

ybinlogp

A fast mysql binlog parser

beans

Bringing people together, one cup of coffee at a time

casper

A fast web application platform built in Rust and Luau

schematizer

A schema store service that tracks and manages all the schemas used in the Data Pipeline

requirements-tools

requirements-tools contains scripts for working with Python requirements, primarily in applications.

osxcollector_output_filters

Filters that process and transform the output of osxcollector

sensu_handlers

Custom Sensu Handlers to support a multi-tenant environment, allowing checks themselves to emit the type of handler behavior they need in the event json

graphql-guidelines

GraphQL @ Yelp Schema Guidelines

kegmate

Arduino/iPad powered kegerator

ephemeral-port-reserve

Find an unused port, reliably

parcelgen

Helpful tool to make data objects easier for Android

salsa

A tool for exporting iOS components into Sketch 📱💎

yelp-ios

docker-observium

Observium docker image with both professional and community edition support, ldap auth, and easy plugin support.

yelp-android

terraform-provider-signalform

SignalForm is a terraform provider to codify SignalFx detectors, charts and dashboards

mycroft

pidtree-bcc

eBPF tool for logging process ancestry of outbound TCP connections

terraform-provider-gitfile

Terraform provider for checking out git repositories and making changes

ffmpeg-android

pushmanager

Pushmanager is a web application to manage source code deployments.

zygote

A Python HTTP process management utility.

yelp_kafka

An extension of the kafka-python package that adds features like multiprocess consumers.

pgctl

Manage sets of developer services -- "playground control"

EMRio

Elastic MapReduce instance optimizer

s3mysqldump

Dump mysql tables to s3, and parse them

android-varanus

A client-side Android library to monitor and limit network traffic sent by your apps

pyramid_zipkin

Pyramid tween to add Zipkin service spans

puppet-netstdlib

A collection of Puppet functions for interacting with the network

sqlite3dbm

sqlite-backed dictionary conforming to the dbm interface

send_nsca

Pure-python NSCA client

docker-push-latest-if-changed

data_pipeline_avro_util

Provides a Pythonic interface for reading and writing Avro schemas

cocoapods-readonly

Automatically locks all CocoaPod source files.

uwsgi_metrics

WebImageView

An enhanced and improved ImageView for Android that displays images loaded over the interwebs

task_processing

Interfaces and shared infrastructure for generic task processing at Yelp.

PushmasterApp

(Legacy) Yelp pushmaster application built on Google App Engine

tlspretense-service

A Docker container that exposes tlspretense on a port.

puppet-uchiwa

Puppet module for installing Uchiwa

yelp_cheetah

cheetah, hacked by yelpers

logfeeder

fido

Asynchronous HTTP client built on top of Crochet and Twisted

swagger-spec-compatibility

Python library to check Swagger Spec backward compatibility

pyramid-hypernova

A Python client for Airbnb's Hypernova server, for use with the Pyramid web framework.

mr3po

protocols for use with mrjob

YPFastDateParser

A class for parsing strings into NSDate instances, several times faster than NSDateFormatter

yelp_uri

Utilities for dealing with URIs, invented and maintained by Yelp.

pysensu-yelp

A Python library to emit Sensu events that the Yelp Sensu Handlers can understand for Self-Service Sensu Monitoring

terraform-provider-cloudhealth

Terraform provider for Cloudhealth

yelp-rails-example

An example Rails application that uses the Yelp gem to integrate with the API

named_decorator

Dynamically name wrappers based on their callees to untangle profiles of large python codebases

pt-online-schema-change-plugins

environment_tools

Tools for programmatically describing Yelp's different environments (prod, dev, stage)

puppet-cron

A super great cron Puppet module with timeouts, locking, monitoring, and more!

pyswf