uber-archive/cherami-server

This repository has been archived on 18/Feb/2021
Stars
1,417
Rank 32,060 (Top 0.7 %)
Language
Go
License
MIT License
Created almost 8 years ago
Updated about 4 years ago

uber-archive/cherami-server

uber-archive

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Distributed, scalable, durable, and highly available message queue system. This project is deprecated and not maintained.

cherami-server

DISCLAIMER: This project is deprecated and not maintained

Cherami is a distributed, scalable, durable, and highly available message queue system we developed at Uber Engineering to transport asynchronous tasks.

This repo contains the source code of Cherami server, cross-zone replicator server, and several tools. Your application needs to use the client to interact with the server. The client can be found here.

Getting started

To get cherami-server:

git clone [email protected]:uber/cherami-server.git $GOPATH/src/github.com/uber/cherami-server

Build

We use glide to manage Go dependencies. Please make sure glide is in your PATH before you attempt to build.

Build the cherami-server and other binaries (will not run test):

make bins

Local Test

We need a Cassandra running locally in order to run the integration tests. Please make sure cqlsh is in /usr/local/bin, and it can connect to the local Cassandra server.

make test

Run Cherami locally

Setup the cherami keyspace for metadata:

RF=1 ./scripts/cherami-setup-schema

The service can be started as follows:

CHERAMI_ENVIRONMENT=local ./cherami-server start all

Note: cherami-server is configured via config/base.yaml with some parameters overriden by config/local.yaml. In this config, Cherami is bound to localhost.

One can use the CLI to verify if Cherami is running properly:

./cherami-cli --env=prod --hostport=127.0.0.1:4922 create destination /test/cherami

Deploy Cherami as a cluster

Documentation coming soon....

Contributing

We'd love your help in making Cherami great. If you find a bug or need a new feature, open an issue and we will respond as fast as we can. If you want to implement new feature(s) and/or fix bug(s) yourself, open a pull request with the appropriate unit tests and we will merge it after review.

Note: All contributors also need to fill out the Uber Contributor License Agreement before we can merge in any of your changes.

Documentation

Interested in learning more about Cherami? Read the blog post: eng.uber.com/cherami

License

MIT License, please see LICENSE for details.

go-torch

Stochastic flame graph profiler for Go programs

pyflame

🔥 Pyflame: A Ptracing Profiler For Python. This project is deprecated and not maintained.

image-diff

Create image differential between two images

makisu

Fast and flexible Docker image building tool, works in unprivileged containerized environments like Mesos and Kubernetes.

cpustat

high frequency performance measurements for Linux. This project is deprecated and not maintained.

AthenaX

SQL-based streaming analytics platform at scale

plato-research-dialogue-system

This is the Plato Research Dialogue System, a flexible platform for developing conversational AI agents.

npm-shrinkwrap

A consistent shrinkwrap tool

chaperone

A Kafka audit system

coding-challenge-tools

Uber's tools team coding challenge

hyperbahn

Service discovery and routing for large scale microservice operations

sql-differential-privacy

Dataflow analysis & differential privacy for SQL queries. This project is deprecated and not maintained.

phabricator-jenkins-plugin

Jenkins plugin to integrate with Phabricator, Harbormaster, and Uberalls

ohana-ios

Contacts simplified. This project is deprecated and not maintained.

rave

A data model validation framework that uses java annotation processing.

jetstream-ios

An elegant model framework written in Swift

node-stap

Tools for analyzing Node.js programs with SystemTap. This project is deprecated and not maintained.

r-dom

React DOM wrapper

focuson

A tool to surface security issues in python code

cherami-client-go

Go Client Implementation of Cherami - A distributed, scalable, durable, and highly available message queue system. This project is deprecated and not maintained.

viewport-mercator-project

NOTE: The viewport-mercator-project repo is archived and code has moved to

infer-plugin

Gradle plugin that allows easy integration with the infer static analyzer.

express-statsd

Statsd route monitoring middleware for connect/express

android-build-environment

Docker repository for android build environment

in-n-out

A library to perform point-in-geofence searches.

buck-http-cache

An Implementation of Buck's HTTP Cache API as a distributed cache service. This project is deprecated and not maintained.

statsrelay

A consistent-hashing relay for statsd and carbon metrics

hacheck

HAproxy healthcheck proxying service

potter

a CLI to create node.js services

opentracing-go

A general-purpose instrumentation API for distributed tracing systems

idl

A CLI for managing Thrift IDL files

jetstream

Jetstream Sync server framework

canduit

Node.js Phabricator Conduit API client. This project is deprecated and not maintained.

kafka-spraynozzle

A nozzle to spray a kafka topic at an HTTP endpoint. This project is deprecated and not maintained.

usb2fac

Enabling 2fac confirmation for newly connected USB devices

nanny

Cluster management for Node processes

auto-value-bundle

Extends Autovalue to extract data from a bundle into a value object.

node-flame

Tools for analyzing Node.js programs with ptrace. This project is deprecated and not maintained.

Bug-Bounty-Page

A repo to make our changes more transparent to bug bounty researchers in our program (so they can see commits, etc).

paranoid-request

An SSRF-preventing wrapper around Node's request module

lint-trap

JavaScript linter module for Uber projects

thriftify

JavaScript implementation of Thrift encoding and decoding

HackerOneAlchemy

A tool to generate statistics and help manage bug bounty reports in HackerOne.

express-translate

Add simple translation support to Express

cherami-thrift

Thrift APIs for Cherami - A distributed, scalable, durable, and highly available message queue system. This project is deprecated and not maintained.

h1-python

A HackerOne API client for Python

cidrtrie

Trie implementation of a CIDR lookup table

ios-template

This template provides a starting point for open source iOS projects at Uber.

tcheck

TChannel health check utility

job_progress

Store the progress of a job

java-code-styles

IntelliJ IDEA code style settings for Uber's Java and Android projects.

fixed-server

Server for HTTP fixtures

vis-academy

A set of tutorials on how our frameworks make effective data visualization applications.

shared-docs

Shared Markdown Documents from Uber Engineering

typed-request-stack

Middleware stack runner for typed HTTP requests

cherami-client-python

Python Client for Cherami - A distributed, scalable, durable, and highly available message queue system. This project is deprecated and not maintained.

failpointsjs

instafork

py-find-unicode

Find incorrect unicode() invocations

shallow-settings

Shallow inheritance-based settings for your application

clusto-query

Silly CLI for querying clusto more quickly

gg

Go dependency debugger

connect-csrf-lite

CSRF validation middleware for Connect/Express

javax-extras

(DEPRECATED) Extra utilities for javax

fixtures-fs

Create a temporary fs with JSON fixtures

redis-delete-pattern

Delete a set of keys from a pattern in Redis

opentracing-python

NOTE: This repository has been retired. The latest OpenTracing APIs can be found in the official repository.

tchannel-gen

Scaffolding for new TChannel w/ Hyperbahn applications

node-dot-arcanist

Uber's .arcanist folder as an npm module

cherami-client-java

Java Client for Cherami. This project is deprecated and not maintained.

pyrehol

Python wrapper for Firehol

dubstep

This repo is DEPRECATED. See https://github.com/dubstepjs/core

ottr

Easy, robust end-to-end UI tests for web apps

clouseau

A Node.js performance profiler by Uber

fusion-orchestrate

Tools and scripts for working across multiple fusion repos at once

vertica-aesgcm-udx

stacked

request-redis-cache

Make requests and cache them in Redis

nodesol-write

Kafka producer.

uLeak

DEPRECATED: This is continued in https://github.com/behroozkhorashadi/uLeak

request-mocha

Request utilities for Mocha

UberBuilder

Make building flexible, immutable objects a simple task

uberclass-clouseau

A subclass of uberclass that adds profiling support

deck.gl-data-osm

OSM data for the data visualization library deck.gl examples (https://uber.github.io/deck.gl/#/)

backbone-api-client

Backbone mixin built for interacting with API clients

fusion-release

Releases and verifies FusionJS packages

cache-redis

An ES6 Map-like cache with redis backing

redis-broadcast

Write redis commands to a set of redises efficiently