• Stars
    star
    448
  • Rank 97,523 (Top 2 %)
  • Language
    Java
  • Created over 6 years ago
  • Updated about 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Anna: A KVS for any scale

Note: This is a snapshot of the Anna codebase as of March, 2018. The latest codebase is released and maintained here (https://github.com/hydro-project/anna).

Anna is an in-memory KVS that delivers high performance at multiple scales, from a single core machine to NUMA to geo-distributed deployment. It also provides a wide spectrum of coordination-free isolation levels that aim to meet the consistency requirements of different applications.

Build Instruction (Ubuntu):

  1. Install Clang and libc++, run:
    sudo apt-get update.
    sudo apt-get install -y build-essential autoconf automake libtool curl make g++ unzip pkg-config wget clang-3.9.
    sudo update-alternatives --install /usr/bin/clang clang /usr/bin/clang-3.9 1.
    sudo update-alternatives --install /usr/bin/clang++ clang++ /usr/bin/clang++-3.9 1.
    sudo apt-get install -y libc++-dev libc++abi-dev libtbb-dev.

  2. Install cmake, run:
    wget https://cmake.org/files/v3.9/cmake-3.9.4-Linux-x86_64.tar.gz.
    tar xvzf cmake-3.9.4-Linux-x86_64.tar.gz.
    mv cmake-3.9.4-Linux-x86_64 /usr/bin/cmake.
    export PATH=$PATH:/usr/bin/cmake/bin.
    rm cmake-3.9.4-Linux-x86_64.tar.gz.

  3. Install protobuf: after cloning the protobuf repo, run:
    ./autogen.sh.
    ./configure CXX=clang++ CXXFLAGS='-std=c++11 -stdlib=libc++ -O3 -g'.
    make.
    make check.
    sudo make install.
    ldconfig.

  4. Build KVS, run:
    bash scripts/build_release.sh.
    (This command will build a KVS that provides last-writer-win consistency. Lattice composition for other consistency levels can be found in kvs/include)

IP Configuration:

For each server node:

  1. The ip of the current node should be stored in conf/server/server_ip.txt.
  2. The ip of the seed node should be stored in conf/server/seed_server.txt. The seed node can be any proxy node.
  3. The ip of all the proxy nodes should be stored in conf/server/proxy_address.txt. Each line contains a single proxy ip.

For each proxy node:

  1. The ip of the current node should be stored in conf/proxy/proxy_ip.txt.

For each user/benchmark node:

  1. The ip of the current node should be stored in conf/user/user_ip.txt.
  2. The ip of all the proxy nodes should be stored in conf/user/proxy_address.txt. Each line contains a single proxy ip.

Run Instruction:

Please start the proxy first, and then the server and client.

  1. Start a proxy by running ./build/kvs/kvs_proxy.
  2. Start a server by running ./build/kvs/kvs_server.
  3. Start a client by running ./build/kvs/kvs_user.

The accepted input formats are GET $key and PUT $key $value.

More Repositories

1

confluo

Real-time Monitoring and Analysis of Data Streams
C++
1,442
star
2

clipper

A low-latency prediction-serving system
C++
1,399
star
3

cs294-ai-sys-sp19

CS294; AI For Systems and Systems For AI
HTML
220
star
4

actnn

ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
Python
201
star
5

flor

🌻 Flow with FlorDB
Jupyter Notebook
151
star
6

graphtrans

Representing Long-Range Context for Graph Neural Networks with Global Attention
Python
122
star
7

cirrus

Serverless ML Framework
C++
107
star
8

piranha

Piranha: A GPU Platform for Secure Computation
C++
88
star
9

cpp_project_template

Minimal C++ Project Template
C++
38
star
10

risecamp

RISECamp Tutorials
Jupyter Notebook
38
star
11

jedi-pairing

Go, C++, and C implementation of a bilinear group and pairing-based cryptography for both embedded and non-embedded systems
C++
34
star
12

dory

Go
32
star
13

cs294-rise-fa16

CS294 RISE Course Material
32
star
14

cs294-ai-sys-fa19

CS294-162; Machine Learning Systems Seminar
HTML
31
star
15

hypersched

Deadline-based hyperparameter tuning on RayTune.
Python
31
star
16

LatticeFlow

C++
28
star
17

mage

MAGE: Memory-Aware Garbling Engine
C++
25
star
18

aws-audit

aws consolidated billing audit/reporting tool
Python
24
star
19

waldo

C++
23
star
20

snoopy

A high-throughput oblivious storage system
C
23
star
21

MerkleSquare

A Go library for MerkleSquare: A Low-Latency Transparency Log System
Go
20
star
22

clipper-tutorials

Jupyter Notebook
17
star
23

fluent-old

Bloom + C++
JavaScript
17
star
24

cs294-ai-sys-sp22

CS294 AI Systems Class Website
SCSS
15
star
25

jarvis

Build, configure, and track workflows with Jarvis.
Python
13
star
26

caravel

Studying GPU Multi-tenancy
Jupyter Notebook
12
star
27

jedi-protocol-go

Golang implementation of JEDI: Many-to-Many End-to-End Encryption and Key Delegation for IoT
Go
12
star
28

costco

Python
10
star
29

cs262a-fall2020

CS 262a Fall 2020
HTML
6
star
30

tcplp

Performant TCP for Low-Power Wireless Networks
5
star
31

mage-scripts

Benchmarking scripts for MAGE
Python
5
star
32

clipper-website

Hugo sources for clipper.ai website
CSS
4
star
33

kaggle-nlp-disasters

https://www.kaggle.com/c/nlp-getting-started
Jupyter Notebook
3
star
34

clipper-serving-testbed

Python
2
star
35

fluent_scala

Scala
2
star
36

netplay

C++
1
star
37

buddy

An Python/SQL DSL for CALM cloud programming
Python
1
star
38

flor-camp2018

Jupyter Notebook
1
star
39

maceta

Delta Pruning: pruning spurious/deleterious changes that arise organically from iterative model development
1
star