• Stars
    star
    39
  • Rank 693,563 (Top 14 %)
  • Language
    C
  • License
    Apache License 2.0
  • Created over 2 years ago
  • Updated over 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A GPU-accelerated DNN inference serving system that supports instant kernel preemption and biased concurrent execution in GPU scheduling.

More Repositories

1

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
C++
7,898
star
2

OS-Course-Lab

本仓库包含上海交通大学IPADS实验室设计的操作系统课程系列实验。
C
234
star
3

ServerlessBench

A benchmark suite for serverless computing
C++
216
star
4

wukong

A graph-based distributed in-memory store that leverages efficient graph exploration to provide highly concurrent and low-latency queries over big linked data
C++
188
star
5

xstore

Fast RDMA-based Ordered Key-Value Store using Remote Learned Cache
C++
111
star
6

Bamboo

Bamboo-7B Large Language Model
88
star
7

reef

REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU scheduling.
Cuda
84
star
8

drtmh

Fast In-memory Transaction Processing using Hybrid RDMA Primitives
C++
67
star
9

drtm

Fast In-memory Transaction Processing using RDMA and HTM
C++
55
star
10

HEDB

Towards A Secure Yet Maintainable Encrypted Database
C++
55
star
11

DeSearch

a decentralized search engine with a decentralized verifiable dataflow
C
54
star
12

vegito

C++
51
star
13

krcore-artifacts

Ths is a fast RDMA abstraction layer that works both in the kernel and user-space.
Rust
49
star
14

disb

DISB is a new DNN inference serving benchmark with diverse workloads and models, as well as real-world traces.
C++
46
star
15

gnnlab

A Factored System for Sample-based GNN Training over GPUs
Python
41
star
16

cocytus

Cocytus is an efficient and available in-memory K/V-store through hybrid erasure coding and replication
C
30
star
17

SQLSolver

An automated prover that verifies the equivalence of SQL queries
Java
27
star
18

librdpma

C++
25
star
19

ugache

C++
20
star
20

fgnn-artifacts

FGNN's artifact evaluation (EuroSys 2022)
Python
17
star
21

dst

A decentralized scalar timestamp scheme
C++
14
star
22

fisslock

A fast and scalable distributed lock service using programmable switches.
C++
12
star
23

wukong-cube

A distributed in-memory store for temporal knowledge graphs
C++
10
star
24

hackwrench

C++
9
star
25

ugache-artifacts

The artifact evaluation of SOSP 2023 for UGache
C++
8
star
26

COREMU

COREMU is a scalable and portable parallel full system emulator built on Qemu. Currently, COREMU supports X86_64 and ARM (MPcore).
C
7
star
27

eunomia

C++
6
star
28

wukong-g

Fast and Concurrent RDF Queries using RDMA-assisted GPU Graph Exploration
C++
5
star
29

Kernel-TwinFunction

1
star