Lightning-AI/LitServe Lightning-AI/LitServe

  • Stars
    star
    1,954
  • Rank 23,567 (Top 0.5 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created 9 months ago
  • Updated 10 days ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
Lightning-AI/LitServe
github

Lightning-AI

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Lightning-fast serving engine for AI models. Flexible. Easy. Enterprise-scale.

More Repositories

1

pytorch-lightning

Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.
Python
27,831
star
2

litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Python
9,495
star
3

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Python
5,930
star
4

torchmetrics

Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications.
Python
2,029
star
5

deep-learning-project-template

Pytorch Lightning code guideline for conferences
Python
1,219
star
6

lightning-thunder

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.
Python
1,116
star
7

dl-fundamentals

Deep Learning Fundamentals -- Code material and exercises
Jupyter Notebook
324
star
8

litdata

Transform datasets at scale. Optimize datasets for fast AI model training.
Python
299
star
9

tutorials

Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.
Python
275
star
10

engineering-class

Lightning Bits: Engineering for Researchers repo
Python
129
star
11

lightning-ColossalAI

Large Scale Distributed Model Training with Colossal AI and Lightning AI
Python
50
star
12

utilities

Common Python utilities and GitHub Actions in Lightning Ecosystem
Python
46
star
13

ecosystem-ci

Automate issue discovery for your projects against Lightning nightly and releases.
Python
45
star
14

forked-pdb

Python pdb for multiple processes
Python
28
star
15

lightning-Habana

Lightning support for Intel Habana accelerators.
Python
23
star
16

lightning-Hivemind

Lightning Training strategy for HiveMind
Python
9
star
17

lightning-Graphcore

Python
7
star
18

LAI-E2E-ContinualAI-Emulator

Python
6
star
19

Lightning-multinode-templates

Multinode templates for Pytorch Lightning
Python
6
star
20

lightning-ui

Frontend for Lightning apps and home of the Design System
TypeScript
4
star
21

lightning-gan

Python
3
star
22

e2e-speed-benchmark-tests

Tests scripts which ensure that app startup times do not regress
Python
2
star
23

lightning-Horovod

Lightning Training strategy for Horovod
Python
2
star
24

LAI-lightning-template-jupyterlab-App

Python
1
star
25

cloud-training-workshop

Jupyter Notebook
1
star