Lightning-AI/LitServe Lightning-AI/LitServe

  • Stars
    star
    2,278
  • Rank 20,215 (Top 0.4 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created 12 months ago
  • Updated about 1 month ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
Lightning-AI/LitServe
github

Lightning-AI

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Lightning-fast serving engine for any AI model of any size. Flexible. Easy. Enterprise-scale.

More Repositories

1

pytorch-lightning

Pretrain, finetune ANY AI model of ANY size on multiple GPUs, TPUs with zero code changes.
Python
28,208
star
2

litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Python
10,409
star
3

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Python
5,973
star
4

torchmetrics

Machine learning metrics for distributed, scalable PyTorch applications.
Python
2,117
star
5

deep-learning-project-template

Pytorch Lightning code guideline for conferences
Python
1,236
star
6

lightning-thunder

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.
Python
1,178
star
7

litdata

Transform datasets at scale. Optimize datasets for fast AI model training.
Python
347
star
8

dl-fundamentals

Deep Learning Fundamentals -- Code material and exercises
Jupyter Notebook
342
star
9

tutorials

Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.
Python
286
star
10

engineering-class

Lightning Bits: Engineering for Researchers repo
Python
131
star
11

utilities

Common Python utilities and GitHub Actions in Lightning Ecosystem
Python
50
star
12

lightning-ColossalAI

Large Scale Distributed Model Training with Colossal AI and Lightning AI
Python
50
star
13

ecosystem-ci

Automate issue discovery for your projects against Lightning nightly and releases.
Python
45
star
14

forked-pdb

Python pdb for multiple processes
Python
30
star
15

lightning-Habana

Lightning support for Intel Habana accelerators.
Python
25
star
16

lightning-Hivemind

Lightning Training strategy for HiveMind
Python
9
star
17

lightning-Graphcore

Python
7
star
18

Lightning-multinode-templates

Multinode templates for Pytorch Lightning
Python
7
star
19

LAI-E2E-ContinualAI-Emulator

Python
6
star
20

lightning-ui

Frontend for Lightning apps and home of the Design System
TypeScript
4
star
21

lightning-gan

Python
3
star
22

e2e-speed-benchmark-tests

Tests scripts which ensure that app startup times do not regress
Python
2
star
23

lightning-Horovod

Lightning Training strategy for Horovod
Python
2
star
24

LAI-lightning-template-jupyterlab-App

Python
1
star
25

cloud-training-workshop

Jupyter Notebook
1
star