Lightning-AI/lightning-thunder

Stars
1,012
Rank 43,643 (Top 0.9 %)
Language
Python
License
Apache License 2.0
Created about 2 months ago
Updated 5 days ago

Lightning-AI/lightning-thunder

Lightning-AI

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

pytorch-lightning

Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

litgpt

Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

torchmetrics

Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications.

deep-learning-project-template

Pytorch Lightning code guideline for conferences

dl-fundamentals

Deep Learning Fundamentals -- Code material and exercises

Jupyter Notebook

tutorials

Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.

litdata

Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.

engineering-class

Lightning Bits: Engineering for Researchers repo

lightning-ColossalAI

Large Scale Distributed Model Training with Colossal AI and Lightning AI

litserve

Deploy AI models at scale. High-throughput serving engine for AI/ML models that uses the latest state-of-the-art model deployment techniques.

ecosystem-ci

Automate issue discovery for your projects against Lightning nightly and releases.

utilities

Common Python utilities and GitHub Actions in Lightning Ecosystem

forked-pdb

Python pdb for multiple processes

lightning-ui

Frontend for Lightning apps and home of the Design System

lightning-Habana

Lightning support for Intel Habana accelerators.

lightning-Hivemind

Lightning Training strategy for HiveMind

lightning-Graphcore

LAI-E2E-ContinualAI-Emulator

Lightning-multinode-templates

Multinode templates for Pytorch Lightning

lightning-gan

lightning-Horovod

Lightning Training strategy for Horovod

e2e-speed-benchmark-tests

Tests scripts which ensure that app startup times do not regress

LAI-lightning-template-jupyterlab-App