Lightning-AI/engineering-class

Stars
128
Rank 272,402 (Top 6 %)
Language
Python
Created about 2 years ago
Updated over 1 year ago

Lightning-AI/engineering-class

Lightning-AI

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Lightning Bits: Engineering for Researchers repo

Lightning Bits: Engineering for Researchers

This repository contains additional materials and show notes for the Lightning Bits: Engineering for Researchers video series.

Ep 01: Notebooks vs Python Projects

🍿 Watch Episode 1
📖 Read show notes
ep01-nbs-vs-projects/project: Layout of an example project
A glimpse of Sebastian's typical workflows using both notebooks and Python projects/packages

Ep 02: The 8 Essential Terminal Commands you Need to Know

Ep 03: How to Use Virtual Environments to Keep Your Computer Organized

Ep 04: How to Be More Productive Using Python Integrated Development Environments (IDEs)

Ep 05: How to Debug Python Code -- Find Errors More Efficiently

Ep 06: Version Control Your Code Using Git ... And Thank Yourself Later

Ep 07: Managing Code Projects with Git Branching

Ep 08: Creating a Pull Request on GitHub

Ep 09: Collaborate on Coding Projects with GitHub

Ep 10: Level-Up Your Python Skills Using Classes and Object-Oriented Programming Concepts

Questions or Suggestions?

If you have questions or suggestions, please don't hesitate to reach out to William (@_willfalcon) and Sebastian (@rasbt) on Twitter or join our Slack Channel. For more episodes, also check out the Lightning Bits: Engineering for Researchers.

pytorch-lightning

Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

litgpt

Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

torchmetrics

Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications.

deep-learning-project-template

Pytorch Lightning code guideline for conferences

lightning-thunder

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

dl-fundamentals

Deep Learning Fundamentals -- Code material and exercises

Jupyter Notebook

tutorials

Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.

litdata

Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.

lightning-ColossalAI

Large Scale Distributed Model Training with Colossal AI and Lightning AI

litserve

Deploy AI models at scale. High-throughput serving engine for AI/ML models that uses the latest state-of-the-art model deployment techniques.

ecosystem-ci

Automate issue discovery for your projects against Lightning nightly and releases.

utilities

Common Python utilities and GitHub Actions in Lightning Ecosystem

forked-pdb

Python pdb for multiple processes

lightning-ui

Frontend for Lightning apps and home of the Design System

lightning-Habana

Lightning support for Intel Habana accelerators.

lightning-Hivemind

Lightning Training strategy for HiveMind

lightning-Graphcore

LAI-E2E-ContinualAI-Emulator

Lightning-multinode-templates

Multinode templates for Pytorch Lightning

lightning-gan

e2e-speed-benchmark-tests

Tests scripts which ensure that app startup times do not regress

lightning-Horovod

Lightning Training strategy for Horovod

LAI-lightning-template-jupyterlab-App