Lightning-AI/lightning-Hivemind Lightning-AI/lightning-Hivemind

  • Stars
    star
    9
  • Rank 1,883,908 (Top 39 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created over 1 year ago
  • Updated 12 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
Lightning-AI/lightning-Hivemind
github

Lightning-AI

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Lightning Training strategy for HiveMind

More Repositories

1

pytorch-lightning

Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.
Python
26,929
star
2

litgpt

Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.
Python
6,647
star
3

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Python
5,800
star
4

torchmetrics

Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications.
Python
1,934
star
5

deep-learning-project-template

Pytorch Lightning code guideline for conferences
Python
1,208
star
6

lightning-thunder

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.
Python
1,032
star
7

dl-fundamentals

Deep Learning Fundamentals -- Code material and exercises
Jupyter Notebook
309
star
8

tutorials

Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.
Python
269
star
9

litdata

Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.
Python
189
star
10

engineering-class

Lightning Bits: Engineering for Researchers repo
Python
128
star
11

lightning-ColossalAI

Large Scale Distributed Model Training with Colossal AI and Lightning AI
Python
50
star
12

litserve

Deploy AI models at scale. High-throughput serving engine for AI/ML models that uses the latest state-of-the-art model deployment techniques.
Python
49
star
13

ecosystem-ci

Automate issue discovery for your projects against Lightning nightly and releases.
Python
45
star
14

utilities

Common Python utilities and GitHub Actions in Lightning Ecosystem
Python
43
star
15

forked-pdb

Python pdb for multiple processes
Python
28
star
16

lightning-ui

Frontend for Lightning apps and home of the Design System
TypeScript
20
star
17

lightning-Habana

Lightning support for Intel Habana accelerators.
Python
20
star
18

lightning-Graphcore

Python
7
star
19

LAI-E2E-ContinualAI-Emulator

Python
6
star
20

Lightning-multinode-templates

Multinode templates for Pytorch Lightning
Python
6
star
21

lightning-gan

Python
3
star
22

e2e-speed-benchmark-tests

Tests scripts which ensure that app startup times do not regress
Python
2
star
23

lightning-Horovod

Lightning Training strategy for Horovod
Python
2
star
24

LAI-lightning-template-jupyterlab-App

Python
1
star