Aleph-Alpha/scaling Aleph-Alpha/scaling

  • Stars
    star
    40
  • Rank 680,660 (Top 14 %)
  • Language
    Python
  • License
    Other
  • Created 3 months ago
  • Updated 3 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
Aleph-Alpha/scaling
github

Aleph-Alpha

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for training large language models.

More Repositories

1

ts-rs

Generate TypeScript bindings from Rust types
Rust
1,131
star
2

magma

MAGMA - a GPT-style multimodal model that can understand any combination of images and language. NOTE: The freely available model from this repo is only a demo. For the latest multimodal and multilingual models from Aleph Alpha check out our website https://app.aleph-alpha.com
Python
477
star
3

aleph-alpha-client

Python
87
star
4

intelligence-layer-sdk

a unified framework for leveraging LLMs
Python
53
star
5

trigrams

Python
43
star
6

AtMan

Jupyter Notebook
26
star
7

examples

Jupyter Notebook
25
star
8

NeurIPS-WANT-submission-efficient-parallelization-layouts

Python
23
star
9

aleph-alpha-tokenizer

A rustic language tokenizer library inspired by huggingface's tokenizers
Rust
7
star
10

aleph-alpha-client-rs

Rust
7
star
11

Divergent_Tokens

7
star
12

bootcamp

Jupyter Notebook
6
star
13

MultiFusion

MultiFusion: Fusing Pre-Trained Models for Multi-Lingual, Multi-Modal Image Generation (https://arxiv.org/abs/2305.15296)
HTML
4
star
14

blended-dataset-loop

Compute a balanced order of dataset indices for training
Rust
1
star
15

lock-hierarchy-rs

Validate lock hierarchies in Rust code
Rust
1
star