EPFL Machine Learning and Optimization Laboratory (@epfml)
Guthub

epfml

Twitter logo Share LinkedIn logo Share Facebook logo Share

Top repositories

1

sent2vec

General purpose unsupervised sentence representations
C++
1,187
star
2

ML_course

EPFL Machine Learning Course, Fall 2023
Jupyter Notebook
1,159
star
3

attention-cnn

Source code for "On the Relationship between Self-Attention and Convolutional Layers"
Python
1,050
star
4

OptML_course

EPFL Course - Optimization for Machine Learning - CS-439
Jupyter Notebook
1,029
star
5

landmark-attention

Landmark Attention: Random-Access Infinite Context Length for Transformers
Python
258
star
6

federated-learning-public-code

Python
154
star
7

collaborative-attention

Code for Multi-Head Attention: Collaborate Instead of Concatenate
Python
145
star
8

powersgd

Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727
Python
127
star
9

disco

Decentralized & federated privacy-preserving ML training, using p2p networking, in JS
TypeScript
123
star
10

dynamic-sparse-flash-attention

Jupyter Notebook
112
star
11

DenseFormer

Python
68
star
12

ChocoSGD

Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356
Python
59
star
13

llm-baselines

Python
55
star
14

sparsifiedSGD

Sparsified SGD with Memory: https://arxiv.org/abs/1809.07599
Jupyter Notebook
53
star
15

optML-pku

summer school materials
42
star
16

LocalSGD-Code

Python
41
star
17

error-feedback-SGD

SGD with compressed gradients and error-feedback: https://arxiv.org/abs/1901.09847
Jupyter Notebook
28
star
18

Bi-Sent2Vec

Robust Cross-lingual Embeddings from Parallel Sentences
C++
20
star
19

byzantine-robust-optimizer

Learning from history for Byzantine Robustness
Jupyter Notebook
20
star
20

opt-summerschool

Short Course on Optimization for Machine Learning - Slides and Practical Labs - DS3 Data Science Summer School, June 24 to 28, 2019, Paris, France
Jupyter Notebook
20
star
21

interpret-lm-knowledge

Extracting knowledge graphs from language models as a diagnostic benchmark of model performance (NeurIPS XAI 2021).
Jupyter Notebook
20
star
22

cola

CoLa - Decentralized Linear Learning: https://arxiv.org/abs/1808.04883
Python
18
star
23

opt-shortcourse

Short Course on Optimization for Machine Learning - Slides and Practical Lab - Pre-doc Summer School on Learning Systems, July 3 to 7, 2017, Zürich, Switzerland
Jupyter Notebook
18
star
24

byzantine-robust-noniid-optimizer

Python
14
star
25

X2Static

X2Static embeddings
Python
12
star
26

powergossip

Code for "Practical Low-Rank Communication Compression in Decentralized Deep Learning"
Python
12
star
27

kubernetes-setup

MLO group setup for kubernetes cluster
Dockerfile
12
star
28

relaysgd

Code for the paper “RelaySum for Decentralized Deep Learning on Heterogeneous Data”
Jupyter Notebook
10
star
29

topology-in-decentralized-learning

Code related to ’Beyond spectral gap: The role of the topology in decentralized learning‘.
Python
10
star
30

quasi-global-momentum

Python
9
star
31

piecewise-affine-multiplication

Python
7
star
32

rotational-optimizers

Python
6
star
33

byzantine-robust-decentralized-optimizer

Jupyter Notebook
6
star
34

uncertainity-estimation

Code for the paper “The Peril of Popular Deep Learning Uncertainty Estimation Methods”
Jupyter Notebook
6
star
35

getting-started

Python
6
star
36

text_to_image_generation

Python
5
star
37

easy-summary

difficulty-guided text summarization
Python
5
star
38

FeAI

Federated Learning with TensorFlow.js
Vue
4
star
39

autoTrain

Open Challenge - Automatic Training for Deep Learning
Python
3
star
40

ghost-noise

Python
3
star
41

pax

JAX-like API for PyTorch
Python
3
star
42

personalized-collaborative-llms

Python
2
star
43

phantomedicus

MedSurge: medical survey generator
Jupyter Notebook
1
star