Rahaf (@rahafaljundi)
github

rahafaljundi

Twitter logo Share LinkedIn logo Share Facebook logo Share

Top repositories

1

MAS-Memory-Aware-Synapses

Memory Aware Synapses method implementation code
Jupyter Notebook
93
star
2

Gradient-based-Sample-Selection

Python
70
star
3

Selfless-Sequential-Learning

Python
26
star
4

Encoder-Based-Lifelong-learning

MATLAB
16
star
5

Pytorch-implementation-of-Encoder-Based-Lifelong-learning

Jupyter Notebook
9
star
6

Expert-Gate

We introduce a model of lifelong learning, based on a Network of Experts. New tasks / experts are learned and added to the model sequentially, building on what was learned before. To ensure scalability of this process, data from previous tasks cannot be stored and hence is not available when learning a new task. A critical issue in such context, not addressed in the literature so far, relates to the decision of which expert to deploy at test time. We introduce a set of gating autoencoders that learn a representation for the task at hand, and, at test time, automatically forward the test sample to the relevant expert. This also brings memory efficiency as only one expert network has to be loaded into memory at any given time. Further, the autoencoders inherently capture the relatedness of one task to another, based on which the most relevant prior model to be used for training a new expert, with finetuning or learning without-forgetting, can be selected. We evaluate our method on image classification and video prediction problems.
MATLAB
9
star
7

Selfless-Sequential-Learning-Deprecated-

Python
2
star