• Stars
    star
    257
  • Rank 158,728 (Top 4 %)
  • Language
    Python
  • Created about 6 years ago
  • Updated about 5 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Complementary code for the Targeted Dropout paper

Targeted Dropout

Aidan N. Gomez, Ivan Zhang, Kevin Swersky, Yarin Gal, and Geoffrey E. Hinton

Table of Contents

Requirements

  • Python 3
  • Tensorflow 1.8

Quick Start

  1. Train a model: python -m TD.train --hparams=resnet_default
  2. Prune that model: python -m TD.scripts.prune.eval --hparams=resnet_default --prune_percent 0.0,0.25,0.5,0.75,0.95

Flags

  • --env: one of local, gcp (GPU instances), or tpu (TPU instances). Feel free to add more if necessary.
  • --hparams: the hparam set you want to run.
  • --hparam_override: manually specify hparams to be overridden (e.g --hparam_override 'drop_rate=0.66')