ML and NLP Paper Discussions
One of our community-driven efforts it to discuss interesting ML or NLP papers and foster an inclusive, safe, and open platform that allows it. This repository contains notes and discussions for our weekly NLP paper discussions. You will find notes, questions, and other findings and topics the community found interesting.
Interested to join these discussions in the future? Check out our future events here and join the discussion in our Slack group.
July 4, 2020
Paper: A Simple Framework for Contrastive Learning of Visual Representations
Authors: Ting Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey Hinton
Notes: Link
June 20, 2020
Paper: VirTex: Learning Visual Representations from Textual Annotations
Authors: Karan Desai, Justin Johnson
Notes: Link
June 13, 2020
Paper: When BERT Plays the Lottery, All Tickets Are Winning
Authors: Sai Prasanna, Anna Rogers, Anna Rumshisky
Notes: Link
June 06, 2020
Paper: Language Models are Few-Shot Learners
Authors: Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, Dario Amodei
Notes: Link
May 30, 2020
Paper: Experience Grounds Language
Authors: Yonatan Bisk, Ari Holtzman, Jesse Thomason, Jacob Andreas, Yoshua Bengio, Joyce Chai, Mirella Lapata, Angeliki Lazaridou, Jonathan May, Aleksandr Nisnevich, Nicolas Pinto, Joseph Turian
Notes: Link
May 23, 2020
Paper: On the relationship between self-attention and convolutional layers
Authors: Jean-Baptiste Cordonnier, Andreas Loukas & Martin Jaggi
Notes: Link
May 16, 2020
Paper: TLDR: Extreme Summarization of Scientific Documents
Authors: Isabel Cachola, Kyle Lo, Arman Cohan, Daniel S. Weld
Notes: Link
May 2, 2020
Paper: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Authors: Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu
Notes: Link