Toward ethical, transparent and fair AI/ML: a critical reading list for engineers, designers, and policy makers

In the past 5 years there’s been a lot of enthusiasm about AI and specifically machine learning and deep learning. As we continuously deploy AI models in the wild we are forced to re-examine what are the effects of knowledge symbolisation, generalisation and classification on the historical, political and social conditions of human life. We also need to remind ourselves that algorithms don’t exercise their power over us. People do.

This reading list is made for engineers, scientists, designers, policy makers and those interested in machine learning and AI. It’s an open ended document that examines machine learning as a sociotechnical system and contextualises its critical discourse. For suggestions and comments please tweet @irinimalliaraki or drop me an email at [email protected]

These sections aren't in any particular order. There's overlap and interaction between these topics that you can jump around as much as you want; Reading "out of order" could lead to interesting connections.

CRITICAL AI

Must

• Manufacturing an Artificial Intelligence Revolution, Yarden Katz, 2017 (paper)
• The critical engineering manifesto, Julian Oliver, Gordan Savičić, Danja Vasiliev
• Resisting Reduction: Designing our Complex Future with Machines, Joi Ito , 2017 (article)
• The Seven Deadly Sins of Predicting the Future of AI, Rodney Brooks, 2017 (article)
• Remarks on the Hole of Representation in Computer ‘Vision’, Benjamin Bratton, 2017 (video)

Optional

• Critical Studies in Machine Intelligence, Karlsruhe University of Arts and Design
• Linguistic Capitalism and Algorithmic Mediation, F Kaplan, 2014 (article)
• Defining Algorithmic Ideology: Using Ideology Critique to Scrutinize Corporate Search Engines, Astrid Mager (paper)
• Toward a Critical Technical Practice: Lessons Learned in Trying to Reform AI, Philip E. Agre, 1997 (paper)
• Don’t Call AI “Magic”, M.C.Elish, 2017 (article)
• Deep Learning: A Critical Appraisal, Gary Marcus, 2017 (paper)
• A list of lists and literature review on critical algorithm studies by Tarleton Gillespie and Nick Seaver: https://socialmediacollective.org/reading-lists/critical-algorithm-studies/#0.5
• AI and Alchemy, Hubert Dreyfus, 1965

AI ACCOUNTABILITY & GOVERNANCE

Must

• Algorithmic Accountability: On the Investigation of Black Boxes, 2014, Nicholas Diakopoulos (article)
• Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability, Mike Ananny, Kate Crawford, 2016 (paper)
• The Scored Society: Due Process for Automated Predictions, 2014, Danielle Keats Citron & Frank Pasquale (paper)
• Computational Power and the Social Impact of Artificial Intelligence, Tim Hwang, 2018 (paper)

Optional

• Mapping AI Governance, NESTA, 2019
• Moral Crumple Zones: Cautionary Tales in Human-Robot Interaction (We Robot 2016), M. C. Elish, 2016 (paper)
• Transparent, Explainable, and Accountable AI for Robotics, Sandra Wachter,Brent Mittelstadt, Luciano Floridi (paper)
• The Threat of Algocracy: Reality, Resistance and Accommodation, John Danaher, 2016 (paper)
• List of articles on Fairness, Accountability, and Transparency in Machine Learning

AI TRANSPARENCY, EXPLAINABILITY & BIAS

Bias

• The Trouble with Bias — NIPS 2017 Keynote — Kate Crawford (video)
• Technology Is Biased Too. How Do We Fix It?, Laura Hudson, 2017 (article)
• Machine Bias: There’s software used across the country to predict future criminals. And it’s biased against blacks, julia Angwin, Jeff Larson, Surya Mattu and Lauren Kirchner, 2016 (article)
• Artificial Intelligence’s White Guy Problem, Kate Crawford, 2016 (article)
• Why Stanford Researchers Tried to Create a ‘Gaydar’ Machine, Heather Murphy, 2017 (article)
• The Dark Secret at the Heart of AI, Will Knight, 2017 (article)

Transparency and Explainability

Must

• Big Data’s Disparate Impact, Solon Barocas & Andrew D. Selbst, 2016 (paper)
• Interpretable Machine Learning: A Guide for Making Black Box Models Explainable, Christoph Molnar, 2018 (book)
• The Mythos of Model Interpretability, Zachary C. Lipton, 2017 (paper)
• Towards A Rigorous Science of Interpretable Machine Learning, Finale Doshi-Velez and Been Kim, 2017 (paper)

Optional

• Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability, Mike Ananny, Kate Crawford, 2016 (paper)
• Algorithmic Transparency for the Smart City, Robert Brauneis and Ellen P. Goodman (paper)
• Weapons Of Math Destruction: How Big Data Increases Inequality And Threatens Democracy, Crown, 2016
• Digital Decisions, CDT, 2017
• The Intuitive Appeal of Explainable Machines, Andrew D. Selbst and Solon Barocas, 2017 (paper)

AI FAIRNESS

Must

• Computer says no: why making AIs fair, accountable and transparent is crucial, Ian Sample, 2017 (article)
• On the (im)possibility of fairness, Sorelle A. Friedler, Carlos Scheidegger, Suresh Venkatasubramanian (paper)
• Algorithmic decision making and the cost of fairness, Sam Corbe-Davies, Emma Pierson, Avi Feller, 2017 (paper)
• Algorithmic Justice League
• Understanding unintended sources of unfairness in data driven decision making, Moritz Hardt, 2014 (article)
• Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor, Virginia Eubanks, 2018
• List of lists http://algorithmtips.org/resources/

AI OWNERSHIP & CONTROL

• Big data: Bringing competition policy to the digital era, OECD (paper)
• Big Other: Surveillance Capitalism and the Prospects of an Information Civilization, 2015, Shoshana Zuboff (paper)
• Why Big Tech Companies Are Open-Sourcing Their AI Systems, Patrick Shafto (article)
• Artificial Intelligence Pushes the Antitrust Envelope, Michaella Ross, 2017 (article)

AI ETHICS

Must

• Why Artificial Intelligence Is Still Waiting For Its Ethics Transplant, Scott Rosenberg, 2017 (article)
• Ethics in AI, debate by Imperial College London (video)
• The ethics of algorithms: Mapping the debate, Brent Daniel Mittelstadt, Patrick Allo, Mariarosaria Taddeo, Sandra Wachter and Luciano Floridi, 2016 (paper)
• ASILOMAR AI principles (article)
• The Ethics of Artificial Intelligence, Nick Bostrom and Eliezer Yudkowsky, Machine Intelligence Research Institute (paper)
• Toward an Ethics of Algorithms: Convening, Observation, Probability, and Timeliness, Mike Ananny, 2015 (paper)

Optional

• EthicsNet, a dataset for machine ethics
• Moral Machine by MIT, a crowd-sourced picture of human opinion on how machines should make decisions when faced with moral dilemmas
• Crowdsourcing Empathy by MIT, 2017
• Ethically aligned design: A Vision for Prioritizing Human Wellbeing with Artificial Intelligence and Autonomous Systems, IEEE, 2016 (paper)
• Towards a machine ethics, Prof. Dr. Oliver Bendel (paper)
• Moral Decision Making Frameworks for Artificial Intelligence, Vincent Conitzer, Walter Sinnott-Armstrong, Jana Schaich Borg, Yuan Deng, Max Kramer (paper)
• Toward Ensuring Ethical Behavior from Autonomous Systems: A Case-Supported Principle-Based Paradigm, Michael Anderson, Susan Leigh Anderson, 2015 (paper)
• Artificial Rhetorical Agents and the Computing of Phronesis, Jennifer Maher, 2016 (paper)
• The Philosophy of Science and its relation to Machine Learning, Jon Williamson (paper)

AI POLICY & LAW

• Is effective regulation of AI possible? Eight potential regulatory problems,John Danaher, 2015 (articles)
• THE NATIONAL ARTIFICIAL INTELLIGENCE RESEARCH AND DEVELOPMENT STRATEGIC PLAN, National Science and Technology Council, 2016 (paper)
• AI Investment Framework, David Kelnar, 2017 (article)
• Encoded laws, policies, and virtues: the offspring of artificial intelligence and public-policy collaboration, Matt Chessen, 2017 (article)
• AI in the UK: ready, willing and able?, HOUSE OF LORDS Select Committee on Artificial Intelligence, 2018, (report)

AI & LABOUR

Automation and inequality

• Prof. Michael Osborne — The Impact of Artificial Intelligence on Jobs, 2017 (video)
• The Relentless Pace of Automation, David Rodman, 2017 (article)
• Technological Unemployment and the Value of Work, John Danaher, 2015 (articles) Optional
• The Economics of Artificial Intelligence: An Agenda, Ajay K. Agrawal, Joshua Gans, and Avi Goldfarb, 2017 (collection of papers)
• Machine learning and the politics of data, Amaro, 2017 (video)
• Theories of Technology and the Production of Value from Everyday Life, 2015 (videos)

Discrimination

• Understanding Fair Labor Practices in a Networked Age by Tamara Kneese, Alex Rosenblat, and Danah Boyd, 2014 (paper)
• Networked Employment Discrimination, Alex Rosenblat, Tamara Kneese, and danah boyd, 2014 (paper)
• Economic Models of (Algorithmic) Discrimination, Bryce W. Goodman (paper)
• Data-Driven Discrimination at Work, Pauline T. Kim, 2017 (paper)

AI & SOCIAL IMPACT

Must

• AI Now 2017 — Experts Workshop (video)
• Artificial Intelligence for Social Good, Gregory D. Hager, Ann Drobnis, Fei Fang, Rayid Ghani, Amy Greenwald, Terah Lyons, David C. Parkes, Jason Schultz, Suchi Saria, Stephen F. Smith, and Milind Tambe, 2017 (paper)
• AI for the Common Good: Sustainable, Inclusive and Trustworthy, Derek O’Halloran, 2017 (paper)
• Harnessing Artificial Intelligence for the Earth, PwC and the World Economic Forum, 2018 (paper)
• Principles for Accountable Algorithms and a Social Impact Statement for Algorithms, FATML.org

Optional

• An AI pattern language, M.C. Elish and Tim Hwang, Data & Society (paper)
• Computational Power and the Social Impact of Artificial Intelligence, Tim Hwang, 2018, (paper)
• AI Now, 2017 Report, Alex Campolo, Madelyn Sanfilippo, Meredith Whittaker, Kate Crawford (paper)
• Keeping track of what AI can do, and where it is being applied https://deepindex.org/
• AI Progress Measurement: Measuring the Progress of AI Research, Electronic Frontier Foundation
• Exponential View by Azeem Azhar, mailing list all things AI and society

AI & PROPAGANDA

• Weapons of Mass Persuasion, Tim Hwang, 2015 (article)
• The Observatory on Social Media
• The Computational Propaganda Research Project(COMPROP) investigates the interaction of algorithms, automation and politics.
• Conversation AI is a collaborative research effort exploring ML as a tool for better discussions online.
• Engineering the public: Big data, surveillance and computational politics, Tufekci, 2014 (article)

AI & DESIGN

• Machine Learning for Designers, Patrick Hebron, 2016
• Experience Design in the Machine Learning Era, Fabien Girardin, 2016 (article)
• Design, Philosophy and A.I., Benjamin Bratton. 2016 (video)
• The UX of AI, Google
• Human-Centered Machine Learning, Jess Holbrook, 2017 (article)

AI AUDITING & SECURITY

Must

• Auditing Algorithms: Research Methods for Detecting Discrimination on Internet Platforms, Christian Sandvig , Kevin Hamilton , Karrie Karahalios , & Cedric Langbort, 2014
• Ten simple rules for responsible big data research, Matthew Zook ,Solon Barocas, danah boyd, Kate Crawford, Emily Keller, Seeta Peña Gangadharan, Alyssa Goodman, 2017 (article)
• The Malicious Use of Artificial Intelligence, University of Oxford, Centre for the Study of Existential Risk, Future of Life Institute, OpenAI, Center for a New American Security, EFF, 2018

Optional

• https://pair-code.github.io/facets/: Facets contains two robust visualizations to aid in understanding and analyzing machine learning datasets.
• Adversarial ML, Chaos Communication Congress 2017 (video)
• Machine Deception: Paper Roundup, Tim Hwang, 2018 (article)
• Practical Techniques for Interpreting Machine Learning Models: Introductory Open Source Examples Using Python, H2O, and XGBoost, Patrick Hall, 2018
• Auditing Algorithms
• Wild Patterns: Ten Years After the Rise of Adversarial Machine Learning, Battista Biggioa , Fabio Roli

PEOPLE & ORGANISATIONS

There are plenty of research groups and initiatives both in academia and in the industry start thinking about the relevance of ethics and safety in AI:

• Future of Life Institute(Boston)
• AI4ALL
• Centre for Data Ethics and Innovation Consultation (UK)
• People for the Ethical Treatment of Reinforcement Learners
• Berkman Klein Center (Boston)
• Alan Turing Institute Data Ethics Group
• Institute Electrical and Electronic Engineers — IEEE (Global)
• Centre for the study on existential risks (Cambridge, UK)
• Association for the Advancement of Artificial Intelligence
• The Machine Intelligence Research Institute
• Council on the Future of AI and Robotics
• Data & Society’s Intelligence and Autonomy Initiative
• Facebook Artificial Intelligence Research
• Ethics of Governance and Artificial Intelligence fund
• Microsoft: AI research group
• K&L gates endowment for ethics (Global)
• Center for human-compatible AI (Berkeley, CA)
• Machine Intelligence Research Institute (Berkeley, CA)
• USC center for AI in society (Los Angeles)
• Leverhulme center for future of intelligence (Cambridge, UK)
• Partnership on AI (Global)
• Future of Humanity Institute (Oxford, UK)
• AI Austin (Austin, US)
• Open AI (San Francisco, US)
• Campaign to Stop Killer Robots (Global)
• AI, Ethics and Governance Project
• Campaign against Sex Robots (Global)
• PAIR | People+AI Research Initiative
• Digital Ethics Lab- Oxford Internet Institute
• The MIT Laboratory for Social Machines
• Foundation for Responsible Robotics (Global)
• Data & Society (New York, US)
• World Economic Forum’s Council on the Future of AI and Robotics (Global)
• AI Now Initiative (New York, US)
• Allen Institute for Artificial intelligence
• IEEE Global Initiative for Ethical Considerations in Artificial Intelligence and Autonomous Systems
• AI100 (Stanford, CA)
• Artificial Intelligence Committee — UK Parliament (AI Lords on Twitter)
• Open Roboethics Institute
• Ada Lovelace Institute