際際滷

際際滷Share a Scribd company logo
Algorithmic Bias:
Where It Comes From and What to Do
About It
(Introduction)
26 March 2017
Andy Oram, Editor, OReilly Media
This work is licensed under the
Creative Commons Attribution 4.0 International License.
The Discoveries
https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing
2
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2208240
Algorithmic Bias  Andy Oram
The Hype
https://www.theatlantic.com/technology/archive/2016/04/how-big-data-harms-poor-communities/477423/
3
https://www.nytimes.com/2015/08/11/upshot/algorithms-and-bias-q-and-a-with-cynthia-dwork.html
Algorithmic Bias  Andy Oram
https://hbr.org/2013/04/the-hidden-biases-in-big-data
https://www.technologyreview.com/s/602933/how-to-hold-algorithms-accountable/
https://www.brookings.edu/blog/techtank/2016/12/01/addressing-racial-bias-in-the-online-economy/
http://www.pewinternet.org/2017/02/08/code-dependent-pros-and-cons-of-the-algorithm-age/
The Books
4
Algorithmic Bias  Andy Oram
https://weaponsofmathdestructionbook.com/
http://www.hup.harvard.edu/catalog.php?isbn=9780674368279
The Feds
5
Algorithmic Bias  Andy Oram
https://obamawhitehouse.archives.gov/sites/default/files/microsites/ostp/2016_0504_data_discrimination.pdf
Association for Computing Machinery principles
6
Algorithmic Bias  Andy Oram
https://www.acm.org/binaries/content/assets/public-policy/2017_usacm_statement_algorithms.pdf
Questions addressed in this talk
 Why do algorithms discriminate?
7
 What is unfair bias?
 Who is in control of the data?
 How can outsiders validate algorithms?
 Where does free software play a role?
 How should we use algorithms, given these risks?
Algorithmic Bias  Andy Oram
The role of free software
8
Algorithmic Bias  Andy Oram
htttps://qz.com/938635/a-predictive-policing-startup-released-all-its-code-so-it-can-be-scoured-for-bias/
https://github.com/CivicScape
Barriers to opening the source code
 Selfish actors might game the system
9
 Machine learning doesn't produce human-readable decision
processes
 Can't keep up with constant tweaks to the algorithms
 The devil often lies in the data
 Trade secrets and other legal controls
Algorithmic Bias  Andy Oram
Barriers to using the source code if it's open
 How do you know at all if an algorithm is judging you?
10
 Who can understand the algorithms?
 Power imbalances--do you dare to challenge the owner of the
algorithm?
 The devil often lies in the data
Algorithmic Bias  Andy Oram

More Related Content

Algorithmic bias: introduction