Algorithms are the new boogie men when it comes to social control and institutional discrimination. Researchers and now policy-makers decry bias and lack of accountability in the algorithms and predictive analytics that determine who gets hired for a job, who can get a loan, who qualifies for insurance, and even who goes to jail. This short introduction to a panel describes the landscape, lists key questions regarding bias in analytics, and describes the difficulties with the common suggestion that algorithms and code be published. The actual panel was recorded and posted as a video at https://media.libreplanet.org/u/libreplanet/m/algorithmic-bias-where-it-comes-from-and-what-to-do-about-it/
1 of 10
Download to read offline
More Related Content
Algorithmic bias: introduction
1. Algorithmic Bias:
Where It Comes From and What to Do
About It
(Introduction)
26 March 2017
Andy Oram, Editor, OReilly Media
This work is licensed under the
Creative Commons Attribution 4.0 International License.
4. The Books
4
Algorithmic Bias Andy Oram
https://weaponsofmathdestructionbook.com/
http://www.hup.harvard.edu/catalog.php?isbn=9780674368279
5. The Feds
5
Algorithmic Bias Andy Oram
https://obamawhitehouse.archives.gov/sites/default/files/microsites/ostp/2016_0504_data_discrimination.pdf
6. Association for Computing Machinery principles
6
Algorithmic Bias Andy Oram
https://www.acm.org/binaries/content/assets/public-policy/2017_usacm_statement_algorithms.pdf
7. Questions addressed in this talk
Why do algorithms discriminate?
7
What is unfair bias?
Who is in control of the data?
How can outsiders validate algorithms?
Where does free software play a role?
How should we use algorithms, given these risks?
Algorithmic Bias Andy Oram
8. The role of free software
8
Algorithmic Bias Andy Oram
htttps://qz.com/938635/a-predictive-policing-startup-released-all-its-code-so-it-can-be-scoured-for-bias/
https://github.com/CivicScape
9. Barriers to opening the source code
Selfish actors might game the system
9
Machine learning doesn't produce human-readable decision
processes
Can't keep up with constant tweaks to the algorithms
The devil often lies in the data
Trade secrets and other legal controls
Algorithmic Bias Andy Oram
10. Barriers to using the source code if it's open
How do you know at all if an algorithm is judging you?
10
Who can understand the algorithms?
Power imbalances--do you dare to challenge the owner of the
algorithm?
The devil often lies in the data
Algorithmic Bias Andy Oram