We need to be vigilant about how we design and train these machine-learning systems, or we will see ingrained forms of bias built into the artificial intelligence of the future.
Kate CrawfordRead
If you're not thinking about the way systemic bias can be propagated through the criminal justice system or predictive policing, then it's very likely that, if you're designing a system based on historical data, you're going to be perpetuating those biases.
Interpretation
What this quote means
The quote warns that without awareness of systemic biases in existing data, we risk continuing those biases in new systems.
Kate Crawford emphasizes the importance of understanding systemic bias, particularly in the context of the criminal justice system and predictive policing. She argues that if one does not actively consider how these biases are ingrained in historical data, any new systems designed around this data are likely to perpetuate those same inequities, leading to further injustice and discrimination.
Themes
Systemic BiasCriminal JusticePredictive PolicingHistorical DataInequality
In practice
Example use cases
In a speech about social justice initiatives, one could use this quote to highlight the importance of addressing bias in technology.
More from Kate Crawford
All quotes →As we move into an era in which personal devices are seen as proxies for public needs, we run the risk that already-existing inequities will be further entrenched. Thus, with every big data set, we need to ask which people are excluded. Which places are less visible? What happens if you live in the shadow of big data sets?
Kate CrawfordRead
Only by developing a deeper understanding of AI systems as they act in the world can we ensure that this new infrastructure never turns toxic.
Kate CrawfordRead
It is a failure of imagination and methodology to claim that it is necessary to experiment on millions of people without their consent in order to produce good data science.
Kate CrawfordRead
The fear isn't that big data discriminates. We already know that it does. It's that you don't know if you've been discriminated against.
Kate CrawfordRead
If you have rooms that are very homogeneous, that have all had the same life experiences and educational backgrounds, and they're all relatively wealthy, their perspective on the world is going to mirror what they already know. That can be dangerous when we're making systems that will affect so many diverse populations.
Kate CrawfordRead
Similar quotes
Those who peacefully gather to express sympathy for the family of Michael Brown must have their rights respected at all times. And journalists must not be harassed or prevented from covering a story that needs to be told.
Eric HolderRead
For a lawyer to do less than his utmost is, I strongly feel, a betrayal of his client. Though in criminal trials one tends to focus on the defense attorney and his client the accused, the prosecutor is also a lawyer, and he too has a client: the People. And the People are equally entitled to their day in court, to a fair and impartial trial, and to justice.
Vincent BugliosiRead
The success of any legal system is measured by its fidelity to the universal ideal of justice.
Earl WarrenRead
People who are well represented at trial do not get the death penalty.
Ruth Bader GinsburgRead
The people who have been unjustly disenfranchised by our criminal justice system and the people who daily fight for them always have, and always will be, the inspiration and focus of my efforts.
Malcolm JenkinsRead
I understood at a young age that administrations come and go, but laws stay. So I decided to become a lawyer in order to help create a more just and peaceful world, not just in a fleeting moment but in a way that will endure from one generation to the next.
Kerry KennedyRead