If you have rooms that are very homogeneous, that have all had the same life experiences and educational backgrounds, and they're all relatively wealthy, their perspective on the world is going to mirror what they already know. That can be dangerous when we're making systems that will affect so many diverse populations.
Interpretation
Diversity in perspectives is crucial for creating systems that serve everyone fairly.
In this quote, Kate Crawford highlights the risks of homogeneity in decision-making spaces. When groups are composed of individuals with similar backgrounds, experiences, and wealth, their collective viewpoint becomes narrow, potentially leading to systemic outcomes that overlook or harm diverse populations. This emphasizes the importance of including varied perspectives in processes that impact a wide range of communities.
In practice
In a conference about social justice, this quote could frame a discussion on the importance of diverse voices.
If you're not thinking about the way systemic bias can be propagated through the criminal justice system or predictive policing, then it's very likely that, if you're designing a system based on historical data, you're going to be perpetuating those biases.
We need to be vigilant about how we design and train these machine-learning systems, or we will see ingrained forms of bias built into the artificial intelligence of the future.
As we move into an era in which personal devices are seen as proxies for public needs, we run the risk that already-existing inequities will be further entrenched. Thus, with every big data set, we need to ask which people are excluded. Which places are less visible? What happens if you live in the shadow of big data sets?
Only by developing a deeper understanding of AI systems as they act in the world can we ensure that this new infrastructure never turns toxic.
It is a failure of imagination and methodology to claim that it is necessary to experiment on millions of people without their consent in order to produce good data science.
The fear isn't that big data discriminates. We already know that it does. It's that you don't know if you've been discriminated against.
You ought to love all mankind; nay, every individual of mankind. You ought not to love the individuals of your domestic circles less, but to love those who exist beyond it more. Once make the feelings of confidence and of affection universal, and the distinctions of property and power will vanish; nor are they to be abolished without substituting something equivalent in mischief to them, until all mankind shall acknowledge an entire community of rights.
Sometimes human places, create inhuman monsters.
The relationship between individuals or communities and the environment ultimately stems from their relationship with God. When ‘man turns his back on the Creator’s plan, he provokes a disorder which has inevitable repercussions on the rest of the created order.
A man in a desert can hold absence in his cupped hands, knowing it is something that feeds him more than water.
Small natures require despotism to exercise their sinews, as great souls thirst for equality to give play to their heart.
I often think of the image only I can see now, and of which I’ve never spoken. It’s always there, in the same silence, amazing. It’s the only image of myself I like, the only one in which I recognize myself, in which I delight
Subscribe for the occasional hand-picked quote. No noise.