Algorithms of Oppression

Home > Nonfiction > Algorithms of Oppression > Page 16
Algorithms of Oppression Page 16

by Safiya Umoja Noble


  Figure 5.2. A call to the profession to address algorithmic bias in library discovery systems by Matthew Reidsma attempts to influence the field of information studies. Source: Reidsma, 2016.

  I sought to test the call that Reidsma made to the profession to interrogate library information management tools by conducting searches in a key library database. I looked in the largest library image database available to academic libraries, ArtStor, and found troublesome practices of metadata management there too. Undoubtedly, these kinds of cataloging stances can be evaluated in the context of the field of library science, which is largely averse to teaching and talking about race and the White racial gaze on information. I have published several articles with colleagues about the challenges of teaching about race in the library and information studies classroom and the importance of integrating theory and training of information workers around issues of social justice in the profession. I interpret these kinds of cataloging mishaps as a result of the investment of the profession in colorblind ideology. Unable and unequipped to think through the complexities of systems of racialization, the profession writ large struggles to find frameworks to think critically about the long-term consequences of misidentification of people and, in this case, concepts about works of art.

  Figure 5.3. Search in ArtStor for “black history” features the work of a series of European and White American artists, March 2, 2016. The first result is work by Thomas Waterman Wood.

  Figure 5.4. On to Liberty, an oil on canvas by Theodore Kauffman, a German painter, is the first item under “African American stereotype.”

  Figure 5.5. A satirical piece by the artist Damali Ayo and her online piece Rent-A-Negro, which is a critique of liberal racial ideologies that tokenize African Americans. The work is cataloged as “racism.”

  Search as a Source of Reality

  Indeed, problematic results in ArtStor are just a small window into a long and troubled history of misrepresentation in library subject cataloging and classification systems, which are faithful reflections of the problematic representations in mainstream U.S. culture. Our ability to recognize these challenges can be enhanced by asking questions about how technological practices are embedded with values, which often obscure the social realities within which representations are formed. The interface of the search engine as a mechanism for accessing the Internet is not immune, nor impartial, to the concerns of embedded value systems. Search is also more than the specific mathematical algorithms and deep-machine learning developed by computer scientists and software engineers to index upward of a trillion pages of information and move some from the universal data pile to the first page of results on a computer screen. The interface on the screen presents an information reality, while the operations are rendered increasingly invisible.36 The media and communications scholar Alex Galloway destabilizes the idea that digital technologies are transparent, benign windows or doors providing a view or path to somewhere and in themselves insignificant—the digital interface is a material reality structuring a discourse, embedded with historical relations, working often under the auspices of ludic capitalism, where a kind of playful engagement of labor is masked in vital digital media platforms such as Google.37 Search does not merely present pages but structures knowledge, and the results retrieved in a commercial search engine create their own particular material reality. Ranking is itself information that also reflects the political, social, and cultural values of the society that search engine companies operate within, a notion that is often obscured in traditional information science studies.

  Further, new digital technologies may constitute containers for old media discourses, and the web interface (such as a plain Google search box) is a transitional format from previous media forms.38 Certainly in the case of digital technology such as commercial search engines, the interface converges with the media itself. Commercial search, in the case of Google, is not simply a harmless portal or gateway; it is in fact a creation or expression of commercial processes that are deeply rooted in social and historical production and organization processes. John Battelle, who has carefully traced the history of Google, describes search as the product of our needs and desires, aggregated by companies:

  Link by link, click by click, search is building possibly the most lasting, ponderous, and significant cultural artifact in the history of humankind: the Database of Intentions. The Database of Intentions is simply this: the aggregate results of every search ever entered, every result list ever tendered, and every path taken as a result. . . . This information represents the real-time history of post-Web culture—a massive clickstream database of desires, needs, wants, and preferences that can be discovered, subpoenaed, archived, tracked and exploited for all sorts of ends.39

  Undoubtedly, search is also pivotal in the development of artificial intelligence. In many ways, Google Search is an attempt to use computer science as a basis for sorting and making decisions about the relevance and quality of information rather than human sorting and web-indexing practices—practices that search engine companies such as Yahoo! and those of the past invested in heavily and that were both expensive to implement and limited and less responsive in real time.40

  Providing Context for Information about People

  In a narrow sense, information is a series of signals and messages that can be expressed through mathematics, algorithms, and statistical probabilities. In a broader sense, however, Tefko Saracevic, a professor emeritus of information science at Rutgers, suggests that information is constituted through “cognitive processing and understanding.”41 There is a pivotal relationship between information and users that is dependent on human understanding. It is this point that I want to emphasize in the context of information retrieval: information provided to a user is deeply contextualized and stands within a frame of reference. For this reason, it is important to study the social context of those who are organizing information and the potential impacts of the judgments inherent in informational organization processes. Information must be treated in a context; “it involves motivation or intentionality, and therefore it is connected to the expansive social context or horizon, such as culture, work, or problem-at-hand,” and this is fundamental to the origins of information science and to information retrieval.42 Information retrieval as a practice has become a highly commercialized industry, predicated on federally funded experiments and research initiatives, leading to the formation of profitable ventures such as Yahoo! and Google, and a focus on information relevance continues to be of importance to the field. Information science is essentially deeply entwined with the history of library science and has primarily been concerned with the collection, storage and retrieval, and access to and use of information. Saracevic notes that “the domain of information science is the transmission of the universe of human knowledge in recorded form, centering on manipulation (representation, organization, and retrieval) of information, rather than knowing information.”43 This foregrounds the ways that representations in search engines are decontextualized in one specific type of information-retrieval process, particularly for groups whose images, identities, and social histories are framed through forms of systemic domination. Although there is a long, broad, and historical context for addressing categorizations, the impact of learning from these traditions has not yet been fully realized.44

  Attention to “the universe of human knowledge” is suggestive for contextualizing information-retrieval practices this way, leading to inquiries into the ways current information-retrieval practices on the web, via commercial search engines, make some types of information available and suppress others. The present focus on the types of information presented in identity-based searches shows that they are removed from the social context of the historical representations and struggles over disempowering forms of representation. These critiques have been levied toward other media practices such as television and print culture. Whether human beings believe that the information delivered in search is relevant has consistently b
een the basis of judgment about information quality,45 but what is underdiscussed is that retrieval of information in commercial platforms such as web-based search engines is not unique to the individual searcher. A web-based commercial search engine does not entirely “know” who a user is, and it is not customizing everything to our personal and political tastes, although it is aggregating us to people it thinks are similar to us on the basis of what is known through our digital traces.

  Finding Culturally Situated Information on the Web

  The field of LIS is significantly engaged in information classification and organization work, which can inform the framework for thinking about developing ICTs that are focused on surfacing prioritized results, such as the search engine. Critical race theory in this process of developing information-organization tools is of great value, particularly when thinking about the phenomenon of excessive recall of documents on the web that are irrelevant or decontextualized. Responses to the kinds of problematic biases in large commercial search engines are part of the growing motivation behind a host of culturally situated search engines that are emerging, particularly Blackbird (www.blackbirdhome.com), a Mozilla Firefox browser designed to help surface content of greater relevance to African Americans. Blackbird has been met with mixed reviews, from support and interest to wholesale rejection.46 In any case, organizations and individuals are responding to the limits of traditional commercial search engines through the development of such search engines. Identity-focused websites, a combination of web-based browsers and web directories, are emerging to prioritize the interests of specific communities on the basis of the human-curated practices of the past and can be seen in search engines such as BlackWebPortal (www.blackwebportal.com); GatewayBlackPortal (www.gatewayblack.com), which is based on international models such as JGrab, a Jewish search engine; BlackFind.com (www.blackfind.com); and Blackbird. Sites such as Jewogle (www.jewogle.com), which serves as an online encyclopedia of the accomplishments of Jewish people; Jewish.net (http://jewish.net/), which is used to “search the Jewish Web”; JewGotIt (www.jewgotit.com); and Maven Search (www.maven.co.il), which catalogs over fifteen thousand Jewish websites, have emerged in the hundreds, some tongue in cheek, across religion, culture, and national origin. Much of this is a response of communities that are seeking control over relevant content and representation, as well as access to quality information within racial or group identity.

  One of the fundamental challenges for these culturally situated search engines is the way in which they make visible the contradictions and biases in search engines, which André Brock discusses in relationship to Blackbird. He notes that “Blackbird’s efforts to foreground African American content were seen as an imposition on the universal appeal of the internet, highlighting the perception of the browser as a social structure limited by Black representation.”47 Brock’s work indicates that though there is a demand for culturally relevant Internet browsing that will help surface content of interest to Black people, its value works against norms on the web, making it less desirable.

  Reproducing Social Relations through Information Technologies

  Online racial disparities cannot be ignored because they are part of the context within which ICTs proliferate, and the Internet is both reproducing social relations and creating new forms of relations based on our engagement with it. Technologies and their design do not dictate racial ideologies; rather, they reflect the current climate. As users engage with technologies such as search engines, they dynamically co-construct content and the technology itself.48 Online information and content available in search is also structured systemically by the infusion of advertising revenue and the surveillance of user searches, which the subjects of such practices have very little ability to reshape or reformulate. Lack of attention to the current exploitative nature of online keyword searches only further entrenches the problematic identities in the media for women of color, identities that have been contested since the advent of commercial media such as broadcast, print, and radio. Noticeably absent in the discussions of search is the broader social and technical interplay that exists dynamically in the way technology is increasingly mediating public access to information, from libraries to the search engine.

  Now, more than ever, a new conception of information access and quality rooted in historical, economic, and social relations could have a transformational effect on the role and consequences of search engines. It is my goal through this research to ensure that traditionally underrepresented ideas and perspectives are included in the shaping of the field—to surface counternarratives that would allow for a questioning of the normalization of such practices. Rather than prioritize the dominant narratives, Internet search platforms and technology companies could allow for greater expression and serve as a democratizing tool for the public. This is rendered impossible with the current commercial practices.

  What we need are public search engine alternatives, united with public-interest journalism and librarianship, to ensure that the public has access to the highest quality information available.

  6

  The Future of Information Culture

  In March 2010, the U.S. Federal Communications Commission (FCC) put forward its ten-year broadband plan, wherein it called for high-speed Internet to become the common medium of communications in the United States.1 This plan still governs the information landscape. The FCC envisioned that the Internet, as the common medium, would potentially displace current telecommunications and broadcast television systems as the primary communications vehicle in the public sphere. According to the report, “almost two-thirds of the time users spend online is focused on communication, information searching, entertainment or social networking.”2 The plan called for increased support for broadband connectivity to facilitate Americans’ ability to access vital information, and it is focused on infrastructure, devices, accessibility, and connectivity. However, the plan made no mention of the role of search engines in the distribution of information to the public, with the exception of noting that the plan itself will be archived and made available in perpetuity in the archives of the Internet. Primary portals to the Internet, whether connecting through the dwindling publicly funded access points in libraries and schools or at home, serve as a gateway to information and cannot be ignored. Access to high-quality information, from journalism to research, is essential to a healthy and viable democracy. As information moves from the public sphere to private control by corporations, a critical juncture in the quality of information available and the public’s ability to sift and use it is at stake, as the noted political economist Herbert Schiller forewarned:

  The American economy is now hostage to a relatively small number of giant private companies, with inter-locking connections, that set the national agenda. This power is particularly characteristic of the communication and information sector where the national cultural-media agenda is provided by a very small (and declining) number of integrated private combines. The development has deeply eroded free individual expression, a vital element of a democratic society.3

  An increasingly de- and unregulated commercially driven Internet raises significant issues about how information is accessed and made available. This is exacerbated by the gamification of news and headlines, as Nicole Cohen of the Institute of Communication, Culture, Information, and Technology at the University of Toronto, Mississauga, has documented in her ethnography of journalists who write for online news outlets. In her book Writers’ Rights: Freelance Journalism in a Digital Age, she documents the increasing tensions between journalists and commercial news media organizations.4 In some cases, journalists are facing screens that deliver real-time analytics about the virality of their stories. Under these circumstances, journalists are encouraged to modify headlines and keywords within a news story to promote greater traction and sharing among readers. The practices Cohen details are precisely the kind of algorithmically driven analytics that place pressure on journalists to modify their content for the express pur
poses of increasing advertising traffic. Undoubtedly, in this case, big-data analytics have potential to significantly compromise the quality of reporting to the public.

  As quality information typically provided by the public sector moves into more corporate and commercial spaces, the ability of the public to ensure protections that are necessary in a democracy is eroded, due to the cost of access. Organizations such as FreePress.org are showing how the rise of advertising and commercial interests have bankrupted the quality and content of journalism, heretofore considered a fundamental and necessary component of a democratic society. The media scholars Robert McChesney and John Nichols have noted in great historical detail and with abundant concrete evidence the importance of information in a democratic society—free from commercial interests.5 These rapid shifts over the past decade from the public-interest journalism environment prior to the 1990s, along with the corporate takeover of U.S. news media, have eroded the quality of information available to the public. Similarly, the move of the Internet from a publicly funded, military-academic project to a full-blown commercial endeavor has also impacted how information is made available on the web.

 

‹ Prev