Big Data: A Revolution That Will Transform How We Live, Work, and Think
Page 28
human perceptions: big data changes, [>]
IBM, [>]
and electric automobiles, [>]–[>]
founded, [>]
and language translation, [>]–[>], [>]
Project Candide, [>]–[>]
ID3, [>]
“If You Have Too Much Data, Then ‘Good Enough’ Is Good Enough” (Hellend), [>]
Import.io, [>]
imprecision. See also exactitude
in data-processing, [>]–[>]
nature of, [>]–[>]
as positive feature of big data, [>]–[>], [>]–[>], [>]–[>], [>], [>], [>]
and scale, [>], [>], [>], [>], [>]
and truth, [>]
In Retrospect (McNamara), [>]
inflation: big data and calculation of, [>]–[>]
information. See also big data; data; open data
analysis of, [>]–[>], [>]
as basis of the universe, [>]–[>]
growth in amount of, [>]–[>], [>], [>]–[>], [>], [>], [>]
Hilbert attempts to measure, [>]–[>]
history of, [>]–[>], [>]–[>]
innovations in processing technology, [>]–[>]
laws for use of, [>]
qualitative changes in, [>]
world total, [>]
“information society,” [>]–[>], [>]–[>], [>]
Infoseek, [>]
InfoSpace, [>]
Inrix: traffic-pattern analysis by, [>]–[>], [>]
insurance industry: predictive analytics in, [>]–[>]
uses geospatial location data, [>]
International Meridian Conference (Washington, 1884), [>]
International Organization for Standards (ISO), [>]
Internet: privacy and, [>]–[>]
Internet Movie Database, [>]
intuition: vs. data analysis, [>], [>], [>]–[>], [>], [>], [>], [>]
iPhone, [>]
Iraq War: predictive analytics in, [>]
ITA Software, [>], [>], [>], [>]
iTrem, [>]
James, Bill, [>]
Jana, [>]
Japanese-Americans: internment of (1942), [>]
Jawbone, [>]
Jetpac, [>]
Jobs, Steve, [>]–[>]
and DNA sequencing, [>]–[>], [>]
Jonas, Jeff, [>]
justice: based on free will, [>]–[>]
Kaggle, [>]–[>], [>]
Kahneman, Daniel: on causality, [>]
Kelvin, William Thomson, Lord, [>]
Kennedy, Len, [>]
Kennedy, Ted, [>], [>]
Khandelwal, Shashank, [>]–[>]
Kindle e-book reader, [>], [>]–[>]
Kinnard, Douglas: The War Managers, [>]
Koshimizu, Shigeomi: analyzes ergonomic data, [>], [>], [>], [>]–[>]
Kunze, John: on credit card fraud, [>]
Laney, Doug, [>], [>], [>]
Large Synoptic Survey Telescope, [>]
laws: against misuse of big data, [>], [>]–[>]
protecting privacy, [>], [>]
for use of information, [>]
Leavitt, Stephen: Freakonomics, [>]–[>]
Levis, Jack, [>]–[>]
Lewis, Michael: Moneyball, [>]
lexicology, computational, [>]
Linden, Greg, [>]–[>]
LinkedIn, [>], [>], [>], [>], [>]
Luther, Martin, [>]
Lytro camera, [>]–[>]
machine learning, [>], [>]
machine translation. See translation, language
manhole covers, exploding, [>]–[>], [>]–[>], [>], [>]
mapmaking, [>]
Marcken, Carl de, [>]
Marcus, James: Amazonia, [>]
MarketPsych, [>]–[>]
MasterCard, [>]
mathematical models: Google uses, [>]–[>], [>]
search engines and, [>]–[>]
Maury, Matthew Fontaine: The Physical Geography of the Sea, [>]–[>]
revolutionizes marine navigation, [>]–[>], [>], [>], [>], [>], [>], [>], [>], [>], [>]
Mayer, Marissa, [>]
McGregor, Carolyn: and premature births, [>]–[>], [>], [>]
McKinsey Global Institute, [>], [>]
McNamara, Robert: and data analysis, [>]–[>], [>]–[>], [>]
as defense secretary, [>]
In Retrospect, [>]
measurement: in datafication, [>], [>]–[>]
exactitude and, [>]–[>], [>]
mechanical & structural failure: predictive analytics in, [>], [>]–[>], [>], [>], [>]
media, online: Prismatic analyzes, [>]–[>]
medical records: correlation analysis of, [>], [>]–[>], [>]
Medici family, [>]
MedStar Washington Hospital Center (Washington, D.C.), [>]–[>], [>]
Mercator, Gerardus, [>], [>]
Merrill, Douglas, [>]–[>]
messiness. See imprecision
MetaCrawler, [>]
metadata: in datafication, [>]–[>]
metric system, [>]
Microsoft, [>], [>], [>]
Amalga software, [>]–[>], [>]
and data-valuation, [>]
and language translation, [>]
Word spell-checking system, [>]–[>]
Minority Report [film], [>]–[>], [>]
Moneyball [film], [>], [>]–[>], [>], [>]
Moneyball (Lewis), [>]
Moore’s Law, [>]
Mydex, [>]
nanotechnology: and qualitative changes, [>]
Nash, Bruce, [>]
nations: big data and competitive advantage among, [>]–[>]
natural language processing, [>]
navigation, marine: correlation analysis in, [>]–[>]
Maury revolutionizes, [>]–[>], [>], [>], [>], [>], [>], [>], [>], [>], [>]
Negroponte, Nicholas: Being Digital, [>]
Netbot, [>]
Netflix, [>]
collaborative filtering at, [>]
data-reuse by, [>]
releases personal data, [>]
Netherlands: comprehensive civil records in, [>]–[>]
network analysis, [>]
network theory, [>]
big data in, [>]–[>]
New York City: exploding manhole covers in, [>]–[>], [>]–[>], [>], [>]
government data-reuse in, [>]–[>]
New York Times, [>]–[>]
Next Jump, [>]
Neyman, Jerzy: on statistical sampling, [>]
Ng, Andrew, [>]
1984 (Orwell), [>], [>]
Norvig, Peter, [>]
“The Unreasonable Effectiveness of Data,” [>]
Nuance: fails to understand data-reuse, [>]–[>]
numerical systems: history of, [>]–[>]
Oakland Athletics, [>]–[>]
Obama, Barack: on open data, [>]
Och, Franz Josef, [>]
Ohm, Paul: on privacy, [>]
oil refining: big data in, [>]
ombudsmen, [>]
Omidyar, Pierre, [>]
open data. See also big data; data; information
in European Union, [>]
government and, [>]–[>]
in Great Britain, [>]
Obama on, [>]
public nature of, [>]–[>], [>]–[>]
World Bank and, [>]
Open Data Institute, [>]
Open Knowledge Foundation, [>]
O’Reilly, Tim, [>]
Orwell, George: 1984, [>], [>]
Pacioli, Luca: and double-entry bookkeeping, [>]–[>]
Page, Larry, [>]
Palfrey, John, [>]
Parise, Brian, [>]
parole boards: use predictive analytics, [>]
Pasteur, Louis: and rabies vaccine, [>]–[>]
“PayPal Mafia,” [>]
Pearl, Judea, [>]
Pentland, Sandy, [>], [>]
Physical Geography of the Sea, The (Maury), [>]–[>]
Picasso, Pablo, [>]
Pint
erest, [>]
police: use predictive analytics, [>], [>]–[>], [>]
police state: East Germany as, [>], [>], [>]
Power of Habit, The (Duhigg), [>]–[>]
precision. See exactitude
predictive analytics, [>], [>]. See also correlation analysis; data analysis
big data and, [>]–[>], [>], [>]–[>]
Department of Homeland Security uses, [>]
vs. free will, [>], [>], [>], [>]–[>]
in health care, [>]–[>], [>]
in insurance industry, [>]–[>]
in Iraq War, [>]
in mechanical & structural failure, [>], [>]–[>], [>], [>], [>]
parole boards use, [>]
police use, [>], [>]–[>], [>]
in profiling, [>]
punishment based on, [>], [>]–[>], [>], [>]–[>], [>], [>]–[>]
in sports, [>]–[>], [>]
by Target, [>]–[>]
and terrorism, [>], [>]–[>], [>]
by UPS, [>]
predictive policing, [>]
and crime prevention, [>]–[>]
price-prediction: for consumer products, [>]–[>], [>]
PriceStats, [>]
printing press: socioeconomic effects of, [>], [>], [>]–[>]
Prismatic: analyzes online media, [>]–[>]
privacy: and anonymization, [>]–[>]
and big data, [>]–[>], [>], [>], [>]
and cell phone data, [>], [>]
Google and, [>]–[>]
and Internet, [>]–[>]
laws protecting, [>], [>]
and notice & consent, [>], [>], [>]–[>]
Ohm on, [>]
and opting out, [>], [>]
and personal data, [>]–[>], [>]–[>], [>], [>], [>]
profiling: and guilt by association, [>]–[>]
predictive analytics in, [>]
progress: as concept, [>]–[>]
Project Gutenberg, [>]
proxies: in correlation analysis, [>]–[>], [>], [>]
Ptolemy: Geographia, [>]
public health: reporting system limitations, [>]–[>]
punch cards: Hollerith and, [>], [>]
punishment: based on predictive analytics, [>], [>]–[>], [>], [>]–[>], [>], [>]–[>]
quality control: statistical sampling in, [>]
Quantcast, [>]
quantification. See measurement
“quantified self” movement, [>]
quantum physics, [>]
rabies vaccine: Pasteur and, [>]–[>]
randomness: needed in statistical sampling, [>]–[>]
real estate: regulation of illegal conversions, [>]–[>]
reality mining, [>]–[>]
record-keeping: in the ancient world, [>]–[>]
Reuters, [>]
Rigobon, Roberto, [>]
Roadnet Technologies, [>]
Rolls-Royce, [>]
Roman numerals, [>]–[>]
Rudin, Cynthia, [>], [>]
Rudin, Ken, [>]
sabermetrics, [>]
Saddam Hussein: trial of, [>]
Salathé, Marcel, [>]–[>]
sales data: analysis of, [>], [>], [>], [>]
Salesforce.com, [>]
sampling, statistical: big data replaces, [>]–[>], [>], [>]–[>], [>]–[>]
exactitude necessary in, [>], [>]–[>]
Graunt and, [>]
limitations inherent in, [>]–[>], [>], [>]
Neyman on, [>]
in quality control, [>]
randomness needed in, [>]–[>]
scale in, [>]
Silver on, [>]
scale: in data, [>]–[>]
imprecision and, [>], [>], [>], [>], [>]
qualitative functions of, [>], [>]–[>], [>], [>]–[>], [>]–[>]
in statistical sampling, [>]
scientific method: vs. correlation analysis, [>]–[>]
Scott, James: Seeing Like a State, [>]
search engines: and mathematical models, [>]–[>]
search terms: analysis and reuse of, [>]–[>], [>], [>], [>], [>]
Seeing Like a State (Scott), [>]
Sense Networks, [>], [>]
sentiment analysis, [>], [>]–[>], [>]
Silver, Nate: on statistical sampling, [>]
Skyhook, [>]
Sloan Digital Sky Survey, [>]
Smith, Adam, [>]
social media: datafication by, [>]–[>]
social networking analysis: Huberman and, [>]
social sciences: data-gathering in, [>], [>]
Society for American Baseball Research, [>]
speech-recognition: at Google, [>]–[>]
spell-checking systems: and data-reuse, [>]–[>]
sports: predictive analytics in, [>]–[>], [>]
Stasi, [>], [>], [>]
statisticians: demand for, [>], [>]
statistics: military use of, [>]
stock market investment: datafication in, [>]–[>]
subprime mortgage scandal (2009): correlation analysis and, [>]
sumo wrestling: corruption in, [>]–[>], [>]
Sunlight Foundation, [>]
Super Crunchers (Ayres), [>]
surveillance: by government, [>]–[>], [>]–[>]
SWIFT: data-reuse by, [>]
tagging: vs. categorization, [>]–[>]
Taleb, Nassim Nicholas, [>]
Target: predictive analytics by, [>]–[>]
Telefonica Digital Insights, [>]
Teradata, [>], [>], [>]
terrorism: predictive analytics and, [>], [>]–[>], [>]
text: correlation analysis of, [>]–[>]
datafication of, [>], [>]
The-Numbers.com: predicts Hollywood film profitability, [>]–[>]
Thomson Reuters, [>]
traffic-pattern analysis: by Inrix, [>]–[>], [>]
translation, language, [>]
Google and, [>]–[>], [>], [>], [>]
IBM and, [>]–[>], [>]
Microsoft and, [>]
transparency: of algorithms, [>]
truth: data as, [>], [>]
imprecision and, [>]
23andMe, [>]
Twitter, [>], [>], [>]–[>], [>]
as big-data company, [>], [>]–[>]
data processing by, [>]
datafication by, [>]–[>]
message analysis by, [>]
Udacity, [>]
Universal Transverse Mercator (UTM) system, [>]
universe: information as basis of, [>]–[>]
“Unreasonable Effectiveness of Data, The” (Norvig), [>]
UPS: predictive analytics by, [>]
uses geospatial location data, [>]–[>]
UPS Logistics Technologies, [>]
U.S. Bureau of Labor Statistics, [>]
U.S. Census Bureau: data-gathering innovations by, [>]–[>]
U.S. Centers for Disease Control: reporting system limitations, [>]–[>]
U.S. Department of Homeland Security, [>]
uses predictive analytics, [>]
U.S. National Security Agency (NSA): data-gathering by, [>]–[>]
U.S. President’s Council of Advisors on Science and Technology, [>]
value, economic: big data and creation of, [>], [>], [>], [>], [>]–[>], [>]–[>], [>]–[>], [>]–[>]
of reusing data, [>]–[>], [>]–[>], [>]–[>], [>]–[>], [>], [>]
Varian, Hal, [>]
video game design: correlation analysis in, [>]–[>]
Vietnam War: data misused in, [>], [>]–[>]
Visa, [>]
von Ahn, Luis: invents Captcha & ReCaptcha, [>]–[>]
Walmart, [>]
analyzes sales data, [>], [>], [>], [>]
merchandising innovations by, [>]–[>]
War Managers, The (Kinnard), [>]
Warden, Pete, [>]
Watts, Duncan, [>]
Weinberger, David, [>]
Wikipedia, [>]
Windows Azure Marketplace,
[>]
World Bank, [>]
and open data, [>]
Xoom, [>]–[>]
Yahoo, [>], [>], [>]
YouTube: data processing by, [>]
Zeo, [>]
ZestFinance, [>]–[>]
Zillow, [>]
Zuckerberg, Mark, [>], [>]
Zynga, [>]–[>]
About the Authors
VIKTOR MAYER-SCHÖNBERGER is Professor of Internet Governance and Regulation at the Oxford Internet Institute, Oxford University. A widely recognized authority on big data, he is the author of over a hundred articles and eight books, including Delete: The Virtue of Forgetting in the Digital Age. He is on the advisory boards of corporations and organizations around the world, including Microsoft and the World Economic Forum.
KENNETH CUKIER is the Data Editor of the Economist and a prominent commentator on developments in big data. His writings on business and economics have appeared in Foreign Affairs, the New York Times, the Financial Times, and elsewhere.