Rationality- From AI to Zombies

by Eliezer Yudkowsky

  Feynman, Richard P., Robert B. Leighton, and Matthew L. Sands. The Feynman Lectures on Physics. 3 vols. Reading, MA: Addison-Wesley, 1963.

  Finucane, Melissa L., Ali Alhakami, Paul Slovic, and Stephen M. Johnson. “The Affect Heuristic in Judgments of Risks and Benefits.” Journal of Behavioral Decision Making 13, no. 1 (2000): 1–17.

  Fong, Geoffrey T., David H. Krantz, and Richard E. Nisbett. “The Effects of Statistical Training on Thinking about Everyday Problems.” Cognitive Psychology 18, no. 3 (1986): 253–292. doi:10.1016/0010-0285(86)90001-0.

  Frank, Adam. The Constant Fire: Beyond the Science vs. Religion Debate. University of California Press, 2009.

  Freire, Paulo. The Politics of Education: Culture, Power, and Liberation. Greenwood Publishing Group, 1985.

  Galbraith, John Kenneth. Economics, Peace and Laughter. Plume, 1981.

  Ganzach, Yoav. “Judging Risk and Return of Financial Assets.” Organizational Behavior and Human Decision Processes 83, no. 2 (2000): 353–370. doi:10.1006/obhd.2000.2914.

  Gendlin, Eugene T. Focusing. Bantam Books, 1982.

  Gibbon, Edward. The History of the Decline and Fall of the Roman Empire. J. & J. Harper, 1829.

  Gigerenzer, Gerd, and Ulrich Hoffrage. “How to Improve Bayesian Reasoning without Instruction: Frequency Formats.” Psychological Review 102 (1995): 684–704.

  Gilbert, Daniel T., Douglas S. Krull, and Patrick S. Malone. “Unbelieving the Unbelievable: Some Problems in the Rejection of False Information.” Journal of Personality and Social Psychology 59 (4 1990): 601–613. doi:10.1037/0022-3514.59.4.601.

  Gilbert, Daniel T., and Patrick S. Malone. “The Correspondence Bias.” Psychological Bulletin 117, no. 1 (1995): 21–38. http://www.wjh.harvard.edu/~dtg/Gilbert%20&%20Malone%20(CORRESPONDENCE%20BIAS).pdf.

  Gilbert, Daniel T., Romin W. Tafarodi, and Patrick S. Malone. “You Can’t Not Believe Everything You Read.” Journal of Personality and Social Psychology 65 (2 1993): 221–233. doi:10.1037/0022-3514.65.2.221.

  Gilbert, William S., and Arthur Sullivan. The Mikado. Opera, 1885.

  Gilovich, Thomas, Dale Griffin, and Daniel Kahneman, eds. Heuristics and Biases: The Psychology of Intuitive Judgment. New York: Cambridge University Press, 2002. doi:10.2277/0521796792.

  Goertzel, Ben, and Cassio Pennachin, eds. Artificial General Intelligence. Cognitive Technologies. Berlin: Springer, 2007. doi:10.1007/978-3-540-68677-4.

  Good, Irving John. “Speculations Concerning the First Ultraintelligent Machine.” In Advances in Computers, edited by Franz L. Alt and Morris Rubinoff, 6:31–88. New York: Academic Press, 1965. doi:10.1016/S0065-2458(08)60418-0.

  Graur, Dan, and Wen-Hsiung Li. Fundamentals of Molecular Evolution. 2nd ed. Sunderland, MA: Sinauer Associates, 2000.

  Griffin, Dale, and Amos Tversky. “The Weighing of Evidence and the Determinants of Confidence.” Cognitive Psychology 24, no. 3 (1992): 411–435. doi:10.1016/0010-0285(92)90013-R.

  Haidt, Jonathan. “The Emotional Dog and Its Rational Tail: A Social Intuitionist Approach to Moral Judgment.” Psychological Review 108, no. 4 (2001): 814–834. doi:10.1037/0033-295X.108.4.814.

  Halberstadt, Jamin Brett, and Gary M. Levine. “Effects of Reasons Analysis on the Accuracy of Predicting Basketball Games.” Journal of Applied Social Psychology 29, no. 3 (1999): 517–530.

  Haldane, John B. S. “A Mathematical Theory of Natural and Artificial Selection.” Mathematical Proceedings of the Cambridge Philosophical Society 23 (5 1927): 607–615. doi:10.1017/S0305004100011750.

  Hamermesh, Daniel S., and Jeff E. Biddle. “Beauty and the Labor Market.” The American Economic Review 84 (5 1994): 1174–1194.

  Hansen, Katherine, Margaret Gerbasi, Alexander Todorov, Elliott Kruse, and Emily Pronin. “People Claim Objectivity After Knowingly Using Biased Strategies.” Personality and Social Psychology Bulletin 40, no. 6 (2014): 691–699.

  Hanson, Robin. “You Are Never Entitled to Your Opinion.” Overcoming Bias (blog) (2006). http://www.overcomingbias.com/2006/12/you_are_never_e.html.

  Harris, Sam. The End of Faith: Religion, Terror, and the Future of Reason. WW Norton & Company, 2005.

  Hastorf, Albert, and Hadley Cantril. “They Saw a Game: A Case Study.” Journal of Abnormal and Social Psychology 49 (1954): 129–134. http://www2.psych.ubc.ca/~schaller/Psyc590Readings/Hastorf1954.pdf.

  Heuer, Richards J. Psychology of Intelligence Analysis. Center for the Study of Intelligence, Central Intelligence Agency, 1999.

  Hibbard, Bill. “Super-Intelligent Machines.” ACM SIGGRAPH Computer Graphics 35, no. 1 (2001): 13–15. http://www.siggraph.org/publications/newsletter/issues/v35/v35n1.pdf.

  Hintze, Daniel. “Problem Class Dominance in Predictive Dilemmas.” Honors thesis (2014).

  Hodgell, Patricia C. Seeker’s Mask. Meisha Merlin Publishing, Inc., 2001.

  Holt, Jim. “Thinking Inside the Boxes.” Slate (2002). http://www.slate.com/articles/arts/egghead/2002/02/thinkinginside%5C_the%5C_boxes.single.html.

  Holyoak, Keith J., and Robert G. Morrison. The Oxford Handbook of Thinking and Reasoning. Oxford University Press, 2013.

  Hsee, Christopher K. “Less Is Better: When Low-Value Options Are Valued More Highly than High-Value Options.” Behavioral Decision Making 11 (2 1998): 107–121.

  ———. “The Evaluability Hypothesis: An Explanation for Preference Reversals between Joint and Separate Evaluations of Alternatives.” Organizational Behavior and Human Decision Processes 67 (3 1996): 247–257. doi:10.1006/obhd.1996.0077.

  Hsee, Christopher K., and Howard C. Kunreuther. “The Affection Effect in Insurance Decisions.” Journal of Risk and Uncertainty 20 (2 2000): 141–159. doi:10.1023/A:1007876907268.

  Hutter, Marcus. Universal Artificial Intelligence: Sequential Decisions Based On Algorithmic Probability. Berlin: Springer, 2005. doi:10.1007/b138233.

  Huxley, Thomas Henry. Evolution and Ethics and Other Essays. Macmillan, 1894.

  Imagination Engines, Inc. “The Imagination Engine®; or ImagitronTM.” 2011. http://www.imagination-engines.com/ie.htm.

  Jaynes, Edwin T. Probability Theory: The Logic of Science. Edited by George Larry Bretthorst. New York: Cambridge University Press, 2003. doi:10.2277/0521592712.

  ———. “Probability Theory as Logic.” In Maximum Entropy and Bayesian Methods, edited by Paul F. Fougère. Springer Netherlands, 1990.

  ———. “Probability Theory, with Applications in Science and Engineering.” Unpublished manuscript (1974).

  Jones, Edward E., and Victor A. Harris. “The Attribution of Attitudes.” Journal of Experimental Social Psychology 3 (1967): 1–24. http://www.radford.edu/~jaspelme/443/spring-2007/Articles/Jones_n_Harris_1967.pdf.

  Joyce, James M. The Foundations of Causal Decision Theory. New York: Cambridge University Press, 1999. doi:10.1017/CBO9780511498497.

  Kahneman, Daniel. “Comments by Professor Daniel Kahneman.” In Valuing Environmental Goods: An Assessment of the Contingent Valuation Method, edited by Ronald G. Cummings, David S. Brookshire, and William D. Schulze, 1.B:226–235. Experimental Methods for Assessing Environmental Benefits. Totowa, NJ: Rowman & Allanheld, 1986. http://yosemite.epa.gov/ee/epa/eerm.nsf/vwAN/EE-0280B-04.pdf/$file/EE-0280B-04.pdf.

  Kahneman, Daniel, Ilana Ritov, and David Schkade. “Economic Preferences or Attitude Expressions?: An Analysis of Dollar Responses to Public Issues.” Journal of Risk and Uncertainty 19, nos. 1–3 (1999): 203–235. doi:10.1023/A:1007835629236.

  Kahneman, Daniel, David A. Schkade, and Cass R. Sunstein. “Shared Outrage and Erratic Awards: The Psychology of Punitive Damages.” Journal of Risk and Uncertainty 16 (1 1998): 48–86. doi:10.1023/A:1007710408413.

  Kahneman, Daniel, and Amos Tversky. “Prospect Theory: An Analysis of Decision Under Risk.” Econometrica 47 (1979): 263–292.

  Keats, John. “Lamia.” The Poetical Works of John Keats (London: Macmillan) (1884).

  Keysar, Boaz. “Language Users as Problem Solvers: Just What Ambiguity Problem Do They Solve?” In Social and C
ognitive Approaches to Interpersonal Communication, edited by Susan R. Fussell and Roger J. Kreuz, 175–200. Mahwah, NJ: Lawrence Erlbaum Associates, 1998.

  ———. “The Illusory Transparency of Intention: Linguistic Perspective Taking in Text.” Cognitive Psychology 26 (2 1994): 165–208. doi:10.1006/cogp.1994.1006.

  Keysar, Boaz, and Dale J. Barr. “Self-Anchoring in Conversation: Why Language Users Do Not Do What They ‘Should.’” In Gilovich, Griffin, and Kahneman, Heuristics and Biases, 150–166.

  Keysar, Boaz, and Bridget Bly. “Intuitions of the Transparency of Idioms: Can One Keep a Secret by Spilling the Beans?” Journal of Memory and Language 34 (1 1995): 89–109. doi:10.1006/jmla.1995.1005.

  Keysar, Boaz, and Anne S. Henly. “Speakers’ Overestimation of Their Effectiveness.” Psychological Science 13 (3 2002): 207–212. doi:10.1111/1467-9280.00439.

  Kirk, Robert. Mind and Body. McGill-Queen’s University Press, 2003.

  Knishinsky, A. “The Effects of Scarcity of Material and Exclusivity of Information on Industrial Buyer Perceived Risk in Provoking a Purchase Decision.” Doctoral dissertation, Arizona State University, 1982.

  Kosslyn, Stephen M. Image and Brain: The Resolution of the Imagery Debate. Cambridge, MA: MIT Press, 1994.

  Krips, Henry. “Measurement in Quantum Theory.” In The Stanford Encyclopedia of Philosophy, Fall 2013, edited by Edward N. Zalta.

  Kruschke, John K. Doing Bayesian Data Analysis, Second Edition: A Tutorial with R, JAGS, and Stan. Academic Press, 2014.

  ———. “What to Believe: Bayesian Methods for Data Analysis.” Trends in Cognitive Sciences 14, no. 7 (2010): 293–300.

  Kulka, Richard A., and Joan B. Kessler. “Is Justice Really Blind?: The Effect of Litigant Physical Attractiveness on Judicial Judgment.” Journal of Applied Social Psychology 8 (4 1978): 366–381. doi:10.1111/j.1559-1816.1978.tb00790.x.

  Kunreuther, Howard, Robin Hogarth, and Jacqueline Meszaros. “Insurer Ambiguity and Market Failure.” Journal of Risk and Uncertainty 7 (1 1993): 71–87. doi:10.1007/BF01065315.

  Lakoff, George. Women, Fire, and Dangerous Things: What Categories Reveal about the Mind. Chicago: Chicago University Press, 1987.

  Latané, Bibb, and John M. Darley. “Bystander ‘Apathy.’” American Scientist 57, no. 2 (1969): 244–268. http://www.jstor.org/stable/27828530.

  Lazarsfeld, Paul F. “The American Solidier—An Expository Review.” Public Opinion Quarterly 13, no. 3 (1949): 377–404.

  Le Guin, Ursula K. The Farthest Shore. Saga Press, 2001.

  Ledwig, Marion. “Newcomb’s Problem.” PhD diss., University of Constance, 2000.

  Lichtenstein, Sarah, and Paul Slovic. “Reversals of Preference Between Bids and Choices in Gambing Decisions.” Journal of Experimental Psychology 89, no. 1 (1971): 46–55.

  ———, eds. The Construction of Preference. Cambridge University Press, 2006.

  Lichtenstein, Sarah, Paul Slovic, Baruch Fischhoff, Mark Layman, and Barbara Combs. “Judged Frequency of Lethal Events.” Journal of Experimental Psychology: Human Learning and Memory 4, no. 6 (1978): 551–578. doi:10.1037/0278-7393.4.6.551.

  Liersch, Michael J., and Craig R. M. McKenzie. “Duration Neglect by Numbers and Its Elimination by Graphs.” Organizational Behavior and Human Decision Processes 108, no. 2 (2009): 303–314.

  Mack, Denise, and David Rainey. “Female Applicants’ Grooming and Personnel Selection.” Journal of Social Behavior and Personality 5 (5 1990): 399–407.

  MacKay, David J. C. Information Theory, Inference, and Learning Algorithms. New York: Cambridge University Press, 2003.

  Matthews, Robert. “Do We Need to Change the Definition of Science?” New Scientist (May 2008).

  Mazis, Michael B. “Antipollution Measures and Psychological Reactance Theory: A Field Experiment.” Journal of Personality and Social Psychology 31 (1975): 654–666.

  Mazis, Michael B., Robert B. Settle, and Dennis C. Leslie. “Elimination of Phosphate Detergents and Psychological Reactance.” Journal of Marketing Research 10 (1973): 390–395.

  McDermott, Drew. “Artificial Intelligence Meets Natural Stupidity.” SIGART Newsletter, no. 57 (1976): 4–9. doi:10.1145/1045339.1045340.

  McFadden, Daniel L., and Gregory K. Leonard. “Issues in the Contingent Valuation of Environmental Goods: Methodologies for Data Collection and Analysis.” In Contingent Valuation: A Critical Assessment, edited by Jerry A. Hausman, 165–215. Contributions to Economic Analysis220. New York: North-Holland, 1993. doi:10.1108/S0573-8555(1993)0000220007.

  Mercier, Hugo, and Dan Sperber. “Why Do Humans Reason? Arguments for an Argumentative Theory.” Behavioral and Brain Sciences 34 (2011): 57–74. https://hal.archives-ouvertes.fr/file/index/docid/904097/filename/MercierSperberWhydohumansreason.pdf.

  Meyers, David G. Exploring Social Psychology. New York: McGraw-Hill, 1994.

  Mitchell, Tom M. Machine Learning. McGraw-Hill Science/Engineering/Math, 1997.

  Moore, John. Slay and Rescue. Xlibris Corp, 2000.

  Muehlhauser, Luke. “The Power of Agency.” Less Wrong (blog) (2011). http://lesswrong.com/lw/5i8/the_power_of_agency/.

  Musashi, Miyamoto. Book of Five Rings. New Line Publishing, 2003.

  Mussweiler, Thomas, and Fritz Strack. “Comparing Is Believing: A Selective Accessibility Model of Judgmental Anchoring.” European Review of Social Psychology 10 (1 1999): 135–167. doi:10.1080/14792779943000044.

  Nagel, Thomas. “What Is It Like to Be a Bat?” Philosophical Review 83, no. 4 (1974): 435–450. http://www.jstor.org/stable/2183914.

  Newby-Clark, Ian R., Michael Ross, Roger Buehler, Derek J. Koehler, and Dale Griffin. “People Focus on Optimistic Scenarios and Disregard Pessimistic Scenarios While Predicting Task Completion Times.” Journal of Experimental Psychology: Applied 6, no. 3 (2000): 171–182. doi:10.1037/1076-898X.6.3.171.

  Nickerson, Raymond S. “Confirmation Bias: A Ubiquitous Phenomenon in Many Guises.” Review of General Psychology 2, no. 2 (1998): 175.

  Nisbett, Richard E., and Timothy D. Wilson. “Telling More than We Can Know: Verbal Reports on Mental Processes.” Psychological Review 84 (1977): 231–259. http://people.virginia.edu/~tdw/nisbett&wilson.pdf.

  Orwell, George. 1984. Signet Classic, 1950.

  ———. “Politics and the English Language.” Horizon (April 1946).

  ———. “Why Socialists Don’t Believe in Fun.” Tribune (December 1943).

  Pearce, David. The Hedonistic Imperative. http://www.hedweb.com/, 1995.

  Pearl, Judea. Causality: Models, Reasoning, and Inference. 2nd ed. New York: Cambridge University Press, 2009.

  ———. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Mateo, CA: Morgan Kaufmann, 1988.

  Peirce, Charles Sanders. Collected Papers. Harvard University Press, 1931.

  Pinker, Steven. The Blank Slate: The Modern Denial of Human Nature. New York: Viking, 2002.

  Piper, Henry Beam. “Police Operation.” Astounding Science Fiction (July 1948).

  Pirsig, Robert M. Zen and the Art of Motorcycle Maintenance: An Inquiry Into Values. 1st ed. New York: Morrow, 1974.

  Planck, Max. Scientific Autobiography and Other Papers. New York: Philosophical Library, 1949.