The Evolution of Cooperation
![]() | This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these template messages)
|
![]() Book cover | |
Author | Robert Axelrod |
---|---|
Language | English |
Genre | Philosophy, sociology |
Publisher | Basic Books |
Publication date | April 1984 |
Publication place | United States |
Media type | Hardback, paperback, audiobook |
Pages | 241 |
ISBN | 0-465-00564-0 |
OCLC | 76963800 |
302 14 | |
LC Class | HM131.A89 1984 |
The Evolution of Cooperation is a 1984 book written by political scientist Robert Axelrod[1] that expands upon a paper of the same name written by Axelrod and evolutionary biologist W.D. Hamilton.[2] The article's summary addresses the issue in terms of "cooperation in organisms, whether bacteria or primates".[2]
The book details a theory on the emergence of cooperation between individuals, drawing from game theory and evolutionary biology. Since 2006, reprints of the book have included a foreword by Richard Dawkins and have been marketed as a revised edition.
The book provides an investigation into how cooperation can emerge and persist as explained by the application of game theory.[3] The book provides a detailed explanation of the evolution of cooperation, beyond traditional game theory. Academic literature regarding forms of cooperation that are not easily explained in traditional game theory, especially when considering evolutionary biology, largely took its modern form as a result of Axelrod's and Hamilton's influential 1981 paper[2] and the subsequent book.
Background: Axelrod's tournaments
[edit]Axelrod initially solicited strategies from other game theorists to compete in the first tournament. Each strategy was paired with each other strategy for 200 iterations of a Prisoner's Dilemma game and scored on the total points accumulated through the tournament. The winner was a very simple strategy submitted by Anatol Rapoport called "tit for tat" (TFT) that cooperates on the first move, and subsequently echoes (reciprocates) what the other player did on the previous move. The results of the first tournament were analyzed and published, and a second tournament was held to see if anyone could find a better strategy. TFT won again. Axelrod analyzed the results and made some interesting discoveries about the nature of cooperation, which he describes in his book.[4]
In both actual tournaments and various replays, the best-performing strategies were nice:[5] that is, they were never the first to defect. Many of the competitors went to great lengths to gain an advantage over the "nice" (and usually simpler) strategies, but to no avail: tricky strategies fighting for a few points generally could not do as well as nice strategies working together. TFT (and other "nice" strategies generally) "won, not by doing better than the other player, but by eliciting cooperation [and] by promoting the mutual interest rather than by exploiting the other's weakness."[6]
Being "nice" can be beneficial, but it can also lead to being suckered. To obtain the benefit – or avoid exploitation – it is necessary to be provocable and forgiving. When the other player defects, a nice strategy must immediately be provoked into retaliatory defection.[7] The same goes for forgiveness: return to cooperation as soon as the other player does. Overdoing the punishment risks escalation, and can lead to an "unending echo of alternating defections" that depresses the scores of both players.[8]
Most of the games that game theory had heretofore investigated are "zero-sum" – that is, the total rewards are fixed, and a player does well only at the expense of other players. But real life is not zero-sum. Our best prospects are usually in cooperative efforts. In fact, TFT cannot score higher than its partner; at best it can only do "as good as". Yet it won the tournaments by consistently scoring a strong second-place with a variety of partners.[9] Axelrod summarizes this as "don't be envious";[10] in other words, don't strive for a payoff greater than the other player's.[11]
In any IPD game, there is a certain maximum score each player can get by always cooperating. But some strategies try to find ways of getting a little more with an occasional defection (exploitation). This can work against some strategies that are less provocable or more forgiving than TFT, but generally, they do poorly. "A common problem with these rules is that they used complex methods of making inferences about the other player [strategy] – and these inferences were wrong."[12] Against TFT one can do no better than to simply cooperating.[13] Axelrod calls this "clarity". Or: "don't be too clever".[14]
The success of any strategy depends on the nature of the particular strategies it encounters, which depends on the composition of the overall population. To better model the effects of reproductive success Axelrod also did an "ecological" tournament, where the prevalence of each type of strategy in each round was determined by that strategy's success in the previous round. The competition in each round becomes stronger as weaker performers are reduced and eliminated. The results were amazing: a handful of strategies – all "nice" – came to dominate the field.[15] In a sea of non-nice strategies the "nice" strategies – provided they were also provocable – did well enough with each other to offset the occasional exploitation. As cooperation became general the non-provocable strategies were exploited and eventually eliminated, whereupon the exploitive (non-cooperating) strategies were out-performed by the cooperative strategies.
In summary, success in an evolutionary "game" correlated with the following characteristics:
- Be nice: cooperate, never be the first to defect.
- Be provocable: return defection for defection, cooperation for cooperation.
- Don't be envious: focus on maximizing your own 'score', as opposed to ensuring your score is higher than your 'partner's'.
- Don't be too clever: or, don't try to be tricky. Clarity is essential for others to cooperate with you.
Foundation of reciprocal cooperation
[edit]The lessons described above apply in environments that support cooperation, but whether cooperation is supported at all, depends crucially on the probability (called ω [omega]) that the players will meet again,[16] also called the discount parameter or, figuratively, the shadow of the future. When ω is low – that is, the players have a negligible chance of meeting again – each interaction is effectively a single-shot Prisoner's Dilemma game, and one might as well defect in all cases (a strategy called "ALL D"), because even if one cooperates there is no way to keep the other player from exploiting that. But in the iterated PD the value of repeated cooperative interactions can become greater than the benefit/risk of single exploitation (which is all that a strategy like TFT will tolerate).
Curiously, rationality and deliberate choice are not necessary, nor trust nor even consciousness,[17] as long as there is a pattern that benefits both players (e.g., increases fitness), and some probability of future interaction. Often the initial mutual cooperation is not even intentional, but having "discovered" a beneficial pattern both parties respond to it by continuing the conditions that maintain it.
This implies two requirements for the players, aside from whatever strategy they may adopt. First, they must be able to recognize other players, to avoid exploitation by cheaters. Second, they must be able to track their previous history with any given player, in order to be responsive to that player's strategy.[18]
Even when the discount parameter ω is high enough to permit reciprocal cooperation there is still a question of whether and how cooperation might start. One of Axelrod's findings is that when the existing population never offers cooperation nor reciprocates it – the case of ALL D – then no nice strategy can get established by isolated individuals; cooperation is strictly a sucker bet. (The "futility of isolated revolt".[19]) But another finding of great significance is that clusters of nice strategies can get established. Even a small group of individuals with nice strategies with infrequent interactions can yet do so well on those interactions to make up for the low level of exploitation from non-nice strategies.[20]
Cooperation becomes more complicated, however, as soon as more realistic models are assumed that for instance offer more than two choices of action, provide the possibility of gradual cooperation, make actions constrain future actions (path dependence), or in which interpret the associate's actions are is non-trivial (e.g. recognizing the degree of cooperation shown)[21]
Subsequent work
[edit]In 1984 Axelrod estimated that there were "hundreds of articles on the Prisoner's Dilemma cited in Psychological Abstracts",[22] and estimated that citations to The Evolution of Cooperation alone were "growing at the rate of over 300 per year".[23] To fully review this literature is infeasible. What follows are therefore only a few selected highlights.
Axelrod considers his subsequent book, The Complexity of Cooperation,[24] to be a sequel to The Evolution of Cooperation. Other work on the evolution of cooperation has expanded to cover prosocial behavior generally,[25] and in religion,[26] other mechanisms for generating cooperation,[27] the IPD under different conditions and assumptions,[28] and the use of other games such as the Public Goods and Ultimatum games to explore deep-seated notions of fairness and fair play.[29] It has also been used to challenge the rational and self-regarding "economic man" model of economics,[30] and as a basis for replacing Darwinian sexual selection theory with a theory of social selection.[31]
Nice strategies are better able to invade if they have social structures or other means of increasing their interactions. Axelrod discusses this in chapter 8; in a later paper he and Rick Riolo and Michael Cohen[32] use computer simulations to show cooperation rising among agents who have negligible chance of future encounters but can recognize similarity of an arbitrary characteristic (such as a green beard); whereas other studies[33] have shown that the only Iterated Prisoner's Dilemma strategies that resist invasion in a well-mixed evolving population are generous strategies.
When an IPD tournament introduces noise (errors or misunderstandings), TFT strategies can get trapped into a long string of retaliatory defections, thereby depressing their score. TFT also tolerates "ALL C" (always cooperate) strategies, which then give an opening to exploiters.[34] In 1992 Martin Nowak and Karl Sigmund demonstrated a strategy called Pavlov (or "win–stay, lose–shift") that does better in these circumstances.[35] Pavlov looks at its own prior move as well as the other player's move. If the payoff was R or P (see "Prisoner's Dilemma", above) it cooperates; if S or T it defects.
In a 2006 paper Nowak listed five mechanisms by which natural selection can lead to cooperation.[36] In addition to kin selection and direct reciprocity, he shows that:
- Indirect reciprocity is based on knowing the other player's reputation, which is the player's history with other players. Cooperation depends on a reliable history being projected from past partners to future partners.
- Network reciprocity relies on geographical or social factors to increase the interactions with nearer neighbors; it is essentially a virtual group.
- Group selection[37] assumes that groups with cooperators (even altruists) will be more successful as a whole, and this will tend to benefit all members.
The payoffs in the Prisoner's Dilemma game are fixed, but in real life defectors are often punished by cooperators. Where punishment is costly there is a second-order dilemma amongst cooperators between those who pay the cost of enforcement and those who do not.[38] Other work has shown that while individuals given a choice between joining a group that punishes free-riders and one that does not initially prefer the sanction-free group, yet after several rounds they will join the sanctioning group, seeing that sanctions secure a better payoff.[39]
In small populations or groups there is the possibility that indirect reciprocity (reputation) can interact with direct reciprocity (e.g. tit for tat) with neither strategy dominating the other.[40] The interactions between these strategies can give rise to dynamic social networks which exhibit some of the properties observed in empirical networks[41] If network structure and choices in the Prisoner's dilemma co-evolve, then cooperation can survive. In the resulting networks cooperators will be more centrally located than defectors who will tend to be in the periphery of the network.[42]
In "The Coevolution of Parochial Altruism and War" by Jung-Kyoo Choi and Samuel Bowles. From their summary:
Altruism—benefiting fellow group members at a cost to oneself —and parochialism—hostility towards individuals not of one's own ethnic, racial, or other group—are common human behaviors. The intersection of the two—which we term "parochial altruism"—is puzzling from an evolutionary perspective because altruistic or parochial behavior reduces one's payoffs by comparison to what one would gain from eschewing these behaviors. But parochial altruism could have evolved if parochialism promoted intergroup hostilities and the combination of altruism and parochialism contributed to success in these conflicts.... [Neither] would have been viable singly, but by promoting group conflict they could have evolved jointly.[43]
Consideration of the mechanisms through which learning from the social environment occurs is pivotal in studies of evolution. In the context of this discussion, learning rules, specifically conformism and payoff-dependent imitation, are not arbitrarily predetermined but are biologically selected. Behavioral strategies, which include cooperation, defection, and cooperation coupled with punishment, are chosen in alignment with the agent's prevailing learning rule. Simulations of the model under conditions approximating those experienced by early hominids reveal that conformism can evolve even when individuals are solely faced with a cooperative dilemma, contrary to previous assertions. Moreover, the incorporation of conformists significantly amplifies the group size within which cooperation can be sustained. These model results demonstrate robustness, maintaining validity even under conditions of high migration rates and infrequent intergroup conflicts.[44]
Neither Choi & Bowles nor Guzmán, Rodriguez-Sicket and Rowthorn claim that humans have actually evolved in this way, but that computer simulations show how war could be promoted by the interaction of these behaviors. A crucial open research question, thus, is how realistic the assumptions are on which these simulation models are based.[45]
Software
[edit]Several software packages have been created to run prisoner's dilemma simulations and tournaments, some of which have available source code.
- The source code for the second tournament run by Robert Axelrod (written by Axelrod and many contributors in Fortran) is available online
- PRISON, a library written in Java, last updated in 1999
- Axelrod-Python, written in Python
Recommended reading
[edit]- Axelrod, Robert; Hamilton, William D. (27 March 1981), "The Evolution of Cooperation" (PDF), Science, 211 (4489): 1390–96, Bibcode:1981Sci...211.1390A, doi:10.1126/science.7466396, PMID 7466396
- Axelrod, Robert (1984), The Evolution of Cooperation, Basic Books, ISBN 0-465-02122-0
- Axelrod, Robert (2006), The Evolution of Cooperation (Revised ed.), Perseus Books Group, ISBN 0-465-00564-0
- Axelrod, Robert (1997), "The Complexity of Cooperation: Agent-Based Models of Competition and Collaboration", Complexity, 3 (3), Princeton University Press: 46–48, Bibcode:1998Cmplx...3c..46C, doi:10.1002/(SICI)1099-0526(199801/02)3:3<46::AID-CPLX6>3.0.CO;2-K, ISBN 0-691-01567-8
- Dawkins, Richard (1989) [1976], The Selfish Gene (2nd ed.), Oxford Univ. Press, ISBN 0-19-286092-5
- Gould, Stephen Jay (June 1997), "Kropotkin was no crackpot", Natural History, 106: 12–21
- Kropotkin, Peter. Mutual Aid: A Factor of Evolution at Project Gutenberg
- Ridley, Matt (1996), The Origins of Virtue, Viking (Penguin Books), ISBN 0-670-86357-2
- Sigmund, Karl; Fehr, Ernest; Nowak, Martin A. (January 2002), "The Economics of Fair Play" (PDF), Scientific American, vol. 286, no. 1, pp. 82–87, Bibcode:2002SciAm.286a..82S, doi:10.1038/scientificamerican0102-82, PMID 11799620, archived from the original (PDF) on 18 May 2011
- Trivers, Robert L. (March 1971), "The Evolution of Reciprocal Altruism" (PDF), Quarterly Review of Biology, 46: 35–57, doi:10.1086/406755, S2CID 19027999[dead link]
- Vogel, Gretchen (20 February 2004), "News Focus: The Evolution of the Golden Rule", Science, 303 (5661): 1128–31, doi:10.1126/science.303.5661.1128, PMID 14976292, S2CID 178426383
See also
[edit]References
[edit]- ^ Axelrod's book was summarized in Douglas Hofstadter's May 1983 "Metamagical Themas" column in Scientific American (Hofstadter 1983) (reprinted in his book (Hofstadter 1985); see also Richard Dawkin's summary in the second edition of The Selfish Gene (Dawkins 1989, ch. 12).
- ^ a b c Axelrod, Robert; Hamilton (1981). "Evolution of Cooperation". Science. 211 (4489). American Association for the Advancement of Science: 1390–1396. Bibcode:1981Sci...211.1390A. doi:10.1126/science.7466396. PMID 7466396 – via JSTO.
- ^ Axelrod & Hamilton 1981. sfn error: multiple targets (2×): CITEREFAxelrodHamilton1981 (help)
- ^ Axelrod 1984.
- ^ Axelrod 1984, p. 113.
- ^ Axelrod 1984, p. 130.
- ^ Axelrod 1984, pp. 62, 211.
- ^ Axelrod 1984, p. 186.
- ^ Axelrod 1984, p. 112.
- ^ Axelrod 1984, pp. 110–113.
- ^ Axelrod 1984, p. 25.
- ^ Axelrod 1984, p. 120.
- ^ Axelrod 1984, pp. 47, 118.
- ^ Axelrod 1984, pp. 120+.
- ^ Axelrod 1984, pp. 48–53.
- ^ Axelrod 1984, p. 13.
- ^ Axelrod 1984, pp. 18, 174.
- ^ Axelrod 1984, p. 174.
- ^ Axelrod 1984, p. 150.
- ^ Axelrod 1984, pp. 63–68, 99
- ^ Prechelt, Lutz (1996). "INCA: A multi-choice model of cooperation under restricted communication". Biosystems. 37 (1–2): 127–134. Bibcode:1996BiSys..37..127P. doi:10.1016/0303-2647(95)01549-3.
- ^ Axelrod 1984, pp. 28.
- ^ Axelrod 1984, pp. 3.
- ^ Axelrod 1997.
- ^ Boyd 2006; Bowles 2006.
- ^ Norenzayan & Shariff 2008.
- ^ Nowak 2006.
- ^ Axelrod & Dion 1988; Hoffman 2000 categorizes and summarizes over 50 studies
- ^ Nowak, Page & Sigmund 2000; Sigmund, Fehr & Nowak 2002.
- ^ Camerer & Fehr 2006.
- ^ Roughgarden, Oishi & Akcay 2006.
- ^ Riolo, Cohen & Axelrod 2001.
- ^ Stewart and Plotkin (2013)
- ^ Axelrod (1984, pp. 136–138) has some interesting comments on the need to suppress universal cooperators. See also a similar theme in Piers Anthony's novel Macroscope.
- ^ Nowak & Sigmund 1992; see also Milinski 1993.
- ^ Nowak 2006;
- ^ Here group selection is not a form of evolution, which is problematical (see Dawkins (1989), ch. 7), but a mechanism for evolving cooperation.
- ^ Hauert & others 2007.
- ^ Gürerk, Irlenbusch & Rockenbach 2006
- ^ Phelps, S., Nevarez, G. & Howes, A., 2009. The effect of group size and frequency of encounter on the evolution of cooperation. In LNCS, Volume 5778, ECAL 2009, Advances in Artificial Life: Darwin meets Von Neumann. Budapest: Springer, pp. 37–44. [1].
- ^ Phelps, S (2012). "Emergence of social networks via direct and indirect reciprocity" (PDF). Autonomous Agents and Multi-Agent Systems. doi:10.1007/s10458-012-9207-8. S2CID 1337854.
- ^ Fosco and Mengel (2011)
- ^ Choi & Bowles 2007, p. 636.
- ^ Guzmán, R. A.; Rodríguez-Sickert, C.; Rowthorn, R. (2007). "When in Rome, do as the Romans do: the coevolution of altruistic punishment, conformist learning, and cooperation" (PDF). Evolution and Human Behavior. 28 (2): 112–117. Bibcode:2007EHumB..28..112A. doi:10.1016/j.evolhumbehav.2006.08.002.
- ^ Rusch 2014.
Bibliography
[edit]Most of these references are to the scientific literature, to establish the authority of various points in the article. A few references of lesser authority, but greater accessibility are also included.
- Axelrod, Robert (1984), The Evolution of Cooperation, Basic Books, ISBN 0-465-02122-0
- Axelrod, Robert (1997), "The Complexity of Cooperation: Agent-Based Models of Competition and Collaboration", Complexity, 3 (3), Princeton University Press: 46–48, Bibcode:1998Cmplx...3c..46C, doi:10.1002/(SICI)1099-0526(199801/02)3:3<46::AID-CPLX6>3.0.CO;2-K
- Axelrod, Robert (July 2000), "On Six Advances in Cooperation Theory" (PDF), Analyse & Kritik, 22: 130–151, doi:10.1515/auk-2000-0107, S2CID 17399009
- Axelrod, Robert (2006), The Evolution of Cooperation (Revised ed.), Perseus Books Group, ISBN 0-465-00564-0
- Axelrod, Robert; D'Ambrosio, Lisa (1996), Annotated Bibliography on the Evolution of Cooperation (PDF)
- Axelrod, Robert; Dion, Douglas (9 December 1988), "The Further Evolution of Cooperation" (PDF), Science, 242 (4884): 1385–90, Bibcode:1988Sci...242.1385A, doi:10.1126/science.242.4884.1385, PMID 17802133, S2CID 41453503
- Axelrod, Robert; Hamilton, William D. (27 March 1981), "The Evolution of Cooperation" (PDF), Science, 211 (4489): 1390–96, Bibcode:1981Sci...211.1390A, doi:10.1126/science.7466396, PMID 7466396
- Binmore, Kenneth G. (1994), Game Theory and the Social Contract: Vol. 1, Playing Fair, MIT Press
- Binmore, Kenneth G. (1998a), Game Theory and the Social Contract: Vol. 2, Just Playing, MIT Press
- Binmore, Kenneth G. (1998b), Review of 'The Complexity of Cooperation'
- Binmore, Kenneth G. (2004), "Reciprocity and the social contract" (PDF), Politics, Philosophy & Economics, 3: 5–6, doi:10.1177/1470594X04039981, S2CID 144880524
- Bowler, Peter J. (1984), Evolution: The History of an Idea, Univ. of California Press, ISBN 0-520-04880-6
- Bowles, Samuel (8 December 2006), "Group Competition, Reproductive Leveling, and the Evolution of Human Altruism", Science, 314 (5805): 1569–72, Bibcode:2006Sci...314.1569B, doi:10.1126/science.1134829, PMID 17158320, S2CID 6032103, archived from the original on 7 February 2009, retrieved 23 February 2009
- Bowles, Samuel; Choi, Jung-Koo; Hopfensitz, Astrid (2003), "The co-evolution of individual behaviors and social institutions" (PDF), Journal of Theoretical Biology, 223 (2): 135–147, Bibcode:2003JThBi.223..135B, doi:10.1016/S0022-5193(03)00060-2, PMID 12814597, archived from the original (PDF) on 19 February 2005, retrieved 23 February 2009
- Boyd, Robert (8 December 2006), "The Puzzle of Human Sociality" (PDF), Science, 314 (5805): 1555–56, doi:10.1126/science.1136841, PMID 17158313, S2CID 86630847, archived from the original (PDF) on 17 October 2018, retrieved 6 March 2011
- Camerer, Colin F.; Fehr, Ernst (6 January 2006), "When Does 'Economic Man' Dominate Social Behavior?" (PDF), Science, 311 (5757): 47–52, Bibcode:2006Sci...311...47C, doi:10.1126/science.1110600, PMID 16400140, S2CID 1316190
- Carnegie, Andrew (1900), The Gospel of Wealth, and Other Timely Essays
- Choi, Jung-Kyoo; Bowles, Samuel (26 October 2007), "The Coevolution of Parochial Altruism and War", Science, 318: 636–40, Bibcode:2007Sci...318..636C, doi:10.1126/science.1144237, PMID 17962562, S2CID 2058440
- Darwin, Charles (1964) [1859], On the Origin of Species (A Facsimile of the First ed.), Harvard Univ. Press
- Dawkins, Richard (1989) [1976], The Selfish Gene (2nd ed.), Oxford Univ. Press, ISBN 0-19-286092-5
- Fosco, Constanza; Mengel, Friederike (2011). "Cooperation through Imitation and Exclusion in Networks" (PDF). Journal of Economic Dynamics and Control. 35 (5): 641–658. doi:10.1016/j.jedc.2010.12.002.[permanent dead link]
- Gauthier, David P. (1986), Morals by agreement, Oxford Univ. Press
- Gauthier, David P., ed. (1970), Morality and Rational Self-Interest, Prentice-Hall
- Gould, Stephen Jay (June 1997), "Kropotkin was no crackpot", Natural History, 106: 12–21
- Gürerk, Özgür; Irlenbusch, Bernd; Rockenbach, Bettina (7 April 2006), "The Competitive Advantage of Sanctioning Institutions" (PDF), Science, 312 (5770): 108–11, Bibcode:2006Sci...312..108G, doi:10.1126/science.1123633, PMID 16601192, S2CID 40038573, archived from the original (PDF) on 19 July 2011
- Hamilton, William D. (1963), "The Evolution of Altruistic Behavior" (PDF), American Naturalist, 97 (896): 354–56, doi:10.1086/497114, S2CID 84216415[dead link]
- Hamilton, William D. (1964), "The Genetical Evolution of Social Behavior" (PDF), Journal of Theoretical Biology, 7 (1): 1–16, 17–52, Bibcode:1964JThBi...7....1H, doi:10.1016/0022-5193(64)90038-4, PMID 5875341, archived from the original (PDF) on 29 December 2009
- Hardin, Garrett (13 December 1968), "The Tragedy of the Commons", Science, 162 (3859): 1243–1248, Bibcode:1968Sci...162.1243H, doi:10.1126/science.162.3859.1243, PMID 5699198
- Hauert, Christoph; Traulsen, Arne; Brandt, Hannelore; Nowak, Martin A.; Sigmund, Karl (29 June 2007), "Via Freedom to Coercion: The Emergence of Costly Punishment" (PDF), Science, 316 (5833): 1905–07, Bibcode:2007Sci...316.1905H, doi:10.1126/science.1141588, PMC 2430058, PMID 17600218, archived from the original (PDF) on 18 May 2011
- Henrich, Joseph (7 April 2006), "Cooperation, Punishment, and the Evolution of Human Institutions" (PDF), Science, 312 (5770): 60–61, doi:10.1126/science.1126398, PMID 16601179, S2CID 39232348, archived from the original (PDF) on 29 June 2011
- Henrich, Joseph; et al. (23 June 2007), "Costly Punishment Across Human Societies" (PDF), Science, 312 (5781): 1767–70, Bibcode:2006Sci...312.1767H, doi:10.1126/science.1127333, PMID 16794075, S2CID 4793548
- Hobbes, Thomas (1651), Leviathan, Bobbs-Merrill [and others] (published 1958)
- Hoffman, Robert (2000), "Twenty Years on: The Evolution of Cooperation Revisited" (PDF), Journal of Artificial Societies and Social Simulation, 3 (2): 1390–1396
- Hofstadter, Douglas R. (May 1983), "Metamagical Themas: Computer Tournaments of the Prisoner's Dilemma Suggest How Cooperation Evolves", Scientific American, vol. 248, pp. 16–26
- Hofstadter, Douglas R. (1985), "The Prisoner's Dilemma Computer Tournaments and the Evolution of Cooperation", Metamagical Themas: Questing for the Essence of Mind and Pattern, Basic Books, pp. 715–730, ISBN 0-465-04540-5
- Kavka, Gregory S. (1986), Hobbesian moral and political theory, Princeton Univ. Press
- Kropotkin, Petr (1902), Mutual Aid: A Factor in Evolution
- Maynard Smith, John (1976), "Evolution and the Theory of Games", American Scientist, vol. 61, no. 1, pp. 41–45, Bibcode:1976AmSci..64...41M
- Maynard Smith, John (September 1978), "The Evolution of Behavior", Scientific American, vol. 239, no. 3, pp. 176–92, Bibcode:1978SciAm.239c.176S, doi:10.1038/scientificamerican0978-176, PMID 705322
- Maynard Smith, John (1982), Evolution and the Theory of Games, Cambridge Univ. Press
- Melville, Herman (1851), Moby-Dick, Bobbs-Merrill [and others] (published 1977)
- Milinski, Manfred (1 July 1993), "News and Views: Cooperation Wins and Stays", Nature, 364 (6432): 12–13, Bibcode:1993Natur.364...12M, doi:10.1038/364012a0, PMID 8316291
- Morse, Phillip M.; Kimball, George E. (1951), Methods of Operations Research, The MIT Press, ISBN 9780262130059
- Morse, Phillip M.; Kimball, George E. (1956), "How to Hunt a Submarine", in Newman, James R. (ed.), The World of Mathematics, vol. 4, Simon and Schuster, pp. 2160–79
- Norenzayan, Ara; Shariff, Azim F. (3 October 2008), "The Origin and Evolution of Religious Prosociality" (PDF), Science, 322 (5898): 58–62, Bibcode:2008Sci...322...58N, doi:10.1126/science.1158757, PMID 18832637, S2CID 28514
- Nowak, Martin A (8 December 2006), "Five Rules for the Evolution of Cooperation" (PDF), Science, 314 (5805): 1560–63, Bibcode:2006Sci...314.1560N, doi:10.1126/science.1133755, PMC 3279745, PMID 17158317, archived from the original (PDF) on 18 May 2011
- Nowak, Martin A; Page, Karen M.; Sigmund, Karl (8 September 2000), "Fairness Versus Reason in the Ultimatum Game" (PDF), Science, 289 (5485): 1773–75, Bibcode:2000Sci...289.1773N, doi:10.1126/science.289.5485.1773, PMID 10976075, archived from the original (PDF) on 19 July 2011
- Nowak, Martin A.; Sigmund, Karl (16 January 1992), "Tit For Tat in Heterogenous Populations" (PDF), Nature, 355 (6016): 250–253, Bibcode:1985Natur.315..250T, doi:10.1038/315250a0, PMID 3889654, S2CID 4344991, archived from the original (PDF) on 16 June 2011
- Nowak, Martin A.; Sigmund, Karl (1 July 1993), "A strategy of win-stay, lose-shift that outperforms tit for tat in Prisoner's Dilemma" (PDF), Nature, 364 (6432): 56–58, Bibcode:1993Natur.364...56N, doi:10.1038/364056a0, PMID 8316296, S2CID 4238908, archived from the original (PDF) on 4 July 2008
- Poundstone, William (1992), "Prisoner's Dilemma: John von Neumann, Game Theory and the Puzzle of the Bomb", Physics Today, 45 (9), Anchor Books: 73–74, Bibcode:1992PhT....45i..73P, doi:10.1063/1.2809809, ISBN 0-385-41580-X
- de Quervain, D. J.-F.; Fischbacker, Urs; Treyer, Valerie; Schellhammer, Melanie; Schnyder, Ulrich; Buck, Alfred; Fehr, Ernst (24 August 2004), "The Neural Basis of Altruistic Punishment", Science, 305: 1254–1258, Bibcode:2004Sci...305.1254D, doi:10.1126/science.1100735, PMID 15333831, S2CID 264669
- Rand, Ayn (1961), The Virtue of Selfishness: A New Concept of Egoism, The New American Library
- Rapoport, Anatol; Chammah, Albert M. (1965), Prisoner's Dilemma, Univ. of Michigan Press
- Riolo, Rick L.; Cohen, Michael D.; Axelrod, Robert (23 November 2001), "Evolution of cooperation without reciprocity" (PDF), Nature, 414 (6862): 441–43, Bibcode:2001Natur.414..441R, doi:10.1038/35106555, hdl:2027.42/62686, PMID 11719803, S2CID 4317386
- Roughgarden, Joan; Oishi, Meeko; Akcay, Erol (17 February 2006), "Reproductive Social Behavior: Cooperative Games to Replace Sexual Selection" (PDF), Science, 311 (5763): 965–69, Bibcode:2006Sci...311..965R, doi:10.1126/science.1110105, PMID 16484485, S2CID 32364112, archived from the original (PDF) on 21 July 2011
- Rousseau, Jean Jacques (1762), The Social Contract, E. P. Dutton & Co. [and others] (published 1950)
- Rusch, Hannes (2014), "The Evolutionary Interplay of Intergroup Conflict and Altruism in Humans: A Review of Parochial Altruism Theory and Prospects for its Extension", Proceedings of the Royal Society B: Biological Sciences, 281 (1794): 20141539, doi:10.1098/rspb.2014.1539, PMC 4211448, PMID 25253457
- Sanfey, Alan G. (26 October 2007), "Social Decision-Making: Insights from Game Theory and Neuroscience", Science, 318 (5850): 598–602, Bibcode:2007Sci...318..598S, doi:10.1126/science.1142996, PMID 17962552
- Sigmund, Karl; Fehr, Ernest; Nowak, Martin A. (January 2002), "The Economics of Fair Play" (PDF), Scientific American, vol. 286, no. 1, pp. 82–87, Bibcode:2002SciAm.286a..82S, doi:10.1038/scientificamerican0102-82, PMID 11799620, archived from the original (PDF) on 18 May 2011
- Stewart, Alexander; Plotkin, Joshua B. (17 September 2013), "From extortion to generosity, evolution in the Iterated Prisoner's Dilemma", Proceedings of the National Academy of Sciences, 110 (38): 15348–15353, Bibcode:2013PNAS..11015348S, doi:10.1073/pnas.1306246110, PMC 3780848, PMID 24003115
- Trivers, Robert L. (March 1971), "The Evolution of Reciprocal Altruism" (PDF), Quarterly Review of Biology, 46: 35–57, doi:10.1086/406755, S2CID 19027999[dead link]
- Vogel, Gretchen (20 February 2004), "News Focus: The Evolution of the Golden Rule", Science, 303 (5661): 1128–31, doi:10.1126/science.303.5661.1128, PMID 14976292, S2CID 178426383
- Von Neumann, John; Morgenstern, Oskar (1944), "Theory of Games and Economic Behavior", Nature, 157 (3981), Princeton Univ. Press: 172, Bibcode:1946Natur.157..172R, doi:10.1038/157172a0, S2CID 29754824
- Wade, Nicholas (20 March 2007), "Scientist Finds the Beginnings of Morality in Primitive Behavior", The New York Times: D3
- Williams, John D. (1954), The Compleat Strategyst, RAND Corp.
- Williams, John D. (1966), The Compleat Strategyst: being a primer on the theory of games of strategy (2nd ed.), McGraw-Hill Book Co.
- Wilson, Edward O. (2000) [1975], Sociobiology: The New Synthesis (25th Anniversary ed.), Harvard Univ. Press, ISBN 0-674-00235-0