Field of Science

Showing posts with label Cooperation. Show all posts
Showing posts with label Cooperation. Show all posts

Freedom and the Public Goods

ResearchBlogging.org

Last post, I used the example of a protest against peanut allergy-related procedures to explore how the American conception of "rights" may be changing. In particular, I suggested that ideas of common or collective good were being displaced by an increasingly narrow and selfish definition of individual liberty.

A few friends pointed out that I may have unfairly maligned libertarians, anarchists, and others wary of government power.  These people aren't necessarily opposed to volunteerism or helping others; they just don't want to be coerced into doing so (or have their money taken for these purposes).  

This is a fair point.  However, it doesn't make me feel much better about the "leave me alone" political philosophy.  I don't think this philosophy will ever be up to solving our common challenges.  To illustrate why, I'd like to bring in a concept from game theory.

The Public Goods Game represents situations in which there is a common resource ("public good") that benefits all members of a group.  The public good might be a clean kitchen, a functioning electrical grid, or a healthy environment.  This good cannot be maintained without contributions from some group members.  Contributions can be in the form of doing something (washing dishes, working in the community garden, donating to NPR) or not doing something (not littering in a public park, not overfishing a lake).

The dilemma is this: everyone benefits from the public good, but contributions are voluntary.  The public goods game has no built-in incentive to contribute, beyond the desire to make things better for everyone.  So "free-riders" can benefit from others' contributions without contributing anything themselves. 

Both theory and experiment predict that cooperation cannot be sustained in such a game.  A typical experimental result looks like this:

Horizontal axis is time (number of game rounds)  SOURCE: Fehr and Gaechter (2000)


Contributions decline over time to virtually nothing. This is not because the participants are inherently selfish.  Indeed, at the start of the game, many people are inclined to contribute.  However, they realize at some point that others are exploiting their generosity.  Not wanting the benefits of their hard work to reward those who don't contribute, people eventually stop contributing altogether.  This unfortunate outcome has a name: the Tragedy of the Commons

Economists and social scientists have identified a few mechanisms that can reverse this tragedy.  If the participants know each other, and also interact in settings aside from the game, then concern for one's reputation can motivate people to contribute (Milinski et al. 2002, Rand et al. 2009).  This helps explain why co-ops can be successful: everyone knows each other.  They can reward or punish others based on their contributions to cooking, cleaning, and other tasks. 

But what about global challenges like climate change, environmental conservation, and sustainable use of resources?  These involve billions of players across the globe, and there are strong financial incentives to exploit the public good for individual gain.  Furthermore, it can be difficult to trace problems like pollution or overfishing to the individuals or companies responsible.  How these large-scale challenges be solved?

Research has identified only one answer. If the game is too large and complex for individual interactions to maintain cooperation, the solution is for the participants to invest in institutions (Gureck et al., 2006; Sigmund et al., 2010).  These institutions must have the power to investigate the actions of individuals, and reward or punish them based on their contributions. In other words, a social contract is needed, together with institutions to enforce it.

Of course, powerful institutions have inherent potential for corruption and abuse.  This is what worries libertarians and anarchists.  I share that concern.  But the solution, in my view, is to build in democratic checks, so that these institutions are as responsive as possible to the people they serve.

It's hardly a perfect solution.  Institutions can become entangled with those they should regulate.  Democratic checks can be co-opted. 

But to solve the largest problems that face humanity, we can't count on good will and personal responsibility alone.

References:

Ernst Fehr, & Simon Gaechter (2000). Cooperation and Punishment in Public Goods Experiments American Economic Review, 90 (4)

Özgür Gürerk, Bernd Irlenbusch, & Bettina Rockenbach (2006). The Competitive Advantage of Sanctioning Institutions Science, 312 (5770), 108-111 DOI: 10.1126/science.1123633

Milinski, M., Semmann, D., & Krambeck, H. (2002). Reputation helps solve the ‘tragedy of the commons’ Nature, 415 (6870), 424-426 DOI: 10.1038/415424a

Rand, D., Dreber, A., Ellingsen, T., Fudenberg, D., & Nowak, M. (2009). Positive Interactions Promote Public Cooperation Science, 325 (5945), 1272-1275 DOI: 10.1126/science.1177418

Sigmund, K., De Silva, H., Traulsen, A., & Hauert, C. (2010). Social learning promotes institutions for governing the commons Nature, 466 (7308), 861-863 DOI: 10.1038/nature09203

Eusociality and a blow to kin selection

A new paper hit the internet today. "The Evolution of Eusociality" by Martin Nowak, Corina Tarnita, and E.O. Wilson re-frames an old evolutionary question and strikes a blow in an increasingly heated debate.

Eusociality is when individual organisms act as a collective reproducing unit. The best-known examples are ants and honeybees, but recently discovered examples include certain beetles, shrimp, and mole rats. Typically all reproduction is done by a single queen, and the rest of the colony exists only to support and protect the queen. Eusociality represents the highest degree of social organization found in nature.

The evolutionary origins of eusociality are something of a puzzle. To transition to eusociality, individuals must give up their own reproductive potential to support that of the queen. This is the ultimate sacrifice, as far as evolution is concerned. If evolution favors those who produce the most offspring, how can it select for actually giving up the chance to reproduce?

The classical answer to this question is kin selection: the idea that cooperative acts can occur between close relatives. Dawkins explained this using the concept of "selfish genes" that promote cooperation with others who have the same gene. One proponent, J.B.S. Haldane, famously said he would jump into a river to save two brothers, or eight cousins.

Ants and honeybees, the two oldest-known examples of eusocial animals, have a special genetic structure in which siblings share 3/4 of their genes, as compared to 1/2 in most sexual reproducers. It seemed reasonable that these close genetic relationships made possible such large-scale organization and extreme altruism.

However, as more eusocial species were discovered, including mammals, this association fell apart. There no longer appears to be any significant relationship between eusociality and relatedness of siblings.

Nowak, Tarnita, and Wilson provide a new model which focuses on the competition between reproductive units, which can be individual or collective. But perhaps more importantly, they thoroughly deconstruct the mathematics underlying kin selection theory.

The big debate in evolutionary theory right now is between those who believe all cooperation can be explained by kin selection (in its more mathematical guise of inclusive fitness theory), and those who believe that the more standard natural selection concept has more explanatory power. This debate has become increasingly heated in recent years.

Backed by rigorous mathematics, the authors argue that
Inclusive fitness theory is not a simplification over the standard approach. It is an alternative accounting method, but one that works only in a very limited domain. Whenever inclusive fitness does work, the results are identical to those of the standard approach. Inclusive fitness theory is an unnecessary detour, which does not provide additional insight or information.

The import of this argument might not be apparent to those not immersed in the field, but this paper could be a turning point in how the evolution of cooperation is understood. Social behavior cannot all be reduced to selfish genes. There are in fact many mechanisms allowing cooperation to evolve. Understanding these mechanisms will continue to be a fascinating question in evolutionary theory.

Evolutionary Game Theory and Archaeology

As a mathematical evolutionary theorist, I use abstract methods to investigate how the structure of an evolutionary process determines whether social behaviors like cooperation can be successful. So I was excited to learn over the holidays (from David Carballo, archaeologist and family friend of my partner) that archaeologists are pursuing the same question from an entirely different angle.

As far as I can understand it, there is a new field of research looking at whether evolutionary game theory (EGT) can help explain major societal shifts. One article looks at the sudden appearance of communal architecture projects in Andes mountain societies (in the second and third millenia B.C.E.) that previously had few permanent buildings. These new constructions appear to be built for use by the entire community, and their construction clearly required large-scale cooperation. Using a combination of EGT and historical arguments, the authors posit that the labor for these projects was not coerced. Rather, the chiefs of these societies were able to mobilize cooperation by enforcing norms of fairness and justice. In their words:

Cooperation does not magically emerge. However, when the appropriate conditions are met, cooperation becomes the adaptive choice of people assessing the costs and benefits of participating in specialized versus nonspecialized labor, loss of autonomy, gain in material wealth and nonmaterial benefits, and degree to which the production and redistribution process is “fair.”
While all cooperative systems are vulnerable to "free-riders", who attempt to receive benefits without contributing, the authors argue that the combined mechanisms of punishment and group selection (see this post) were sufficient to overcome this difficulty.

I'm excited to see this field taking off in so many different directions, and I'm looking forward to see what new intersections develop!

Brits and Yanks on the Titanic

Discovery News Top Stories: Manners Lowered Brits' Chances of Survival on Titanic, said my Gmail ad banner. Intrigued, I clicked the link.

It seems behavioral economists David Savage and Bruno Frey, looking through historical records, found that Britons had the highest death rate of any nationality aboard the Titanic, even though the ship's crew was British. There is anecdotal evidence that British politeness contributed to their mortality: Witnesses heard the captain saying "Be British, boys, be British!"--meaning for them to "queue up" and wait for women and kids. Meanwhile, Americans, whom some saw elbowing their way forward to board the lifeboats, had the highest survival rate of any nationality.

Behavior in all animals reflects a delicate balance between cooperative and selfish instincts. Human history, in particular, shows extreme examples of both greed and selflessness. These behaviors, like all others, are evolved; and reflect the multilayered incentives for selfish and altruistic behavior that run throughout evolutionary history.

Assuming Savage and Bruno are correct, it appeared the jerks took the day in this instance. If we suppose that evolutionary history contained many such "Titanic moments", in which the self-interested could elbow out the polite in the struggle for survival, one might conclude that only the selfish would emerge from evolution unscathed.

But there's more to the picture. We'll never know if more could have survived the Titanic had everyone on board worked together. Certainly fewer would have survived had everyone been fighting for a spot on the lifeboats. If we imagine many Titanics sinking in simultaneous, independent events, it's possible that more altruists would survive overall, because boats of mostly altruists would save a higher percentage of passengers than boats filled with arseholes. So there is a sense in which, while selfishness works on an individual level, cooperation may do better on a large scale. (This is essentially the group selection argument I refered to in this post--one of many explanations for why both altruism and selfishness are seen in the products of evolution.)

One can also ask how the social norms in America and Great Britain evolved to be this way. British and American people separated far too recently to have diverged genetically, but the two nations have certainly evolved culturally along different paths. An argument could be made that America, with its vast expanses of open (except for Native Americans) land and looser socioeconomic hierarchy, rewarded bold and individualistic behavior more than old, statified Britain.

Neither British nor American social norms were evolved specifically for the Titanic. Behaviors adapted for one context played out in another, resulting in a higher proportional survival for Americans, perhaps a lower total survival than if all the passengers were British.

In considering the behaviors we'll need to survive in a world of global interconnection and environmental fragility, it's important to remember that behavior evolves in context. If we can anticipate the kinds of behaviors we'll need in the future, can we also anticipate the changes we'll need to make to start evolving these behaviors now?

The Evolution of Cooperation

First of all, a personal triumph: I've had my first academic paper accepted! "A New Phylogenetic Diversity Measure Generalizing the Shannon Index with Application to Phyllostomid Bats" is tentatively accepted for publication at the American Naturalist, a venerable biology journal. Whooo!

But on to our main topic: It's one of evolution's oldest riddles. If evolution is a brutal battle for survival, in which only the fittest survive, why do we see so much cooperation in nature? Why, in extreme cases, do some animals sacrifice themselves to help others of their species? In the competition between individuals, genes, and species, what kind of advantage does this altruistic behavior confer?

This question is quite deep and has generated an array of possible answers, whose implications go beyond evolutionary biology. I'll outline the history of how this question has been explored, and offer something of a synthesis to conclude.


  • Reciprocation-It pays to help someone else if that person will help you in return. This fact is incontrovertible, and helps explain many of the interactions we see in nature, like monkeys grooming each other. However, reciprocation does not explain the acts of extreme altruism sometimes seen in nature, such as cellular slime moulds that sacrifice themselves to help others find food. So it can’t be the whole story—some actions really are selfless.


  • Group selection-This is the idea that Darwinian evolution acts on groups of organisms as well as on individuals. If the members of a group cooperate well together, then the group as a whole may survive, while other less cooperative groups die off. This idea fell out of favor in the 60's as mathematical analysis showed group selection is generally a much weaker evolutionary force than individual selection. New models, however, show that group selection can be important in some circumstances.


  • Kin discrimination-This view holds that the real unit of Darwinian selection is not organisms or groups but genes. Since genes are the material that is passed on through generations, the genes that help themselves out will survive the best. So if your gene “sees” that another individual has the same gene, your gene will “want” to help that person out in order to further its own interests. Of course, genes can’t really see each other. But your genes can tell you to help out your relatives, who are likely to have the same genes as you. This is the kin discrimination theory: our genes tell us to help our immediate family members, and thereby further their own gene-centric interests. Preferential behavior toward relatives is commonly observed in animals, and one study even found closely-related plants helping each other out.


  • Repeated interactions-Axelrod’s tournaments of Prisoner’s Dilemma games show that, while it may be beneficial to act selfishly in the short run, more cooperative strategies are better if you know you’ll be interacting with someone repeatedly. The best strategies for repeated interactions are those which reward others who cooperate with you and punish those who don’t.


  • Spatial structure-Cooperators do best if they’re surrounded by other cooperators. One way this can happen is in ecosystems where offspring are born close to their parents and don’t move much. In this case, the children of cooperators stay and cooperate with their relatives, while the children of selfish bastards hang out with their selfish bastard relatives and be miserable. Thus, systems with a strong spatial structure and little movement tend to favor cooperators. The system breaks down if the selfish bastards can move fast enough to find the cooperators and exploit them. Robert Austin found that spatial separation could help "altruistic" bacteria survive coexist with their "selfish" bretheren.


  • Punishment-Evolutionary biologists have also explored the idea that punishment can help enforce cooperative behavior. Punishment can be “vigilante-style”, where any individual who sees someone else acting unethically can hurt them, or there can be some kind of agreed-upon authority whose job it is to punish misbehavers. The question of if and how punishment works in nature seems still up for debate.



Bottom line is, it doesn’t pay to be a nice guy in a world of assholes. But if you can find other nice people to interact with, and some mechanism for keeping the assholes out of your little nice-people club, then you’re on to something.

Each of the proposed mechanisms for cooperation has interesting implications for human society. I’ll highlight just one of them for now: spatial structure. When humans first evolved, long-distance travel was difficult, and so different societies could develop independently with their own norms of cooperation or selfishness. But now we can travel across the world in a day, so the spatial separation is gone. Any thoughts on the implications of this change for the stability of human cooperation?

Further reading

Tragedy of the Commons in Evolution

Based partly on the feedback from last column, I'd like to probe a bit deeper into the connection between altruism, evolution, and space. Not outer space, mind you, but space here on planet Earth.

We all know that in Darwinian evolution, the species that survive and reproduce best in their environment are the ones that persist and evolve. We know from observing nature that this system tends to produce sustainable ecosystems in which every species seems to play a useful role, even if they are also competing for survival. In particular, no level of the food chain eats so much of the level below as to cause it to go extinct.

Now suppose that in a grassland ecosystem, some animal speices got really good at eating grass. So good, in fact, that it could devour an entire field, roots and all, in a season, and use all that energy to reproduce faster much than its competitors. It would seem that this species has an evolutionary advantage over its slower peers. Of course, this advantage would be very short-term; the grass couldn't grow back the next season, so all species, including this super-eater, would starve.

This situation might be called a Tragedy of the Commons, a phrase popularized by a 1968 Science article by Garret Hardin. This phrase refers to a general situation where there is a shared resource everyone depends on. Without some check on everyone's behavior, some individuals may be tempted to take more than their share, and if this happens too often, the resource is depleted and everyone suffers. (The current depletion of the global edible fish population is one of many real-life examples.)

The question is, why hasn't this tragedy wiped out life on earth by this point? What's to stop a super-eater from spontaneously evolving somewhere, multiplying rapidly, spreading throughout the planet, and destroying all life everywhere?

Several studies (May and Nowak, Werfel and Bar-Yam, Austin et. al.), each taking different approaches, point to a common answer: space. If a selfish overeater evolves somewhere, it will exhaust the resources around it, but then it will die off while other species in other ecosystems live sustainably. As long as there is sufficient space in the world, an overzealous species will cause its own destruction before it can spread very far. In this way, evolution on a sufficiently large planet actually favors organisms that live in harmony with their environment.

Now, if there was some species that could not only suck its environment dry, but also move fast enough to outrace the devastation it was causing, we'd have a real problem on our hands. Fortunately, it seems this has never happened.

Or has it???

Altruistic and Selfish Bacteria

The Boston University Physics Department hosted a very interesting talk yesterday by Robert Austin of Princeton. Austin has been studying the social behavior of bacteria, in order to help understand the social dynamics of other organisms, including humans. He shared with us some intriguing results about selfish and altruistic individuals, and the social dynamics between the two.

Indeed, Austin and his collaborators found a single gene that controls bacteria "selfishness." If it's off, bacteria slow down their metabolism and reproduction rate when they sense their environment has been depleted of nutrients. This prevents them from completely destroying their living space. However, if this gene is turned on ("expressed" is the technical term) the bacteria go right on eating until nothing is left. They even develop the ability to feed off of other dead bacteria.

Interesetingly, the gene is off by default when bacteria are found in the wild. But if you put them in a petri dish, mix them together, and cut off their food supply, you rather quickly (after only about 4 days!) see selfish mutants emerge. These mutants rapidly consume all the remaining food, including each other, and then starve.

This is an interesting conundrum. The petri dish situation seems pretty dire: first the cheaters win, and then everyone loses. This is another prisoner's dilemma situation: cheaters seem to have the advantage over the self-restraining altruists, but if everyone cheats then everyone is worse off.

On the other hand, bacteria in the wild exercise restraint, so there must be something different going on in the wild than in the petri dish.

Intrigued, Austin and his colleagues set up a different experiment. They designed an artificial landscape conatining many differnt chambers in which the bacteria could isolate themselves. Food sources were spread unevenly through the landscape. They also found a way to "manufacture" the selfish bacteria by fiddling with their DNA, and they dyed them a different color from the altruists to discern the interactions between the two.

In this situation, the altruists and the cheaters managed to coexist by segregating themselvs. The altruists gathered in dense clumps (and lived in harmony?) while the cheaters spread out sparsely (they don't even like each other!) around the altruists, occasionally gobbling up a dead one. Somehow, the altruists are able to segregate themselves in such a way that the cheaters can't steal their food; a marked contrast to the first experiments in which the bacteria were continually mixed together. Here's what this segretation looks like within two of the "chambers":



The chamber on the left, which is nutrient-poor, contains mainly cheaters waiting for others to die. The nutrient-rich chamber on the right contains "patches" of altruists and cheaters, never fully mixed. You can't see it from the picture, but the green altuists are very densely clumped and the red cheaters are spread apart from each other.

The possible life lesson here is that altruists can exist in a society with cheaters if the altruists can segregate themselves to form (utpoian?) communities. If there is forced mixing between the two groups then, unfortunately, it all ends in tragedy.

A very similar lesson can be found in the work of Werfel and Bar-Yam, but that's a story for another time.

The Prisoner's Dilemma

You and an acquaintance are charged (and rightfully so!) as co-conspirators in a train robbery. You are being interviewed separately by the police. You can either rat your buddy out or keep silent and do more time. Your acquaintance has the same choices.

If one of you rats and the other remains silent, the one who cooperated with the police gets off free and the other serves 10 years. If you both keep silent, they can only convict on a lesser charge (for lack of evidence), so you each do a year. If you both rat on each other, you each do five years.

Both you and your acquaintance know this information. Assuming neither of you cares what happens to the other, and there are no recriminations in the outside world (we'll revisit both of these assumptions later), what is likely to happen?

Under the assumptions we've made, neither of you has any incentive to help the other. No matter what the other guy does, you get a better result by ratting on him. You both come to the same conclusion, so you both do five years.

This game is one of the most famous examples in game theory. It presents something of a dilemma: By each choosing the option that serves them best, the two "players" in the game end up with a result (5 years each) that is worse than if they had each kept silent. Choosing the best option individually leaves them worse off as a whole.

The game is traditionally phrased in terms of prisoners, but it applies pretty well to any situation when people have an opportunity to screw someone else over for their own benefit. If it truly is better in each situation to screw the other person, then everyone will end up screwing everyone else (in a bad way), and everyone will be worse off.

I think of this game when I drive up my street after a snowstorm, looking for a parking spot. People on my block (and all over Boston, from what I've seen) have the perverse idea that if they dig their car out of the snow, they "own" the spot they parked it in until the snow melts. They mark their spots with chairs or traffic cones. I've thought about doing the same. On the one hand, I think it's ridiculous for people to "claim" spots, just because they happened to park there before the storm. On the other hand, if everyone else does it and I don't, I can't park anywhere. If everyone else has chosen the selfish option, why shouldn't I? Classic Prisoner's Dilemma.

So does this bode ill for humankind? Is this a game-theoretic "proof" that we're all going to stab each other in the back? To answer these questions, let's look back at the assumptions we made.

First, we assumed that you don't care what happens to the other person. If you do care, you'd be much more likely to keep silent, which would end with a better result for both of you. A little selflessness helps everyone.

We also assumed that there were no consequences to your actions beyond what was spelled out in the game. A lot of ways you can screw others for your own benefit, such as breaking into your neighbor's house, are illegal. Laws can't deal with all prisoner's dilemma situations, but they can eliminate some of the worst ones.

There is a third, hidden assumption that we made: we assumed the game would only be played once. If the game is played over and over many times, is it possible for more cooperative strategies to emerge successful? This question was addressed by David Axelrod in The Evolution of Cooperation who found that, while selfishness is the best short-term strategy, cooperative strategies will win in the long run if the game is played enough times. More specifically, he identified four hallmarks of successful strategies: (here I quote Wikipedia)

  • Nice: The most important condition is that the strategy must be "nice", that is, it will not defect before its opponent does. Almost all of the top-scoring strategies were nice; therefore a purely selfish strategy will not "cheat" on its opponent, for purely utilitarian reasons first.

  • Retaliating: However, Axelrod contended, the successful strategy must not be a blind optimist. It must sometimes retaliate. An example of a non-retaliating strategy is Always Cooperate. This is a very bad choice, as "nasty" strategies will ruthlessly exploit such softies.

  • Forgiving: Another quality of successful strategies is that they must be forgiving. Though they will retaliate, they will once again fall back to cooperating if the opponent does not continue to play defects. This stops long runs of revenge and counter-revenge, maximizing points.

  • Non-envious: The last quality is being non-envious, that is not striving to score more than the opponent (impossible for a ‘nice’ strategy, i.e., a 'nice' strategy can never score more than the opponent).

Are these principles to live by? Perhaps. Axelrod and others think the success of these kinds of strategies may help explain the evolution of altruistic behavior in animals. At any rate, it seems to suggest that nice guys can get ahead, if they're willing to be mean at the right moments.