In
game theory
Game theory is the study of mathematical models of strategic interactions. It has applications in many fields of social science, and is used extensively in economics, logic, systems science and computer science. Initially, game theory addressed ...
, grim trigger (also called the grim strategy or just grim) is a
trigger strategy for a repeated game.
Initially, a player using grim trigger will cooperate, but as soon as the opponent defects (thus satisfying the trigger condition), the player using grim trigger will defect for the remainder of the iterated game. Since a single defect by the opponent triggers defection forever, grim trigger is the most strictly unforgiving of strategies in an iterated game.
In
Robert Axelrod's book ''
The Evolution of Cooperation'', grim trigger is called "Friedman", for a 1971 paper by
James W. Friedman, which uses the concept.
The infinitely repeated prisoners' dilemma
The infinitely repeated
prisoners’ dilemma is a well-known example for the grim trigger strategy. The normal game for two prisoners is as follows:
In the prisoners' dilemma, each player has two choices in each stage:
# Cooperate
# Defect for an immediate gain
If a player defects, he will be punished for the remainder of the game. In fact, both players are better off to stay silent (cooperate) than to betray the other, so playing (C, C) is the cooperative profile while playing (D, D), also the unique
Nash equilibrium
In game theory, the Nash equilibrium is the most commonly used solution concept for non-cooperative games. A Nash equilibrium is a situation where no player could gain by changing their own strategy (holding all other players' strategies fixed) ...
in this game, is the punishment profile.
In the grim trigger strategy, a player cooperates in the first round and in the subsequent rounds as long as his opponent does not defect from the agreement. Once the player finds that the opponent has betrayed in the previous game, he will then defect forever.
In order to evaluate the
subgame perfect equilibrium (SPE) for the following grim trigger strategy of the game, strategy S* for players ''i'' and ''j'' is as follows:
* Play C in every period unless someone has ever played D in the past
* Play D forever if someone has played D in the past
Then, the strategy is an SPE only if the discount factor is
. In other words, neither Player 1 or Player 2 is incentivized to defect from the cooperation profile if the discount factor is greater than one half.
To prove that the strategy is a SPE, cooperation should be the best response to the other player's cooperation, and the defection should be the best response to the other player's defection.
Step 1: Suppose that D is never played so far.
* Player i's payoff from C :
* Player i's payoff from D :
Then, C is better than D if
.
Step 2: Suppose that someone has played D previously, then Player j will play D no matter what.
* Player i's payoff from C :
* Player i's payoff from D :
Since
, playing D is optimal.
The preceding argument emphasizes that there is no incentive to deviate (no profitable deviation) from the cooperation profile if
, and this is true for every subgame. Therefore, the strategy for the infinitely repeated prisoners’ dilemma game is a Subgame Perfect Nash equilibrium.
In iterated prisoner's dilemma strategy competitions, grim trigger performs poorly even without
noise
Noise is sound, chiefly unwanted, unintentional, or harmful sound considered unpleasant, loud, or disruptive to mental or hearing faculties. From a physics standpoint, there is no distinction between noise and desired sound, as both are vibrat ...
, and adding signal errors makes it even worse. Its ability to
threaten permanent defection gives it a theoretically effective way to sustain trust, but because of its unforgiving nature and the inability to communicate this threat in advance, it performs poorly.
Grim trigger in international relations
Under the grim trigger in
international relations
International relations (IR, and also referred to as international studies, international politics, or international affairs) is an academic discipline. In a broader sense, the study of IR, in addition to multilateral relations, concerns al ...
perspective, a nation cooperates only if its partner has never exploited it in the past. Because a nation will refuse to cooperate in all future periods once its partner defects once, the indefinite removal of cooperation becomes the threat that makes such strategy a limiting case.
Grim trigger in user-network interactions
Game theory has recently been used in developing future
communications systems, and the user in the user-network interaction game employing the grim trigger strategy is one of such examples.
If the grim trigger is decided to be used in the user-network interaction game, the user stays in the network (cooperates) if the network maintains a certain quality, but punishes the network by stopping the interaction and leaving the network as soon as the user finds out the opponent defects. Antoniou et al. explains that “given such a strategy, the network has a stronger incentive to keep the promise given for a certain quality, since it faces the threat of losing its customer forever.”
Comparison with other strategies
Tit for tat
Tit for tat is an English saying meaning "equivalent retaliation". It is an alternation of '' tip for tap'' "blow for blow", first recorded in 1558.
It is also a highly effective strategy in game theory. An agent using this strategy will fi ...
and grim trigger strategies are similar in nature in that both are trigger strategies where a player refuses to defect first if he has the ability to punish the opponent for defecting. The difference, however, is that grim trigger seeks maximal punishment for a single defection while tit for tat is more forgiving, offering one punishment for each defection.
See also
*
*
*
*
*
*
References
{{Game theory
Strategy (game theory)