Nash On The Crossroads of Information and Game Theory
Nash On The Crossroads of Information and Game Theory
Nash On The Crossroads of Information and Game Theory
Abstract
The purpose of this paper is to review elements of game theory as it applies to wireless
communication and interference channels. A special focus will be put on a series of John Nash’s
works [10] [11] [9], examining how his ideas, such as Nash’s Bargaining Solution and Nash’s
Equilibrium, are being used in a wide variety of channels. All of these elements will lead into a
survey of recent work that views concepts of information theory as part of a competitive game.
I. I NTRODUCTION
One can argue that in an increasingly growing world, it is imperative that we continually
strive to better the interactions that we encounter on a daily basis. When two or more
people find themselves in a conflict, certain strategies or rules are developed to find the best
possible solution. This is true in political standoffs, wartime negotiations, and even in our
technology. With every day, the multitude and power of our appliances and devices grow
as well. With the increase in number, comes an increase in interference from each other
and from other channels. Through the study of Information Theory, we begin to learn more
about the limits of different types of channels and different strategies that can be taken to
increase the capacity of a channel. These decisions can not always be made selfishly and
we must be able to program or control these links in a rational matter. Where information
theory leaves off, game theory becomes relevant.
Game theory is a field of applied mathematics that describes and analyzes interactive
decision situations. [12] Among the most important contributions to the field was that of
John Nash. He revolutionized the field by expanding the solutions necessary to generalizes
a strategy. Both Nash’s Bargaining Solution and Nash’s Equilibrium have been used as a
measure of multiple entity interactions [10] [11] [9].
We attempt to survey recent works and publications to see how game theory has been used
by different communication models, specifically wireless models and interference channels,
to expand the possibilities of the model and improve the now necessary focus of how these
channels interact with increasing number of channels fighting for a decreasing number of
resources.
Section II will give an overview of Game Theory, including a detailed look on Nash’s
Bargaining Solution (NBS) and Nash’s Equilibrium (NE).. Section III will survey recent
works who have used Game Theory in their analysis of Wireless models and Interference
channels.
2
B. Nash’s Equilibrium
In the formulation of his bargaining solution, Nash mentions ”an anticipation” that ”is
especially distinguished” [9], this was the anticipation of no cooperation between the players.
He would later formulate the idea in his doctoral thesis entitled ”Non-cooperative Games”.
The title would be used to describe a new type of game in which coalitions were not formed
and the players acted independently without collaborating communication [11]. The center
of this theory was that for a finite game, finite in time and strategies, there exists atleast
one equilibrium point. A Nash Equilbrium is a n-tuple point that corresponds to the mutual
best response for each player in terms of utility and one where a player cannot benefit
from changing strategies unilaterally[12]. In this equilibrium, while making an independent
decision, each player assumes that the other players will also pick a strategy that will induce
an Equilbria solution and has no incentive to stray from this choice.
To better present the concept of Nash’s Equilibrium and non-cooperative games, a model
was developed called the The Prisoner’s Dilemma. The version that will be used in this
survery was found in [14]. The story behind the game starts with the arrest and subsequent
interrogation of two prisoners in separate rooms. The district attorney offers a deal to each
prisoner if they confess to the crime and testify against the other. If they confess and the
other does not, then they would be set free as the other will serve up to 15 years in prison.
If they do not confess and the other does, then they will serve 15 years in prison. If neither
of them confess, then they will both serve one year in prison. If they both confess, then
they both serve 5 years in prison. Figure 3 shows this scenario.
4
In this example, the choice of confession is considered the best response as your payoff can
not be worsened by the other’s decision. If each player plays the game with the knowledge
that the other will also play towards the mutual best response, then the tuple (Confess,
Confess) is considered the Nash Equilibrium. In a simple explanation, this holds true because
you cannot benefit from changing your strategy. As pointed out in [14], this strategy is
not considered Pareto optimal because from the prisoner’s point of view there were other
strategies that would yield less time in jail. With his equilibirum, Nash gave us a general
solution form to von Neumann’s model [8][7] and said that further work in game theory
would simplify to an analysis of equilibriums.
used in a wide variety of fields such as political science, sociology, biological science,
as well as more recently in the field of communication networks. This article will briefly
highlight the application of game theory in the realm of wireless models and interference
channels.
A. Wireless Models
The steady departure of wired appliances and the increasingly mobile world has made the
study of wireless technology very important. As this mobile world expands, the resources
become more limited and thus creates a competitive environment to share these properties
such as power, bandwidth, etc. Protocols and strategies are formulated as the interaction two
wireless entities is seen in the sense of a game. Each party or node enters into a situation in
which recent work shows NE or NBS is the best strategy or solution. In [15], a cooperation
strategy is developed in relay networks based on the Nash Bargaining Solution, where the
utility function is used to find a cooperative strategy to allocate bandwidth. The solution
solves the question of when and how to cooperate.
[13] takes a similar approach in their analysis on spectrum sharing networks, as they find
NBS to be a compromise of fairness and efficiency. The game is modeled using the Shannon
capacity
K
BX H k pk
Ci (p) = log2 (1 + σ2 Pii i k k )
K k=1 K
+ j6i Hji pj
where pki is the power transmitted by node i and Hjik as the channel gain from j to the
receiver of i, as the utility function.
[14] designed a NE backoff strategy for Wireless ad Hoc Networks. Wireless Ad Hoc
Networks are a collection wireless nodes that have no central infrastructure and require a
protocol to assist in the passing of information though the network. They formulated the
problem similarly to the Prisoner’s Dilemma, where the node have a choice of transmit or
not transmit and each pairing has a certain payoff and/or penalty, such as a utility function
of a failed transmission or delay sensitivity. They applied a Nash strategy to a TCP session
and found a fair backoff strategy between nodes. A thorough breakdown of a wireless ad
hoc network and how they can be modeled as games by OSI layer, is featured in [12].
B. Interference Channels
The work on wireless models attempt to formulate strategies to combat problems and
conflicts with limited resources. This conflict allows us to view the nodes as players in
a game who are trying to find their optimal solutions or capacities. Finding the capacity
region of Interference channels is still a problem in information theory. There has been some
success in achievable regions such as the work of Han and Kobayashi, who found a new
achievable rate interference channels with ”less” strong interference using a polymatroidal
structure [4]. While their work is constantly being updated and improved upon [3], new
research has been looking at the problem through a game theoretic viewpoint. The Han-
Kobayashi uses a scheme that requires that the two channels split their information into a
common and private stream. The common stream is encoded to lessen the interference seen
by the other user. The choice of how to encode or decode along with the desire to maximize
one’s rate is a conflict that can be seen as a non-cooperative game [2].
6
If capacity regions can be viewed as a Nash solution region with an equilibrium point,
then there must be a pairing of endcoding strategies, for instance, that either channel would
not want to deviate from. Figure 4 shows that if we characterize α as an interference level,
or ratio of Signal to Noise Ratio (SNR) and Interference to Noise Ratio (INR), then as α
increases the area seen as the intersection of the deterministic channel capacity region C and
NE bounds ”box”B also increases. The area always has a point on the sum-rate boundary
of C [2].
Fig. 4. Examples of CN E for a symmetric deterministic channel with normalized cross gain α [12]
The characterization of interference channels as competitive games is not new, but recently
has been gaining momentum. It has most likely done so because of the interest on the
interaction of individual links or channels and the growth of non-cooperative solutions, such
as iterative water-filling, as a viable solution for multiple access channels and broadcast
channels [5][6]. [5] shows the development of a game theoretic region of achievability,
because information theory will give you a region that allows all points on the boundary on
the channel may be achievable, but not realistic as a link may choose to deviate from the
encoding scheme. Using the concepts of NE and NBS, one would be finding the rate pairs
least likely to be deviated from.
Not every application of game theory is automatically linked with Nash’s contributions
and proved successful. [1] found multiple Nash Equilibirum points in different evaluation
regions when trying to formulate a specturm sharing scheme of two receivers and two
carriers. They found that a scheme following a Stackelberg game model, where a certain
operator is chosen as a leader, produced better results and more achievable. Figure 5 shows
their simulation results.
IV. C ONCLUSION
It has increasingly become apparent that game theory can be applied to many different
fields. Most recently, there has been a growing movement to use elements of game theory,
7
Fig. 5. [1]
especially the various contributions of John Nash, to combat some of the limitations of
Information theory. What NE and NBS provide, is as stable-set of solutions that have
withstood decades of advancements to stand relevant. This new insight can only expand
our view to see channels and links as players in a game and that John Nash might have
already solved it.
R EFERENCES
[1] M. Bennis, M. Le Treust, S. Lasaulce, M. Debbah, and J. Lilleberg, “Spectrum sharing games on the interference
channel,” in Game Theory for Networks, 2009. GameNets ’09. International Conference on, May 2009, pp. 515–522.
[2] R. Berry and D. Tse, “Information theory meets game theory on the interference channel,” in Proceedings of the
IEEE Information Theory Workshop (ITW), June 10-12 2009.
[3] Y. Chao, B. Chen, and J. Zhang, “A new achievable rate region for the interference channel with common information,”
in Wireless Communications and Networking Conference 2007, March 11 - 15 2007, pp. 2071–2075.
[4] T. S. Han and K. Kobayashi, “A new achievable rate region for the interference channel,” IEEE Transactions on
Information Theory, vol. 27, no. 1, pp. 49–60, January 1981.
[5] A. Leshem and E. Zehavi, “Bargaining over the interference channel,” in Information Theory, 2006 IEEE International
Symposium on, July 2006, pp. 2225–2229.
[6] ——, “Game theory and the frequency selective interference channel,” Signal Processing Magazine, IEEE, vol. 26,
no. 5, pp. 28–40, September 2009.
[7] G. J. Mailath, “Do people play nash equilibrium? lessons from evolutionary game theory,” Journal of Economic
Literature, vol. 36, no. 3, pp. 1347–1374, September 1998.
[8] R. B. Myerson, “Nash equilibrium and the history of economic theory,” Journal of Economic Literature, vol. 37,
no. 3, pp. 1067–1082, September 1999.
[9] J. Nash, “The bargaining problem,” Econometrica, vol. 18, pp. 155–162, April 1950.
[10] ——, “Equilibrium points in n-person games,” Proceedings of the National Academy of Sciences, vol. 36, no. 1, pp.
48–49, 1950.
[11] ——, “Non-cooperative games,” The Annals of Mathematics, vol. 54, no. 2, pp. 286–295, 1951.
[12] V. Srivastava, J. Neel, A. Mackenzie, R. Menon, L. Dasilva, J. Hicks, J. Reed, and R. P. Gilles, “Using game theory
to analyze wireless ad hoc networks,” IEEE Communications Suverys and Tutorials, vol. 7, no. 4, pp. 46–56, 2005.
[13] J. Suris, L. DaSilva, Z. Han, and A. MacKenzie, “Cooperative game theory for distributed spectrum sharing,” in
Communications, 2007. ICC ’07. IEEE International Conference on, June 2007, pp. 5282–5287.
[14] Y. Xiao, X. Shan, and Y. Ren, “Game theory models for ieee 802.11 dcf in wireless ad hoc networks,” IEEE
Communications Magazine, vol. 45, no. 3, pp. S22–S26, March 2005.
[15] Z. Zhang, J. Shi, H.-H. Chen, M. Guizani, and P. Qiu, “A cooperation strategy based on nash bargaining solution in
cooperative relay networks,” IEEE Transactions on Vehicular Technology, vol. 57, no. 4, pp. 2570–2577, July 2008.