Elsevier

Computer Communications

Volume 109, 1 September 2017, Pages 13-23
Computer Communications

Distributed cell selection in heterogeneous wireless networks

https://doi.org/10.1016/j.comcom.2017.05.005Get rights and content

Abstract

A critical issue in many wireless networks is how to establish the best possible quality connections between users to base stations. This is in particular challenging when users are randomly located over a geographical region, and each covered by a number of heterogeneous base stations. To this end, we design a smart and efficient cell selection mechanism to improve the user-base station connection in heterogeneous wireless networks. We formulate the cell selection problem as an asymmetric congestion game with consideration of users’ heterogeneity in their locations and their data rates to various cells. We show the existence of pure Nash equilibria (PNE) and propose a concurrent distributed learning algorithm to converge to them. In the algorithm, we allow users to perform random error-tolerant updates synchronously, and guarantee them to reach one or multiple PNE with the largest utilities. In addition, we do a systematical investigation on the implementation of the algorithm in practical networks. Simulation results show that the algorithm can achieve satisfactory performance with acceptable convergence rate.

Introduction

The integration of heterogeneous wireless access networks over an Internet Protocol (IP) backbone is one of the most important trends in future communication systems. In such a heterogeneous network, the concept of being always connected becomes being always best connected (ABC) [1]. With ABC functionality, a user is allowed to choose the best available access networks in a best possible way anytime anywhere. To this end, a smart and efficient cell selection mechanism is crucial for users.

In heterogeneous networks, to avoid high burden to the system, it is unrealistic to implement an algorithm with a central controller leading all the users. Thus, an alternative approach is to design a decentralized cell selection mechanism, by which each user makes its own decision without coordination. This is feasible because the Cognitive Radio (CR) technologies are popularized, whereby devices have capabilities to obtain knowledge and reconfigure parameters such as the access networks. In essence, the distributed cell selection scenario is closely related to the heterogeneous type CR system [2]. A key challenge of designing the mechanism is to resolve the competition among users in a fully distributed style, especially when they have no information about the resources, such as the availabilities and qualities.

Game theory is an effective tool to model the users’ competition. Directed by some learning algorithms, the users can get information and behave correspondingly to achieve equilibrium. However, when the theory is applied into a cell selection problem, some critical features should be considered. First, due to users’ different locations and cells’ different coverage areas, the users each have their own sets of resources. Second, the strictly asynchronous learning algorithms, which are often adopted in theoretical models, are hard to be directly implemented in a practical system. This is because the heterogeneous access networks always belong to different operators, which makes it impossible to do an accurate scheduling of users’ accessing. Last, the learning errors cannot be eliminated in complicated wireless environments (which include noise and fading), leading to the inaccuracies of learning results and hence the users’ erroneous decisions.

Based on the above considerations, we propose our game model and the distributed learning algorithm. We consider a practical scenario where heterogeneous networks coexist, and each user is covered by multiple base stations (BSs). The users are selfish to select their believed best cells, hence causing network congestion and performance degradation. We formulate the cell selection problem as an asymmetric congestion game, in which we consider both the users’ positions (which decide their distinct strategy sets) and their specific data rates of accessing heterogeneous networks. We study the distributed learning algorithms which allow synchronous updates. Moreover, we allow the users to make mistakes when changing their strategies. The main contributions of this paper are as follows.

  • General game model formulation: We formulate the cell selection problem in heterogeneous networks as an asymmetric singleton congestion game with player-specific payoff functions and show the existence of PNE, at which each user chooses the best cell taking into account the decisions of others.

  • Distributed learning algorithms leading users to satisfactory PNE: We propose the error-tolerant concurrent distributed learning algorithm, which converges to Nash equilibria by the local one-step observations of users. Furthermore, we prove that it has the property of eliminating all the weakly dominated PNE and leading the users to a more satisfactory one. In addition, we provide detailed discussions on the implementation of the algorithm in practical networks in terms of terminal conditions, non-uniform probe and error probabilities, etc.

The remainder of the paper is organized as follows. Related work is given in Section 2. In Section 3, we present the system model and the game model. We then prove the existence of PNE of our game in Section 4. In Section 5, we propose the concurrent distributed learning algorithm, and study its properties. We make some discussion in Section 6 and evaluate the performance of our algorithms through simulation results in Section 7. Finally, the conclusion is drawn in Section 8.

Section snippets

Related work

In the environment where heterogeneous networks coexist, the competition between users, between networks and between users and networks can all be formulated as different types of games [3], [4]. Among them, congestion game is extensively studied.

Congestion game is first studied in the wire-line routing problem, where each source node seeks for the route with the minimum delay cost [5]. Recent studies apply it in wireless networks to model the competition for resources among selfish users. In

Network model

We consider a wireless network which consists of K BSs and M users. Their sets are denoted by K={1,2,,K} and M={1,2,,M}, respectively. The BSs represent the access points or base stations of heterogeneous networks, such as the TDMA, OFDMA, CDMA and CSMA networks. All the BSs have partially coverage areas as shown in Fig. 1. In addition, due to the technologies of spectrum separation among different types of networks and spatial reuse among the same type of network, all the BSs are assumed to

Existence of a pure strategy Nash equilibrium in ASPS

In this section we show the existence of PNE, and show the properties of ASPS for the design of learning algorithms. We define the pure Nash equilibrium as follows.

Definition 1 PNE

The σ=(σ1,σ2,,σM) is a PNE if and only if each σm ∈ Σm is a best-reply strategy which satisfies πσmm(nσm)πkm(nk+1)for allmM,kK,σmK and   kσm.

Theorem 1

A finite ASPS has a pure Nash equilibrium.

The sketch of proof is provided in Appendix A.

In traditional congestion games (e.g., the resource-homogeneous or user-homogeneous congestion

Distributed learning algorithm for cell selection

In this part, we introduce the concurrent learning algorithm to achieve the PNE of ASPS. The algorithm is fully distributed. That is, users learn the environment and adapt the strategies based on their own measurements without information exchange. In addition, the algorithm operates in a bounded-rationality style, not requiring common/prior knowledge or large storage space for history information. The key idea of the algorithm is to allow more than one users to do synchronous updates

Terminal condition

One characteristic of CDLAE is that the users may switch among several dominating PNE.3 This is because we allow the users to keep on sampling even if they achieve a dominating PNE. This characteristic makes CDLAE well-suited for the users who keep on pursuing high throughput (e.g., when they are accessing web information), especially in a

Simulation results

We consider a heterogeneous network with K=6 BSs and several users. The number of users M is fixed as 10 unless otherwise specified. All of them are distributed in a 1000 × 1000 square area. The types of BSs are set as 2 TDMA, 2 OFDMA, 1 CSMA and 1 CDMA. The coverage radiuses of the BSs are defined as 300, 400, 400, 500, 500 and 700, respectively. As denoted in Section 3, we define the payoff function πkm(nk) as the throughput that the users obtain by accessing different BSs, which is as

Conclusion

In this paper, we generalize the asymmetric congestion game framework for cell selection mechanism design in heterogeneous networks by considering both the users’ distinct positions and data rates. We propose CDLAE that converges to PNE based on the local one-step observations of users. Simulation results show that CDLAE can converge in an affordable time even when the number of users is large. In addition, CDLAE can lead the users to a more satisfactory PNE by eliminating the weakly dominated

Acknowledgments

This work is supported by NSF China (Nos. 61601126, U1405251, 61571129); Science Foundation of Fujian Province (Nos. 2016J01299, JA15089, 2015J01250).

References (29)

  • D. Monderer et al.

    Potential games

    Games Econ. Behav.

    (1996)
  • I. Milchtaich

    Congestion games with player-specific payoff functions

    Games Econ. Behav.

    (1996)
  • J.W. Friedman et al.

    Learning in games by random sampling

    J. Econ. Theory

    (2001)
  • E. Gustafsson et al.

    Always best connected

    IEEE Wireless Commun.

    (2003)
  • S. Filin et al.

    International standardization of cognitive radio systems

    IEEE Commun. Mag.

    (2011)
  • L. Wang et al.

    Mathematical modeling for network selection in heterogeneous wireless networksła tutorial

    IEEE Commun. Surv. Tut.

    (2013)
  • R. Trestian et al.

    Game theory-based network selection: solutions and challenges

    IEEE Commun. Surv. Tut.

    (2012)
  • A. Orda et al.

    Competitive routing in multiuser communication networks

    IEEE/ACM Trans. Netw.

    (1993)
  • Y. Xu et al.

    Opportunistic spectrum access in unknown dynamic environment: a game-theoretic stochastic learning solution

    IEEE Trans. Wireless Commun.

    (2012)
  • R. Southwell et al.

    Convergence dynamics of resource-homogeneous congestion games

    Game Theory for Networks

    (2012)
  • L.M. Law et al.

    Price of anarchy of congestion games with player-specific constants

    Proc. of IEEE WCSP 2012, Huangshan, China, October

    (2012)
  • E. Aryafar et al.

    RAT selection games in hetnets

    Proc. of IEEE INFOCOM 2013, Turin, Italy, April

    (2013)
  • C. Tekin et al.

    Atomic congestion games on graphs and their applications in networking

    IEEE/ACM Trans. Netw.

    (2012)
  • M. Liu et al.

    Spectum sharing as congestion games

    Proc. of IEEE Allerton 2008, Monticello, IL, USA, September

    (2008)
  • View full text