A Hidden Markov Model based smartphone heterogeneity resilient portable indoor localization framework

https://doi.org/10.1016/j.sysarc.2020.101806Get rights and content

Abstract

Indoor localization is an emerging application domain that promises to enhance the way we navigate in various indoor environments, as well as track equipment and people. Wireless signal-based fingerprinting is one of the leading approaches for indoor localization. Using ubiquitous Wi-Fi access points and Wi-Fi transceivers in smartphones has enabled the possibility of fingerprinting-based localization techniques that are scalable and low-cost. But the variety of Wi-Fi hardware modules and software stacks used in today's smartphones introduce errors when using Wi-Fi based fingerprinting approaches across devices, which reduces localization accuracy. We propose a framework called SHERPA-HMM that enables efficient porting of indoor localization techniques across mobile devices, to maximize accuracy. An in-depth analysis of our framework shows that it can deliver up to 8× more accurate results as compared to state-of-the-art localization techniques for a variety of environments.

Introduction

The arrival of Global Positioning System (GPS) technology within smartphones has revolutionized the way we navigate in the outdoor world. Today, indoor localization technology holds a similar potential to disrupt the way we navigate within indoor spaces that are unreachable by GPS. An example scenario is localizing patients, staff, and equipment in large hospitals and assisted living facilities. Precise location information can allow first responders closest to a patient to be notified in emergencies. Some startups (e.g., Shopkick, Zebra) are also beginning to provide indoor localization services that can help customers locate products inside a store [1].

Unlike GPS for outdoor localization, no standardized solution exists for indoor localization. Therefore, a myriad of techniques have been developed that use various sensors and radio frequencies. Some commonly utilized radio signals are Bluetooth, ZigBee, and Wi-Fi [2]. Among these, Wi-Fi based indoor localization has been the most widely researched, due to its low setup cost and easy availability. Today, Wi-Fi access points are deployed in most indoor locales around the world and all smartphones support Wi-Fi connectivity.

Despite the advantages of Wi-Fi based indoor localization, there are also some drawbacks. Many prior solutions perform indoor localization by measuring Wi-Fi Received Signal Strength Indicator (RSSI) values and calculating distance from Wi-Fi Access Points (WAPs). These works assume that wireless signal strength reduces in a deterministic manner as a function of distance from a signal source (i.e., WAP). But Wi-Fi signals suffer from weak wall penetration, multipath fading, and shadowing effects in real-world environments, making it difficult to establish a direct mathematical relationship between RSSI and distance from WAPs. These issues have served as a motivation for using fingerprinting-based techniques. Fingerprinting is based on the idea that each indoor location exhibits a unique signature of WAP RSSI values. Due to its independence from the RSSI-distance relationship, fingerprinting can overcome some of the aforementioned drawbacks with Wi-Fi based indoor localization.

Fingerprinting is usually carried out in two phases. In the first phase (called offline or training phase), the RSSI values for visible WAPs are collected along indoor paths of interest. The resulting database of values may further be used to train models (e.g., machine learning-based) for location estimation. In the second phase (online or testing phase), the models are deployed on smartphones and used to predict the location of the user carrying the smartphone, based on real-time readings of WAP RSSI values on the smartphone.

A majority of the literature that utilizes fingerprinting employs the same smartphone for (offline) data collection and (online) location prediction [[3], [4], [5], [6], [7]]. This assumes that in a real-world setting, users would have access to the same smartphone as the one used in the offline phase. But today's diverse smartphone market, with various brands and models, largely invalidates such an assumption. In reality, the smartphone user base is a distribution of heterogeneous devices that vary in antenna gain, Wi-Fi chipset, OS version, etc. [8,[25], [26], [27], [28], [29], [30]].

Recent work has shown that the perceived Wi-Fi RSSI values for a given location captured by different smartphones can vary significantly [9]. This variation degrades the localization accuracy of conventional fingerprinting. Therefore, there is a need for portable and device heterogeneity-aware fingerprinting techniques. In this paper, we present a lightweight Wi-Fi RSSI fingerprinting framework for Smartphone Heterogeneity Resilient Portable localization with Hidden Markov Models (SHERPA-HMM) that is portable across smartphones with minimal accuracy loss. The novel contributions of our work are:

  • We conduct an in-depth analysis of Wi-Fi fingerprinting across smartphones to emphasize the importance of device heterogeneity-resilient indoor localization;

  • We formulate the indoor localization problem as a Hidden Markov Model (HMM) that utilizes heterogeneity resilient metrics for user path prediction;

  • We design the SHERPA-HMM framework for portable Wi-Fi fingerprinting-based indoor localization; SHERPA-HMM employs a lightweight software-based approach to combine noisy fingerprints over distinct smartphones and pattern matching/filtering to improve location accuracy;

  • We evaluate SHERPA-HMM against state-of-the-art localization techniques, across a variety of Android-based smartphones that are used for indoor localization along paths in real buildings.

Section snippets

Background and related work

Since the establishment of wireless RF signal based indoor localization a few decades ago, a significant level of advancement has been achieved in this area. In general, most indoor localization techniques fall under three major categories: 1) static propagation model-based, 2) triangulation/trilateration-based, and 3) fingerprinting-based. Early indoor localization solutions used static propagation model-based techniques that relied on the relationship between distance and Wi-Fi RSSI gain [10]

Heterogenous fingerprint analysis

We begin with an analysis of the impact of smartphone heterogeneity on a state-of-the-art indoor localization technique: Euclidean-based KNN [3]. To capture the impact of device heterogeneity we observe the performance of the KNN technique to localize six users on five benchmark paths (Fig. 1) using six distinct devices (Table 1).

Fig. 2 shows the boxplots (distribution) for localization error (in the online/testing phase) across all smartphones and indoor paths, for four scenarios where the KNN

Hidden Markov Model (HMM) formulation

In this section, we discuss the formulation of the indoor localization process as a Hidden Markov Model (HMM). An HMM statistical prediction model is one that estimates the next hidden state given the transition probability of moving from the current hidden state to the next hidden state and probabilities of observable states [39]. HMMs are particularly renowned for identifying patterns that change with time and have applications in the area of handwriting recognition [38], activity recognition

SHERPA-HMM framework

In this section, we first discuss the Wi-Fi fingerprinting phase (Section 5.1) and fingerprint pre-processing (Section 5.2) required by SHERPA-HMM. Section 5.3 describes the offline training phase database created in SHERPA-HMM. Section 5.4 describes the software-based SHERPA-HMM framework and its main components that are used in the online testing phase: a noise resilient fingerprint sampling, a pattern matching metric, HMM-based location predictor, and additional optimizations.

Motion-aware prediction deferral

Scanning for Wi-Fi fingerprints is one of the most energy intensive aspect of fingerprinting-based indoor localization frameworks. In the real-world, the user may choose to stop and look at the surroundings while on a path. Any Wi-Fi scans or location prediction cycles that may take place while the user has stopped would be wasted. To avoid such a scenario, SHERPA-HMM tracks the number of steps taken by the user as he or she walks along a path. SHERPA-HMM defers scanning for Wi-Fi fingerprints

Heterogeneous devices and fingerprinting

To investigate the impact of smartphone heterogeneity, we employed six different smartphones (shown in Table 1). This allows us to explore the impact of device heterogeneity based on varying chipsets and vendors. We created an Android application that recorded the x-y coordinate from the user and included a scan button. Once the scan button was pressed, multiple Wi-Fi scans were performed. The RSSI value and MAC address for each WAP were recorded in an SQLite database (Section 5.1), and then

Sensitivity analysis on scans per prediction

To quantify the potential improvement of using mean RSSI vectors in our framework, we conducted a sensitivity analysis to compare the accuracy results for SHERPA-HMM using a single RSSI vector and the vectors formed by considering the mean of 1 to 5 scanned fingerprints. Fig. 7 depicts the overall localization error for various values of scans per prediction over individual benchmark paths. Even though the overall errors for the Engr_Office and Glover paths are significantly lower than the

Conclusion and future work

In this paper, we proposed the SHERPA-HMM framework that is a computationally lightweight solution to the mobile device heterogeneity problem for fingerprinting-based indoor localization. Our analysis in this work provides important insights into the role of mobile device heterogeneity on localization accuracy. SHERPA-HMM was able to deliver superior levels of accuracy as compared to state-of-the-art indoor localization techniques using only a limited number of samples for each fingerprinting

Saideep Tiku is a Ph.D. student in the ECE Department at Colorado State University, Fort Collins, Colorado, USA. His research interests include indoor localization, and energy efficiency for fault tolerant embedded systems. He is a Student Member of the IEEE.

References (46)

  • “Enterprise Indoor LBS Market in the US 2016-2020”, 2016[online]...
  • C. Langlois et al.

    Indoor localization with smartphones

    IEEE Consum. Electron.

    (2017)
  • S. Pasricha et al.

    LearnLoc: a framework for smart indoor localization with embedded mobile devices,

  • A. Mittal et al.

    Adapting convolutional neural networks for indoor localization with smart mobile devices

  • V. Singh et al.

    Ensemble based real-time indoor localization using stray WiFi signal

  • X. Wang et al.

    CiFi: deep convolutional neural networks for indoor localization with 5GHz Wi-Fi

  • W. Xue et al.

    Improved neighboring reference points selection method for wi-fi based indoor localization

    Sens. Lett.

    (2018)
  • J. Park et al.

    Implications of device diversity for organic localization

  • H. Zou et al.

    A robust indoor positioning system based on the procrustes analysis and weighted extreme learning machine

    Trans. Wirel. Commun.

    (2016)
  • K. Chintalapudi et al.

    Indoor localization without the pain

  • J. Schmitz et al.

    Real-time indoor localization with TDOA and distributed software defined radio: demonstration abstract

  • J. Xiong et al.

    Towards fine-grained radio-based indoor location

  • E. Soltanaghaei et al.

    Multipath triangulation: decimeter-level wifi localization and orientation with a single unaided receiver

  • M.B. Kjærgaard

    Indoor location fingerprinting with heterogeneous clients

    Pervas. Mob. Comput.

    (2010)
  • C. Figuera et al.

    Time-space sampling and mobile device calibration for Wi-Fi indoor location systems

    Trans. Mob. Comput.

    (2011)
  • A. Haeberlen et al.

    Practical robust localization over large-scale 802.11 wireless networks

  • S. Fang et al.

    Calibration-free approaches for robust wi-fi positioning against device diversity: a performance comparison

  • M.B. Kjærgaard et al.

    Hyperbolic location fingerprinting: a calibration-free solution for handling differences in signal strength

  • A.K.M. Mahtab Hossain et al.

    SSD: a robust RF location fingerprint addressing mobile devices' heterogeneity

    Trans. Mob. Comput.

    (2013)
  • H. Zou et al.

    A robust indoor positioning system based on the procrustes analysis and weighted extreme learning machine

    Trans. Wirel. Commun.s

    (2016)
  • F. Li et al.

    A reliable and accurate indoor localization method using phone inertial sensors

  • “Android Step Counter API”, 2018[online]....
  • R.C. Browning et al.

    Effects of obesity and sex on the energetic cost and preferred speed of walking

    J. Appl. Physiol.

    (2006)
  • Cited by (18)

    • Transfer learning-based UWB indoor localization using MHT-MDC and clusterization-based sparse fingerprinting

      2022, Journal of Computational Science
      Citation Excerpt :

      Our experiments demonstrate that our approach can significantly improve the localization accuracy and reduce the effort necessary to deploy the UWB system in different localizations, thanks to transfer learning. Similar results, but for static measurements, have been introduced in [58]. Our research focused on a dynamic localization algorithm that localizes the object in movement using the UWB Pozyx localization system.

    • An Overview of Indoor Localization Techniques

      2023, Machine Learning for Indoor Localization and Navigation
    View all citing articles on Scopus

    Saideep Tiku is a Ph.D. student in the ECE Department at Colorado State University, Fort Collins, Colorado, USA. His research interests include indoor localization, and energy efficiency for fault tolerant embedded systems. He is a Student Member of the IEEE.

    Sudeep Pasricha received his Ph.D. in computer science from the University of California, Irvine in 2008. He is currently a Rockwell-Anderson Professor of ECE at Colorado State University. His-research interests include energy-efficiency and fault-tolerance for embedded and mobile computing. He is a Senior Member of the IEEE.

    Branislav M. Notaroš received the Dipl.Ing. (B.S.), M.S., and Ph.D. degrees in electrical engineering from the University of Belgrade, Belgrade, Yugoslavia, in 1988, 1992, and 1995, respectively. He is currently a Professor with the Department of Electrical and Computer Engineering, Colorado State University (CSU), His research interests and activities are in computational electromagnetics, higher order numerical methods, antennas, scattering, microwaves, metamaterials, characterization of snow and rain, surface and radar precipitation measurements, RF design for MRI at ultra-high magnetic fields, and electromagnetics education.

    Qi Han received the Ph.D. degree in computer science from the University of California, Irvine, in 2005. Currently, she is an associate professor with the Department of Electrical Engineering and Computer Science, Colorado School of Mines, Colorado. Her research interests include distributed systems, middleware, mobile and pervasive computing, dynamic data management, and cyber physical systems. She was the program chair of IEEE PerCom'16 and MobiSPC'14. She is a member of the IEEE and the ACM.

    View full text