Yongtae Park
ABSTRACT
This paper presents VisIoT, a system that tracks the location of a wireless transmitter in IoT devices and displays it in the screen of an AR device such as smart glasses and tablet. The proposed system benefits existing IoT systems by enabling intuitive interaction between a user and IoT devices and further enhancing visualization of the data collected from IoT sensors. VisIoT achieves them through a combination of wireless sensing and camera motion tracking. By using the azimuth and elevation angles between the wireless transmitter and the camera-equipped mobile device, VisIoT can instantly identify the location of the IoT device from the camera image. This paper introduces novel azimuth and elevation estimation algorithms that leverage the phase difference of the signals from two antennas together with the tracked camera rotation. We prototype VisIoT using a tablet PC and a USRP software radio, and develop a software that tracks and visualizes the location of ZigBee nodes in real time. The evaluation results show that VisIoT can accurately track the nodes with the median position error of 6%.
- Roundup Of Internet Of Things Forecasts And Market Estimates, 2016. https://www.forbes.com/sites/louiscolumbus/2016/11/27/roundup-of-internet-of-things-forecasts-and-market-estimates-2016/#2b069df0292d.Google Scholar
- J Antonio Garc'ia-Mac'ias, Jorge Alvarez-Lozano, Paul Estrada-Martinez, and Edgardo Avilés-López. Browsing the internet of things with sentient visors. Computer, (5):46--52, 2011. Google ScholarDigital Library
- Hanas Subakti and Jehn-Ruey Jiang. A marker-based cyber-physical augmented-reality indoor guidance system for smart campuses. In 2016 IEEE 18th International Conference on High-Performance Computing and Communications, IEEE 14th International Conference on Smart City, and IEEE 2nd International Conference on Data Science and Systems (HPCC/SmartCity/DSS), pages 1373--1379. IEEE, 2016.Google Scholar
- Volker Paelke. Augmented reality in the smart factory: Supporting workers in an industry 4.0. environment. In Emerging Technology and Factory Automation (ETFA), 2014 IEEE, pages 1--4. IEEE, 2014.Google ScholarCross Ref
- Konstantinos Michalakis, John Aliprantis, and George Caridakis. Visualizing the internet of things: Naturalizing human-computer interaction by incorporating ar features. IEEE Consumer Electronics Magazine, 7(3):64--72, 2018.Google ScholarCross Ref
- Paula Fraga-Lamas, Tiago M Fernández-Caramés, Óscar Blanco-Novoa, and Miguel A Vilar-Montesinos. A review on industrial augmented reality systems for the industry 4.0 shipyard. IEEE Access, 6:13358--13375, 2018.Google ScholarCross Ref
- Dongsik Jo and Gerard Jounghyun Kim. Ariot: scalable augmented reality framework for interacting with internet of things appliances everywhere. IEEE Transactions on Consumer Electronics, 62(3):334--340, 2016. Google ScholarDigital Library
- Wenguang Mao, Jian He, and Lili Qiu. Cat: high-precision acoustic motion tracking. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, pages 69--81. ACM, 2016. Google ScholarDigital Library
- Rajalakshmi Nandakumar, Vikram Iyer, and Shyamnath Gollakota. 3d localization for sub-centimeter sized devices. In Proceedings of the 16th ACM Conference on Embedded Networked Sensor Systems, pages 108--119. ACM, 2018. Google ScholarDigital Library
- Aruba Asset Tracking. https://www.arubanetworks.com/assets/so/SO_AssetTracking.pdf.Google Scholar
- Richard Hartley and Andrew Zisserman. Multiple view geometry in computer vision. Cambridge university press, 2003. Google ScholarDigital Library
- Manikanta Kotaru, Kiran Joshi, Dinesh Bharadia, and Sachin Katti. Spotfi: Decimeter level localization using wifi. In ACM SIGCOMM Computer Communication Review, volume 45, pages 269--282. ACM, 2015. Google ScholarDigital Library
- Jie Xiong and Kyle Jamieson. Arraytrack: a fine-grained indoor location system. Usenix, 2013. Google ScholarDigital Library
- Richard Szeliski and Heung-Yeung Shum. Creating full view panoramic image mosaics and environment maps. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques, pages 251--258. ACM Press/Addison-Wesley Publishing Co., 1997. Google ScholarDigital Library
- Zhengyou Zhang. A flexible new technique for camera calibration. IEEE Transactions on pattern analysis and machine intelligence, 22, 2000. Google ScholarDigital Library
- Jue Wang, Deepak Vasisht, and Dina Katabi. Rf-idraw: virtual touch screen in the air using rf signals. In ACM SIGCOMM Computer Communication Review, volume 44, pages 235--246. ACM, 2014. Google ScholarDigital Library
- Cherian P Mathews and Michael D Zoltowski. Eigenstructure techniques for 2-d angle estimation with uniform circular arrays. IEEE Transactions on signal processing, 42(9):2395--2407, 1994. Google ScholarDigital Library
- Zhang Xiaofei, Li Jianfeng, and Xu Lingyun. Novel two-dimensional doa estimation with l-shaped array. EURASIP Journal on Advances in Signal Processing, 2011(1):50, 2011.Google ScholarCross Ref
- Nie Xi and Li Liping. A computationally efficient subspace algorithm for 2-d doa estimation with l-shaped array. IEEE signal processing letters, 21(8):971--974, 2014.Google Scholar
- Yuntao Wu and Hing Cheung So. Simple and accurate two-dimensional angle estimation for a single source with uniform circular array. IEEE Antennas and Wireless Propagation Letters, 7:78--80, 2008.Google ScholarCross Ref
- Tieqi Xia, Yi Zheng, Qun Wan, and Xuegang Wang. Decoupled estimation of 2-d angles of arrival using two parallel uniform linear arrays. IEEE Transactions on Antennas and Propagation, 55(9):2627--2632, 2007.Google ScholarCross Ref
- Lu Gan, Jian-Feng Gu, and Ping Wei. Estimation of 2-d doa for noncircular sources using simultaneous svd technique. IEEE Antennas and Wireless Propagation Letters, 7:385--388, 2008.Google ScholarCross Ref
- Swarun Kumar, Stephanie Gil, Dina Katabi, and Daniela Rus. Accurate indoor localization with zero start-up cost. In Proceedings of the 20th annual international conference on Mobile computing and networking, pages 483--494. ACM, 2014.Google ScholarDigital Library
- Sangki Yun, Yi-Chao Chen, and Lili Qiu. Turning a mobile device into a mouse in the air. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services, pages 15--29. ACM, 2015. Google ScholarDigital Library
- David G Lowe. Distinctive image features from scale-invariant keypoints. International journal of computer vision, 60(2):91--110, 2004. Google ScholarDigital Library
- Herbert Bay, Andreas Ess, Tinne Tuytelaars, and Luc Van Gool. Speeded-up robust features (surf). Computer vision and image understanding, 110(3):346--359, 2008. Google ScholarDigital Library
- Microsoft Sensor API. https://docs.microsoft.com/en-us/windows/desktop/sensorsapi/portal.Google Scholar
- Hyung-Jik Lee and Seul Jung. Gyro sensor drift compensation by kalman filter to control a mobile inverted pendulum robot system. In 2009 IEEE International Conference on Industrial Technology, pages 1--6. IEEE, 2009.Google ScholarDigital Library
- Sheng Shen, Mahanth Gowda, and Romit Roy Choudhury. Closing the gaps in inertial motion tracking. In Proceedings of the 24th Annual International Conference on Mobile Computing and Networking, pages 429--444. ACM, 2018. Google ScholarDigital Library
- Thomas Schmid, L Choong, and S Leidelöf. Ucla zigbee phy, 2009.Google Scholar
- Robert C Streijl, Stefan Winkler, and David S Hands. Mean opinion score (mos) revisited: methods and applications, limitations and alternatives. Multimedia Systems, 22(2):213--227, 2016.Google ScholarDigital Library
- Robert Wilson. Propagation losses through common building materials 2.4 ghz vs 5 ghz. Magis Networks Inc.: San Diego, CA, USA, 2002.Google Scholar
- Ioannis Pefkianakis and Kyu-Han Kim. Accurate 3d localization for 60 ghz networks. In Proceedings of the 16th ACM Conference on Embedded Networked Sensor Systems, pages 120--131. ACM, 2018. Google ScholarDigital Library
- Souvik Sen, Romit Roy Choudhury, and Srihari Nelakuditi. Spinloc: Spin once to know your location. In Proceedings of the Twelfth Workshop on Mobile Computing Systems & Applications, page 12. ACM, 2012. Google ScholarDigital Library
- Souvik Sen, Jeongkeun Lee, Kyu-Han Kim, and Paul Congdon. Avoiding multipath to revive inbuilding wifi localization. In Proceeding of the 11th annual international conference on Mobile systems, applications, and services, pages 249--262. ACM, 2013. Google ScholarDigital Library
- Liqun Li, Pan Hu, Chunyi Peng, Guobin Shen, and Feng Zhao. Epsilon: A visible light based positioning system. In 11th $$USENIX$$ Symposium on Networked Systems Design and Implementation ($$NSDI$$ 14), pages 331--343, 2014. Google ScholarDigital Library
- Hanchuan Li, Peijin Zhang, Samer Al Moubayed, Shwetak N Patel, and Alanson P Sample. Id-match: A hybrid computer vision and rfid system for recognizing individuals in groups. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pages 4933--4944. ACM, 2016. Google ScholarDigital Library
- Xiaochen Liu, Yurong Jiang, Puneet Jain, and Kyu-Han Kim. Tar: Enabling fine-grained targeted advertising in retail stores. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services, pages 323--336. ACM, 2018. Google ScholarDigital Library
- Francesco Cafaro, Alessandro Panella, Leilah Lyons, Jessica Roberts, and Josh Radinsky. I see you there!: developing identity-preserving embodied interaction for museum exhibits. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1911--1920. ACM, 2013. Google ScholarDigital Library
- Michael Goller, Christoph Feichtenhofer, and Axel Pinz. Fusing rfid and computer vision for probabilistic tag localization. In RFID (IEEE RFID), 2014 IEEE International Conference on, pages 89--96. IEEE, 2014.Google ScholarCross Ref
- Zhongqin Wang, Min Xu, Ning Ye, Ruchuan Wang, and Haiping Huang. Rf-mvo: Simultaneous 3d object localization and camera trajectory recovery using rfid devices and a 2d monocular camera. In 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS), pages 534--544. IEEE, 2018.Google ScholarCross Ref
Index Terms
- When IoT met Augmented Reality: Visualizing the Source of the Wireless Signal in AR View
Recommendations
Calibration-Free Augmented Reality in Perspective
This paper deals with video-based augmented reality and proposes an algorithm for augmenting a real video sequence with views of graphics objects without metric calibration of the video camera by representing the motion of the video camera in projective ...
Analysis of Head Pose Accuracy in Augmented Reality
A method is developed to analyze the accuracy of the relative head-to-object position and orientation (pose) in augmented reality systems with head-mounted displays. From probabilistic estimates of the errors in optical tracking sensors, the uncertainty ...
Mobile Augmented Reality: Composing the feature map retrieval process for robust and ready-to-use monocular tracking
This paper focuses on the preparative process of natural feature map retrieval for a mobile camera-based tracking system. We cover the most important aspects of a general purpose tracking system including the acquisition of the scene's geometry, ...
Comments