Chungkuk Yoo
Inseok Hwang
ABSTRACT
Imagine a densely packed crowd that gathers to convey a common message, such as people in a candlelight vigil or a protest. We envision an innovation through mobile computing technologies to empower such a crowd by enabling them simply to hold their phones up and create a massive collective visualization on top of them. We propose Card-stunt as a Service (CaaS). CaaS is a service enabling a densely packed crowd to instantly visualize symbols using their mobile devices and a server-side service. The key challenge toward realizing an instant collective visualization is how to achieve instant, infrastructure-free, decimeter-level localization of individuals in a massively packed crowd, while maintaining low latency. CaaS addresses the challenges by mobile visible-light angle-of-arrival (AoA) sensing and scalable constrained optimization. It reconstructs relative locations of all individuals and dispatches individualized timed pixels to each one so that they can do their part in the overall visualization. We evaluate CaaS with extensive experiments under diverse reality settings as well as under synthetic workloads scaling up to tens of thousands of people. We deploy CaaS to 49 participants so that they successfully perform a collective visualization cheering up MobiSys.
- Android API, getFullBiasNanos. https://developer.android.com/reference/android/location/GnssClock.html#getFullBiasNanos(). Accessed: April 2, 2017.Google Scholar
- atan2. http://linux.die.net/man/3/atan2. Accessed: December 8, 2016.Google Scholar
- Atlanta stadium with IBM smarter stadiums. https://www-03.ibm.com/press/us/en/pressrelease/46116.wss. Accessed: April 14, 2017.Google Scholar
- Autism speaks card stunt. http://www.cardstunts.com/autism-speaks-card-stunt/. Accessed: April 8, 2017.Google Scholar
- Card Stunts by Kivett Productions. http://www.cardstunts.com/. Accessed: December 8, 2016.Google Scholar
- Cisco connected stadium Wi-Fi solution. http://www.cisco.com/c/dam/en_us/solutions/industries/docs/sports/c78--675063_dSheet.pdf. Accessed: April 14, 2017.Google Scholar
- Guinness record-setting candlelight vigil. http://english.hani.co.kr/arti/english_edition/e_national/687413.html. Accessed: December 8, 2016.Google Scholar
- IBM smarter stadiums. https://www.ibm.com/sports. Accessed: April 14, 2017.Google Scholar
- Iceland fans together with national team performs "Viking war chant". https://www.youtube.com/watch?v=BM6U1tmDjUA. Accessed: April 8, 2017.Google Scholar
- Network identity and timezone (nitz); service description. https://portal.3gpp.org/desktopmodules/Specifications/SpecificationDetails.aspx'specificationId=576. Accessed: April 8, 2017.Google Scholar
- NGMN Alliance. 5g white paper. https://www.ngmn.org/uploads/media/NGMN_5G_White_Paper_V1_0.pdf. Accessed: December 8, 2016.Google Scholar
- OpenCL framework. https://www.khronos.org/opencl/. Accessed: April 6, 2017.Google Scholar
- Protesters create giant Romanian flag. http://www.wsj.com/video/protesters-create-giant-romanian-flag/6EA2237F-2C08--4422-AD55--4BE0D09B637A.html. Accessed: April 8, 2017.Google Scholar
- Schneider's 80th anniversary. http://www.cardstunts.com/schneiders-80th-anniversary/. Accessed: April 8, 2017.Google Scholar
- South Korean protesters march against president again. http://edition.cnn.com/2016/11/12/asia/south-korean-protest-president-park/. Accessed: April 8, 2017.Google Scholar
- Statistical abstract of the united states: 2011. U.S. Census Bureau.Google Scholar
- SurfaceFlinger and Hardware Composer. https://source.android.com/devices/graphics/arch-sf-hwc.html. Accessed: December 5, 2016.Google Scholar
- Texas A&M completes world's largest card stunt. http://tamu.247sports.com/Bolt/AM-completes-worlds-largest-card-stunt-40896549. Accessed: April 8, 2017.Google Scholar
- Texas A&M's Kyle Field fiber for the future, stadium tech report. http://www.corning.com/media/worldwide/coc/documents/TA&M_SINGLEPAGE_LOW.pdf. Accessed: April 14, 2017.Google Scholar
- Thousands call on South Korea's Park to step down. http://edition.cnn.com/2016/11/05/asia/south-korea-president-protests/. Accessed: April 8, 2017.Google Scholar
- N. Banerjee, S. Agarwal, P. Bahl, R. Chandra, A. Wolman, and M. Corner. Virtual compass: relative positioning to sense mobile social interactions. In Proceedings of the 8th International Conference on Pervasive Computing (Pervasive '10), pages 1--21. Springer, 2010. Google ScholarDigital Library
- R. H. Byrd, M. E. Hribar, and J. Nocedal. An interior point algorithm for large-scale nonlinear programming. SIAM Journal on Optimization, 9(4):877--900, 1999. Google ScholarDigital Library
- C.-L. Chin and C.-T. Lin. Detection and compensation algorithm for backlight images with fuzzy logic and adaptive compensation curve. International Journal of Pattern Recognition and Artificial Intelligence, 19(08):1041--1057, 2005.Google ScholarCross Ref
- A. Choudhary, W. Hendrix, K. Lee, D. Palsetia, and W.-K. Liao. Social media evolution of the egyptian revolution. Communications of the ACM, 55(5):74--80, 2012. Google ScholarDigital Library
- I. Constandache, X. Bao, M. Azizyan, and R. R. Choudhury. Did you see bob?: human localization using mobile phones. In Proceedings of the Sixteenth Annual International Conference on Mobile Computing and Networking (MobiCom'10), pages 149--160. ACM, 2010. Google ScholarDigital Library
- E. Cuthill and J. McKee. Reducing the bandwidth of sparse symmetric matrices. In Proceedings of the 1969 24th national conference, pages 157--172. ACM, 1969. Google ScholarDigital Library
- J. Erman and K. K. Ramakrishnan. Understanding the super-sized traffic of the super bowl. In Proceedings of the 2013 Internet Measurement Conference, pages 353--360. ACM, 2013. Google ScholarDigital Library
- S. González-Bailón, J. Borge-Holthoefer, A. Rivero, and Y. Moreno. The dynamics of protest recruitment through an online network. Scientific reports, 1, 2011.Google Scholar
- T. Hao, R. Zhou, and G. Xing. Cobra: color barcode streaming for smartphone systems. In Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services (MobiSys'12), pages 85--98. ACM, 2012. Google ScholarDigital Library
- M. Hazas, C. Kray, H. Gellersen, H. Agbota, G. Kortuem, and A. Krohn. A relative positioning system for co-located mobile devices. In Proceedings of the 3rd International Conference on Mobile Systems, Applications, and Services (MobiSys'05), pages 177--190. ACM, 2005. Google ScholarDigital Library
- T. He, C. Huang, B. M. Blum, J. A. Stankovic, and T. Abdelzaher. Range-free localization schemes for large scale sensor networks. In Proceedings of the 9th Annual International Conference on Mobile Computing and Networking (MobiCom'03), pages 81--95. ACM, 2003. Google ScholarDigital Library
- F. Hermans, L. McNamara, G. Sörös, C. Rohner, T. Voigt, and E. Ngai. Focus: Robust visual codes for everyone. In Proceedings of the 14th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys'16), pages 319--332. ACM, 2016. Google ScholarDigital Library
- D.-Y. Huang, C.-P. Lin, Y.-P. Hung, T.-W. Chang, N.-H. Yu, M.-L. Tsai, and M. Y. Chen. Magmobile: enhancing social interactions with rapid view-stitching games of mobile devices. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia (MUM'12), number 61. ACM, 2012. Google ScholarDigital Library
- I. Hwang, H. Jang, T. Park, A. Choi, C. Hwang, Y. Choi, L. Nachman, and J. Song. Toward delegated observation of kindergarten children's exploratory behaviors in field trips. In Proceedings of the 13th International Conference on Ubiquitous Computing (UbiComp'11), pages 555--556. ACM, 2011. Google ScholarDigital Library
- I. Hwang, H. Jang, T. Park, A. Choi, Y. Lee, C. Hwang, Y. Choi, L. Nachman, and J. Song. Leveraging children's behavioral distribution and singularities in new interactive environments: Study in kindergarten field trips. In Proceedings of the 10th International Conference on Pervasive Computing (Pervasive'12), pages 39--56. Springer, 2012. Google ScholarDigital Library
- H. Jacobs. To count a crowd. Columbia Journalism Review, 6(1):37, 1967.Google Scholar
- H. Jang, S. P. Choe, I. Hwang, C. Hwang, L. Nachman, and J. Song. Rubberband: augmenting teacher's awareness of spatially isolated children on kindergarten field trips. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp'12), pages 236--239. ACM, 2012. Google ScholarDigital Library
- J. Jun, Y. Gu, L. Cheng, B. Lu, J. Sun, T. Zhu, and J. Niu. Social-loc: Improving indoor localization with social sensing. In Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems (SenSys'13), number 14. ACM, 2013. Google ScholarDigital Library
- J. Jurgensen. Concert crowds flounder in digital dead zones. The Wall Street Journal, 2014. Accessed: December 8, 2016.Google Scholar
- Y.-S. Kuo, P. Pannuto, K.-J. Hsiao, and P. Dutta. Luxapose: Indoor positioning with mobile phones and visible light. In Proceedings of the 20th Annual International Conference on Mobile Computing and Networking (MobiCom'14), pages 447--458. ACM, 2014. Google ScholarDigital Library
- A. LaMarca, Y. Chawathe, S. Consolvo, J. Hightower, I. Smith, J. Scott, T. Sohn, J. Howard, J. Hughes, F. Potter, J. Tabert, P. Powledge, G. Borriello, and B. SchilitShow. Place lab: Device positioning using radio beacons in the wild. In Proceedings of the Third International Conference on Pervasive Computing (Pervasive'05), pages 116--133. Springer, 2005. Google ScholarDigital Library
- C. Lewis, A. Chandler, and J. Finney. Where's my pixel? multi-view reconstruction of smart led displays. In The Fifth International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies (UBICOMM'11), pages 83--89. IARIA, 2011.Google Scholar
- L. Li, P. Hu, C. Peng, G. Shen, and F. Zhao. Epsilon: A visible light based positioning system. In Proceedings of the 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI'14), pages 331--343, 2014. Google ScholarDigital Library
- T. Li, Q. Liu, and X. Zhou. Practical human sensing in the light. In Proceedings of the 14th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys'16), pages 71--84. ACM, 2016. Google ScholarDigital Library
- K. Liu, X. Liu, and X. Li. Guoguo: Enabling fine-grained indoor localization via smartphone. In Proceeding of the 11th International Conference on Mobile Systems, Applications, and Services (MobiSys'13), pages 235--248. ACM, 2013. Google ScholarDigital Library
- C. Luo and M. C. Chan. Socialweaver: collaborative inference of human conversation networks using smartphones. In Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems (SenSys'13), number 20. ACM, 2013. Google ScholarDigital Library
- S. K. Mani, R. Durairajan, P. Barford, and J. Sommers. Mntp: Enhancing time synchronization for mobile devices. In Proceedings of the 2016 Internet Measurement Conference, pages 335--348. ACM, 2016. Google ScholarDigital Library
- J. Mannermaa, K. Kalliomaki, T. Manstén, and S. Turunen. Timing performance of various GPS receivers. In Frequency and Time Forum, 1999 and the IEEE International Frequency Control Symposium, 1999., Proceedings of the 1999 Joint Meeting of the European, volume 1, pages 287--290. IEEE, 1999.Google ScholarCross Ref
- A. T. Mariakakis, S. Sen, J. Lee, and K.-H. Kim. Sail: single access point-based indoor localization. In Proceedings of the 12th International Conference on Mobile Systems, Applications, and Services (MobiSys'14), pages 315--328. ACM, 2014. Google ScholarDigital Library
- D. McCafferty. Activism vs. slacktivism. Communications of the ACM, 54(12):17--19, 2011. Google ScholarDigital Library
- D. Merrill, J. Kalanithi, and P. Maes. Siftables: towards sensor network user interfaces. In Proceedings of the 1st international conference on Tangible and Embedded Interaction (TEI'07), pages 75--78. ACM, 2007. Google ScholarDigital Library
- K. Miyaoku, S. Higashino, and Y. Tonomura. C-blink: a hue-difference-based light signal marker for large screen interaction via any mobile terminal. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST'04), pages 147--156. ACM, 2004. Google ScholarDigital Library
- J. Nielsen. Usability engineering. Elsevier, 1994.Google Scholar
- S. Nirjon, J. Liu, G. DeJean, B. Priyantha, Y. Jin, and T. Hart. Coin-GPS: indoor localization from direct GPS receiving. In Proceedings of the 12th International Conference on Mobile Systems, Applications, and Services (MobiSys'14), pages 301--314. ACM, 2014. Google ScholarDigital Library
- T. Ohta and J. Tanaka. Movietile: interactively adjustable free shape multi-display of mobile devices. In SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications, number 18. ACM, 2015. Google ScholarDigital Library
- T. Okatani and K. Deguchi. Easy calibration of a multi-projector display system. International journal of computer vision, 85(1):1--18, 2009. Google ScholarDigital Library
- D. O. Olguín, B. N. Waber, T. Kim, A. Mohan, K. Ara, and A. Pentland. Sensible organizations: Technology and methodology for automatically measuring organizational behavior. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 39(1):43--55, 2009. Google ScholarDigital Library
- C. Peng, G. Shen, Y. Zhang, Y. Li, and K. Tan. Beepbeep: a high accuracy acoustic ranging system using cots mobile devices. In Proceedings of the 5th International Conference on Embedded Networked Sensor Systems (SenSys'07), pages 1--14. ACM, 2007. Google ScholarDigital Library
- J. Rekimoto. Squama: a programmable window and wall for future physical architectures. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp'12), pages 667--668. ACM, 2012. Google ScholarDigital Library
- A. Schmitz, M. Li, V. Schönefeld, and L. Kobbelt. Ad-hoc multi-displays for mobile interactive applications. In Eurographics (Areas Papers), pages 45--52, 2010.Google Scholar
- J. Schwarz, D. Klionsky, C. Harrison, P. Dietz, and A. Wilson. Phone as a pixel: enabling ad-hoc, large-scale displays using mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'12), pages 2235--2238. ACM, 2012. Google ScholarDigital Library
- M. Z. Shafiq, L. Ji, A. X. Liu, J. Pang, S. Venkataraman, and J. Wang. A first look at cellular network performance during crowded events. In ACM SIGMETRICS Performance Evaluation Review, volume 41, pages 17--28. ACM, 2013. Google ScholarDigital Library
- R. Stoleru, T. He, J. A. Stankovic, and D. Luebke. A high-accuracy, low-cost localization system for wireless sensor networks. In Proceedings of the 3rd International Conference on Embedded Networked Sensor Systems (SenSys'05), pages 13--26. ACM, 2005. Google ScholarDigital Library
- R. Stoleru, P. Vicaire, T. He, and J. A. Stankovic. Stardust: a flexible architecture for passive localization in wireless sensor networks. In Proceedings of the 4th International Conference on Embedded Networked Sensor Systems (SenSys'06), pages 57--70. ACM, 2006. Google ScholarDigital Library
- A. Symington and N. Trigoni. Encounter based sensor tracking. In Proceedings of the thirteenth ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc'12), pages 15--24. ACM, 2012. Google ScholarDigital Library
- S. Valenzuela. Unpacking the use of social media for protest behavior the roles of information, opinion expression, and activism. American Behavioral Scientist, 57(7):920--942, 2013.Google ScholarCross Ref
- O. Varol, E. Ferrara, C. L. Ogan, F. Menczer, and A. Flammini. Evolution of online user behavior during a social upheaval. In Proceedings of the 2014 ACM Conference on Web Science (WebSci'14), pages 81--90. ACM, 2014. Google ScholarDigital Library
- D. Vasisht, S. Kumar, and D. Katabi. Decimeter-level localization with a single WiFi access point. In Proceedings of 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI'16), pages 165--178, 2016. Google ScholarDigital Library
- R. A. Waltz, J. L. Morales, J. Nocedal, and D. Orban. An interior algorithm for nonlinear optimization that combines line search and trust region steps. Mathematical programming, 107(3):391--408, 2006.Google ScholarCross Ref
- A. Wang, Z. Li, C. Peng, G. Shen, G. Fang, and B. Zeng. Inframe+: Achieve simultaneous screen-human viewing and hidden screen-camera communication. In Proceedings of the 13th International Conference on Mobile Systems, Applications, and Services (MobiSys'15), pages 181--195. ACM, 2015. Google ScholarDigital Library
- P. A. Zandbergen. Accuracy of iphone locations: A comparison of assisted GPS, WiFi and cellular positioning. Transactions in GIS, 13(s1):5--25, 2009.Google Scholar
- Z. Zhang, D. Chu, X. Chen, and T. Moscibroda. Swordfight: Enabling a new class of phone-to-phone action games on commodity phones. In Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services (MobiSys'12), pages 1--14. ACM, 2012. Google ScholarDigital Library
- Z. Zhong and T. He. Msp: multi-sequence positioning of wireless sensor nodes. In Proceedings of the 5th international Conference on Embedded Networked Sensor Systems (SenSys'07), pages 15--28. ACM, 2007. Google ScholarDigital Library
- Z. Zhong and T. He. Achieving range-free localization beyond connectivity. In Proceedings of the 7th ACM Conference on Embedded Networked Sensor Systems (SenSys'09), pages 281--294. ACM, 2009. Google ScholarDigital Library
- P. Zhou, M. Li, and G. Shen. Use it free: Instantly knowing your phone attitude. In Proceedings of the 20th Annual International Conference on Mobile Computing and Networking (MobiCom'14), pages 605--616. ACM, 2014. Google ScholarDigital Library
Index Terms
- Card-stunt as a Service: Empowering a Massively Packed Crowd for Instant Collective Expressiveness
Recommendations
Card-Stunt as a Service: Empowering a Massively Packed Crowd for Instant Collective Expressiveness
Excerpted from "Card-stunt as a Service: Empowering a Massively Packed Crowd for Instant Collective Expressiveness" from MobiSys 2017, Proceedings of the 15th Annual ACM International Conference on Mobile Systems, Applications, and Services, with ...
Demo: Card-stunt as a Service: Empowering a Massively Packed Crowd for Instant Collective Expressiveness
MobiSys '17: Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and ServicesConsider a massive crowd who gathered together to convey their common voice to public, e.g., supporters of a team sitting together in a stadium, people doing a candlelight vigil in a public square, and so on. Imagine that they hold up their smartphone ...
High-accuracy differential tracking of low-cost GPS receivers
MobiSys '13: Proceeding of the 11th annual international conference on Mobile systems, applications, and servicesIn many mobile wireless applications such as the automated driving of cars, formation flying of unmanned air vehicles, and source localization or target tracking with wireless sensor networks, it is more important to know the precise relative locations ...
Comments