Ming Li
ABSTRACT
Table display surfaces, like Microsoft PixelSense, can display multimedia content to a group of users simultaneously, but it is expensive and lacks mobility. On the contrary, mobile devices are more easily available, but due to limited screen size and resolution, they are not suitable for sharing multimedia data interactively. In this paper we present a "Dynamic Tiling Display", an interactive display surface built from mobile devices. Our framework utilizes the integrated front facing camera of mobile devices to estimate the relative pose of multiple mobile screens arbitrarily placed on a table. Using this framework, users can create a large virtual display where multiple users can explore multimedia data interactively through separate windows (mobile screens). The major technical challenge is the calibration of individual displays, which is solved by visual object recognition using front facing camera inputs.
Supplemental Material
Available for Download
Supplemental material.
- Artoolkitplus. http://handheldar.icg.tugraz.at/artoolkitplus.php.Google Scholar
- R. Borovoy and B. Knep. Junkyard jumbotron. http://jumbotron.media.mit.edu.Google Scholar
- K. Hinckley, G. Ramos, F. Guimbretiere, P. Baudisch, and M. Smith. Stitching: pen gestures that span multiple displays. In AVI '04: Proceedings of the working conference on Advanced visual interfaces, pages 23--31, New York, NY, USA, 2004. ACM. Google ScholarDigital Library
- H. Kato and M. Billinghurst. Marker tracking and hmd calibration for a video-based augmented reality conferencing system. In IWAR '99: Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality, page 85, Washington, DC, USA, 1999. IEEE Computer Society. Google ScholarDigital Library
- S. Lee-Delisle. PixelPhones. http://seb.ly/2011/09/pixelphones-a-huge-display-made-with-smart-phones/, 2011.Google Scholar
- D. Merrill, J. Kalanithi, and P. Maes. Siftables: towards sensor network user interfaces. In TEI '07: Proceedings of the 1st international conference on Tangible and embedded interaction, pages 75--78, New York, NY, USA, 2007. ACM. Google ScholarDigital Library
- Microsoft. Microsoft pixelsense. http://www.microsoft.com/en-us/pixelsense/, 2011.Google Scholar
- A. Schmitz, M. Li, V. Schönefeld, and L. Kobbelt. Ad-Hoc Multi-Displays for Mobile Interactive Applications. In EG 2010 - Areas Papers, pages 45--52, Norrköping, Sweden, 2010. Eurographics Association.Google Scholar
- J. Schwarz, D. Klionsky, C. Harrison, P. Dietz, and A. Wilson. Phone as a pixel: enabling ad-hoc, large-scale displays using mobile devices. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems, CHI '12, pages 2235--2238, New York, NY, USA, 2012. ACM. Google ScholarDigital Library
- I. Welikesmall. IPod Wall. http://vimeo.com/13404489, 2010.Google Scholar
Index Terms
- Dynamic tiling display: building an interactive display surface using multiple mobile devices
Recommendations
Virtual Buttons for Eyes-Free Interaction: A Study
Human-Computer Interaction – INTERACT 2015AbstractThe touch screen of mobile devices, such as smart phones and tablets, is their primary input mechanism. While designed to be used in conjunction with its output capabilities, eyes-free interaction is also possible and useful on touch screens. ...
3-D interaction with a large wall display using transparent markers
AVI '10: Proceedings of the International Conference on Advanced Visual InterfacesIn this paper we proposed a new interface for interacting with large displays via small video devices such as a cell phone. We estimate the location of the camera relative to the display using a matrix of transparent markers embedded on display. As a ...
Dynamic ambient lighting for mobile devices
UIST '11 Adjunct: Proceedings of the 24th annual ACM symposium adjunct on User interface software and technologyThe information a small mobile device can show via its display has been always limited by its size. In large information spaces, relevant information, such as important locations on a map can get clipped when a user starts zooming and panning. Dynamic ...
Comments