skip to main content
10.1145/3173225.3173226acmconferencesArticle/Chapter ViewAbstractPublication PagesteiConference Proceedingsconference-collections
research-article
Public Access

Ani-Bot: A Modular Robotics System Supporting Creation, Tweaking, and Usage with Mixed-Reality Interactions

Published: 18 March 2018 Publication History

Abstract

Ani-Bot is a modular robotics system that allows users to control their DIY robots using Mixed-Reality Interaction (MRI). This system takes advantage of MRI to enable users to visually program the robot through the augmented view of a Head-Mounted Display (HMD). In this paper, we first explain the design of the Mixed-Reality (MR) ready modular robotics system, which allows users to instantly perform MRI once they finish assembling the robot. Then, we elaborate the augmentations provided by the MR system in the three primary phases of a construction kit's lifecycle: Creation, Tweaking, and Usage. Finally, we demonstrate Ani-Bot with four application examples and evaluate the system with a two-session user study. The results of our evaluation indicate that Ani-Bot does successfully embed MRI into the lifecycle (Creation, Tweaking, Usage) of DIY robotics and that it does show strong potential for delivering an enhanced user experience.

Supplementary Material

suppl.mov (fp1015.mp4)
Supplemental video

References

[1]
2017. CageBot. (2017). https://www.cagebot.com/shop/.
[2]
2017. Code-a-pillar. (2017). http://fisher-price.mattel.com/shop/en-us/fp/think-learn-code-a-pillar-starter-gift-set-fgn83.
[3]
2017. Cubelets. (2017). http://www.modrobotics.com/cubelets/cubelets-twenty/.
[4]
2017. HoloLens. (2017). https://www.microsoft.com/en-us/hololens.
[5]
2017. Lego Mindstorm. (2017). https://www.lego.com/en-us/mindstorms.
[6]
2017. MOSS. (2017). http://www.modrobotics.com/moss/programming/.
[7]
2017. Tinkerbots. (2017). https://www.tinkerbots.com/.
[8]
2017. VEX Robotics. (2017). https://www.vexrobotics.com/.
[9]
2017. Vuforia. (2017). https://www.vuforia.com/.
[10]
David Anderson, James L Frankel, Joe Marks, Aseem Agarwala, Paul Beardsley, Jessica Hodgins, Darren Leigh, Kathy Ryall, Eddie Sullivan, and Jonathan S Yedidia. 2000. Tangible interaction+ graphical interpretation: a new approach to 3D modeling. In Proceedings of the 27th annual conference on Computer graphics and interactive techniques. ACM Press/Addison-Wesley Publishing Co., 393--402.
[11]
Ayah Bdeir. 2009. Electronics as material: littleBits. In Proceedings of the 3rd International Conference on Tangible and Embedded Interaction. ACM, 397--400.
[12]
Jonathan Wun Shiung Chong, SK Ong, Andrew YC Nee, and K Youcef-Youmi. 2009. Robot programming using augmented reality: An interactive method for planning collision-free paths. Robotics and Computer-Integrated Manufacturing 25, 3 (2009), 689--701.
[13]
HC Fang, SK Ong, and AYC Nee. 2012. Interactive robot trajectory planning and simulation using augmented reality. Robotics and Computer-Integrated Manufacturing 28, 2 (2012), 227--237.
[14]
HC Fang, SK Ong, and AYC Nee. 2014. A novel augmented reality-based interface for robot path planning. International Journal on Interactive Design and Manufacturing (IJIDeM) 8, 1 (2014), 33--42.
[15]
Jared A Frank, Matthew Moorhead, and Vikram Kapila. 2016. Realizing mixed-reality environments with tablets for intuitive human-robot collaboration for object manipulation tasks. In Robot and Human Interactive Communication (RO-MAN), 2016 25th IEEE International Symposium on. IEEE, 302--307.
[16]
Richard Fung, Sunao Hashimoto, Masahiko Inami, and Takeo Igarashi. 2011. An augmented reality system for teaching sequential tasks to a household robot. In RO-MAN, 2011 IEEE. IEEE, 282--287.
[17]
Saikat Gupta, Sujin Jang, and Karthik Ramani. 2014. PuppetX: a framework for gestural interactions with user constructed playthings. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces. ACM, 73--80.
[18]
Sunao Hashimoto, Akihiko Ishida, Masahiko Inami, and Takeo Igarashi. 2011. Touchme: An augmented reality based remote robot manipulation. In 21st Int. Conf. on Artificial Reality and Telexistence, Proc. of ICAT2011.
[19]
Steven J Henderson and Steven K Feiner. 2011. Augmented reality in the psychomotor phase of a procedural task. In Mixed and Augmented Reality (ISMAR), 2011 10th IEEE International Symposium on. IEEE, 191--200.
[20]
Valentin Heun, James Hobin, and Pattie Maes. 2013a. Reality editor: Programming smarter objects. In Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication. ACM, 307--310.
[21]
Valentin Heun, Shunichi Kasahara, and Pattie Maes. 2013b. Smarter objects: using AR technology to program physical objects and their interactions. In CHI'13 Extended Abstracts on Human Factors in Computing Systems. ACM, 961--966.
[22]
Hiroshi Ishii. 2008. The tangible user interface and its evolution. Commun. ACM 51, 6 (2008), 32--36.
[23]
Kentaro Ishii, Yoshiki Takeoka, Masahiko Inami, and Takeo Igarashi. 2010. Drag-and-drop interface for registration-free object delivery. In RO-MAN, 2010 IEEE. IEEE, 228--233.
[24]
Shunichi Kasahara, Ryuma Niiyama, Valentin Heun, and Hiroshi Ishii. 2013. exTouch: spatially-aware embodied manipulation of actuated objects mediated by augmented reality. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction. ACM, 223--228.
[25]
Majeed Kazemitabaar, Jason McPeak, Alexander Jiao, Liang He, Thomas Outing, and Jon E Froehlich. 2017. MakerWear: A Tangible Approach to Interactive Wearable Creation for Children. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 133--145.
[26]
Yoshifumi Kitamura, Yuichi Itoh, Toshihiro Masaki, and Fumio Kishino. 2000. ActiveCube: a bi-directional user interface using cubes. In Knowledge-Based Intelligent Engineering Systems and Allied Technologies, 2000. Proceedings. Fourth International Conference on, Vol. 1. IEEE, 99--102.
[27]
Jens Lambrecht, Martin Kleinsorge, Martin Rosenstrauch, and Jörg Krüger. 2013. Spatial programming for industrial robots through task demonstration. International Journal of Advanced Robotic Systems 10, 5 (2013), 254.
[28]
Daniel Leithinger, Sean Follmer, Alex Olwal, Samuel Luescher, Akimitsu Hogge, Jinha Lee, and Hiroshi Ishii. 2013. Sublimate: state-changing virtual and physical rendering to augment interaction with shape displays. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 1441--1450.
[29]
Joanne Leong, Florian Perteneder, Hans-Christian Jetter, and Michael Haller. 2017. What a Life!: Building a Framework for Constructive Assemblies. In Tangible and Embedded Interaction. 57--66.
[30]
Natan Linder and Pattie Maes. 2010. LuminAR: portable robotic augmented reality interface design and prototype. In Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 395--396.
[31]
Sotiris Makris, George Pintzos, Loukas Rentzos, and George Chryssolouris. 2013. Assembly support using AR technology based on automatic sequence generation. CIRP Annals-Manufacturing Technology 62, 1 (2013), 9--12.
[32]
Andrew Miller, Brandyn White, Emiko Charbonneau, Zach Kanzler, and Joseph J LaViola Jr. 2012. Interactive 3D model acquisition and tracking of building block structures. IEEE transactions on visualization and computer graphics 18, 4 (2012), 651--659.
[33]
Lai Xing Ng, SK Ong, and AYC Nee. 2010. ARCADE: a simple and fast augmented reality computer-aided design environment using everyday objects. (2010).
[34]
Lai Xing Ng, SW Oon, Soh Khim Ong, and A YC Nee. 2011. GARDE: a gesture-based augmented reality design evaluation system. International Journal on Interactive Design and Manufacturing 5, 2 (2011), 85--94.
[35]
Hyunjoo Oh and Mark D Gross. 2015. Cube-in: A Learning Kit for Physical Computing Basics. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 383--386.
[36]
SK Ong, Yu Pang, and AYC Nee. 2007. Augmented reality aided assembly design and planning. CIRP Annals Manufacturing Technology 56, 1 (2007), 49--52.
[37]
Hayes Solos Raffle, Amanda J Parkes, and Hiroshi Ishii. 2004. Topobo: a constructive assembly system with kinetic memory. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 647 654.
[38]
Philipp Schoessler, Daniel Windham, Daniel Leithinger, Sean Follmer, and Hiroshi Ishii. 2015. Kinetic Blocks: Actuated Constructive Assembly for Interaction and Display. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, 341--349.
[39]
Jasjeet Singh Seehra, Ansh Verma, Kylie Peppler, and Karthik Ramani. 2015. Handimate: Create and animate using everyday objects as material. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 117--124.
[40]
Orit Shaer and Eva Hornecker. 2010. Tangible user interfaces: past, present, and future directions. Foundations and Trends in Human-Computer Interaction 3, 1--2 (2010), 1--137.
[41]
Ronit Slyper, Guy Hoffman, and Ariel Shamir. 2015. Mirror Puppeteering: Animating Toy Robots in Front of a Webcam. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 241--248.
[42]
Masanori Sugimoto, Tomoki Fujita, Haipeng Mi, and Aleksander Krzywinski. 2011. RoboTable2: a novel programming environment using physical robots on a tabletop platform. In Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology. ACM, 10.
[43]
Amanda Sullivan, Mollie Elkin, and Marina Umaschi Bers. 2015. KIBO robot demo: Engaging young children in programming and engineering. In Proceedings of the 14th international conference on interaction design and children. ACM, 418--421.
[44]
X Wang, SK Ong, and Andrew Yeh-Ching Nee. 2016. Multi-modal augmented-reality assembly guidance based on bare-hand interface. Advanced Engineering Informatics 30, 3 (2016), 406--421.
[45]
ZB Wang, SK Ong, and AYC Nee. 2013. Augmented reality aided interactive manual assembly design. The International Journal of Advanced Manufacturing Technology 69, 5--8 (2013), 1311--1321.
[46]
Michael Philetus Weller, Ellen Yi-Luen Do, and Mark D Gross. 2008. Posey: instrumenting a poseable hub and strut construction toy. In Proceedings of the 2nd international conference on Tangible and embedded interaction. ACM, 39--46.
[47]
ML Yuan, SK Ong, and AYC Nee. 2008. Augmented reality for assembly guidance using a virtual interactive tool. International Journal of Production Research 46, 7 (2008), 1745--1767.
[48]
J Zhang, SK Ong, and AYC Nee. 2011. RFID-assisted assembly guidance system in an augmented reality environment. International Journal of Production Research 49, 13 (2011), 3919--3938.

Cited By

View all
  • (2025)An Updated Systematic Mapping Study on Usability and User Experience Evaluation of Touchable Holographic SolutionsJournal on Interactive Systems10.5753/jis.2025.469416:1(172-198)Online publication date: 1-Jan-2025
  • (2023)Usability and User Experience Evaluation of Touchable Holographic Solutions: A Systematic Mapping StudyProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638071(1-13)Online publication date: 16-Oct-2023
  • (2023)Virtual, Augmented, and Mixed Reality for Human-robot Interaction: A Survey and Virtual Design Element TaxonomyACM Transactions on Human-Robot Interaction10.1145/359762312:4(1-39)Online publication date: 31-May-2023
  • Show More Cited By

Index Terms

  1. Ani-Bot: A Modular Robotics System Supporting Creation, Tweaking, and Usage with Mixed-Reality Interactions

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction
    March 2018
    763 pages
    ISBN:9781450355681
    DOI:10.1145/3173225
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 March 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. diy robotics
    2. human-robot interaction
    3. mixed-reality
    4. modular robotics
    5. user interface

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    TEI '18
    Sponsor:

    Acceptance Rates

    TEI '18 Paper Acceptance Rate 37 of 130 submissions, 28%;
    Overall Acceptance Rate 393 of 1,367 submissions, 29%

    Upcoming Conference

    TEI '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)139
    • Downloads (Last 6 weeks)17
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)An Updated Systematic Mapping Study on Usability and User Experience Evaluation of Touchable Holographic SolutionsJournal on Interactive Systems10.5753/jis.2025.469416:1(172-198)Online publication date: 1-Jan-2025
    • (2023)Usability and User Experience Evaluation of Touchable Holographic Solutions: A Systematic Mapping StudyProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638071(1-13)Online publication date: 16-Oct-2023
    • (2023)Virtual, Augmented, and Mixed Reality for Human-robot Interaction: A Survey and Virtual Design Element TaxonomyACM Transactions on Human-Robot Interaction10.1145/359762312:4(1-39)Online publication date: 31-May-2023
    • (2022)A Guided Task and Obstacle Alert Robot System Based on TinyML and Augmented RealityProceedings of the 2022 3rd International Conference on Control, Robotics and Intelligent System10.1145/3562007.3562050(225-229)Online publication date: 26-Aug-2022
    • (2022)MechARspace: An Authoring System Enabling Bidirectional Binding of Augmented Reality with Toys in Real-timeProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545668(1-16)Online publication date: 29-Oct-2022
    • (2022)Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic InterfacesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517719(1-33)Online publication date: 29-Apr-2022
    • (2022)Learning with Yourself: a Tangible Twin Robot System to Promote STEM Education2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS47612.2022.9981423(4981-4988)Online publication date: 23-Oct-2022
    • (2021)Augmented Reality and Deep Learning Guided Task Oriented Robot2021 33rd Chinese Control and Decision Conference (CCDC)10.1109/CCDC52312.2021.9602607(3241-3245)Online publication date: 22-May-2021
    • (2019)GhostAR: A Time-space Editor for Embodied Authoring of Human-Robot Collaborative Task with Augmented RealityProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347902(521-534)Online publication date: 17-Oct-2019
    • (2019)V.RaProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322278(1059-1070)Online publication date: 18-Jun-2019
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media