skip to main content
10.1145/2909824.3020225acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
research-article

Design and Evaluation of Adverb Palette: A GUI for Selecting Tradeoffs in Multi-objective Optimization Problems

Published:06 March 2017Publication History

ABSTRACT

An important part of expressing human intent is identifying acceptable tradeoffs among competing performance objectives. We present and evaluate a set of graphical user interfaces (GUIs), that are designed to allow a human to express intent by expressing desirable tradeoffs. The GUIs require an algorithm that identifies the set of Pareto optimal solutions to the multi-objective decision problem, which means that all the solutions are equally good in the sense that there are no other solutions better for every objective. Given the Pareto set, the GUIs provide different ways for a human to express intent by exploring tradeoffs between objectives; once a tradeoff is selected, the solution is chosen. The GUI designs are applied to interactive human-robot path-selection for a robot in an urban environment, but they can be applied to other tradeoff problems. A user study evaluates GUI designs by requiring users to select a tradeoff that satisfies a specified mission intent. Results of the user study suggest that GUIs designed to support an artist's palette-metaphor can be used to express intent without incurring unacceptable levels of human workload.

References

  1. J. A. Adams. Critical considerations for human-robot interface development. In Proceedings of 2002 AAAI Fall Symposium, pages 1--8, 2002.Google ScholarGoogle Scholar
  2. F. Ahmed and K. Deb. Multi-objective optimal path planning using elitist non-dominated sorting genetic algorithms. Soft Computing, 17(7):1283--1299, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. F. S. Azar. Multiattribute decision-making: use of three scoring methods to compare the performance of imaging techniques for breast cancer detection. 2000.Google ScholarGoogle Scholar
  4. M. Baker, R. Casey, B. Keyes, and H. A. Yanco. Improved interfaces for human-robot interaction in urban search and rescue. In SMC (3), pages 2960--2965. Citeseer, 2004.Google ScholarGoogle Scholar
  5. K. B. Bennett, S. M. Posey, and L. G. Shattuck. Ecological interface design for military command and control. Journal of Cognitive Engineering and Decision Making, 2(4):349--385, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  6. J. Bruce and M. Veloso. Real-time randomized path planning for robot navigation. In Intelligent Robots and Systems, 2002. IEEE/RSJ International Conference, volume 3, pages 2383--2388. IEEE, 2002.Google ScholarGoogle ScholarCross RefCross Ref
  7. A. Bry and N. Roy. Rapidly-exploring random belief trees for motion planning under uncertainty. In Robotics and Automation (ICRA), 2011 IEEE International Conference, pages 723--730. IEEE, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  8. J. Y. Chen, E. C. Haas, and M. J. Barnes. Human performance issues and user interface design for teleoperated robots. Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, 37(6):1231--1245, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. F. Driewer, M. Sauer, and K. Schilling. Discussion of challenges for user interfaces in human-robot teams. In EMCR. Citeseer, 2007.Google ScholarGoogle Scholar
  10. T. Gal, T. Stewart, and T. Hanne. Multicriteria decision making: Advances in MCDM models, algorithms, theory, and applications, volume 21. Springer Science & Business Media, 2013.Google ScholarGoogle Scholar
  11. M. A. Goodrich and A. C. Schultz. Human-robot interaction: A survey. Foundations and trends in human-computer interaction, 1(3):203--275, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. D. S. Hall, L. G. Shattuck, and K. B. Bennett. Evaluation of an ecological interface design for military command and control. Journal of Cognitive Engineering and Decision Making, 6(2):165--193, 2012.Google ScholarGoogle ScholarCross RefCross Ref
  13. C.-L. Hwang and K. Yoon. Multiple attribute decision making: Methods and applications a state-of-the-art survey, volume 186. Springer Science & Business Media, 2012.Google ScholarGoogle Scholar
  14. M. W. Kadous, R. K.-M. Sheh, and C. Sammut. Effective user interface design for rescue robotics. In Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-robot interaction, pages 250--257. ACM, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. L. E. Kavraki, P.vSvestka, J.-C. Latombe, and M. H. Overmars. Probabilistic roadmaps for path planning in high-dimensional configuration spaces. Robotics and Automation, IEEE Transactions on, 12(4):566--580, 1996.Google ScholarGoogle Scholar
  16. S. M. LaValle. Rapidly-exploring random trees: A new tool for path planning. 1998.Google ScholarGoogle Scholar
  17. K. Liu, D. Sakamoto, M. Inami, and T. Igarashi. Roboshop: multi-layered sketching interface for robot housework assignment and management. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 647--656. ACM, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. D. Sakamoto, Y. Sugiura, M. Inami, and T. Igarashi. Graphical instruction for home robots. Computer, 49(7):20--25, 2016.Google ScholarGoogle ScholarCross RefCross Ref
  19. M. T. Shaikh, M. A. Goodrich, D. Yi, and J. Hoehne. Interactive multi-objective path planning through a palette-based user interface. In SPIE DefenseGoogle ScholarGoogle Scholar
  20. Security, pages 98370K--98370K. International Society for Optics and Photonics, 2016.Google ScholarGoogle Scholar
  21. O. M. Shir, S. Chen, D. Amid, D. Boaz, A. Anaby-Tavor, and D. Moor. Pareto optimization and tradeoff analysis applied to meta-learning of multiple simulation criteria. In Proceedings of the 2013 Winter Simulation Conference: Simulation: Making Decisions in a Complex World, pages 89--100. IEEE Press, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Y. Sugiura, D. Sakamoto, A. Withana, M. Inami, and T. Igarashi. Cooking with robots: designing a household system working in open environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 2427--2430. ACM, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. A. B. Talone, E. Phillips, S. Ososky, and F. Jentsch. An evaluation of human mental models of tactical robot movement. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, volume 59, pages 1558--1562. SAGE Publications, 2015.Google ScholarGoogle ScholarCross RefCross Ref
  24. K. J. Vicente and J. Rasmussen. Ecological interface design: Theoretical foundations. Systems, Man and Cybernetics, IEEE Transactions on, 22(4):589--606, 1992.Google ScholarGoogle Scholar
  25. J. Wallenius and S. Zionts. Multiple criteria decision making: From early history to the 21st century. World Scientific, 2011.Google ScholarGoogle Scholar
  26. D. Yi, M. A. Goodrich, and K. D. Seppi. MORRF*: Sampling-based multi-objective motion planning. In Proceedings of the 24th International Conference on Artificial Intelligence, pages 1733--1739. AAAI Press, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Design and Evaluation of Adverb Palette: A GUI for Selecting Tradeoffs in Multi-objective Optimization Problems

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        HRI '17: Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction
        March 2017
        510 pages
        ISBN:9781450343367
        DOI:10.1145/2909824

        Copyright © 2017 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 6 March 2017

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        HRI '17 Paper Acceptance Rate51of211submissions,24%Overall Acceptance Rate242of1,000submissions,24%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader