Tudor B. Ionescu
ABSTRACT
Human-machine interfaces (HMIs) of industrial machines are based on judgements and expectations of experts about how end users will configure, program, and interact with them. Diverse end users and usage contexts, however, require more flexibility of HMIs, for example, to improve labor efficiency by automating various tasks in an interactive way. Cooperator uses software robots and other user interface automation techniques to assist end users with programming, configuring, and interacting with industrial machines in a flexible and adaptive way. Cooperator enables case-by-case extensions of machine functions and interaction modes by connecting to the HMI of industrial machines and acting as a second user. This way, Cooperator empowers end users to go beyond vendor-provided features when interacting with machines. The target audience of this pattern are end users who seeks to improve their interaction experience with a broad range of industrial machines, while avoiding vendor lock-in.
- Asatiani, A., and Penttinen, E. (2016). Turning robotic process automation into commercial success case OpusCapita. Journal of Information Technology Teaching Cases, 6(2), 67-74.Google Scholar
Cross Ref
- Maltais D. (2018). Robotiq's Insights Now Provides Remote Access to the Robot Cell. Retrieved June 18, 2021 from https://blog.robotiq.com/robotiqs-insights-now-provides-remote-access-to-the-robot-cell.Google Scholar
- Ionescu, T. B., Fröhlich, J., and Lachenmayr, M. (2020). Improving safeguards and functionality in industrial collaborative robot HMIs through GUI automation. In Proceedings of the 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA). IEEE.Google ScholarCross Ref
- Huesman, J. (2016). Spaceport Command and Control System User Interface Testing. NASA USRP Report.Google Scholar
- Kasper, M., Correll, N., & Yeh, T. (2014). Abstracting perception and manipulation in end-user robot programming using Sikuli. In Proceedings of the 2014 IEEE International Conference on Technologies for Practical Robot Applications (TePRA). IEEE.Google ScholarCross Ref
- Polden, J., Pan, Z., Larkin, N., Van Duin, S., and Norrish, J. (2011). Offline programming for a complex welding system using DELMIA automation. In Robotic Welding, Intelligence and Automation (pp. 341-349). Springer, Berlin, Heidelberg.Google ScholarCross Ref
- Warner, P. C. (2015). Automatic configuration of programmable logic controller emulators. Air Force Institute of Technology, Wright-Patterson Air Force Base, Ohio.Google Scholar
- Corvin, C. M. (2015). A Feasibility Study on the Application of the ScriptGenE Framework as an Anomaly Detection System in Industrial Control Systems. Air Force Institute of Technology, Wright-Patterson Air Force Base, Ohio.Google Scholar
- Gallenstein, J. K. (2017). Integration of the Network and Application Layers of Automatically Configured Programmable Logic Controller Honeypots. Air Force Institute of Technology, Wright-Patterson Air Force Base, Ohio.Google Scholar
- Girtz, K., Mullins, B., Rice, M., and Lopez, J. (2016). Practical application layer emulation in industrial control system honeypots. In Proceedings of the International Conference on Critical Infrastructure Protection. Springer.Google ScholarCross Ref
- Ionescu, T. B., and Schlund, S. (2019). A participatory programming model for democratizing cobot technology in public and industrial fablabs. Procedia CIRP, 81(1), 93-98.Google ScholarCross Ref
- Alexander, C. (1977). A pattern language: towns, buildings, construction. Oxford University Press.Google Scholar
- Buschmann, F., Meunier, R., Rohnert, H., Sommerlad, P., and Stal, M. (2008). Pattern-Oriented Software Architecture: A System of Patterns (Vol. 1). John Wiley & Sons.Google Scholar
- Ionescu, T. B. (2021). Adaptive Simplex Architecture for Safe, Real-Time Robot Path Planning. Sensors, 21(8), 2589.Google Scholar
- Li, F., Fröhlich, J., Schall, D., Lachenmayr, M., Stückjürgen, C., Meixner, S., and Buschmann, F. (2018,). Microservice patterns for the life cycle of industrial edge software. In Proceedings of the 23rd European Conference on Pattern Languages of Programs (EuroPlop’18). ACM.Google Scholar
- Fowler, M. (2002). Patterns of Enterprise Application Architecture. Addison-Wesley Longman Publishing Co., Inc.Google ScholarDigital Library
- Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., ... and Ng, A. Y. (2009). ROS: an open-source Robot Operating System. In Proceedings of ICRA Workshop on Open-Source Software. IEEE.Google Scholar
- Iba, S., Paredis, C. J., and Khosla, P. K. (2005). Interactive multimodal robot programming. The International Journal of Robotics Research, 24(1), 83-104.Google ScholarCross Ref
- Leotta, M., Clerissi, D., Ricca, F., and Tonella, P. (2014). Visual vs. DOM-based web locators: An empirical study. In International Conference on Web Engineering. Springer.Google ScholarCross Ref
- Bibeault, B., and Kats, Y. (2008). jQuery in Action. Dreamtech Press.Google ScholarDigital Library
- Leotta, M., Clerissi, D., Ricca, F., and Spadaro, C. (2013). Improving test suites maintainability with the page object pattern: An industrial case study. In Proceedings of the 6th International Conference on Software Testing, Verification and Validation Workshops. IEEE.Google ScholarDigital Library
- Hanmer, R. (2013). Patterns for Fault-Tolerant Software. John Wiley & Sons.Google Scholar
- Schumacher, M., Fernandez-Buglioni, E., Hybertson, D., Buschmann, F., and Sommerlad, P. (2013). Security Patterns: Integrating Security and Systems Engineering. John Wiley & Sons.Google ScholarDigital Library
- Github. 2021. GitHub Copilot. Retrieved September 1, 2021 from https://copilot.github.com/.Google Scholar
Index Terms
- Cooperator: Automating Human-Machine Interfaces to Improve User Experience and Task Efficiency: Cooperator
Recommendations
Navigational techniques to improve usability and user experience in RPG games
CGAMES '12: Proceedings of the 2012 17th International Conference on Computer Games: AI, Animation, Mobile, Interactive Multimedia, Educational & Serious Games (CGAMES)This paper presents the design and implementation of a mini map navigation system into an RPG Action Adventure game created using Unity3D game engine with the goal of improving the usability and user experience. The main aim of this work is to find out ...
Evaluating the human machine interface experience in industrial workplaces
HCI '18: Proceedings of the 32nd International BCS Human Computer Interaction ConferenceThe new era of the user experience is focused on the hedonic and emotional aspects of the interaction between the user and the machine, beyond the pragmatic vision of the usability analysis. This new approach has become the main goal of many products, ...
Usability and user experience evaluation of natural user interfaces: a systematic mapping study
Natural user interface (NUI) is considered a recent topic in human–computer interaction (HCI) and provides innovative forms of interaction, which are performed through natural movements of the human body like gestures, voice, and gaze. In the software ...
Comments