ABSTRACT
In this paper we present a novel concept for cognitive assistance and training in manual industrial assembly. In the European FP7 project COGNITO, our aim is to design a mobile, personal system, which instructs operators in task solving and tool handling. The system not only provides instructions, but it is also able to understand and induce human workflows. Due to its high sensing capabilities, the system automatically analyzes and records assembly workflows by observing advanced users to build-up a system-internal understanding of assembly processes. The captured knowledge is then used by the system to assist and train inexperienced operators. The overall approach is based on state-of-the-art techniques in motion and object tracking, task analysis, decision-making and user-adaptive visualisation by means of augmented reality. The COGNITO system is an important step towards cognitive operator support. Enterprise knowledge can be documented, shared and applied in a cooperative and interactive manner, enabling human operators to keep pace with increased complexity in industrial processes.
- Azuma, R. T. (1997). A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments, 6, 4, 355--385.Google ScholarDigital Library
- Baum, L. et al. (1970). A maximization technique occurring in the statistical analysis of probabilistic functions of markov chains. Annals of Mathematical Statistics, 41, 1, 164--171.Google ScholarCross Ref
- Herbst, J., and Karagiannis, D. (2004). Workflow mining with InWoLvE. Computers in Industry 53, 3, 245--264. Google ScholarDigital Library
- Huitt, W. (2006). The cognitive system. Educational Psychology Interactive. Valdosta, GA: Valdosta State University. Retrieved {15-April-2010}, from http://www.edpsycinteractive.org/topics/cogsys/cogsys.html.Google Scholar
- Huynh, T., and Schiele, B. (2005). Analyzing features for activity recognition. In Proc. of the joint conference on Smart objects and ambient intelligence, ACM New York, NY, USA, 159--163. Google ScholarDigital Library
- International Organization for Standardization (1996). ISO 9241: Ergonomics of Human System Interaction.Google Scholar
- Koch, I. (2010). Petri nets - a mathematical formalism to analyze chemical reaction. Molecular Informatics, 29, 12, 838--843.Google ScholarCross Ref
- Lo, B. P. L. et al. (2005). Body Sensor Network -- A Wireless Sensor Platform for Pervasive Healthcare Monitoring, Adjunct Proc. of the 3rd International conference on Pervasive Computing, 77--80.Google Scholar
- Lu, S. C.-Y. (1990). Machine learning approaches to knowledge synthesis and integration tasks for advanced engineering automation. Computers in Industry, 15, 105--120. Google ScholarDigital Library
- Lukowicz, P., et al. (2004). Recognizing workshop activity using body worn microphones and accelerometers. Pervasive Computing, 3001, 18--32.Google ScholarCross Ref
- Lyons, K. et al. (2007). GART: The gesture and activity recognition toolkit. In Proc. of the 12th International conference on Human-Computer Interaction, 718--727. Google ScholarDigital Library
- Rabiner, L., and B. Juang. (1986). An introduction to hidden markov models. ASSP Magazine, IEEE 3, 1, 4--16.Google Scholar
- Sridhar, M. et al. (2008). Learning functional object-categories from a relational spatio-temporal representation. Proc. of the 18th European Conference on Artificial Intelligence, IOS Press Amsterdam, The Netherlands, 606--610. Google ScholarDigital Library
- Ward, J. A. et al. (2006). Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28, 10, 1553--1567. Google ScholarDigital Library
- Zaeh, M. F. et al. Kognitive Assistenzsysteme in der manuellen Montage. wt Werkstattstechnik online, 97, 9.Google Scholar
- Zuehlke, D. 2008. SmartFactory - From Vision to Reality in Factory Technologies. In Proceedings of the 17th International Federation of Automatic Control (IFAC) World Congress, Seoul, South Korea, 82--89.Google ScholarCross Ref
Index Terms
- COGNITO: a cognitive assistance and training system for manual tasks in industry
Recommendations
Manual Assembly Augmented Reality Systems Implementation: A Systematic Literature Mapping
SVR '23: Proceedings of the 25th Symposium on Virtual and Augmented RealityManual assembly operations can benefit from AR-based systems but the industry seems not to follow the idea. A gap between conceptual systems and actual ones on the shop floor in the industry might exist. Recommendations and guidelines for the ...
Evaluating the effectiveness of augmented reality displays for a manual assembly task
The focus of this research was to examine how effectively augmented reality displays, generated with a wearable computer, could be used for aiding an operator performing a manual assembly task. Fifteen subjects were asked to assemble a computer ...
The cognitive systems engineering of automated medical evacuation scheduling and its implications
HICS '96: Proceedings of the 3rd Symposium on Human Interaction with Complex Systems (HICS '96)Analyzing the cognitive tasks of operators of future novel systems in order to provide design guidance represents a major challenge to cognitive systems engineering. Cognitive task analysis based on extant systems may not adequately reflect operator ...
Comments