Shape recognition of laser beam trace for human–robot interface
Introduction
Robots are expected to be introduced not only in factories but also at home. Welfare robots are especially required to be navigated easily and simply by unskilled operators. Considering the use of the aged or injured persons in the hospital, robots are needed to be controlled for themselves while they are taken to their bed. It is desirable to use simple equipment for easy operation in robot navigation. Innumerable methods are reported to navigate robots by means of joy sticks (Honga et al., 1998, Zhu et al., 2011), vocal guidance (Buddhika et al., 2010), and so on (Mikawa et al., 2010, Karkoub et al., 2012, Lapointe and Savard, 2011).
Laser pointer is one of the simplest ways to provide visual instruction (Yamazaki et al., 2002, Oyama et al., 2000, Shibata et al., 2011, Seko et al., 2006). It is not as contrived as joysticks. Its operation is less complicated than vocal guidance. The robot operating methods using laser beam have been proposed in previous studies as intuitive device (Suzuki, 2005, Stopp et al., 2002). They used the laser spot to give orders to mobile robots because one can indicate the arbitrary point from away. A laser pointer has been used only to designate the robot destination in previous studies (Fukuda et al., 2009, Ishii et al., 2009, Kurata et al., 2004, Paromtchik and Asama, 2001, Baczynski and Baczynski, 2004, Iwasaki et al., 2006). Other devices are additionally required to give more complicated commands to robots (Kemp et al., 2008, Choi et al., 2008). The sole report is on the blinking pattern of laser luminescence which adds the supplementary instruction way to a laser targetting system (Mizukawa et al., 2003).
The authors have proposed the navigation system which instructs not only the robot destination but also more complicated command using laser luminescent trace (Minato et al., 2011). When a user draws a figure on a wall or on a floor with a laser pointer, the system identifies its shape and directs a robot to act the intended behavior corresponding to the drawn figure. The image of the figure is acquired by CCD camera, and the figure’s edges are extracted as optical flows by image processing. We proposed the method which detects the figure’s characteristic distribution pattern of optical flow inclinations to classify several kinds of figures.
This paper presents the application of robot operating method using the identification of shape drawn by a laser pointer. The concept of robot navigation system is proposed first, while three typical figures are assumed in this study. Identification method of laser trail is investigated by presenting the pre-processing technique for laser beam spot, by analyzing the geometrical features of the laser trail figures, and by determining the criteria of figure identification. It has been confirmed that a number of laser trail figures can be classified based on the criteria. Finally, we design the shape identification algorithm, construct the prototype system, and evaluate it by applying to the mobile robot navigation to give robot commands by laser drawing.
Section snippets
Concept of robot navigation systems
The conceptual diagram of proposed system is shown in Fig. 1(a). When making a mobile robot approach its target, an operator indicates the target by flashing a laser beam to it. Minuter or complicated instruction is given by laser trail figures to employ the robot for intricate tasks This system acquires motion of the laser spot by a CCD camera, obtains geometric features by calculating optical flows, identifies its shape and gives a robot the command corresponding to the drawn figure. Simple
Optical flow of laser spot trace
When a 650 nm laser beam has been shot on the indoor white wall, a luminescent spot is appeared on the surface. Fig. 2(a) indicates an image taken by a CCD camera. Day light or reflection from walls often prevents CCD cameras from detecting the spot. As we use a red laser beam, extraction of the red component helps the spot to stand out against the background. The RGB color space has been evaluated to extract the red elements, and the camera image has been digitally processed. Both the image
Mobile robot navigation
A mobile robot navigation system has been constructed by applying the laser trace shape identification. Based on the above discussion, an algorithm of robot navigation is designed as shown in Fig. 5. Human operators give commands by drawing figures on the wall. Each figure connoted a specified robot motion. The robot is navigated with a laser pointer when the system distinguishes the drawn shape among candidate ones.
Discussions
This paper deals with only three simple figures to show the typical example of shape identification. The same principle can be applied to intricate figures with discretion. The proposed method evaluates only the histogram of the vector incidence. It pays no attention to the order or the origin of stroke. Therefore, it is impossible to classify different figures that consist of the same types of vectors, e. g., a triangle and a hexagon. The identification algorithm needs to evaluate the order
Conclusion
This paper has studied the shape recognition method of the laser beam trace and its application for navigation of the mobile robots controlled by unskilled operators. The concept of geometric feature extraction of laser beam trace figure has been proposed first to apply to figure identification. Edges of figures are focused on instead of the corners.
Next, we have formulized and constructed image processing techniques such as image denoising and optical flow extraction. These methods are applied
References (28)
- et al.
Artificial force reflection control for teleoperated mobile robots
Mechatronics
(1998) - et al.
Moving to the centre: a gaze-driven remote camera control for teleoperation
Interact. Comput.
(2011) - et al.
Design of a wireless remote monitoring and object tracking robot
Robo. Auton. Syst.
(2012) - et al.
A comparative study of four input devices for desktop virtual walkthroughs
Comput. Hum. Behav.
(2011) - et al.
Adaptation of robot’s perception of fuzzy linguistic information by evaluating vocal cues for controlling a robot manipulator
Artif. Life Robot.
(2010) - Mikawa, M., Morimoto, Y., Tanaka, K., 2010. Guidance method using laser pointer and gestures for librarian robot. In:...
- Yamazaki, K., Yamazaki, A., Kuzuoka, H., Oyama, S., Kato, H., Suzuki, H., Miki, H., 2002. GestureLaser and GestureLaser...
- Oyama, S., Kuzuoka, H., Yamazaki, K., Mitsuishi, M., Suzuki, K., 2000. Development of a mobile robot which embodies a...
- Shibata, S., Yamamoto, T., Jindai, M., 2011. Human-robot interface with instruction of neck movement using laser...
- Seko, Y., Yamaguchi, Y., Saguchi, Y., Miyazaki, J., Koshimizu, H., 2006. Proposal of recordable pointer: pointed...
Cited by (3)
Real-time laser spot detection and tracking system based on parallel multi-target detection and determination algorithm
2023, Review of Scientific InstrumentsLaser spot tracking based on modified circular hough transform and motion pattern analysis
2014, Sensors (Switzerland)Adaptable center detection of a laser line with a normalization approach using Hessian-matrix eigenvalues
2014, Journal of the Optical Society of Korea