Skip to main content

An Intuitive Interaction System Using Laser Spot for Daily Household Tasks Operation Autonomous

  • Conference paper
  • First Online:
  • 2900 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13015))

Abstract

The Wheelchair Mounted Robotic Arm (WMRA) can help the elderly and handicapped to complete some household tasks independently, while due to the mobility of these people are limited, they cannot complete household tasks easily through the interactions that need frequent operations such as using handles. If the tasks are completed automatically and users only need to send commands by gestures or EEG. The user will lose involvement and adaptability to the environment. In this paper, we propose a method named laser intuitive interaction, it can analyze the user’s intention by identifying the semantic information of the laser and assemble actions to complete unstructured tasks. Firstly, the household tasks are summarized base on the International Classification of Functionality, Disability and Health (ICF) and the laser semantics are designed according to the daily household tasks; Secondly, the method of laser semantic detection base on SVM is discussed; Finally, the information of the laser semantic and the action of the robotic arm are integrated into the ROS. The results of the experiment on daily household tasks show that the accuracy of laser semantic detection is above 92%, the number and time of laser interaction are 33% and 75% of the handle interaction.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Graser, A., Heyer, T., Fotoohi, L.: A supportive friend at work: robotic workplace assistance for the disabled. Robot. Autom. Mag. 20(4), 148–159 (2013)

    Article  Google Scholar 

  2. Bien, Z., Chung, M.J., Chang, P.H.: Integration of a rehabilitation robotic system (KARES II) with human-friendly man-machine interaction units. Auton. Robot. 16(2), 165–191 (2004)

    Article  Google Scholar 

  3. Quintero, C.P., Ramirez, O., Jägersand, M.: VIBI: assistive vision-based interface for robot manipulation. In: Proceedings IEEE International Conference on Robotics & Automation, pp. 4458–4463. IEEE, Seattle (2015)

    Google Scholar 

  4. Jiang, H., Wachs, J.P., Duerstock, B.S.: Integrated vision-based robotic arm interface for operators with upper limb mobility impairments. In: IEEE International Conference on Rehabilitation Robotics, pp.1–6. IEEE, Seattle (2013)

    Google Scholar 

  5. Philipp, B., Gionata, S., Ramazan, U.: A human-robot interaction perspective on assistive and rehabilitation robotics. Front. Neurorobot. 11, 24 (2017)

    Article  Google Scholar 

  6. Minato, Y., Tsujimura, T., Izumi, K.: Sign-at-ease: Robot navigation system operated by connoted shapes drawn with laser beam. In: SICE Annual Conference 2011, pp. 2158–2163. IEEE, Tokyo (2011)

    Google Scholar 

  7. Fukuda, Y., Kurihara, Y., Kobayashi, K.: Development of electric wheelchair interface based on laser pointer. In: 2009 ICCAS-SICE, pp. 1148–1151. IEEE, Fukuoka (2009)

    Google Scholar 

  8. Kemp, C.C., Anderson, C.D., Nguyen, H.: A point-and-click interface for the real world: Laser designation of objects for mobile manipulation. In: Amsterdam: Human-Robot Interaction (HRI), pp.241–248. IEEE, Amsterdam (2008)

    Google Scholar 

  9. Hai, N., Jain, A., Anderson, C.: A clickable world: behavior selection through pointing and context for mobile manipulation. In: 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 787–793. IEEE, Nice (2008)

    Google Scholar 

  10. Liu, G.G., Fan, B.H., Wang, C.J.: Application of binocular vision in positioning system of senior and disable people aid’s manipulator. Microcomput. Appl. 035(013), 45–47,50 (2016)

    Google Scholar 

  11. Chavez, F., Alcala, R.: Evolutionary learning of a laser pointer detection fuzzy system for an environment control system. In: 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011), pp. 256–263. IEEE, Taipei (2011)

    Google Scholar 

  12. Sprute, D., Tnnies, K.D., Koenig, M.: This far, no further: introducing virtual borders to mobile robots using a laser pointer. In: 2019 Third IEEE International Conference on Robotic Computing (IRC), pp. 403–408. IEEE, Naples (2019)

    Google Scholar 

Download references

Acknowledgment

This work is supported by the National Key R&D Program of China (Grant No. 2018YFB1309400), the Key R&D Program of Shandong Province (Grant No. 2016GGX101013), and the University Common Construction Project of Weihai (Grant No. 2016DXGJMS04).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ming Zhong .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liu, Y., Li, S., Zhang, W., Liu, Y., Zhong, M. (2021). An Intuitive Interaction System Using Laser Spot for Daily Household Tasks Operation Autonomous. In: Liu, XJ., Nie, Z., Yu, J., Xie, F., Song, R. (eds) Intelligent Robotics and Applications. ICIRA 2021. Lecture Notes in Computer Science(), vol 13015. Springer, Cham. https://doi.org/10.1007/978-3-030-89134-3_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-89134-3_25

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-89133-6

  • Online ISBN: 978-3-030-89134-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics