skip to main content
10.1145/3297280.3297569acmconferencesArticle/Chapter ViewAbstractPublication PagessacConference Proceedingsconference-collections
poster

Social robot navigation based on HRI non-verbal communication: a case study on avocado harvesting

Published: 08 April 2019 Publication History

Abstract

To date, robotic applications in agriculture are still a challenging topic, which has been studied mainly for large farms. However, groves in particular, require tasks, such as picking and handling, that still require human labor force. In countries such as Chile and Peru, avocado is one of the main fruit production, but its growing in complex environments, making it difficult to fully automate the harvesting process. In this scenario, human-robot interaction (HRI) strategies can provide solutions to enhance the farming process. In this work, we propose the use of a HRI strategy via three visual non-verbal communication methods, with the aim of improving the avocado harvesting process leading to possible human workload decrement. Using such HRI directives, a robot motion controller is implemented for the robotic service unit to ensure that the interaction is socially acceptable during the avocado transportation task. The robot social navigation is tested in a simulated environment where the robot interacts with field workers to test three control tasks which are approaching, following and avoiding the human.

References

[1]
George Adamides, Christos Katsanos, Ioannis Constantinou, Georgios Christou, Michalis Xenos, Thanasis Hadzilacos, and Yael Edan. 2017. Design and development of a semi-autonomous agricultural vineyard sprayer: Human-robot interaction aspects. Journal of Field Robotics 34, 8 (2017), 1407--1426.
[2]
Ron Berenstein and Yael Edan. 2012. Human-robot cooperative precision spraying: Collaboration levels and optimization function. Vol. 45. IFAC. 799--804 pages.
[3]
Kerstin Dautenhahn, Michael Walters, Sarah Woods, Kheng Lee Koay, Chrystopher L Nehaniv, A Sisbot, Rachid Alami, and Thierry Siméon. 2006. How may I serve you?: a robot companion approaching a seated person in a helping context. In Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction. ACM, 172--179.
[4]
Michael A. Goodrich and Alan C. Schultz. 2007. Human-Robot Interaction: A Survey. Foundations and Trend® in Human-Computer Interaction 1, 3 (2007), 203--275. arXiv:arXiv:1011.1669v3
[5]
Abhinav Gupta, Aniruddha Kembhavi, and Larry S Davis. 2009. Observing human-object interactions: Using spatial and functional compatibility for recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 10 (2009), 1775--1789.
[6]
Daniel Herrera, Matias Monllor, Diego Santiago, Flavio Roberti, and Ricardo Carelli. 2017. Null-space based control for human following and social field avoidance. In Information Processing and Control (RPIC), 2017 XVII Workshop on. IEEE, 1--6.
[7]
Andrew G Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017).
[8]
Jonathan Huang, Vivek Rathod, Chen Sun, Menglong Zhu, Anoop Korattikara, Alireza Fathi, Ian Fischer, Zbigniew Wojna, Yang Song, Sergio Guadarrama, et al. 2017. Speed/accuracy trade-offs for modern convolutional object detectors. In IEEE CVPR.
[9]
W Kowalczyk, M Michałek, and K Kozłowski. 2012. Trajectory tracking control with obstacle avoidance capability for unicycle-like mobile robot. Bulletin of the Polish Academy of Sciences: Technical Sciences 60, 3 (2012), 537--546.
[10]
Julio C Montesdeoca, Marcos Toibero, and Ricardo Carelli. 2017. Person-following based on social navigation into the sensorized environments. In Robotics and Biomimetics (ROBIO), 2017 IEEE International Conference on. IEEE, 799--803.
[11]
Y Oren. 2008. Performance Analysis of Human-Robot Collaboration in Target Recognition Tasks. (2008). http://www.agri.gov.il/download/files/orenyuval2008msc{_}1.pdf
[12]
J. S. Sonkusare, N. B. Chopade, R. Sor, and S. L. Tade. 2015. A Review on Hand Gesture Recognition System. In 2015 International Conference on Computing Communication Control and Automation. 790--794.
[13]
Xuan-Tung Truong, Voo Nyuk Yoong, and Trung Dung Ngo. 2014. Dynamic social zone for human safety in human-robot shared workspaces. In URAI. 391--396.
[14]
J.P. Vasconez, G. Kantor, and F. Auat Cheein. 2018. Human-Robot Interaction in Agriculture: a Survey and Current Challenges. Biosystems Engineering.
[15]
J. P. Vasconez, J. Salvo, and F. A. Cheein. 2018. Toward Semantic Action Recognition for Avocado Harvesting Process based on Single Shot MultiBox Detector. In XXIII Congress of the Chilean Association of Automatic Control (IEEE ICA-ACCA 2018).
[16]
Maryam Ziaeefar and Robert Bergevin. 2015. Semantic human activity recognition: A literature review. Pattern Recognition 48, 8 (2015), 2329--2345.

Cited By

View all
  • (2024)A Comprehensive Overview of Control Algorithms, Sensors, Actuators, and Communication Tools of Autonomous All-Terrain Vehicles in AgricultureAgriculture10.3390/agriculture1402016314:2(163)Online publication date: 23-Jan-2024
  • (2024)Robot-assisted fruit harvesting: a real-world usability study2024 IEEE 20th International Conference on Automation Science and Engineering (CASE)10.1109/CASE59546.2024.10711777(2517-2523)Online publication date: 28-Aug-2024
  • (2024)Runtime Anomaly Monitoring of Human Perception Models for Robotic Systems2024 IEEE 20th International Conference on Automation Science and Engineering (CASE)10.1109/CASE59546.2024.10711500(723-729)Online publication date: 28-Aug-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SAC '19: Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing
April 2019
2682 pages
ISBN:9781450359337
DOI:10.1145/3297280
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 April 2019

Check for updates

Author Tags

  1. avocado harvesting
  2. human-robot interaction
  3. non-verbal communication
  4. social robot navigation

Qualifiers

  • Poster

Funding Sources

Conference

SAC '19
Sponsor:

Upcoming Conference

SAC '25
The 40th ACM/SIGAPP Symposium on Applied Computing
March 31 - April 4, 2025
Catania , Italy

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)48
  • Downloads (Last 6 weeks)5
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)A Comprehensive Overview of Control Algorithms, Sensors, Actuators, and Communication Tools of Autonomous All-Terrain Vehicles in AgricultureAgriculture10.3390/agriculture1402016314:2(163)Online publication date: 23-Jan-2024
  • (2024)Robot-assisted fruit harvesting: a real-world usability study2024 IEEE 20th International Conference on Automation Science and Engineering (CASE)10.1109/CASE59546.2024.10711777(2517-2523)Online publication date: 28-Aug-2024
  • (2024)Runtime Anomaly Monitoring of Human Perception Models for Robotic Systems2024 IEEE 20th International Conference on Automation Science and Engineering (CASE)10.1109/CASE59546.2024.10711500(723-729)Online publication date: 28-Aug-2024
  • (2024)Probabilistic model-checking of collaborative robotsComputers and Electronics in Agriculture10.1016/j.compag.2024.108987222:COnline publication date: 8-Aug-2024
  • (2024)Human–Robot Collaboration in Modern Agriculture: A Review of the Current Research LandscapeAdvanced Intelligent Systems10.1002/aisy.2023008236:7Online publication date: 22-Jan-2024
  • (2023)An overview of mobile robot navigation technologySCIENTIA SINICA Informationis10.1360/SSI-2022-042053:12(2303)Online publication date: 11-Dec-2023
  • (2023)Toward More Human-Like AI Communication: A Review of Emergent Communication ResearchIEEE Access10.1109/ACCESS.2023.333965611(142317-142340)Online publication date: 2023
  • (2023)A Behavior-Based Fuzzy Control System for Mobile Robot Navigation: Design and AssessmentAdvanced Research in Technologies, Information, Innovation and Sustainability10.1007/978-3-031-48858-0_33(412-426)Online publication date: 20-Dec-2023
  • (2023)Implementation of a human‐aware robot navigation module for cooperative soft‐fruit harvesting operationsJournal of Field Robotics10.1002/rob.2222741:7(2184-2214)Online publication date: 11-Jul-2023
  • (2022)An Integrated Real-Time Hand Gesture Recognition Framework for Human–Robot Interaction in AgricultureApplied Sciences10.3390/app1216816012:16(8160)Online publication date: 15-Aug-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media