Skip to main content
SpringerLink
Log in

Autonomous robot exploration in smart environments exploiting wireless sensors and visual features

  • Published:
annals of telecommunications - annales des télécommunications Aims and scope Submit manuscript

Abstract

This paper presents a complete solution for the integration of robots and wireless sensor networks in an ambient intelligence scenario. The basic idea consists in shifting from the paradigm of a very skilled robot interacting with standard objects to a simpler robot able to communicate with smart objects, i.e., objects capable of interacting among themselves and with the robots. A smart object is a standard item equipped with a wireless sensor node (or mote) that provides sensing, communication, and computational capabilities. The mote’s memory is preloaded with object information, as name, size, and visual descriptors of the object. In this paper, we will show how the orthogonal advantages of wireless sensor network technology and of mobile robots can be synergically combined in our approach. We detail the design and the implementation of the interaction of the robot with the smart objects in the environment. Our approach encompasses three main phases: (a) discovery, the robot discovers the smart objects in the area by using wireless communication; (b) mapping, the robot moving in the environment roughly maps the objects in space using wireless communication; (c) recognition, the robot recognizes and precisely locates the smart object of interest by requiring the object to transmit its visual appearance. Hence, the robot matches this appearance with its visual perception and reach the object for fine-grain interaction. Experimental validation for each of the three phases in a real environment is presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. Some preliminary results obtained with this method were presented in [18].

  2. This value refers to the SIFT feature extraction and matching on a 1,032 × 778 image using the hardware platform described in Section 5.1.

References

  1. Lee J, Hashimoto H (2002) Intelligent space - concept and contents. Adv Robot 16(3):265–280

    Article  Google Scholar 

  2. Kim J, Kim Y, Lee K (2004) The third generation of robotics: ubiquitous robot. In: Proc of the 2nd int conf on autonomous robots and agents, Palmerston North, New Zealand

  3. Dressler F (2006) Self-organization in autonomous sensor and actuator networks. In: Proceedings of the 19th IEEE int conf on architecture of computing systems

  4. Saffiotti A, Broxvall M, Gritti M, LeBlanc K, Lundh R, Rashid J, Seo B, Cho Y (2008) The peis-ecology project: vision and results. In: IROS 2008: intelligent robots and systems. North-Holland Publishing Co., Amsterdam, The Netherlands, The Netherlands, pp 2329–2335

    Chapter  Google Scholar 

  5. Zanca G, Zorzi F, Zanella A, Zorzi M (2008) Experimental comparison of rssi-based localization algorithms for indoor wireless sensor networks. In: REALWSN ’08: proceedings of the workshop on real-world wireless sensor networks. ACM, New York, NY, USA, pp 1–5

    Chapter  Google Scholar 

  6. Viola P, Jones M (2001) Robust real-time object detection. In: Second international workshop on statistical and computational theories of vision

  7. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110

    Article  Google Scholar 

  8. Sivic J, ZA (2003) Video google: a text retrieval approach to object matching in videos. In: Proceedings of the international conference on computer vision

  9. Nister D, Stewenius H (2006) Scalable recognition with a vocabulary tree. In: Proceedings of the ieee computer society conference on computer vision and pattern recognition

  10. Philbin J, Chum O, Isard M, Sivic J, Zisserman A (2007) Object retrieval with large vocabularies and fast spatial matching. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition

  11. Meger D, Forssén P, Lai K, Helmer S, McCann S, Southey T, Baumann M, Little J, Lowe D, Dow B (2007) Curious george: an attentive semantic robot. In: IROS 2007 workshop: from sensors to human spatial concepts

  12. Pretto A, Menegatti E, Pagello E (2007) Reliable features matching for humanoid robots. In: 7th IEEE-RAS international conference on humanoid robots, 2007, pp 532–538

  13. Menegatti E, Zanella A, Zilli S, Zorzi F, Pagello E (2009) Range-only slam with a mobile robot and a wireless sensor networks. In: IEEE international conference on robotics and automation, 2009. ICRA ’09, pp 8–14

  14. Menegatti E, Danieletto M, Mina M, Pretto A, Bardella A, Zanella A, Zanuttigh P (2010) Discovery, localization and recognition of smart objects by a mobile robot. In: Simulation, modeling, and programming for autonomous robots. Lecture notes in computer science, vol 6472. Springer, Berlin, Heidelberg, pp 436–448

    Chapter  Google Scholar 

  15. Schenato L, Fiorentin F (2009) Average timesync: a consensus-based protocol for time synchronization in wireless sensor networks. In: Proceedings of 1st IFAC workshop on estimation and control of networked systems (NecSys09)

  16. Dutta P, Culler D (2008) Practical asynchronous neighbor discovery and rendezvous for mobile sensing applications. In: SenSys ’08: proceedings of the 6th ACM conference on embedded network sensor systems. ACM, New York, NY, USA, pp 71–84

    Chapter  Google Scholar 

  17. Zanella A, Menegatti E, Lazzaretto L (2007) Self localization of wireless sensor nodes by means of autonomous mobile robots. In: Proceedings of the 19th Tyrrhenian international workshop on digital communications, Ischia, Italy, 9–12 Sept 2007

  18. Menegatti E, Danieletto M, Mina M, Pretto A, Bardella A, Zanconato S, Zanuttigh P, Zanella A (2010) Autonomous discovery, localization and recognition of smart objects through wsn and image features. In: IEEE international workshop towards SmArt communications and network technologies applied on autonomous systems (SaCoNAS), Miami, USA

  19. Costa JA, Patwari N, Hero III AO (2006) Distributed weighted-multidimensional scaling for node localization in sensor networks. ACM Trans Sens Netw 2:39–64

    Article  Google Scholar 

  20. Goldsmith A (2005) Wireless communications. Cambridge University Press, New York, NY, USA

    Google Scholar 

  21. Bardella A, Bui N, Zanella A, Zorzi M (2010) An experimental study on ieee 802.15.4 multichannel transmission to improve rssi-based service performance. In: Fourth workshop on real-world wireless sensor networks (REALWSN 2010), Colombo, Sri Lanka

  22. Pretto A, Menegatti E, Bennewitz M, Burgard W, Pagello E (2009) A visual odometry framework robust to motion blur. In: IEEE international conference on robotics and automation, 2009. ICRA ’09, pp 2250–2257

  23. Hartley RI, Zisserman A (2004) Multiple view geometry in computer vision, 2nd edn. Cambridge University Press, Cambridge. ISBN: 0521540518

    Book  MATH  Google Scholar 

  24. Fischler MA, Bolles RC (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24(6):381–395

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dept. of Information Engineering, University of Padova, via Gradenigo 6/B, 35131, Padova, Italy

    Andrea Bardella, Matteo Danieletto, Emanuele Menegatti, Andrea Zanella, Alberto Pretto & Pietro Zanuttigh

Authors
  1. Andrea Bardella
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matteo Danieletto
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Emanuele Menegatti
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Andrea Zanella
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Alberto Pretto
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Pietro Zanuttigh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrea Zanella.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bardella, A., Danieletto, M., Menegatti, E. et al. Autonomous robot exploration in smart environments exploiting wireless sensors and visual features. Ann. Telecommun. 67, 297–311 (2012). https://doi.org/10.1007/s12243-012-0305-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12243-012-0305-z

Keywords

Search

Navigation