Skip to main content
SpringerLink
Log in

Hybrid laser pointer detection algorithm based on template matching and fuzzy rule-based systems for domotic control in real home environments

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

A fundamental problem for disabled or elderly people is to manage their homes while carrying out an almost normal life, which implies using and interacting with a number of home devices. Recent studies in smart homes have proposed methods to use a laser pointer for interacting with home devices, which represents a more user-friendly and less expensive home device control environment. However, detecting the laser spot on the original non-filtered images, using standard and non-expensive cameras, and considering real home environments with varying conditions, is currently an open problem.

This paper proposes a hybrid technique, where a classic technique used in image detection processes, such as Template Matching, has been combined with a Fuzzy Rule Based System for detecting a laser spot in real home environments. The idea is to use this new approach to improve the success rate of the previous algorithms used for detecting the laser spot, decreasing as much as possible the false offs of the system, because, the detection of a false laser spot could lead to dangerous situations.

Using this new hybrid technique a better success rate has been obtained, eliminating almost completely the possibility of dangerous situations that may occur due to incorrect detection of the laser spot in real home environments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Declaration on the rights of disabled persons (1975)

  2. Aguirre E, González A (2003) A fuzzy perceptual model for ultrasound sensors applied to intelligent navigation of mobile robots. Appl Intell 19(3):171–187

    Article  Google Scholar 

  3. Ahlborn BA, Thompson D, Kreylos O, Hamann B, Staadt O (2005) A practical system for laser pointer interaction on large displays. In: VRST ’05: Proceedings of the ACM symposium on virtual reality software and technology. ACM, Monterey, CA, USA, pp 106–109

    Chapter  Google Scholar 

  4. Alcalá R, Alcalá-Fdez J, Gacto M, Herrera F (2009) Improving fuzzy logic controllers obtained by experts: a case study in HVAC systems. Appl Intell 31(1):15–30

    Article  Google Scholar 

  5. Alcalá R, Benítez JM, Casillas J, Cordón O, Pérez R (2003) Fuzzy control of HVAC systems optimized by genetic algorithms. Appl Intell 18(2):155–177

    Article  MATH  Google Scholar 

  6. Alcalá R, Casillas J, Cordón O, González A, Herrera F (2005) A genetic rule weighting and selection process for fuzzy control of heating, ventilating and air conditioning systems. Eng Appl Artif Intell 18(3):279–296

    Article  Google Scholar 

  7. Aldrich F (2003) Smart homes: past, present and future. In: Inside the Smart Home, pp 17–39

    Chapter  Google Scholar 

  8. Bardossy A, Duckstein L (1995) Fuzzy rule-based modeling with application to geophysical, biological and engineering systems. CRC Press, Boca Raton

    Google Scholar 

  9. Basicevic I, Kukolj D, Popovic M (2009) On the application of fuzzy-based flow control approach to high altitude platform communications. Appl Intell, 1–12

  10. Borkowski S, Letessier J, Crowley JL (2005) Spatial control of interactive surfaces in an augmented environment. In: Lecture notes in computer science, vol 3425. Springer, Berlin, pp 228–244

    Google Scholar 

  11. Brad AM, Rishi B, Jeffrey N, Hong PC, Dave K, Robert M, Chris LA (2002) Interacting at a distance: measuring the performance of laser pointers and other devices. In: CHI ’02: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, Minneapolis, Minnesota, USA, pp 33–40

    Google Scholar 

  12. Brown MS, Wong WKH (2003) Laser pointer interaction for camera-registered multiprojector displays. In: IEEE international conference on image processing, Barcelona, Spain, pp 913–916

    Google Scholar 

  13. Brunelli R (2009) Template matching techniques in computer vision: theory and practice. Wiley, Chichester

    Chapter  Google Scholar 

  14. Charles CK, Cressel DA, Hai N, Alexander JT, Zhe X (2008) A point-and-click interface for the real world: laser designation of objects for mobile manipulation. In: HRI ’08: Proceedings of the 3rd ACM/IEEE international conference on human robot interaction. ACM, Amsterdam, The Netherlands, pp 241–248

    Google Scholar 

  15. Chávez F, Fernández F, Olague G, Llano J (2008) An independent and non-intrusive laser pointer environment control device system. In: ICPS ’08: Proceedings of the 5th international conference on pervasive services. ACM, Sorrento, Italy, pp 37–46

    Chapter  Google Scholar 

  16. Cincotti F, Mattia D, Aloise F, Bufalari S, Schalk G, Oriolo G, Cherubini A, Marciani MG, Babiloni F (2008) Non-invasive brain-computer interface system: towards its application as assistive technology. Brain Res Bull 75(6):796–803

    Article  Google Scholar 

  17. Cordón O, Herrera F, Peregrín A (1997) Applicability of the fuzzy operators in the design of fuzzy logic controllers. Fuzzy Sets Syst 86(1):15–41

    Article  MATH  Google Scholar 

  18. Davis J, Chen X (2002) Lumipoint: multi-user laser-based interaction on large tiled displays. Displays 23(5):205–211

    Article  Google Scholar 

  19. Driankov D, Hellendoorn H, Reinfrank M (1996) An introduction to fuzzy control, 2nd edn. Springer, London

    MATH  Google Scholar 

  20. Dufour RM, Miller EL, Galatsanos NP (2002) Template matching based object recognition with unknown geometric parameters. IEEE Trans Image Process 11(12):1385–1396

    Article  MathSciNet  Google Scholar 

  21. Gacto MJ, Alcalá R, Herrera F (2010) A multi-objective evolutionary algorithm for an effective tuning of fuzzy logic controllers in heating, ventilating and air conditioning systems. Appl Intell, DOI:10.1007/s10489-010-0264-x

  22. Goossens M (1998) The EIB system for home and building electronics. The EIB handbook series. The EIB Association, Brussels

    Google Scholar 

  23. United Nations and disabled people: http://tinyurl.com/yc4nodg

  24. World Health Organization: http://tinyurl.com/ydx5fty

  25. International Electrotechnical Commission Portal: http://www.iec.ch/

  26. Jiang L, Liu D, Yang B (2005) Smart home research. Proceedings of 2004 international conference on machine learning and cybernetics, 2004, vol 2, pp 659–663

    Google Scholar 

  27. KNX Association: http://www.knx.org/

  28. Kadouchel R, Abdulrazakl B, Mokhtari M, Girouxl S, Pigot H (2009) Personalization and multi-user management in smart homes for disabled people. Int J Smart Home 3(1):39–48

    Google Scholar 

  29. Kim NW, Lee SJ, Lee BG, Lee JJ (2007) Vision based laser pointer interaction for flexible screens. In: Jacko JA (ed.) Proceedings of the 12th international conference on human-computer interaction: interaction platforms and techniques, vol 4551. Springer, Berlin pp 845–853

    Chapter  Google Scholar 

  30. Kirstein C, Mueller H (1998) Interaction with a projection screen using a camera-tracked laser pointer. In: Multi-media modeling conference international, p 191

    Google Scholar 

  31. KNX/EIB: http://www.knx.org

  32. Latoschik ME, Bomberg E (2007) Augmenting a laser pointer with a diffraction grating for monoscopic 6dof detection. J Virtual Real Broadcast 4(14)

  33. Mamdani EH (1974) Application of fuzzy algorithms for control of simple dynamic plant. Proc Inst Electr Eng 121(12):1585–1588

    Article  Google Scholar 

  34. Mamdani EH, Assilian S (1975) An experiment in linguistic synthesis with a fuzzy logic controller. Int J Man-Mach Stud 7(1):1–13

    Article  MATH  Google Scholar 

  35. Marie C, Daniel E, Christophe E, Eric C (2008) A review of smart homes-present state and future challenges. Comput Methods Programs Biomed 91(1):55–81

    Article  Google Scholar 

  36. Matveyev S, Göbel M (2003) Direct interaction based on a two-point laser pointer technique. In: Rockwood AP (ed.) International conference on computer graphics and interactive techniques. ACM New York, NY, USA, San Diego, California, p 1

    Google Scholar 

  37. Oh JY, Stuerzlinger W (2002) Laser pointers as collaborative pointing devices. In: Proceedings graphics interface, Calgary, Alberta, pp 141–150

    Google Scholar 

  38. Olague G, Fernández F, Pérez C, Lutton E (2006) The infection algorithm: an artificial epidemic approach for dense stereo correspondence. Artif Life 12(4):593–615

    Article  Google Scholar 

  39. Olsen J, Dan R, Travis N (2001) Laser pointer interaction. In: CHI ’01: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, Seattle, Washington, United States, pp 17–22

    Chapter  Google Scholar 

  40. Orpwood R, Gibbs C, Adlam T, Faulkner R, Meegahawatte D (2005) The design of smart homes for people with dementia—user-interface aspects. Univers Access Inf Soc 4(2):156–164

    Article  Google Scholar 

  41. Park J, Hsu C, Arabnia H (2009) Intelligent systems and smart homes. Inf Syst Front 11(5):481–482

    Article  Google Scholar 

  42. Park KH, Bien Z, Lee JJ, Kim BK, Lim JT, Kim JO, Lee H, Stefanov DH, Kim DJ, Jung JW, Do JH, Seo KH, Kim CH, Song WG, Lee WJ (2007) Robotic smart house to assist people with movement disabilities. Auton Robots 22(2):183–198

    Article  Google Scholar 

  43. Portal W3J: http://www.w3j.com/

  44. Pratt WK (2001) Digital image processing. Wiley, Chichester

    Book  Google Scholar 

  45. Rialle V, Duchene F, Noury N, Bajolle L, Demongeot J (2002) Health “smart” home: information technology for patients at home. Telemed J and e-Health 8(4):395–409

    Article  Google Scholar 

  46. Shizuki B, Hisamatsu T, Takahashi S, Tanaka J (2006) Laser pointer interaction techniques using peripheral areas of screens. In: Celentano A (ed.) Proceedings of the working conference on advanced visual interfaces. ACM, New York, USA, Venezia, Italy, pp 95–98

    Chapter  Google Scholar 

  47. Wang LX (1994) Adaptive fuzzy systems and control. Design and stability analysis. Prentice Hall, New York

    Google Scholar 

  48. Werntges HW, Neumann J, Vinarski V (2005) Controlling EIB/KNX devices from Linux using USB. In: Tagungsband Konnex scientific conference, p 1

    Google Scholar 

  49. Wilson E, Karr C, Bennett J (2004) An adaptive, intelligent control system for slag foaming. Appl Intell 20(2):165–177

    Article  MATH  Google Scholar 

  50. Xiaojun B, Yuanchun S, Xiaojie C (2006) Upen: a smart pen-liked device for facilitating interaction on large displays. In: TABLETOP ’06: Proceedings of the first IEEE international workshop on horizontal interactive human-computer systems. IEEE Computer Society, Adelaide, pp 160–168.

    Chapter  Google Scholar 

  51. Zadeh LA (1973) Outline of a new approach to the analysis of complex systems and decision processes. IEEE Trans Syst Man Cybern SMC-3:28–44

    Article  MathSciNet  Google Scholar 

  52. Zadeh LA (2008) Is there a need for fuzzy logic? Inf Sci 178:2751–2779

    Article  MathSciNet  MATH  Google Scholar 

  53. Zhang L, Shi Y, Chen J (2006) Drag and drop by laser pointer: seamless interaction with multiple large displays. In: Lecture notes in computer science, vol 4159. Springer, Berlin, pp 12–20

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Extremadura, 06800, Mérida, Spain

    F. Chávez & F. Fernández

  2. Department of Computer Science and Artificial Intelligence, Research Center on Information and Communications Technology, University of Granada, 18071, Granada, Spain

    R. Alcalá, J. Alcalá-Fdez & F. Herrera

  3. Department of Computer Science, CICESE Research Center, P.O. Box 434944, San Diego, CA, 92143-4944, USA

    G. Olague

Authors
  1. F. Chávez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. F. Fernández
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. R. Alcalá
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. J. Alcalá-Fdez
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. G. Olague
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. F. Herrera
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to F. Chávez.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chávez, F., Fernández, F., Alcalá, R. et al. Hybrid laser pointer detection algorithm based on template matching and fuzzy rule-based systems for domotic control in real home environments. Appl Intell 36, 407–423 (2012). https://doi.org/10.1007/s10489-010-0268-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-010-0268-6

Keywords

Search

Navigation