Skip to main content
Log in

Semi-Markov conditional random fields for accelerometer-based activity recognition

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Activity recognition is becoming an important research area, and finding its way to many application domains ranging from daily life services to industrial zones. Sensing hardware and learning algorithms are two important components in activity recognition. For sensing devices, we prefer to use accelerometers due to low cost and low power requirement. For learning algorithms, we propose a novel implementation of the semi-Markov Conditional Random Fields (semi-CRF) introduced by Sarawagi and Cohen. Our implementation not only outperforms the original method in terms of computation complexity (at least 10 times faster in our experiments) but also is able to capture the interdependency among labels, which was not possible in the previously proposed model. Our results indicate that the proposed approach works well even for complicated activities like eating and driving a car. The average precision and recall are 88.47% and 86.68%, respectively, which are higher than results obtained by using other methods such as Hidden Markov Model (HMM) or Topic Model (TM).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bao L, Intille SS (2004) Activity recognition from user-annotated acceleration data. In: Proceedings of the 2nd international conference on pervasive computing, vol 3001, pp 1–17

  2. Blanke U, Schiele B (2009) Daily routine recognition through activity spotting. In: Proceedings of the 4th international symposium on location and context-awareness, vol 5561, pp 192–206

  3. Boyd S, Vandenberghe L (2004) Convex optimization. Cambridge University Press, Cambridge

    MATH  Google Scholar 

  4. Brdiczka O, Maisonnasse J, Reignier P, Crowley JL (2009) Detecting small group activities from multimodal observations. Appl Intell 30:47–57

    Article  Google Scholar 

  5. Doherty MK (2007) Gene prediction with conditional random fields. Master’s thesis, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology

  6. Favela J, Tentori M, Castro LA, Gonzalez VM, Moran EB, Martínez-García AI (2007) Activity recognition for context-aware hospital applications: issues and opportunities for the deployment of pervasive networks. Mob Netw Appl 12:155–171

    Article  Google Scholar 

  7. Huynh T, Blanke U, Schiele B (2007) Scalable recognition of daily activities with wearable sensors. In: Proceedings of the 3rd international symposium on location and context-awareness, vol 4718, pp 50–67

  8. Huynh T, Fritz M, Schiele B (2008) Discovery of activity patterns using topic models. In: Proceedings of the 10th international conference on ubiquitous computing, vol 344, pp 10–19

  9. Lafferty J, McCallum A, Pereira F (2001) Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the 18th international conference on machine learning, pp 282–289

  10. Lampe M, Strassner M, Fleisch E (2004) A ubiquitous computing environment for aircraft maintenance. In: Proceedings of ACM symposium on applied computing, pp 1586–1592

  11. Liao L, Choudhury T, Fox D, Kautz HA (2007) Training conditional random fields using virtual evidence boosting. In: Proceedings of the 20th international joint conference on artificial intelligence, pp 2530–2535

  12. Liao L, Fox D, Kautz HA (2007) Extracting places and activities from gps traces using hierarchical conditional random fields. Int J Rob Res 26:119–134

    Article  Google Scholar 

  13. Lukowicz P, Starner TE, Troster G, Ward JA (2006) Activity recognition of assembly tasks using body-worn microphones and accelerometers. IEEE Trans Pattern Anal Mach Intell 28:1553–1567

    Article  Google Scholar 

  14. Najafi B, Aminian K, Loew F, Blanc Y, Robert PA (2002) Measurement of stand-sit and sit-stand transitions using a miniature gyroscope and its application in fall risk evaluation in the elderly. IEEE Trans Biomed Eng 49:843–851

    Article  Google Scholar 

  15. Okanohara D, Miyao Y, Tsuruoka Y, Tsujii J (2006) Improving the scalability of semi-Markov conditional random fields for named entity recognition. In: Proceedings of the 21st international conference on computational linguistics and the 44th annual meeting of the association for computational linguistics, pp 465–472

  16. Rabiner LR (1989) A tutorial on hidden Markov models and selected applications in speech recognition. In: Proceedings of the IEEE, vol 77, pp 257–286

  17. Ravi N, Dandekar N, Mysore P, Littman ML (2005) Activity recognition from accelerometer data. In: Proceedings of the 20th national conference on artificial intelligence, vol 20, pp 1541–1546

  18. Sánchez D, Tentori M, Favela J (2008) Activity recognition for the smart hospital. IEEE Intell Syst 23:50–57

    Article  Google Scholar 

  19. Sarawagi S, Cohen W (2005) Semi-Markov conditional random fields for information extraction. In: Proceedings of the 2004 conference on neural information processing systems, pp 1185–1192

  20. Suutala J, Pirttikangas S, Röning J (2007) Discriminative temporal smoothing for activity recognition from wearable sensors. In: Proceedings of the 4th international symposium on ubiquitous computing systems, vol 4836, pp 182–195

  21. Tapia EM, Intille SS, Larson K (2004) Activity recognition in the home setting using simple and ubiquitous sensors. In: Proceedings of the 2nd international conference on pervasive computing, vol 3001, pp 158–175

  22. Truyen TT, Phung DQ, Bui HH, Venkatesh S (2009) Hierarchical semi-Markov conditional random fields for recursive sequential data. In: Proceedings of the 22nd annual conference on neural information processing systems, pp 1657–1664

  23. Vail DL, Veloso MM, Lafferty JD (2007) Conditional random fields for activity recognition. In: Proceedings of the 6th international joint conference on autonomous agents and multi-agent systems, p 235

  24. World Health Organization (2004) Global strategy on diet, physical activity and health. Technical report

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sungyoung Lee.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Vinh, L.T., Lee, S., Le, H.X. et al. Semi-Markov conditional random fields for accelerometer-based activity recognition. Appl Intell 35, 226–241 (2011). https://doi.org/10.1007/s10489-010-0216-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-010-0216-5

Keywords

Navigation