Skip to main content
SpringerLink
Log in

OKRELM: online kernelized and regularized extreme learning machine for wearable-based activity recognition

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Miscellaneous mini-wearable devices (Jawbone Up, Apple Watch, Google Glass, et al.) have emerged in recent years to recognize the user’s activities of daily living (ADLs) such as walking, running, climbing and bicycling. To better suits a target user, a generic activity recognition (AR) model inside the wearable devices requires to adapt itself according to the user’s personality in terms of wearing styles and so on. In this paper, an online kernelized and regularized extreme learning machine (OKRELM) is proposed for wearable-based activity recognition. A small-scale but important subset of every incoming data chunk is chosen to go through the update stage during the online sequential learning. Therefore, OKRELM is a lightweight incremental learning model with less time consumption during the update and prediction phase, a robust and effective classifier compared with the batch learning scheme. The performance of OKRELM is evaluated and compared with several related approaches on a UCI online available AR dataset and experimental results show the efficiency and effectiveness of OKRELM.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Chen Z, Chen Y, Hu L et al (2014) ContextSense: unobtrusive discovery of incremental social context using dynamic Bluetooth data[C]// International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication. ACM, 23–26

  2. Hu L, Chen Y, Wang S et al (2013) A nonintrusive and single-point infrastructure-mediated sensing approach for water-use activity recognition[C]//International Conference on embedded and ubiquitous computing (EUC). IEEE, 2120–2126

  3. Wang S, Zhou G, Hu L et al (2015) CARE: chewing activity recognition using noninvasive single axis accelerometer[C]// International Joint Conference on pervasive and ubiquitous computing: Adjunct Publication. ACM, 109–112

  4. Chen YQ, Yu HC, Miao CY et al (2015) Using motor patterns for stroke detection[J]. Science (Advances in Computational Psychophysiology) 350(6256):12–14

    Google Scholar 

  5. Wang R, Chen F, Chen Z et al (2014) StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones[C]// International Joint Conference on pervasive and ubiquitous computing. ACM, 3–14

  6. https://getpebble.com/steel . Accessed 2 June 2014

  7. https://jawbone.com/up. Accessed 2 June 2014

  8. http://www.bodymedia.com/Support-Help/BodyMedia-FIT-BW. Accessed 2 June 2014

  9. Zhao Q, Hu B, Shi Y et al (2014) Automatic identification and removal of ocular artifacts in EEG—improved adaptive predictor filtering for portable applications[J]. IEEE Trans NanobioScience 13(2):109–117

    Article  Google Scholar 

  10. Hu B, Majoe D, Ratcliffe M et al (2011) EEG-based cognitive interfaces for ubiquitous applications: developments and challenges[J]. IEEE Intell Syst 26(5):46–53

    Article  Google Scholar 

  11. Bao L, Intille SS (2004) Activity recognition from user-annotated acceleration data[C]//International Conference on pervasive computing. Springer, Berlin Heidelberg, 1–17

  12. Berlin E, Van Laerhoven K (2012) Detecting leisure activities with dense motif discovery[C]//International Conference on ubiquitous computing. ACM, 250–259

  13. Hu L (2014) A lightweight and low-power activity recognition system for mini-wearable devices[C]//International Conference on pervasive computing and communications Workshops (PERCOM Workshops). IEEE, 166–167

  14. Pärkkä J, Cluitmans L, Ermes M (2010) Personalization algorithm for real-time activity recognition using PDA, wireless motion bands, and binary decision tree[J]. IEEE Trans Inf Technol Biomed 14(5):1211–1215

    Article  Google Scholar 

  15. Qian H, Mao Y, Xiang W et al (2010) Recognition of human activities using SVM multi-class classifier[J]. Pattern Recognit Lett 31(2):100–111

    Article  Google Scholar 

  16. Hu L, Lu S, Wang X (2013) A new and informative active learning approach for support vector machine[J]. Inf Sci 244:142–160

    Article  MathSciNet  MATH  Google Scholar 

  17. Hu L, Chen Y, Wang S et al (2014) b-COELM: A fast, lightweight and accurate activity recognition model for mini-wearable devices[J]. Pervasive Mob Comput 15:200–214

    Article  Google Scholar 

  18. Zeng Z, Ji Q (2010) Knowledge based activity recognition with dynamic Bayesian network[C]//European Conference on computer vision. Springer Berlin Heidelberg, 532–546

  19. Gaikwad K (2012) HMM classifier for human activity recognition[J]. Comput Sci Eng 2(4):27

    Google Scholar 

  20. Song Y, Lu Z, Leung CW et al (2013) Collaborative boosting for activity classification in microblogs[C]// International Conference on knowledge discovery and data mining. ACM, 482–490

  21. Gu B, Sheng VS (2016) A robust regularization path algorithm for ν-support vector classification. IEEE Trans Neural Netw Learn Syst 99. doi:10.1109/TNNLS.2016.2527796

  22. Gu B, Sun X, Sheng VS (2016) Structural minimax probability machine[J].IEEE Trans Neural Netw Learn Syst 99. doi:10.1109/TNNLS.2016.2544779

  23. Gu B, Sheng VS, Wang Z et al (2015) Incremental learning for ν-support vector regression[J]. Neural Netw 67:140–150

    Article  Google Scholar 

  24. Gu B, Sheng VS, Tay KY et al (2015) Incremental support vector learning for ordinal regression[J]. IEEE Trans Neural Netw Learn Syst 26(7):1403–1416

    Article  MathSciNet  Google Scholar 

  25. Gu B, Sheng V S, Li S (2015) Bi-parameter space partition for cost-sensitive SVM[C]//IJCAI 3532–3539.

  26. Zhang Y, Sun X, Wang B (2016) Efficient algorithm for k-barrier coverage based on integer linear programming[J]. China Commun 13(7):16–23

    Article  Google Scholar 

  27. Wen X, Shao L, Xue Y et al (2015) A rapid learning algorithm for vehicle classification[J]. Inf Sci 295:395–406

    Article  Google Scholar 

  28. Kong Y, Zhang M, Ye D (2017) A belief propagation-based method for task allocation in open and dynamic cloud environments[J]. Knowl Based Syst 115:123–132

    Article  Google Scholar 

  29. Zheng Y, Jeon B, Xu D et al (2015) Image segmentation by generalized hierarchical fuzzy C-means algorithm[J]. J Intell Fuzzy Syst 28(2):961–973

    Google Scholar 

  30. Fu Z, Wu X, Guan C et al (2016) Toward efficient multi-keyword fuzzy search over encrypted outsourced data with accuracy improvement[J]. IEEE Trans Inf Forensics Secur 11(12):2706–2716

    Article  Google Scholar 

  31. Gao X, Hoi S C H, Zhang Y et al (2014) SOML: sparse online metric learning with application to image retrieval. In: Twenty-eighth AAAI conference on artificial intelligence. AAAI Publications

  32. Chen Z, Chen Y, Gao X et al (2015) Unobtrusive sensing incremental social contexts using fuzzy class incremental learning[C]// International Conference on data mining (ICDM). IEEE, 71–80

  33. Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications[J]. Neurocomputing 70(1):489–501

    Article  Google Scholar 

  34. Huang GB, Zhu QY, Siew CK (2004) Extreme learning machine: a new learning scheme of feedforward neural networks[C]// International Joint Conference on Neural Networks. IEEE 2:985–990

    Google Scholar 

  35. Huang GB, Chen L, Siew CK (2006) Universal approximation using incremental constructive feedforward networks with random hidden nodes[J]. IEEE Trans Neural Networks 17(4):879–892

    Article  Google Scholar 

  36. Schmidt WF, Kraaijveld MA, Duin R P W (1992) Feedforward neural networks with random weights[C]// International Conference on Pattern Recognition. IEEE, 1–4

  37. Huang G, Huang GB, Song S et al (2015) Trends in extreme learning machines: a review[J]. Neural Netw 61:32–48

    Article  MATH  Google Scholar 

  38. Huang GB, Zhou H, Ding X et al (2012) Extreme learning machine for regression and multiclass classification[J]. IEEE Trans Syst Man Cybern Part B (Cybernetics) 42(2):513–529

    Article  Google Scholar 

  39. An S, Liu W, Venkatesh S (2007) Face recognition using kernel ridge regression[C]//International Conference on Computer Vision and Pattern Recognition. IEEE, 1–7

  40. Saunders C, Gammerman A, Vovk V (1998) Ridge regression learning algorithm in dual variables[C]//ICML 98:515–521

  41. Liu H, Qin J, Sun F et al (2016) Extreme kernel sparse learning for tactile object recognition[J]. IEEE Trans Cybern 99. doi:10.1109/TCYB.2016.2614809

  42. Hu L, Chen Y, Wang S et al (2016) Less Annotation on Personalized Activity Recognition Using Context Data[C]//International Conference on Ubiquitous Intelligence and Computing(UIC) 327–332.

  43. Liu H, Liu Y, Sun F (2015) Robust exemplar extraction using structured sparse coding[J]. IEEE Trans Neural Netw Learn Syst 26(8):1816–1821

    Article  MathSciNet  Google Scholar 

  44. Liu H, Guo D, Sun F (2016) Object recognition using tactile measurements: kernel sparse coding methods[J]. IEEE Trans Instrum Meas 65(3):656–665

    Article  Google Scholar 

  45. Liu H, Yu Y, Sun F et al (2016) Visual-tactile fusion for object recognition[J]. IEEE Trans Autom Sci Eng

  46. Liang NY, Huang GB, Saratchandran P et al (2006) A fast and accurate online sequential learning algorithm for feedforward networks[J]. IEEE Trans Neural Netw 17(6):1411–1423

    Article  Google Scholar 

  47. Wang X, Han M (2014) Online sequential extreme learning machine with kernels for nonstationary time series prediction[J]. Neurocomputing 145:90–97

    Article  Google Scholar 

  48. Zhou X, Liu Z, Zhu C (2014) Online regularized and kernelized extreme learning machines with forgetting mechanism[J]. Math Probl Eng 2014:938548. doi:10.1155/2014/938548

  49. Zhou XR, Wang CS (2016) Cholesky factorization based online regularized and kernelized extreme learning machines with forgetting mechanism[J]. Neurocomputing 174:1147–1155

    Article  Google Scholar 

  50. Scardapane S, Comminiello D, Scarpiniti M et al (2015) Online sequential extreme learning machine with kernels[J]. IEEE Trans Neural Netw Learn Syst 26(9):2214–2220

    Article  MathSciNet  Google Scholar 

  51. Deng WY, Zheng QH, Wang ZM (2014) Cross-person activity recognition using reduced kernel extreme learning machine[J]. Neural Netw 53:1–7

    Article  Google Scholar 

  52. Guo L, Hao JH, Liu M (2014) An incremental extreme learning machine for online sequential learning problems[J]. Neurocomputing 128:50–58

    Article  Google Scholar 

  53. Hager WW (1989) Updating the inverse of a matrix[J]. SIAM Rev 31(2):221–239

    Article  MathSciNet  MATH  Google Scholar 

  54. Henderson HV, Searle SR (1981) On deriving the inverse of a sum of matrices[J]. SIAM Rev 23(1):53–60

    Article  MathSciNet  MATH  Google Scholar 

  55. Barshan B, Yüksek MC (2014) Recognizing daily and sports activities in two open source machine learning environments using body-worn sensor units[J]. Comput J 57(11):1649–1667

    Article  Google Scholar 

  56. Altun K, Barshan B (2010) Human activity recognition using inertial/magnetic sensor units[C]//International Workshop on Human Behavior Understanding. Springer Berlin Heidelberg, 38–51

Download references

Acknowledgements

The authors are much grateful to Prof. Xingyu Gao from Institute of Software Chinese Academy of Sciences for his constructive comments and suggestions that have helped to improve the quality of this paper. This work is supported by Natural Science Foundation of China under Grant Nos. 61572471 and 61210010, Chinese Academy of Sciences Research Equipment Development Project under Grant No. YZ201527 and Science and Technology Planning Project of Guangdong Province under Grant No. 2015B010105001.

Author information

Authors and Affiliations

  1. Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China

    Lisha Hu, Yiqiang Chen, Jindong Wang, Chunyu Hu & Xinlong Jiang

  2. Beijing Key Laboratory of Mobile Computing and Pervasive Device, Beijing, China

    Lisha Hu, Yiqiang Chen, Jindong Wang, Chunyu Hu & Xinlong Jiang

  3. University of Chinese Academy of Sciences, Beijing, China

    Lisha Hu, Yiqiang Chen, Jindong Wang, Chunyu Hu & Xinlong Jiang

Authors
  1. Lisha Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yiqiang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jindong Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chunyu Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xinlong Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yiqiang Chen.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hu, L., Chen, Y., Wang, J. et al. OKRELM: online kernelized and regularized extreme learning machine for wearable-based activity recognition. Int. J. Mach. Learn. & Cyber. 9, 1577–1590 (2018). https://doi.org/10.1007/s13042-017-0666-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-017-0666-8

Keywords

Search

Navigation