Skip to main content
SpringerLink
Log in

Personal search system based on android using lifelog and machine learning

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

Lifelog is the foundation on which lifelong services and healthcare services are implemented in a smart home system. It also plays a major role in the sub-processes of the system because it acquires information about the home’s residents for home automation and entertainment. Providing personalized services to individuals by acquiring and managing this personal lifelog information has great advantages in terms of service satisfaction and effectiveness. In this paper, we implemented a personal search system based on android that collected and stored an individual’s lifelog based on nine smart phone sensors and used it to derive new meaningful information about the user. The activity recognition module for classifying the user’s behavior, the naive Bayesian method, showed an accuracy of 88.23% and the area under the ROC curve value of 0.941. We designed and implemented density-based spatial clustering method in the module for extracting the point of interest and the participants filled out a satisfaction questionnaire to evaluate the search system. The proposed system efficiently uses a large amount of lifelog data and automates the process of extracting meaningful information, associating it according to the user’s intention.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

References

  1. The Nielsen Koreanclick (2017) 41st Population Estimation Survey Report. 2017.01. http://www.koreanclick.com/insights/newsletter_view.html?code=topic&id=433&page=1

  2. Nejati H, Pomponiu V, Do TT ZY, Iravani S, Cheung NM (2016) Smartphone and mobile image processing for assisted living: health-monitoring apps powered by advanced mobile imaging algorithms. IEEE Signal Process Mag 33(4):30–48

    Article  Google Scholar 

  3. Mafrur R, Nugraha IGD, Choi D (2015) Modeling and discovering human behavior from smartphone sensing life-log data for identification purpose. Hum Centric Comput Inform Sci 5(1):1–18

    Article  Google Scholar 

  4. Ogata H, Hou B, Li M, Uosaki N, Mouri K, Liu S (2014) Ubiquitous learning project using life-logging technology in Japan. Educ Technol Soc J 17(2):85–100

    Google Scholar 

  5. Gemmell J, Bell G, Lueder R (2006) MyLifeBits: a personal database for everything. Commun ACM 49(1):88–95

    Article  Google Scholar 

  6. Hodges S, Berry E, Wood K (2011) SenseCam: a wearable camera that stimulates and rehabilitates autobiographical memory. Memory 19(7):685–696

    Article  Google Scholar 

  7. Doherty A, Caprani N, Óconaire C, Kalnikaite V, Gurrin C, Smeaton AF, O’Connor NE (2011) Passively recognizing human activities through lifelogging. Comput Hum Behav 27(5):1948–1958

    Article  Google Scholar 

  8. Francese R, Risi M, Scanniello G, Tortora G (2016) Lifebook: a mobile personal information management system on the cloud. Proceedings of the International Working Conference on Advanced Visual Interfaces, pp 184–191

  9. Tang D, Botzheim J, Kubota N (2015) Informationally structured pace for life log monitoring in elderly care. In: Systems, Man, and Cybernetics (SMC), 2015 I.E. International Conference on. IEEE, pp 1421–1426

  10. Shah M, Mears B, Chakrabarti C, Spanias A (2012) Lifelogging: archival and retrieval of continuously recorded audio using wearable devices. IEEE International Conference on Emerging Signal Processing Applications, pp 99–102

  11. Jalal A, Kamal S (2014) Real-time life logging via a depth silhouette-based human activity recognition system for smart home services. In: Advanced Video and Signal Based Surveillance (AVSS), 2014 11th IEEE International Conference on, pp 74–80

  12. Tsai MJ, Wu CL, Pradhan SK, Xie Y, Li TY, Fu LC, Zeng YC (2016) Context-aware activity prediction using human behavior pattern in real smart home environments. In: Automation Science and Engineering (CASE), 2016 I.E. International Conference on, pp 168–173

  13. Hamm J, Stone B, Belkin M, Dennis S (2013) Automatic annotation of daily activity from smartphone-based multisensory streams. In: Uhler D, Mehta K, Wong JL (eds) MobiCASE 2012. LNICST 110:328–342

  14. Semantic Web. https://www.w3.org/standards/semanticweb/

  15. Maedche A, Maedche S (2001) Ontology learning for the Semantic Web. IEEE Intell Syst 16(2):72–79

    Article  MATH  Google Scholar 

  16. Heflin J, Hendler JA, Luke S (2003) SHOE: a blueprint for the Semantic Web. MIT Press, Cambridge, pp 29–63

    Google Scholar 

  17. Hu C, Xu Z, Liu Y, Mei L, Chen L (2014) Xiangfeng Luo Semantic link network-based model for organizing multimedia big data. IEEE Trans Emerg Top Comput 2(3):376–387

    Article  Google Scholar 

  18. Berners-Lee T, Hendler J, Lassila O (2001) The Semantic Web. Sci Am 284(5):28–37

    Article  Google Scholar 

  19. Shadbolt N, Hall W, Berners-Lee T (2006) The Semantic Web revisited. IEEE Intell Syst 21(3):96–101

    Article  Google Scholar 

Download references

Funding

This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2015R1D1A1A01059253).

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Sejong University, 98 Gunja-Dong, Gwangjin-Gu, Seoul, 143–747, South Korea

    Yunjin Nam, Dongkyoo Shin & Dongil Shin

Authors
  1. Yunjin Nam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dongkyoo Shin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dongil Shin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dongkyoo Shin.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nam, Y., Shin, D. & Shin, D. Personal search system based on android using lifelog and machine learning. Pers Ubiquit Comput 22, 201–218 (2018). https://doi.org/10.1007/s00779-017-1087-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-017-1087-0

Keywords

Search

Navigation