skip to main content
10.1145/3012709.3012738acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmumConference Proceedingsconference-collections
research-article

NowAndThen: a social network-based photo recommendation tool supporting reminiscence

Authors Info & Claims
Published:12 December 2016Publication History

ABSTRACT

People frequently post their photos on social network sites (e.g. Facebook, Instagram) as a way to share memorable moments, emotions, or locations visited. While sharing photos with the same subjects as past photos could lead to user reminiscence and potentially create valuable benefits, existing products still cannot support this adequately. Based on a survey on user habits in sharing and revisiting photos on social network sites, we propose NowAndThen, a photo recommendation concept and tool that assists reminiscence when sharing photos on social network sites. By combining visual features of the photos and associated tags, a prototype we developed can recommend old photos that have common subjects with the user's current photos of interest. Our study with the prototype shows that this approach can help users positively revive past memories and connections with their friends. In addition, our results include various design insights and implications for future reminiscence-support systems.

References

  1. M. Ames and M. Naaman. 2007. Why we tag: motivations for annotation in mobile and online data. In Proc CHI '07, 971--980. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. T. Apted, J. Kay, and A. Quigley. 2006. Tabletop sharing of digital photographs for the elderly. In Proc CHI '06, 781--790. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. R. Arandjelovic. 2012. Three things everyone should know to improve object retrieval. In Proc. CVPR '12. Google ScholarGoogle ScholarCross RefCross Ref
  4. M. Balabanovic and Y. Shoham. 2006. Knowing me, Knowing you - Using Profiles and Social Networking to Improve Recommender System. BT Technology Journal 24, 3: 82--98.Google ScholarGoogle Scholar
  5. S. Balakrishnan, S. Chaudhuri, and V. Narasayya. 2015. AutoTag 'n Search My Photos: Levaraging the Social Graph for Photo Tagging. In WWW '15.Google ScholarGoogle Scholar
  6. R. Clarke, P. Wright, M. Balaam, and J. McCarthy. 2013. Digital portraits: photo-sharing after domestic violence. In Proc CHI '13, 2517--2526. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. D. Cosley, K. Akey, B. Alson, J. Baxter, M. Broomfield, S. Lee, and C. Sarabu. 2009. Using technologies to support reminiscence. In Proc BCS-HCI '09, 480--484.Google ScholarGoogle Scholar
  8. C. Firan, W. Nejdl, and R. Paiu. 2007. The Benifit of Using Tag-Based Profiles. In Proc. LA-WEB '07,.Google ScholarGoogle Scholar
  9. M.A. Fischler and R.C. Bolles. 1981. Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Commun. ACM 24, 6: 381--395. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. J. Golbeck. 2006. Generating Predictive Movie Recommendations from Trust in Social Networks. In Proc. 4th In. Conf. on Trust Management. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. D. Goldberg, D. Nichols, B. Oki, and D. Terry. 1992. Using collaborative filtering to weave an information tapestry. Commun.ACM 35, 61--70. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. M. Gupta, R. Li, Z. Yin, and J. Han. 2010. Survey on social tagging techniques. ACM SIGKDD Explorations Newsletter, 58--72.Google ScholarGoogle Scholar
  13. I. Guy, N. Zwerdling, R. Inbal, C. David, and E. Uziel. 2010. Social media recommendation based on people and tags,. In Proc. SIGIR '10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. S. Hangal, M.S. Lam, and J. Heer. 2011. MUSE: Reviving Memories Using Email Archives. In Proc UIST '11, 75--84. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. W. Johan and L. Maria. 2005. Smell your way back to childhood: Autobiographical odor memory. Psychonomic Bulletin & Review 13, 2: 240--244.Google ScholarGoogle Scholar
  16. I. Konstas, V. Stathopoulos, and J. Jose. 2009. On social networks and collaborative recommendation. In Proc. SIGIR '09. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. N. Kuwahara, S. Abe, K. Yasuda, and K. Kuwabara. 2006. Networked reminiscence therapy for individuals with dementia by using photo and video sharing. In Proc ASSETS '06, 125--132. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. N. Kuwahara, K. Yasuda, N. Tetsutani, and K. Morimoto. Remote assistance for people with dementia at home using reminiscence systems and a schedule prompter. International Journal of Computers in Healthcare (IJCIH) 1: 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. D. Le, S. Le, S. Kasamwattanarot, P. Sebastien, S. Satoh, V. Nguyen, C. Zhu, D.M. Nguyen, T.D. Ngo, and D.A. Duong. 2014. NII at TRECVID 2014 Instance Search Task. In 2014 TREC Video Retrieval Evaluation Notebook Papers and Slides. Retrieved from http://www-nlpir.nist.gov/projects/tvpubs/tv14.papers/nii.pdfGoogle ScholarGoogle Scholar
  20. H.C. Lee, H.H. Tang, Y.F. Cheng, Y.J. Hsu, S.Y. Cho, and C.H. Chen. 2014. Picgo: Designing Reminiscence and Storytelling for the Elderly with Photo Annotation. In Proc DIS Companion '14, 9--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. C.N. Lewis. 1971. Reminiscing and Self-Concept in Old Age. Journal of Gerontology 26: 240--243. Google ScholarGoogle ScholarCross RefCross Ref
  22. D.G. Lowe. Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision 60, 2: 91--100. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. A. Lucero, J. Holopainen, and T. Jokela. 2011. Pass-them-around: collaborative use of mobile phones for photo sharing. In CHI '11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. A.W Mc Maho and P.J Rududick. Reminiscing in the aged: An adaptational response. Psychodynamic Studies on Aging: Creativity, Reminiscing, and Dying: 64--78.Google ScholarGoogle Scholar
  25. K. Mikolajckzyk and S. Cordelia. 2004. Affine Invariant Interest Point Detectors. International Journal of Computer Vision 60, 2: 91--110.Google ScholarGoogle Scholar
  26. M. Pazzni and D. Billsus. 2007. Content-based recommendation system. The adaptive web: 325--341.Google ScholarGoogle Scholar
  27. S.T. Peesapati, V. Schwanda, J. Schultz, M. Lepage, S.V. Jeong, and D. Cosley. 2010. Pensieve: Supporting Everyday Reminiscence. In Proc CHI '10, 2027--2036. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. D. Petrelli, S. Whittaker, and J. Brockmeier. 2008. Autotopography: what can physical mementos tell us about digital memories. In Proc CHI '08, 53--62. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. J. Philbin, R. Arandjelovic, and Zisserman, A. The Oxford Buildings Dataset. Retrieved from http://www.robots.ox.ac.uk/~vgg/data/oxbuildings/Google ScholarGoogle Scholar
  30. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman. 2007. Object Retrieval with Large Vocabularies and Fast Spatial Matching. In Proc. CVPR '07. Google ScholarGoogle ScholarCross RefCross Ref
  31. Emma Reynolds. 2012. The Ghosts of World War II: The photographs found at flea markets superimposed on to modern street scenes,. Retrieved from http://www.dailymail.co.uk/news/article-2219584/Ghosts-war-Artist-superimposes-World-War-II-photographs-modern-pictures-street-scenes.htmlGoogle ScholarGoogle Scholar
  32. A. Sellen, A. Fogg, M. Aitken, S. Hodges, C. Rother, and K. Wood. 2007. Do life-logging technologies support memory for the past? In Proc CHI' 07, 81--90. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. E. Shechtman and M. Irani. 2007. Matching Local Self-Similarities across Images and Videos. In Proc CVPR' 07. Google ScholarGoogle ScholarCross RefCross Ref
  34. R. Sinha and K. Swearingen. 2001. Comparing Recommendations Made by Online Systems and Friends.Google ScholarGoogle Scholar
  35. M.A. Stefanone, D. Lackaff, and D. Rosen. 2011. Contingencies of Self-Worth and Social-Networking-Site Behavior. Cyberpsychology, Behavior, and Social Networking 14, 1--2: 41--49.Google ScholarGoogle ScholarCross RefCross Ref
  36. J.D Webster. 1993. Construction and validation of the reminiscence Function Scale. Journal of Gerontology 5: 256--262. Google ScholarGoogle ScholarCross RefCross Ref
  37. B. Woods, A. Spector, C. Jones, M. Orrell, and S. Davies. 2005. Reminiscence therapy for dementia. Cochrane Database of Systematic Reviews,. Google ScholarGoogle ScholarCross RefCross Ref
  38. Where can I see my memories? Retrieved from https://www.facebook.com/help/1422085768088554Google ScholarGoogle Scholar
  39. Facebook's new nostalgia feature is already bringing up painful memories. Retrieved from http://www.theverge.com/2015/4/2/8315897/facebook-on-this-day-nostalgia-app-bringing-back-painful-memories.Google ScholarGoogle Scholar
  40. Flickr. Retrieved from https://www.flickr.com/Google ScholarGoogle Scholar
  41. What information does Facebook use to tell that a photo looks like me and to suggest that friends tag me? Retrieved from https://www.facebook.com/help/218540514842030?sr=3&query=tag%20suggestions&sid=0K7GEHb5UWLRmoORL.Google ScholarGoogle Scholar

Index Terms

  1. NowAndThen: a social network-based photo recommendation tool supporting reminiscence

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      MUM '16: Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia
      December 2016
      366 pages
      ISBN:9781450348607
      DOI:10.1145/3012709

      Copyright © 2016 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 12 December 2016

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      MUM '16 Paper Acceptance Rate35of77submissions,45%Overall Acceptance Rate190of465submissions,41%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader