skip to main content
10.1145/3654777.3676383acmotherconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

Personal Time-Lapse

Published: 11 October 2024 Publication History

Abstract

Our bodies are constantly in motion—from the bending of arms and legs to the less conscious movement of breathing, our precise shape and location change constantly. This can make subtler developments (e.g., the growth of hair, or the healing of a wound) difficult to observe. Our work focuses on helping users record and visualize this type of subtle, longer-term change. We present a mobile tool that combines custom 3D tracking with interactive visual feedback and computational imaging to capture personal time-lapse, which approximates longer-term video of the subject (typically, part of the capturing user’s body) under a fixed viewpoint, body pose, and lighting condition. These personal time-lapses offer a powerful and detailed way to track visual changes of the subject over time. We begin with a formative study that examines what makes personal time-lapse so difficult to capture. Building on our findings, we motivate the design of our capture tool, evaluate this design with users, and demonstrate its effectiveness in a variety of challenging examples.

Supplemental Material

MP4 File
Video Figure

References

[1]
2020. Photography in Clinical Medicine. Springer International Publishing, Cham. https://doi.org/10.1007/978-3-030-24544-3
[2]
Andrew Adams, Natasha Gelfand, and Kari Pulli. 2008. Viewfinder alignment. In Computer Graphics Forum, Vol. 27. Wiley Online Library, 597–606. https://doi.org/10.1111/j.1467-8659.2008.01157.x
[3]
AppleDev. 2024. Saving and Loading World Data. https://developer.apple.com/documentation/arkit/arkit_in_ios/data_management/saving_and_loading_world_data
[4]
Soonmin Bae, Aseem Agarwala, and Frédo Durand. 2010. Computational Rephotography. ACM Trans. Graph. 29, 3, Article 24 (jul 2010), 15 pages. https://doi.org/10.1145/1805964.1805968
[5]
Cagatay Barut and Hakan Ertilav. 2011. Guidelines for standard photography in gross and clinical anatomy. Anatomical Sciences Education 4, 6 (2011), 348–356. https://doi.org/10.1002/ase.247
[6]
Ross Brown, Bernd Ploderer, Leonard Si Da Seng, Peter Lazzarini, and Jaap van Netten. 2017. MyFootCare: a mobile self-tracking tool to promote self-care amongst people with diabetic foot ulcers. In Proceedings of the 29th Australian Conference on Computer-Human Interaction(OzCHI ’17). Association for Computing Machinery, New York, NY, USA, 462–466. https://doi.org/10.1145/3152771.3156158
[7]
Elizabeth Chao, Chelsea K. Meenan, and Laura K. Ferris. 2017. Smartphone-Based Applications for Skin Monitoring and Melanoma Detection. Dermatologic Clinics 35, 4 (Oct. 2017), 551–557. https://doi.org/10.1016/j.det.2017.06.014
[8]
Yang Chen and Gérard Medioni. 1992. Object modelling by registration of multiple range images. Image and vision computing 10, 3 (1992), 145–155.
[9]
[9] Hugo Cornellier. 2017. https://youtu.be/65nfbW-27ps?si=7mp5dSxrlBhW4Kj1
[10]
Mayur Davda and Paola Pasquali. 2020. Standardization in Photographic Documentation. Springer International Publishing, Cham, 211–230. https://doi.org/10.1007/978-3-030-24544-3_14
[11]
Jane L. E, Ohad Fried, Jingwan Lu, Jianming Zhang, Radomír Měch, Jose Echevarria, Pat Hanrahan, and James A. Landay. 2020. Adaptive Photographic Composition Guidance. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems(CHI ’20). ACM, 1–13. https://doi.org/10.1145/3313831.3376635
[12]
Jane L. E, Kevin Y. Zhai, Jose Echevarria, Ohad Fried, Pat Hanrahan, and James A. Landay. 2021. Dynamic Guidance for Decluttering Photographic Compositions. In Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology(UIST ’21). ACM. https://doi.org/10.1145/3472749.3474755
[13]
Zemichael Gizaw, Tigist Astale, and Getnet Mitike Kassie. 2022. What improves access to primary healthcare services in rural communities? A systematic review. BMC Primary Care 23, 1 (2022), 313.
[14]
Dirk Hahnel, Sebastian Thrun, and Wolfram Burgard. 2003. An extension of the ICP algorithm for modeling nonrigid objects with mobile robots. In Proceedings of the 18th International Joint Conference on Artificial Intelligence (Acapulco, Mexico) (IJCAI’03). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 915–920.
[15]
Xin He, Xi Zheng, and Huiyuan Ding. 2023. Existing Barriers Faced by and Future Design Recommendations for Direct-to-Consumer Health Care Artificial Intelligence Apps: Scoping Review. Journal of Medical Internet Research 25 (Dec. 2023), e50342. https://doi.org/10.2196/50342
[16]
[16] IMDB. 2024. https://www.imdb.com/name/nm2404488/
[17]
[17] IMI. 2024. https://www.imi.org.uk/resources/professional-resources/national-guidelines/
[18]
Shahram Izadi, David Kim, Otmar Hilliges, David Molyneaux, Richard Newcombe, Pushmeet Kohli, Jamie Shotton, Steve Hodges, Dustin Freeman, Andrew Davison, 2011. Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera. In Proceedings of the 24th annual ACM symposium on User interface software and technology. 559–568.
[19]
[19] Noah Kalina. 2020. https://www.youtube.com/watch?v=wAIZ36GI4p8
[20]
Jeannie Khavkin and David A. F. Ellis. 2011. Standardized Photography for Skin Surface. Facial Plastic Surgery Clinics of North America 19, 2 (May 2011), 241–246. https://doi.org/10.1016/j.fsc.2011.04.001
[21]
Minju Kim and Jungjin Lee. 2019. PicMe: Interactive Visual Guidance for Taking Requested Photo Composition. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300625
[22]
Georg Klein and David Murray. 2007. Parallel tracking and mapping for small AR workspaces. In 2007 6th IEEE and ACM international symposium on mixed and augmented reality. IEEE, 225–234.
[23]
Bálint Kolozsvári. 2024. Kolo / Time Lapse. https://www.youtube.com/@KoloTimeLapse
[24]
Adam Landman, Srinivas Emani, Narath Carlile, David I. Rosenthal, Simon Semakov, Daniel J. Pallin, and Eric G. Poon. 2015. A Mobile App for Securely Capturing and Transferring Clinical Images to the Electronic Health Record: Description and Preliminary Usability Study. JMIR mHealth and uHealth 3 (Jan 2015), e3481. https://doi.org/10.2196/mhealth.3481
[25]
Katie J. Lee, Anna Finnane, and H. Peter Soyer. 2018. Recent trends in teledermatology and teledermoscopy. Dermatology Practical & Conceptual 8, 3 (Jul 2018), 214–223. https://doi.org/10.5826/dpc.0803a13
[26]
Hao Li, Robert W. Sumner, and Mark Pauly. 2008. Global correspondence optimization for non-rigid registration of depth scans. In Proceedings of the Symposium on Geometry Processing (Copenhagen, Denmark) (SGP ’08). Eurographics Association, Goslar, DEU, 1421–1430.
[27]
Kok-Lim Low. 2004. Linear least-squares optimization for point-to-plane icp surface registration. Chapel Hill, University of North Carolina 4, 10 (2004), 1–3.
[28]
Andrew J. Marek, Emily Y. Chu, Michael E. Ming, Zeeshan A. Khan, and Carrie L. Kovarik. 2018. Impact of a smartphone application on skin self-examination rates in patients who are new to total body photography: A randomized controlled trial. Journal of the American Academy of Dermatology 79, 3 (Sept. 2018), 564–567. https://doi.org/10.1016/j.jaad.2018.02.025
[29]
Raúl Mur-Artal, J. M. M. Montiel, and Juan D. Tardós. 2015. ORB-SLAM: A Versatile and Accurate Monocular SLAM System. IEEE Transactions on Robotics 31, 5 (2015), 1147–1163. https://doi.org/10.1109/TRO.2015.2463671
[30]
Richard A Newcombe, Shahram Izadi, Otmar Hilliges, David Molyneaux, David Kim, Andrew J Davison, Pushmeet Kohi, Jamie Shotton, Steve Hodges, and Andrew Fitzgibbon. 2011. Kinectfusion: Real-time dense surface mapping and tracking. In 2011 10th IEEE international symposium on mixed and augmented reality. Ieee, 127–136.
[31]
Bernd Ploderer, Atae Rezaei Aghdam, and Kara Burns. 2022. Patient-Generated Health Photos and Videos Across Health and Well-being Contexts: Scoping Review. Journal of Medical Internet Research 24, 4 (Apr 2022), e28867. https://doi.org/10.2196/28867
[32]
Bernd Ploderer, Atae Rezaei Aghdam, and Kara Burns. 2022. Patient-Generated Health Photos and Videos Across Health and Well-being Contexts: Scoping Review. Journal of Medical Internet Research 24, 4 (April 2022), e28867. https://doi.org/10.2196/28867
[33]
Mark P. Pressler, Mikaela L. Kislevitz, Justin J. Davis, and Bardia Amirlak. 2022. Size and Perception of Facial Features with Selfie Photographs, and Their Implication in Rhinoplasty and Facial Plastic Surgery. Plastic and Reconstructive Surgery 149, 4 (April 2022), 859. https://doi.org/10.1097/PRS.0000000000008961
[34]
K.A. Priebe and H. Selick. 2011. The advanced art of stop-motion animation. Course Technology. https://books.google.com/books?id=2J8VkgAACAAJ Citation Key: priebe2011advanced tex.lccn: 2010922093.
[35]
Rajeev V. Rikhye, Grace Eunhae Hong, Preeti Singh, Margaret Ann Smith, Aaron Loh, Vijaytha Muralidharan, Doris Wong, Rory Sayres, Michelle Phung, Nicolas Betancourt, Bradley Fong, Rachna Sahasrabudhe, Khoban Nasim, Alec Eschholz, Yossi Matias, Greg S. Corrado, Katherine Chou, Dale R. Webster, Peggy Bui, Yuan Liu, Yun Liu, Justin Ko, and Steven Lin. 2024. Differences Between Patient and Clinician-Taken Images: Implications for Virtual Care of Skin Conditions. Mayo Clinic Proceedings: Digital Health 2, 1 (Mar 2024), 107–118. https://doi.org/10.1016/j.mcpdig.2024.01.005
[36]
S. Rusinkiewicz and M. Levoy. 2001. Efficient variants of the ICP algorithm. In Proceedings Third International Conference on 3-D Digital Imaging and Modeling. 145–152. https://doi.org/10.1109/IM.2001.924423
[37]
Hannah Schmitz, Carol L Howe, David G Armstrong, and Vignesh Subbian. 2018. Leveraging mobile health applications for biomedical research and citizen science: a scoping review. Journal of the American Medical Informatics Association 25, 12 (Dec. 2018), 1685–1695. https://doi.org/10.1093/jamia/ocy130
[38]
S. Shaw. 2004. Stop Motion: Craft Skills for Model Animation. Focal Press. https://books.google.com/books?id=kuUAWIvPaAgC
[39]
Doron D. Sommer and Martyn Mendelsohn. 2004. Pitfalls of nonstandardized photography in facial plastic surgery patients. Plastic and Reconstructive Surgery 114, 1 (Jul 2004), 10–14. https://doi.org/10.1097/01.prs.0000127791.31526.e2
[40]
Florine Vegter and J. Joris Hage. 2000. Standardized Facial Photography of Cleft Patients: Just Fit the Grid?The Cleft Palate Craniofacial Journal 37, 5 (Sept. 2000), 435–440. https://doi.org/10.1597/1545-1569_2000_037_0435_sfpocp_2.0.co_2
[41]
Dan E. Webster, Christine Suver, Megan Doerr, Erin Mounts, Lisa Domenico, Tracy Petrie, Sancy A. Leachman, Andrew D. Trister, and Brian M. Bot. 2017. The Mole Mapper Study, mobile phone skin imaging and melanoma risk data collected using ResearchKit. Scientific Data 4, 1 (Feb. 2017), 170005. https://doi.org/10.1038/sdata.2017.5 Publisher: Nature Publishing Group.
[42]
Ruyu Yan, Jiatian Sun, Longxiulin Deng, and Abe Davis. 2022. ReCapture: AR-Guided Time-lapse Photography. In ACM Symposium on User Interface Software and Technology (UIST). https://doi.org/10.1145/3526113.3545641
[43]
Moi Hoon Yap, Katie E. Chatwin, Choon-Ching Ng, Caroline A. Abbott, Frank L. Bowling, Satyan Rajbhandari, Andrew J. M. Boulton, and Neil D. Reeves. 2018. A New Mobile Application for Standardizing Diabetic Foot Images. Journal of Diabetes Science and Technology 12, 1 (Jan 2018), 169–173. https://doi.org/10.1177/1932296817713761
[44]
Timothy Zoltie, Sigrid Blome-Eberwein, Sarah Forbes, Mike Theaker, and Walayat Hussain. 2022. Medical photography using mobile devices. The BMJ 378 (Aug 2022), e067663. https://doi.org/10.1136/bmj-2021-067663

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
UIST '24: Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology
October 2024
2334 pages
ISBN:9798400706288
DOI:10.1145/3654777
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 October 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Camera-based UIs
  2. Graphics / 3D
  3. Virtual/Augmented Reality

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

UIST '24

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 190
    Total Downloads
  • Downloads (Last 12 months)190
  • Downloads (Last 6 weeks)35
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media