skip to main content
10.1145/3372278.3390707acmconferencesArticle/Chapter ViewAbstractPublication PagesicmrConference Proceedingsconference-collections
research-article

Urban Movie Map for Walkers: Route View Synthesis using 360° Videos

Published: 08 June 2020 Publication History

Abstract

We propose a movie map for walkers based on synthesized street walking views along routes in a particular area. From the perspectives of walkers, we captured a number of omnidirectional videos along streets in the target area (1km2 around Kyoto Station). We captured a separate video for each street. We then performed simultaneous localization and mapping to obtain camera poses from key video frames in all of the videos and adjusted the coordinates based on a map of the area using reference points. To join one video to another smoothly at intersections, we identified frames of video intersection based on camera locations and visual feature matching. Finally, we generated moving route views by connecting the omnidirectional videos based on the alignment of the cameras. To improve smoothness at intersections, we generated rotational views by mixing video intersection frames from two videos. The results demonstrate that our method can precisely identify intersection frames and generate smooth connections between videos at intersections.

References

[1]
G. Balamurugan, J. Valarmathi, and V. P. S. Naidu. 2016. Survey on UAV navigation in GPS denied environments. In 2016 International Conference on Signal Processing, Communication, Power and Embedded System (SCOPES). 198--204. https://doi.org/10.1109/SCOPES.2016.7955787
[2]
T. Kindberg, M. Chalmers, and E. Paulos. 2007. Guest Editors' Introduction: Urban Computing. IEEE Pervasive Computing, Vol. 6, 3 (July 2007), 18--20. https://doi.org/10.1109/MPRV.2007.57
[3]
Andrew Lippman. 1980. Movie-maps: An Application of the Optical Videodisc to Computer Graphics. In Proceedings of the 7th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '80). ACM, New York, NY, USA, 32--42. https://doi.org/10.1145/800250.807465
[4]
Ziyu Liu, Anqi Yang, Mengyao Gao, Hong Jiang, Yuhao Kang, Fan Zhang, and Teng Fei. 2019. Towards feasibility of photovoltaic road for urban traffic-solar energy estimation using street view image. Journal of Cleaner Production, Vol. 228 (2019), 303--318.
[5]
P. Lothe, S. Bourgeois, F. Dekeyser, E. Royer, and M. Dhome. 2009. Towards geographical referencing of monocular SLAM reconstruction using 3D city models: Application to real-time accurate vision-based localization. In 2009 IEEE Conference on Computer Vision and Pattern Recognition. 2882--2889. https://doi.org/10.1109/CVPR.2009.5206662
[6]
Richard A. Plunz, Yijia Zhou, Maria Isabel Carrasco Vintimilla, Kathleen Mckeown, Tao Yu, Laura Uguccioni, and Maria Paola Sutto. 2019. Twitter sentiment in New York City parks as measure of well-being. Landscape and Urban Planning, Vol. 189 (2019), 235 -- 246. https://doi.org/10.1016/j.landurbplan.2019.04.024
[7]
Jerome Revaud, Minhyeok Heo, Rafael S. Rezende, Chanmi You, and Seong-Gyun Jeong. 2019. Did It Change? Learning to Detect Point-Of-Interest Changes for Proactive Map Updates. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
[8]
E. Rublee, V. Rabaud, K. Konolige, and G. Bradski. 2011. ORB: An efficient alternative to SIFT or SURF. In 2011 International Conference on Computer Vision. 2564--2571. https://doi.org/10.1109/ICCV.2011.6126544
[9]
Noah Snavely, Steven M. Seitz, and Richard Szeliski. 2006. Photo Tourism: Exploring Photo Collections in 3D. ACM Trans. Graph., Vol. 25, 3 (July 2006), 835--846. https://doi.org/10.1145/1141911.1141964
[10]
Xuan Song, Quanshi Zhang, Yoshihide Sekimoto, Teerayut Horanont, Satoshi Ueyama, and Ryosuke Shibasaki. 2013. Modeling and Probabilistic Reasoning of Population Evacuation during Large-Scale Disaster. In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '13). Association for Computing Machinery, New York, NY, USA, 1231--1239. https://doi.org/10.1145/2487575.2488189
[11]
Shinya Sumikura, Mikiya Shibuya, and Ken Sakurada. 2019. OpenVSLAM: a Versatile Visual SLAM Framework. https://github.com/xdspacelab/openvslam.
[12]
M. Tamaazousti, V. Gay-Bellile, S. N. Collette, S. Bourgeois, and M. Dhome. 2011. NonLinear refinement of structure from motion reconstruction by taking advantage of a partial knowledge of the environment. In CVPR 2011. 3073--3080. https://doi.org/10.1109/CVPR.2011.5995358
[13]
Chaolun Xia, Raz Schwartz, Ke Xie, Adam Krebs, Andrew Langdon, Jeremy Ting, and Mor Naaman. 2014. CityBeat: real-time social media visualization of hyper-local city data. 167--170. https://doi.org/10.1145/2567948.2577020
[14]
Y. Yu, X. Tang, H. Yao, X. Yi, and Z. Li. 2019. Citywide Traffic Volume Inference with Surveillance Camera Records. IEEE Transactions on Big Data (2019), 1--1. https://doi.org/10.1109/TBDATA.2019.2935057
[15]
Y. Zhang. 2015. Introduction to urban computing[J]. Vol. 40. Geomatics and Information Science of Wuhan University.
[16]
Daniel Zünd and Luis Bettencourt. 2019. Streetview Imaging for Automated Assessments of Urban Infrastructure and Services. Mansueto Institute for Urban Innovation Research Paper 4 (2019).

Cited By

View all
  • (2023)3DMovieMap: an Interactive Route Viewer for Multi-Level BuildingsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585885(1-11)Online publication date: 19-Apr-2023
  • (2022)Movie Map for Virtual Exploration in a CityIEICE Transactions on Information and Systems10.1587/transinf.2021MUI0001E105.D:1(38-45)Online publication date: 1-Jan-2022
  • (2020)Building Movie Map - A Tool for Exploring Areas in a City - and its EvaluationsProceedings of the 28th ACM International Conference on Multimedia10.1145/3394171.3413881(3330-3338)Online publication date: 12-Oct-2020

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICMR '20: Proceedings of the 2020 International Conference on Multimedia Retrieval
June 2020
605 pages
ISBN:9781450370875
DOI:10.1145/3372278
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 June 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. free route movie
  2. movie map
  3. omni-directional video
  4. slam

Qualifiers

  • Research-article

Conference

ICMR '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 254 of 830 submissions, 31%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)11
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)3DMovieMap: an Interactive Route Viewer for Multi-Level BuildingsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585885(1-11)Online publication date: 19-Apr-2023
  • (2022)Movie Map for Virtual Exploration in a CityIEICE Transactions on Information and Systems10.1587/transinf.2021MUI0001E105.D:1(38-45)Online publication date: 1-Jan-2022
  • (2020)Building Movie Map - A Tool for Exploring Areas in a City - and its EvaluationsProceedings of the 28th ACM International Conference on Multimedia10.1145/3394171.3413881(3330-3338)Online publication date: 12-Oct-2020

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media