skip to main content
10.1145/3343031.3350587acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
demonstration

Walker's Movie Map: Route Vies Synthesis Using Omni-directional Videos

Published: 15 October 2019 Publication History

Abstract

We present a new movie map for walkers that synthesizes street walking views along routes for walkers in an area. We acquired a number of omnidirectional videos from the perspectives of walkers of streets in a certain area (ex. $1km^2$ around Kyoto Station), then perform SLAM to obtain camera poses of key video frames with the coordinates adjusted to the map of the area using reference points. In order to switch one video to another at intersections, we identify the frames of video intersection using camera locations. We refine the intersection frames using visual feature matching. Finally, we synthesize moving route views by switching omnidirectional videos with alignment of the direction of the cameras. The result shows that our method can precisely identify the intersection frames, and generates smooth switching of videos at the intersection.

References

[1]
G. Balamurugan, J. Valarmathi, and V. P. S. Naidu. 2016. Survey on UAV navigation in GPS denied environments. In 2016 International Conference on Signal Processing, Communication, Power and Embedded System (SCOPES) . 198--204. https://doi.org/10.1109/SCOPES.2016.7955787
[2]
Kazuya Iwami, Satoshi Ikehata, and Kiyoharu Aizawa. 2018. Scale Drift Correction of Camera Geo-Localization using Geo-Tagged Images. In The European Conference on Computer Vision (ECCV) Workshops .
[3]
Andrew Lippman. 1980. Movie-maps: An Application of the Optical Videodisc to Computer Graphics. In Proceedings of the 7th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '80). ACM, New York, NY, USA, 32--42. https://doi.org/10.1145/800250.807465
[4]
P. Lothe, S. Bourgeois, F. Dekeyser, E. Royer, and M. Dhome. 2009. Towards geographical referencing of monocular SLAM reconstruction using 3D city models: Application to real-time accurate vision-based localization. In 2009 IEEE Conference on Computer Vision and Pattern Recognition. 2882--2889. https://doi.org/10.1109/CVPR.2009.5206662
[5]
R. Mur-Artal, J. M. M. Montiel, and J. D. Tardos. 2015. ORB-SLAM: A Versatile and Accurate Monocular SLAM System. IEEE Transactions on Robotics, Vol. 31, 5 (Oct 2015), 1147--1163. https://doi.org/10.1109/TRO.2015.2463671
[6]
E. Rublee, V. Rabaud, K. Konolige, and G. Bradski. 2011. ORB: An efficient alternative to SIFT or SURF. In 2011 International Conference on Computer Vision . 2564--2571. https://doi.org/10.1109/ICCV.2011.6126544
[7]
Shinya Sumikura, Mikiya Shibuya, and Ken Sakurada. 2019. OpenVSLAM: a Versatile Visual SLAM Framework. https://github.com/xdspacelab/openvslam .
[8]
M. Tamaazousti, V. Gay-Bellile, S. N. Collette, S. Bourgeois, and M. Dhome. 2011. NonLinear refinement of structure from motion reconstruction by taking advantage of a partial knowledge of the environment. In CVPR 2011 . 3073--3080. https://doi.org/10.1109/CVPR.2011.5995358

Index Terms

  1. Walker's Movie Map: Route Vies Synthesis Using Omni-directional Videos

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '19: Proceedings of the 27th ACM International Conference on Multimedia
    October 2019
    2794 pages
    ISBN:9781450368896
    DOI:10.1145/3343031
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 October 2019

    Check for updates

    Author Tags

    1. free route movie
    2. movie map
    3. omni-directional video
    4. slam

    Qualifiers

    • Demonstration

    Conference

    MM '19
    Sponsor:

    Acceptance Rates

    MM '19 Paper Acceptance Rate 252 of 936 submissions, 27%;
    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 165
      Total Downloads
    • Downloads (Last 12 months)12
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media