Skip to main content
SpringerLink
Log in

Multi-GPU 3-D Reverse Time Migration with Minimum I/O

  • Conference paper
  • First Online:
High Performance Computing (CARLA 2022)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1660))

Included in the following conference series:

Abstract

Seismic imaging techniques based on two-way wave equations are computationally and data-intensive activities in the oil and gas industry. For instance, Reverse Time Migration (RTM) migrates a set of SEG-Y format data from the disk called a seismogram. Besides, during execution, the RTM application needs to store the forward-propagated wavefield (or source wavefield) on disk to build the final seismic image. Storing the source wavefield for multiple RTMs executing in parallel is even more challenging because the storage capacity can reach tens of Terabytes of information. Aiming to mitigate the storage demand, we develop a 3-D RTM with source wavefield reconstruction. The source wavefield is reconstructed by introducing a new wave equation to the problem and adjusting the initial and boundary conditions to take advantage of random boundary conditions’ (RBC) properties. The RBC does not suppress unwanted waves coming from the artificial boundary enabling full wavefield recovery. We also develop a hybrid OpenACC/MPI implementation for the 3-D RTM on a multi-GPU machine. We test the RTM implementation on the 3-D HPC4E Seismic Test Suite. The numerical experiments show that the OpenACC/MPI 3-D RTM, which implements the wavefield reconstruction, presents the best execution times and hard disk demands.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://sdumont.lncc.br/support_manual.php?pg=support.

  2. 2.

    https://hpc4e.bsc.es/downloads/hpc-geophysical-simulation-test-suite.

References

  1. Barbosa, C.H., Coutinho, A.L.: Enhancing reverse time migration: hybrid parallelism plus data compression. In: Proceedings of the XLI Ibero-Latin-American Congress on Computational Methods in Engineering. ABMEC (2020)

    Google Scholar 

  2. Barbosa, C.H., Coutinho, A.L.: Seismic modeling and migration with random boundaries on the NEC SX-Aurora TSUBASA. arXiv preprint arXiv:2204.03380 (2022)

  3. Barbosa, C.H., et al.: A workflow for seismic imaging with quantified uncertainty. Comput. Geosci. 145, 104615 (2020)

    Article  Google Scholar 

  4. Cerjan, C., Kosloff, D., Kosloff, R., Reshef, M.: A nonreflecting boundary condition for discrete acoustic and elastic wave equations. Geophysics 50(4), 705–708 (1985)

    Article  Google Scholar 

  5. Clapp, R.G.: Reverse time migration: saving the boundaries. Stanford Exploration Project 137 (2008)

    Google Scholar 

  6. Clapp, R.G.: Reverse time migration with random boundaries. In: SEG Technical Program Expanded Abstracts 2009, pp. 2809–2813. Society of Exploration Geophysicists (2009)

    Google Scholar 

  7. Faria, E.: Migração antes do empilhamento utilizando propagação reversa no tempo, January 1986. http://www.cpgg.ufba.br/pgeof/resumos/gfm/gfm0056a.html

  8. Givoli, D.: Time reversal as a computational tool in acoustics and elastodynamics. J. Comput. Acoust. 22(03), 1430001 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  9. Komatitsch, D., Martin, R.: An unsplit convolutional perfectly matched layer improved at grazing incidence for the seismic wave equation. Geophysics 72(5), SM155–SM167 (2007)

    Google Scholar 

  10. Kukreja, N., Hückelheim, J., Louboutin, M., Hovland, P., Gorman, G.: Combining checkpointing and data compression to accelerate adjoint-based optimization problems. In: Yahyapour, R. (ed.) Euro-Par 2019. LNCS, vol. 11725, pp. 87–100. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29400-7_7

    Chapter  Google Scholar 

  11. Kukreja, N., Hückelheim, J., Louboutin, M., Washbourne, J., Kelly, P.H., Gorman, G.J.: Lossy checkpoint compression in full waveform inversion: a case study with ZFPv0. 5.5 and the overthrust model. Geosci. Model Dev. 15(9), 3815–3829 (2022)

    Google Scholar 

  12. Kushida, N., Lin, Y.-T., Nielsen, P., Le Bras, R.: Acceleration in acoustic wave propagation modelling using OpenACC/OpenMP and its hybrid for the global monitoring system. In: Wienke, S., Bhalachandra, S. (eds.) WACCPD 2019. LNCS, vol. 12017, pp. 25–46. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-49943-3_2

    Chapter  Google Scholar 

  13. Li, Q., Fu, L.Y., Wu, R.S., Du, Q.: Efficient acoustic reverse time migration with an attenuated and reversible random boundary. IEEE Access 8, 34598–34610 (2020)

    Article  Google Scholar 

  14. Lindstrom, P., Chen, P., Lee, E.J.: Reducing disk storage of full-3D seismic waveform tomography (F3DT) through lossy online compression. Comput. Geosci. 93, 45–54 (2016)

    Article  Google Scholar 

  15. Liu, H., et al.: The issues of prestack reverse time migration and solutions with graphic processing unit implementation. Geophys. Prospect. 60(5), 906–918 (2012)

    Article  Google Scholar 

  16. Nguyen, B.D., McMechan, G.A.: Five ways to avoid storing source wavefield snapshots in 2D elastic prestack reverse time migration. Geophysics 80(1), S1–S18 (2015)

    Article  Google Scholar 

  17. Pasalic, D., McGarry, R.: Convolutional perfectly matched layer for isotropic and anisotropic acoustic wave equations. In: SEG Technical Program Expanded Abstracts 2010, pp. 2925–2929. Society of Exploration Geophysicists (2010)

    Google Scholar 

  18. Qawasmeh, A., Hugues, M.R., Calandra, H., Chapman, B.M.: Performance portability in reverse time migration and seismic modelling via OpenACC. Int. J. High Perform. Comput. Appl. 31(5), 422–440 (2017)

    Article  Google Scholar 

  19. Schuster, G.T.: Seismic Inversion. Society of Exploration Geophysicists, Tulsa (2017)

    Google Scholar 

  20. Serpa, M.S., et al.: Energy efficiency and portability of oil and gas simulations on multicore and graphics processing unit architectures. Concurr. Comput. Pract. Exp. 33(18), e6212 (2021)

    Google Scholar 

  21. Silva, K.C.: Modelagem, mrt e estudos de iluminação empregando o conceito de dados sísmicos blended, January 2012. http://www.coc.ufrj.br/pt/dissertacoes-de-mestrado/112-msc-pt-2012/2265-karen-carrilho-da-silva

  22. Sun, W., Fu, L.Y.: Two effective approaches to reduce data storage in reverse time migration. Comput. Geosci. 56, 69–75 (2013)

    Article  Google Scholar 

  23. Symes, W.W.: Reverse time migration with optimal checkpointing. Geophysics 72(5), SM213–SM221 (2007)

    Google Scholar 

  24. Wang, Y.: Frequencies of the Ricker wavelet. Geophysics 80(2), A31–A37 (2015)

    Article  Google Scholar 

  25. Zand, T., Malcolm, A., Gholami, A., Richardson, A.: Compressed imaging to reduce storage in adjoint-state calculations. IEEE Trans. Geosci. Remote Sens. 57(11), 9236–9241 (2019)

    Article  Google Scholar 

  26. Zhou, H.W., Hu, H., Zou, Z., Wo, Y., Youn, O.: Reverse time migration: a prospect of seismic imaging methodology. Earth Sci. Rev. 179, 207–227 (2018)

    Article  Google Scholar 

Download references

Acknowledgements

This study was financed in part by CAPES, Brazil Finance Code 001. This work is also partially supported by FAPERJ, CNPq, and Petrobras. Computer time on Santos Dumont machine at the National Scientific Computing Laboratory (LNCC - Petrópolis).

Author information

Authors and Affiliations

  1. High-Performance Computing Center, COPPE Federal University of Rio de Janeiro, Rio de Janeiro, Brazil

    Carlos H. S. Barbosa & Alvaro L. G. A. Coutinho

Authors
  1. Carlos H. S. Barbosa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alvaro L. G. A. Coutinho
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Carlos H. S. Barbosa .

Editor information

Editors and Affiliations

  1. Federal University of Rio Grande do Sul, Porto Alegre, Brazil

    Philippe Navaux

  2. Universidad Industrial de Santander, Bucaramanga, Colombia

    Carlos J. Barrios H.

  3. Laboratório Nacional de Computação Científica, Petrópolis, Brazil

    Carla Osthoff

  4. Laboratorio Nacional de Computación de Alto Rendimiento, Santiago, Chile

    Ginés Guerrero

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Barbosa, C.H.S., Coutinho, A.L.G.A. (2022). Multi-GPU 3-D Reverse Time Migration with Minimum I/O. In: Navaux, P., Barrios H., C.J., Osthoff, C., Guerrero, G. (eds) High Performance Computing. CARLA 2022. Communications in Computer and Information Science, vol 1660. Springer, Cham. https://doi.org/10.1007/978-3-031-23821-5_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-23821-5_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-23820-8

  • Online ISBN: 978-3-031-23821-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation