Skip to main content

Advertisement

Springer Nature Link
Log in

Frame rate computing and aggregation measurement toward QoS/QoE in Video-SAR systems for UAV-borne real-time remote sensing

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

This research aims to introduce some new findings toward multimedia and communication aspects of Video-SAR imaging systems. The first suggestion is a modified frame rate computation considering all systematic design, signal, and data processing characteristics. In addition to the conventional radar models, we propose new conditions on how to take the multimedia requirements into account to respond to the radar and multimedia demands simultaneously. Since Video-SAR is eventually used by an end user, the Video-SAR designers must follow the temporal resolution requirements through the frame rate for both aspects of radar and multimedia systems. To do this, an integrated procedure is suggested to include all the required conditions. The second finding of this research is focused on the issue of data aggregation and multisource compression in Video-SAR. The proposed approach is an upper bound for aggregation ability of all the data hiding-based aggregators. This bound is found with using measurement of unoccupied space in the host image/frame. Besides, some numerical examples are provided to explain the computation of frame rate while there are different scenarios in a practical Video-SAR system. Also, we compute the unoccupied space for a radar frame compared to an optical sample to reveal the inherent characteristics of the Video-SAR data.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+
from $39.99 /Month
  • Starting from 10 chapters or articles per month
  • Access and download chapters and articles from more than 300k books and 2,500 journals
  • Cancel anytime
View plans

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

References

  1. Damini A, Balaji B, Parrya C, Mantle V (2010) A videosar mode for the X-band wideband experimental airborne radar. Proc of SPIE 7699:76990E-E76992

    Article  Google Scholar 

  2. Sandia National Laboratories, "Infrared-VideoSAR Comparison", https://www.sandia.gov/radar/video/index.html. Access date: 24 Ferbuary 2021

  3. Kim S, Ka M-H (2019) SAR raw data simulation for multiple-input multiple-output video synthetic aperture radar using beat frequency division frequency modulated continuous wave". Microw Opt Technol Lett. https://doi.org/10.1002/mop.31748

    Article  Google Scholar 

  4. Hu R, R. M, Y.M. Pi, (2017) A Video-SAR imaging technique for aspect-dependent scattering in wide angle". IEEE Sens J 17:3677–3688

    Article  Google Scholar 

  5. Song XS, Yu WD (2016) Processing video-SAR data with the fast backprojection method. IEEE Trans Aerosp Electron Syst 52:2838–2848

    Article  Google Scholar 

  6. Zhang Y, Zhu D, Mao X, Jin W (2019) Location displacement analysis on target height in VideoSAR image sequence. J Eng 2019(19):5584–5587

    Article  Google Scholar 

  7. Khosravi MR, Bahri-Aliabadi B, Samadi S, Rostami H, Karimi V (2020) A tutorial and performance analysis on ENVI tools for SAR image despeckling. Current Signal Transduction Therapy 15(2):216–223

  8. Yocky DA, West RD, Riley RM, Calloway TM (2019) Monitoring surface phenomena created by an underground chemical explosion using fully polarimetric VideoSAR. IEEE Trans Geosci Remote Sens 57(5):2481–2493

    Article  Google Scholar 

  9. Zhao S, Chen J, Yang W, Sun B, Wang Y (2015) "Image formation method for spaceborne video SAR", in Proc. of the IEEE 5th Asia-Pacific Conference on Synthetic Aperture Radar (APSAR), pp. 148–151

  10. Miller J, Bishop E, Doerry A (2013) "An Application of Backprojection for Video SAR Image Formation Exploiting a Subaperture Circular Shift Register", Proc. of SPIE Vol. 8746. https://doi.org/10.1117/12.2016417

  11. Yang X, Shi J (2020) Ground Moving Target Tracking and Refocusing Using Shadow in Video-SAR. Remote Sens. https://doi.org/10.3390/rs12183083

  12. Wallace HB (2015) Development of a video SAR for FMV through clouds. Proc SPIE. https://doi.org/10.1117/12.2181420

  13. Yan H, Mao X, Zhang J, Zhu D (2016) "Frame Rate Analysis of Video Synthetic Aperture Radar (ViSAR) ", Proceedings of ISAP2016, Okinawa, Japan. https://ieeexplore.ieee.org/document/7821422

  14. Bahri-Aliabadi B, Khosravi MR, Samadi S (2018) "Frame Rate Computing in Video SAR Using Geometrical Analysis", The 24th Int'l Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA'18), ; Las Vegas, USA, pp 165–167

  15. Kim S, Fan R, Dominski F (2018) ViSAR: A 235 GHz Radar for Airborne Applications, In Proc. IEEE Radar Conf, USA, pp 1549–1554. https://doi.org/10.1109/RADAR.2018.8378797

  16. Li Z, Dong Z (2019) An Enhanced V-BM3D Algorithm for VideoSAR Denoising Combined with Temporal Information, in Proc. of 2019 IEEE 4th International Conference on Signal and Image Processing. https://doi.org/10.1109/SIPROCESS.2019.8868569

  17. Kim S (2017) SAR video generation of MIMO video SAR with beat frequency division FMCW, 2017 11th International Conference on Signal Processing and Communication Systems (ICSPCS); Australia. https://doi.org/10.1109/ICSPCS.2017.8270460

  18. Kim S, Yu J (2017) Signal processing for a multiple-input, multiple-output (MIMO) video synthetic aperture radar (SAR) with beat frequency division frequency-modulated continuous wave (FMCW). Remote Sens 9(5):491

    Article  Google Scholar 

  19. Gu C, Chang W (2016) "The Formation of High-resolution FMCW SAR Video", 2016 Progress In Electromagnetic Research Symposium (PIERS); China

  20. Zhang Y, Zhu D (2020) Scattering key-frame extraction for comprehensive VideoSAR summarization: a spatiotemporal background subtraction perspective. IEEE Trans Instrum Meas 69(7):4768–4784

    Article  Google Scholar 

  21. Liu B, Zhang X, Tang K, Liu M, Liu L (2016) "Spaceborne video-sar moving target surveillance system", in Proc. of IEEE International Geoscience and Remote Sensing Symposium (IGARSS)

  22. Zhang Y, Zhu D (2018) Height Retrieval in Postprocessing-based VideoSAR Image Sequence Using Shadow Information. IEEE Sens J 18(19):8108–8116. https://doi.org/10.1109/JSEN.2018.2865112

  23. Jian L (2018) An efficient image formation algorithm for spaceborne video SAR, in Proc. of IEEE International Geoscience and Remote Sensing Symposium (IGARSS). https://doi.org/10.1109/IGARSS.2018.8517711

  24. Yocky DA, West RD (2019) Monitoring surface phenomena created by an underground chemical explosion using fully polarimetric VideoSAR. IEEE Trans Geosci Remote Sens 57(5):2481–2493

    Article  Google Scholar 

  25. Wang D, Zhu D, Liu R (2019) "Video SAR High-speed Processing Technology Based on FPGA", 2019 IEEE MTT-S International Microwave Biomedical Conference (IMBioC), China

  26. Liang J, Zhang H (2019) Study on pointing accuracy effect on image quality of space-borne video SAR. IOP Conf Series: Mater Sci Eng 490(2019):072011. https://doi.org/10.1088/1757-899X/490/7/072011

    Article  Google Scholar 

  27. Hu R, Li X (2019) Refocusing and Zoom-In Polar Format Algorithm for Curvilinear Spotlight SAR Imaging on Arbitrary Region of Interest. IEEE Transactions on Geoscience and Remote Sens 57(10):7995–8010

  28. Zuo F, Min R (2019) Improved method of video synthetic aperture radar imaging algorithm. IEEE Geosci Remote Sens Lett 6(16):897–901

    Article  Google Scholar 

  29. Linnehan R, Miller J, Asadi A (2019) "Map-drift autofocus and scene stabilization for video-SAR", 2018 IEEE Radar Conference (RadarConf18), 2019; USA

  30. Jian L, Running Z (2018) "An Efficient Image Formation Algorithm for Spaceborne Video SAR", in Proc. of IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Spain

  31. Hu R, Min R, Zuo F, Pi Y (2019) "An algorithm for persistent imaging of curvilinear video SAR", 2018 IEEE Radar Conference (RadarConf18), USA

  32. Ding J, Xu Z (2018) Efficient doppler ambiguity resolver for video SAR. Electron Lett 54(7):443–445

    Article  Google Scholar 

  33. Tian X, Liu J (2021) Simultaneous Detection and Tracking of Moving-Target Shadows in ViSAR Imagery, IEEE Transactions on Geoscience and Remote Sensing, 2021

  34. Liu Z, An D (2019) "Moving Target Shadow Detection and Global Background Reconstruction for VideoSAR Based on Single-Frame Imagery", IEEE Access, 2019

  35. Liao L, Zhu D (2016) "An Approach for Detecting Moving Target in VideoSAR Imagery Sequence", 2016 CIE International Conference on Radar (RADAR), China

  36. Wang H, Chen Z, Zheng S (2017) "Preliminary Research of Low-RCS Moving Target Detection Based on Ka-Band Video SAR", IEEE Geoscience and Remote Sensing Letters

  37. Zhang Y, Yang S, Li H, Xu Z (2018) "Shadow tracking of moving target based on CNN for video SAR system", in Proc. of IEEE International Geoscience and Remote Sensing Symposium (IGARSS)

  38. Damini A, Mantle V, Davidson G (2013) "A New Approach to Coherent Change Detection in VideoSAR Imagery using Stack Averaged Coherence", IEEE Radar Conference (RadarCon13),

  39. Li Z, Yu A (2019) Suppressing false alarm in VideoSAR via gradient-weighted edge information. Remote Sens 11(2677):2019

    Google Scholar 

  40. Khosravi MR, Samadi S (2019) "Data compression in ViSAR sensor networks using non-linear adaptive weighting. EURASIP J Wirel Commun Netw. https://doi.org/10.1186/s13638-019-1577-z

    Article  Google Scholar 

  41. Khosravi MR, Samadi S (2020) Reliable data aggregation in internet of ViSAR vehicles using chained dual-phase adaptive interpolation and data embedding. IEEE Internet Things J 7(4):2603–2610

    Article  Google Scholar 

  42. Khosravi MR, Samadi S (2019) Efficient payload communications for IoT-enabled ViSAR vehicles using discrete cosine transform-based quasi-sparse bit injection. EURASIP J Wirel Commun Netw 2019:262

    Article  Google Scholar 

  43. Khosravi MR, Samadi S (2019) Modified Data Aggregation for Aerial ViSAR Sensor Networks in Transform Domain, The 25th Int'l Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA'19), 2019; Las Vegas, USA

  44. Khosravi MR, Samadi S, Mohseni R (2020) Spatial interpolators for intra-frame resampling of SAR videos: a comparative study using real-time HD, medical and radar data. Current Signal Transduction Therapy 15(2):136–188. https://doi.org/10.2174/2213275912666190618165125

  45. Zhang Y, Zhu D, Mao X, Yu X, Zhang J, Li Y (2020) Multirotors Video Synthetic Aperture Radar: System Development and Signal Processing. IEEE A&E Systems Magazine. https://doi.org/10.1109/MAES.2020.3000318

  46. Khosravi MR, Samadi S (2021) Mobile multimedia computing in cyber-physical surveillance services through UAV-borne video-SAR: a taxonomy of intelligent data processing for IoMT-enabled radar sensor networks. Tsinghua Sci Technol. https://doi.org/10.26599/TST.2021.9010013

    Article  Google Scholar 

  47. Khosravi MR, Samadi S (2021) BL-ALM: a blind scalable edge-guided reconstruction filter for smart environmental monitoring through green IoMT-UAV networks. IEEE Trans Green Commun Netw. https://doi.org/10.1109/TGCN.2021.3067555

    Article  Google Scholar 

  48. Meyer S (2018) "PhaseNet for Video Frame Interpolation", International Conference on Computer Vision and Pattern Recognition (CVPR),

  49. Jamshidi A, Yazdi M, Manafi M (2017) Image compression based on intelligent information removing and inpainting reconstruction algorithms. J Signal Data Proces 14(2):97–114

    Article  Google Scholar 

  50. Khosravi MR, Yazdi M (2018) A lossless data hiding scheme for medical images using a hybrid solution based on IBRW error histogram computation and quartered interpolation with greedy weights. Neural Comput Appl 30:2017–2028

    Article  Google Scholar 

  51. Khosravi MR (2021) ACI: a bar chart index for non-linear visualization of data embedding and aggregation capacity in IoMT multi-source compression. Wireless Netw. https://doi.org/10.1007/s11276-021-02626-x

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Electronics Engineering, Shiraz University of Technology, Shiraz, Iran

    Mohammad R. Khosravi & Sadegh Samadi

Authors
  1. Mohammad R. Khosravi
    View author publications

    Search author on:PubMed Google Scholar

  2. Sadegh Samadi
    View author publications

    Search author on:PubMed Google Scholar

Corresponding author

Correspondence to Mohammad R. Khosravi.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khosravi, M.R., Samadi, S. Frame rate computing and aggregation measurement toward QoS/QoE in Video-SAR systems for UAV-borne real-time remote sensing. J Supercomput 77, 14565–14582 (2021). https://doi.org/10.1007/s11227-021-03869-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-021-03869-3

Keywords