Skip to main content
Log in

Beamforming and Scalable Image Processing in Vehicle-to-Vehicle Networks

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

Vehicle to Vehicle (V2V) communication allows vehicles to wirelessly exchange information on the surrounding environment and enables cooperative perception. It helps prevent accidents, increase the safety of the passengers, and improve the traffic flow efficiency. However, these benefits can only come when the vehicles can communicate with each other in a fast and reliable manner. Therefore, we investigated two areas to improve the communication quality of V2V: First, using beamforming to increase the bandwidth of V2V communication by establishing accurate and stable collaborative beam connection between vehicles on the road; second, ensuring scalable transmission to decrease the amount of data to be transmitted, thus reduce the bandwidth requirements needed for collaborative perception of autonomous driving vehicles. Beamforming in V2V communication can be achieved by utilizing image-based and LIDAR’s 3D data-based vehicle detection and tracking. For vehicle detection and tracking simulation, we tested the Single Shot Multibox Detector deep learning-based object detection method that can achieve a mean Average Precision of 0.837 and the Kalman filter for tracking. For scalable transmission, we simulate the effect of varying pixel resolutions as well as different image compression techniques on the file size of data. Results show that without compression, the file size for only transmitting the bounding boxes containing detected object is up to 10 times less than the original file size. Similar results are also observed when the file is compressed by lossless and lossy compression to varying degrees. Based on these findings using existing databases, the impact of these compression methods and methods of effectively combining feature maps on the performance of object detection and tracking models will be further tested in the real-world autonomous driving system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6

Similar content being viewed by others

References

  1. Dong, Z., Shi, W., Tong, G., & Yang, K. (2020). Collaborative Autonomous Driving: Vision and Challenges.

  2. Choi, J., Va, V., Gonzalez-Prelcic, N., Daniels, R., Bhat, C. R., & Heath, R. W. (2016). Millimeter-Wave Vehicular Communication to Support Massive Automotive Sensing. IEEE Communications Magazine, 54(12), 160–167. https://doi.org/10.1109/MCOM.2016.1600071CM

    Article  Google Scholar 

  3. Uijlings, J. R., Van De Sande, K. E., Gevers, T., & Smeulders, A. W. (2013). Selective search for object recognition. International journal of computer vision, 104(2), 154–171.

    Article  Google Scholar 

  4. Chih-Fon, T. (2012). "Bag-of-words representation in image annotation: A review." International Scholarly Research Notices 2012.

  5. Liang, L., Liu, C., Shum, H. Y. (2001). Real-time texture synthesis by patch-based sampling. Technical Report MSR-TR-2001–40, Microsoft Research, 2001.

  6. Eltanany A.S., SAfy Elwan M., Amein A.S. (2020). Key Point Detection Techniques. In: Hassanien A., Shaalan K., Tolba M. (eds) Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2019. AISI 2019. Advances in Intelligent Systems and Computing, vol 1058. Springer, Cham

  7. Yurtsever, E., Lambert, J., Carballo, A., & Takeda, K. (2020). A survey of autonomous driving: Common practices and emerging technologies. IEEE Access, 8, 58443–58469.

    Article  Google Scholar 

  8. Redmon, J., Divvala, S.K., Girshick, R.B., Farhadi A. (2016). “You only look once: Unified, real-time object detection,” 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 779–788.

  9. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C. Y., Berg, A. C. (2015) “SSD: Single shot MultiBox detector,”.

  10. Che, E., Jung, J., & Olsen, M. J. (2019). Object Recognition, Segmentation, and Classification of Mobile Laser Scanning Point Clouds: A State of the Art Review. Sensors, 19(4), 810.

    Article  Google Scholar 

  11. Hernández, J. (2009). Marcotegui, B. Filtering of artifacts and pavement segmentation from mobile lidar data. In Proceedings of the 2009 ISPRS Workshop on Laser Scanning, Paris, France, 1–2.

  12. Xiao, W., Vallet, B., Schindler, K., Paparoditis, N. (2016). Street-side vehicle detection, classification and change detection using mobile laser scanning data. ISPRS Journal of Photogrammetry and Remote Sensing, 114, 166–178. 

  13. Geiger, A., Lenz, P., Urta-sun, R. (2012) “”Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite”. In: Conference on Computer Vision and Pattern Recognitioon (CVPR).

  14. Geiger A et al. (2013). “Vision meets Robotics: The KITTI Dataset”. In: International Journal oof Robotics Research (IJRR).

  15. Everingham, M. et al. (2007). The PASCAL Visual Object Classes Challenge 2007 (VOC2007) Results. https://www.pascal-network.org/challenges/VOC/voc2007/workshop/index.html.

  16. Everingham, M. et al. (2012). The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results. https://www.pascal-network.org/challenges/VOC/voc2012/

  17. Lin T.Y. et al. (2014). Microsoft COCO: Common Objects in Context. In: Fleet D., Pajdla T., Schiele B., Tuytelaars T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8693. Springer, Cham

  18. Ali, E., Ismail, M., Nordin, R., et al. (2017). Beamforming techniques for massive MIMO systems in 5G: Overview, classification, and trends for future research. Frontiers Inf Technol Electronic Eng, 18, 753–772. https://doi.org/10.1631/FITEE.1601817

    Article  Google Scholar 

  19. Urmson, C., Anhalt, J., Bagnell, D., Baker, C., Bittner, R., Clark, M., Dolan, J., Duggins, D., Galatali, T., Geyer, C., et al. (2008). Autonomous driving in urban environments: Boss and the urban challenge. Journal of Field Robotics, 25(8), 425–466.

    Article  Google Scholar 

  20. Lambert, J., Liang, L., Morales Y., Akai N., Carballo A., Takeuchi, E., Narksri, P., Seiya, S., Takeda, K., (2018). “Tsukuba challenge 2017 dynamic object tracks dataset for pedestrian behavior analysis,” Journal of Robotics and Mechatronics (JRM), vol. 30, no. 4.

  21. Dubuisson, M., Jain, A.K. (1994) “A modified hausdorff distance for object matching,”. In Proceedings of 12th International Conference on Pattern Recognition, vol. 1, pp. 566–568 vol. 1.

  22. Balanca, P, (2017). SSD: Single Shot MultiBox Detector in Tensorflow. SSD-Tensorflow. https://github.com/balancap/SSD-Tensorflow.

  23. Qiao, S., Liang-Chieh C., Yuille, A.L., (2020). “DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolution.” ArXiv abs/2006.02334: n. pag.

  24. Barret, Z., Ghiasi, G., Lin, T.Y., Cui, Y., Liu, H., Cubuk, E.D., Le, Q.V. (2020) “Rethinking Pre-training and Self-training.” ArXiv abs/2006.06882 (2020): n. pag.

  25. Kanthasamy, N., Du R., Gill, K. S., Wyglinski, A. M., Cowlagi, R. (2018) "Assessment of Positioning Errors on V2V Networks Employing Dual Beamforming,". IEEE 88th Vehicular Technology Conference (VTC-Fall), pp. 1–5. https://doi.org/10.1109/VTCFall.2018.8690921

  26. Ziv, J., & Lempel, A. (1978). Compression of individual sequences via variable-rate coding. IEEE Transactions on Information Theory., 24(5), 530. https://doi.org/10.1109/TIT.1978.1055934

    Article  MathSciNet  MATH  Google Scholar 

  27. DEUTSCH, Peter. GZIP file format specification version 4.3. 1996.

  28. BURROWS, Michael et WHEELER, David J. A block-sorting lossless data compression algorithm. 1994.

  29. PAVLOV, Igor. 7-Zip. URL http://www.7-zip.org/, 2012

  30. COLLET, Yann, et al. Lz4: Extremely fast compression algorithm. URL http://lz4.github.io/lz4/, 2013

Download references

Acknowledgements

This research was partly supported by NSF ECCS # 2010366 to Drs. Wang and Fang.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Honggang Wang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ngo, H., Fang, H. & Wang, H. Beamforming and Scalable Image Processing in Vehicle-to-Vehicle Networks. J Sign Process Syst 94, 445–454 (2022). https://doi.org/10.1007/s11265-021-01696-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-021-01696-6

Keywords

Navigation