Skip to main content

Advertisement

Springer Nature Link
Log in

Supereye: smart advertisement insertion for online video streaming

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Without any doubt, state of art advertisement insertion mechanisms along with the requested video content has emerged to be the most crucial part of online video delivery ecosystems. There are several widely deployed methods which have been used since the first days of video streaming such as tag word matching between video content versus advertisement content along with manual matching-based approaches. Conventional but non-scalable and context independent methods cannot fulfil the requirements of an online video platform when there are several millions of user generated videos along with premium content and advertisement of varying production quality. In such environment, a content aware advertisement insertion framework is required based on object recognition, machine learning and artificial intelligence to understand the context of the video and match appropriate advertisement and stitch the advertisement at the most convenient moment of the target video content. In this paper, SuperEye; a deployment ready, content aware, scalable, distributed advertisement insertion framework for a 5G oriented online video platform is designed and developed. The foundational object analyzing mechanism of the underlying system examine each particular context that is part of the wider video and advertisement catalogue using object recognition while generating a time-lapse map of all objects that are detected through the video. Based upon this information, the framework matches the most significant object that is detected for a particular interval and associates the advertisement with similar properties. Additionally, this novel technique does not require any watch history or personalized data related to the user, but primarily interested in only the current requested content information. Therefore, this framework can work along with any type of recommendation engine or rank based association algorithm. The proposed framework is independent of the user information and regarding the subjective user results collected, successful video to ad match ratios of SuperEye significantly exceed the current implementations of YouTube, Vimeo and DailyMotion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Ahad MA et al (2019) Handling small size files in Hadoop: challenges, opportunities, and review. Soft Comput Data Anal. pp 653-663, 2018. India

  2. Apatean A et al (2016) “An Intelligent Eye-Detection Based, Vocal E-Book Reader for The Internet Of Things”. Acta Technica Napocensis Electron Telecomm, Volume 57, Number 2, Romania.

  3. Bouraqia K, … Ladid L (2020) Quality of experience for streaming services: measurements, challenges and insights. IEEE Access 8:13341–13361

    Article  Google Scholar 

  4. Bryan RN et al (2020) Medical image analysis: human and machine. Acad Rad Special Rev 27(1):P76–P78 USA

    Article  Google Scholar 

  5. Bulkan U et al (2020) Modelling quality of experience for online video advertisement insertion. IEEE Trans Broadcasting, 2020 United Kingdom

  6. Çambay VY, … (2019) International artificial intelligence and data processing symposium (IDAP), 2019. Malatya, Turkey

  7. Checkley G “Video recommendation based on video titles”, patent no: US10387431B2, 2020. USA

  8. Dharavath R et al (2020) Capturing anomalies of Cassandra performance with increase in data volume: a NoSQL analytical approach. Adv Data Sci Manag pp 3-20, 2020. India

  9. Duan R et al (2019) “Object recognition and Localization Base on binocular vision”, IGTA image and graphics technologies and applications pp 300-309, 2019. China

  10. Dutta S et al (2020) “Crowd behavior analysis and alert system using image processing”, emerging Technology in Modelling and Graphics pp 721-729, 2019. India

  11. Eldering CA “Advertisement insertion techniques for digital video streams”, patent no: US6704930B1, 2020, USA.

  12. Fiedler M et al (2010) “A generic quantitative relationship between quality of experience and quality of service”, IEEE Network, volume: 24, issue: 2, 2010. USA.

  13. Foulsham M (2019) “Living with the new general data protection regulation (GDPR)”, financial compliance, Palgrave Macmillan, Cham, 2019. USA

  14. Fu J et al (2020) “Contextual deconvolution network for semantic segmentation. Patt Recogn, 101, 2020. China

  15. Gong W et al “Visual signal representation for fast and robust object recognition”, IEEE 18th European control conference(ECC), 2019. Italy

  16. Guo S et al (2019) Foreign object detection of transmission lines based on faster R-CNN. Springer Inform Sci Appl:269–275

  17. Harijanto B et al (2020) “Recognition of the character on the map captured by the camera using k-nearest neighbor”, IOP conference series: materials science and engineering, 2020. Japan

  18. Hayakawa Y et al (2020) “Feature extraction of video using artificial neural network”, deep learning and neural networks: concepts, methodologies, tools, and applications, 2020. Japan

  19. Hossfeld T et al (2011) “Quantification of YouTube QoE via crowdsourcing”, 2011 IEEE international symposium on multimedia. Dana Point CA, USA

  20. Isaak J et al (2018) “User data privacy: Facebook, Cambridge Analytica, and privacy protection”, IEEE computer, 2018. USA

  21. ITU-T, Telecommunication Standardization Sector OF ITU, P.912 (03–2016) “Subjective video quality assessment methods for recognition tasks”, “Series P: Terminals and Subjective And Objective Assessment Methods”, Audiovisual quality in multimedia services. (online) https://www.itu.int/rec/T-REC-P.912

  22. Ketyko I et al “QoE measurement of Mobile YouTube video streaming”, MoViD proceedings of the 3rd workshop on Mobile video delivery, October 2010. Italy.

  23. Khan UA, et al (2020) “Movie tags prediction and segmentation using deep learning”, IEEE access, 2020, USA

  24. Kustikova, V. et al, “Intel Distribution of OpenVINO Toolkit: A Case Study of Semantic Segmentation”, AIST 2019: Analysis of images, social networks and texts pp 11-23, 2019, Russia

  25. Leon V et al (2020) “A TensorFlow extension framework for optimized generation of hardware CNN inference engines”, special issue MOCAST: modern circuits and systems technologies on electronics, 2019. Athens

  26. Licciardello M et al (2020) Understanding video streaming algorithms in the wild. Networking Int Archit, 2020. Germany

  27. Liss B “Interactive advertising system with tracking of viewer's engagement”, patent no: US10514823B1, 2020. USA

  28. Marthews A et al (2019) Privacy policy and competition. Economic Studies at Brookings, December

  29. Mohamed KS (2020) “Parallel computing: OpenMP, MPI, and CUDA”, springer neuromorphic computing and beyond pp 63-93, 2020. Egypt

  30. Osterle H (2020) “Life with machine intelligence”, springer nature life engineering, 2019. Switzerland

  31. Pathan M et al (2008) Content delivery networks: state of the art, insights, and imperatives. Content Deliv Networks. pp 3-32, 2020. India

  32. Qian X et al (2020) “Object detection in remote sensing images based on improved bounding box regression and multi-level features fusion”, image processing and spatial neighborhoods for remote sensing data analysis, 2020. China

  33. Susmitha AVV (2020) Smart recognition system for business predictions (you only look once – V3) unified, real-time object detection. springer internet of things for industry 4.0 pp 137-146, 2019, India

  34. Urban T et al (2019) “A study on subject data access in online advertising after the GDPR”, data privacy management, cryptocurrencies and Blockchain technology, springer, Cham, 2019. Luxembourg

  35. Wamser F et al (2012) “Utilizing buffered YouTube playtime for QoE-oriented scheduling in OFDMA networks”, 24th International Teletraffic Congress (ITC 24). Krakow. Poland 24:288–302

    Google Scholar 

  36. Wang X (2020) “Supervised learning for data classification based object recognition”, machine learning-based natural scene recognition for Mobile robot localization in an unknown environment, springer, 2020. Singapore

  37. Wen L et al (2020) “UA-DETRAC: a new benchmark and protocol for multi-object detection and tracking”, Elsevier computer vision and image understanding, 2020. USA

  38. Wu X et al (2020) “SVM-based image partitioning for vision recognition of AGV guide paths under complex illumination conditions”, robotics and computer-integrated manufacturing, 2019. China

  39. Zhaoping L (2020) “Artificial and natural intelligence: from invention to discovery”, ScienceDirect neuron, 2019. Beijing

Download references

Author information

Authors and Affiliations

  1. London South Bank University School of Engineering, London, UK

    Utku Bulkan, Tasos Dagiuklas & Muddesar Iqbal

Authors
  1. Utku Bulkan
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Tasos Dagiuklas
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Muddesar Iqbal
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Utku Bulkan.

Ethics declarations

Conflıct of interest dısclosure

Authors: * Bulkan, U., Dagiuklas T. and Iqbal, M. declare that they have no conflict of interest.

Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bulkan, U., Dagiuklas, T. & Iqbal, M. Supereye: smart advertisement insertion for online video streaming. Multimed Tools Appl 82, 9361–9379 (2023). https://doi.org/10.1007/s11042-022-13469-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13469-9

Keywords