ABSTRACT
Commercial conversational search engines need a business model. Since advertising is the main source of revenue for “traditional” ten-blue-links web search, ads are not an unlikely option for conversational search either. In traditional web search, ads are usually placed above organic search results. However, large language models (LLMs) may be dynamically prompted to blend product placements with “organic” conversational responses, similar to native advertising in journalism. This type of advertising can be very difficult to recognize, depending on how subtly it is integrated and disclosed. To raise awareness of this potential development, we analyze the capabilities of current LLMs to blend ads with generative search results. In a user study, we ask people about the perceived quality of (emulated) search results in different advertising scenarios. In a substantial number of cases, our survey participants do not notice brand or product placements when they do not expect them. Thus, our results show the potential of LLMs to subtly mix advertising with generated search results. This warrants further investigation, for example, to develop appropriate advertising disclosure rules, and to detect advertising in generated results. Our research also raises broader concerns about whether commercial or open-source generative models can be trusted not to be fine-tuned to generate ads rather than “genuine” responses.
- Vibhanshu Abhishek and Kartik Hosanagar. 2007. Keyword Generation for Search Engine Advertising Using Semantic Similarity between Terms. In Proceedings of ICPS 2007. 89–94.Google ScholarDigital Library
- Michelle A. Amazeen and Bartosz W. Wojdynski. 2020. The Effects of Disclosure Format on Native Advertising Recognition and Audience Perceptions of Legacy and Online News Publishers. Journalism 21, 12 (2020), 1965–1984.Google ScholarCross Ref
- Susan Auty and Charlie Lewis. 2004. Exploring Children’s Choice: The Reminder Effect of Product Placement. Psychology & Marketing 21, 9 (2004), 697–713.Google ScholarCross Ref
- Yana R. Avramova, Patrick De Pelsmacker, and Nathalie Dens. 2017. Brand Placement in Text: The Short-and Long-Term Effects of Placement Modality and Need for Cognition. International Journal of Advertising 36, 5 (2017), 682–704.Google ScholarCross Ref
- Terrence M. Barnhardt, Isabel Manzano, Maria Brito, Melissa Myrick, and Steven M. Smith. 2016. The Effects of Product Placement in Fictitious Literature on Consumer Purchase Intention. Psychology & marketing 33, 11 (2016), 883–898.Google Scholar
- S. Bartlett Boughton. 2005. Search Engine Marketing. Perspectives in Business 2, 1 (2005), 29–33.Google Scholar
- Nataliya Boyko and Yuliia Kholodetska. 2022. Using Artificial Intelligence Algorithms in Advertising. In Proceedings of CSIT 2022. 317–321.Google ScholarCross Ref
- Colin Campbell, Kirk Plangger, Sean Sands, and Jan Kietzmann. 2022. Preparing for an Era of Deepfakes and AI-Generated Ads: A Framework for Understanding Responses to Manipulated Advertising. Journal of Advertising 51, 1 (2022), 22–38.Google ScholarCross Ref
- Ye Chen, Michael Kapralov, Dmitry Pavlov, and John F. Canny. 2009. Factor Modeling for Advertisement Targeting. In Proceedings of NeurIPS 2009. 324–332.Google Scholar
- Jin-A. Choi and Kiho Lim. 2020. Identifying Machine Learning Techniques for Classification of Target Advertising. ICT Express 6, 3 (2020), 175–180.Google ScholarCross Ref
- Michael F. Cramphorn and Denny Meyer. 2009. The Gear Model of Advertising-Modelling Human Response to Advertising Stimuli. International Journal of Market Research 51, 3 (2009), 1–17.Google ScholarCross Ref
- Juan Feng, Hemant Bhargava, and David Pennock. 2007. Implementing Sponsored Search in Web Search Engines: Computational Evaluation of Alternative Mechanisms. INFORMS Journal on Computing 19, 1 (2007), 137–148.Google ScholarDigital Library
- Ariel Fuxman, Panayiotis Tsaparas, Kannan Achan, and Rakesh Agrawal. 2008. Using the Wisdom of the Crowds for Keyword Generation. In Proceedings of WWW 2008. 61–70.Google ScholarDigital Library
- Laura Granka, Helene Hembrooke, and Geri Gay. 2006. Location Location Location: Viewing Patterns on WWW Pages. In Proceedings of ETRA 2006. 43–43.Google ScholarDigital Library
- Erik Hermann. 2022. Leveraging Artificial Intelligence in Marketing for Social Good — An Ethical Perspective. Journal of Business Ethics 179, 1 (2022), 43–61.Google ScholarCross Ref
- Dustin Hillard, Stefan Schroedl, Eren Manavoglu, Hema Raghavan, and Chris Leggetter. 2010. Improving Ad Relevance in Sponsored Search. In Proceedings of WSDM 2010. 361–370.Google ScholarDigital Library
- J. Weston Hughes, Keng-hao Chang, and Ruofei Zhang. 2019. Generating Better Search Engine Text Advertisements with Deep Reinforcement Learning. In Proceedings of SIGKDD 2019. 2269–2277.Google ScholarDigital Library
- Deborah Hümpfner and Markus Appel. 2020. Native Advertising: Werbung, die nicht als solche erkannt werden will. In Die Psychologie des Postfaktischen: Über Fake News,„Lügenpresse“, Clickbait & Co.Springer, 59–66.Google Scholar
- Hamed Jafarzadeh, Aybüke Aurum, John D’Ambra, and Amir Ghapanchi. 2015. A Systematic Review on Search Engine Advertising. Pacific Asia Journal of the Association for Information Systems 7, 3 (2015), 1–32.Google ScholarCross Ref
- Jim Jansen. 2011. Understanding Sponsored Search: Core Elements of Keyword Advertising. Cambridge University Press.Google Scholar
- Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, and Geri Gay. 2005. Accurately Interpreting Clickthrough Data as Implicit Feedback. In Proceedings of SIGIR 2005. 4–11.Google ScholarDigital Library
- Hidetaka Kamigaito, Peinan Zhang, Hiroya Takamura, and Manabu Okumura. 2021. An Empirical Study of Generating Texts for Search Engine Advertising. In Proceedings of NAACL-HLT 2021. 255–262.Google ScholarCross Ref
- Diane Kelly and Leif Azzopardi. 2015. How Many Results per Page? A Study of SERP Size, Search Behavior and User Experience. In Proceedings of SIGIR 2015. 183–192.Google Scholar
- Jan Kietzmann, Jeannette Paschen, and Emily Treen. 2018. Artificial Intelligence in Advertising. Journal of Advertising Research 58, 3 (2018), 263–267.Google ScholarCross Ref
- Erwin Lammenett. 2021. Praxiswissen Online-Marketing: Affiliate-, Influencer-, Content-, Social-Media-, Amazon-, Voice-, B2B-, Sprachassistenten-und E-Mail-Marketing, Google Ads, SEO. Springer.Google Scholar
- Dirk Lewandowski. 2017. Users’ Understanding of Search Engine Advertisements. Journal of Information Science Theory and Practice 5, 4 (2017), 6–25.Google Scholar
- Dirk Lewandowski, Friederike Kerkmann, Sandra Rümmele, and Sebastian Sünkler. 2018. An Empirical Investigation on Search Engine Ad Disclosure. Journal of the Association for Information Science and Technology 69, 3 (2018), 420–437.Google ScholarDigital Library
- Colin Porlezza. 2017. Digitaler Journalismus zwischen News und Native Advertising – Risiken und Nebenwirkungen einer heiklen Beziehung. In Abbruch-Umbruch-Aufbruch. Nomos, 249–270.Google Scholar
- Khowanas Saeed Qader, Pshdar Abdalla Hamza, Rizhin Nuree Othman, Sanarya Adnan Anwer, Hawkar Anwar Hamad, Bayar Gardi, Hamin Khasrow Ibrahim, 2022. Analyzing Different Types of Advertising and its Influence on Customer Choice. International Journal of Humanities and Education Development (IJHED) 4, 6 (2022), 8–21.Google ScholarCross Ref
- Weizhen Qi, Yeyun Gong, Yu Yan, Jian Jiao, Bo Shao, Ruofei Zhang, Houqiang Li, Nan Duan, and Ming Zhou. 2020. ProphetNet-Ads: A Looking Ahead Strategy for Generative Retrieval Models in Sponsored Search Engine. In Proceedings of NLPCC 2020. 305–317.Google ScholarDigital Library
- Xuebing Qin and Zhibin Jiang. 2019. The Impact of AI on the Advertising Process: The Chinese Experience. Journal of Advertising 48, 4 (2019), 338–346.Google ScholarCross Ref
- Matthew Richardson, Ewa Dominowska, and Robert Ragno. 2007. Predicting Clicks: Estimating the Click-Through Rate for New Ads. In Proceedings of WWW 2007. 521–530.Google ScholarDigital Library
- Erin E. Schauster, Patrick Ferrucci, and Marlene S. Neill. 2016. Native Advertising is the New Journalism: How Deception Affects Social Responsibility. American Behavioral Scientist 60, 12 (2016), 1408–1424.Google ScholarCross Ref
- Ravi Sen. 2005. Optimal Search Engine Marketing Strategy. International Journal of Electronic Commerce 10, 1 (2005), 9–25.Google ScholarDigital Library
- Michael Shumanov, Holly B. Cooper, and Michael T. Ewing. 2021. Using AI Predicted Personality to Enhance Advertising Effectiveness. European Journal of Marketing 56, 6 (2021), 1590–1609.Google ScholarCross Ref
- Benjamin C. Storm and Eve Stoller. 2015. Exposure to Product Placement in Text can Influence Consumer Judgments. Applied Cognitive Psychology 29, 1 (2015), 20–31.Google ScholarCross Ref
- Carlo Strapparava, Alessandro Valitutti, and Oliviero Stock. 2007. Automatizing Two Creative Functions for Advertising. In Proceedings of IJWCC 2007. 99–108.Google Scholar
- Wei Sun, Ying Li, Anshul Sheopuri, and Thales Teixeira. 2018. Computational Creative Advertisements. In Proceedings of WWW 2018 (Companion Volume. 1155–1162.Google ScholarDigital Library
- Demetrios Vakratsas and Xin (Shane) Wang. 2021. Artificial Intelligence in Advertising Creativity. Journal of Advertising 50, 1 (2021), 39–51.Google ScholarCross Ref
- William M. Weilbacher. 2003. How Advertising Affects Consumers. Journal of Advertising Research 43, 2 (2003), 230–234.Google ScholarCross Ref
- Bartosz W. Wojdynski. 2016. The Deceptiveness of Sponsored News Articles: How Readers Recognize and Perceive Native Advertising. American Behavioral Scientist 60, 12 (2016), 1475–1491.Google ScholarCross Ref
- Ping Xiao and Josep Blat. 2013. Generating Apt Metaphor Ideas for Pictorial Advertisements. In Proceedings of ICCC 2013. 8–15.Google Scholar
- Ines Zelch, Matthias Hagen, and Martin Potthast. 2023. Commercialized Generative AI: A Critical Study of the Feasibility and Ethics of Generating Native Advertising Using Large Language Models in Conversational Web Search. In 5th International Symposium on Open Search Technology (OSSYM 2023). International Open Search Symposium.Google Scholar
Index Terms
- A User Study on the Acceptance of Native Advertising in Generative IR
Recommendations
Consumer Search Activities and the Value of Ad Positions in Sponsored Search Advertising
Consumer search activities can be endogenously determined by the ad positions in sponsored search advertising. We model how advertisers compete for ad positions in sponsored listings and, conditional on the list of sponsored ads, how online consumers ...
Search advertising placement strategy: Exploring the efficacy of the conventional wisdom
Search advertising is one of the most important forms of electronic commerce. While click-through rates are considered a key measure of search advertising effectiveness by search providers, brand attention can also be a valuable objective. Our paper ...
Predicting user response to sponsored advertising on social media via the technology acceptance model
Sponsored advertising has generated strong advertising revenues for Facebook in recent years. As sponsored ads are built on an interactive platform that could be seen as invasive to user privacy, the growth of this advertising platform has important ...
Comments