skip to main content
research-article

Conversational Context-sensitive Ad Generation with a Few Core-Queries

Published: 11 September 2023 Publication History

Abstract

When people are talking together in front of digital signage, advertisements that are aware of the context of the dialogue will work the most effectively. However, it has been challenging for computer systems to retrieve the appropriate advertisement from among the many options presented in large databases. Our proposed system, the Conversational Context-sensitive Advertisement generator (CoCoA), is the first attempt to apply masked word prediction to web information retrieval that takes into account the dialogue context. The novelty of CoCoA is that advertisers simply need to prepare a few abstract phrases, called Core-Queries, and then CoCoA automatically generates a context-sensitive expression as a complete search query by utilizing a masked word prediction technique that adds a word related to the dialogue context to one of the prepared Core-Queries. This automatic generation frees the advertisers from having to come up with context-sensitive phrases to attract users’ attention. Another unique point is that the modified Core-Query offers users speaking in front of the CoCoA system a list of context-sensitive advertisements. CoCoA was evaluated by crowd workers regarding the context-sensitivity of the generated search queries against the dialogue text of multiple domains prepared in advance. The results indicated that CoCoA could present more contextual and practical advertisements than other web-retrieval systems. Moreover, CoCoA acquired a higher evaluation in a particular conversation that included many travel topics to which the Core-Queries were designated, implying that it succeeded in adapting the Core-Queries for the specific ongoing context better than the compared method without any effort on the part of the advertisers. In addition, case studies with users and advertisers revealed that the context-sensitive advertisements generated by CoCoA also had an effect on the content of the ongoing dialogue. Specifically, since pairs unfamiliar with each other more frequently referred to the advertisement CoCoA displayed, the advertisements had an effect on the topics about which the pairs spoke. Moreover, participants of an advertiser role recognized that some of the search queries generated by CoCoA fit the context of a conversation and that CoCoA improved the effect of the advertisement. In particular, they learned how to design of designing a good Core-Query at ease by observing the users’ response to the advertisements retrieved with the generated search queries.

References

[1]
Zeynep Akkalyoncu Yilmaz, Shengjin Wang, Wei Yang, Haotian Zhang, and Jimmy Lin. 2019. Applying BERT to document retrieval with Birch. In Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, 19–24. DOI:
[2]
Ziv Bar-Yossef and Naama Kraus. 2011. Context-sensitive query auto-completion. In Proceedings of the 20th International Conference on World Wide Web (WWW’11). Association for Computing Machinery, New York, NY, 107–116. DOI:
[3]
Antoine Bordes, Y.-Lan Boureau, and Jason Weston. 2017. Learning end-to-end goal-oriented dialog. In Proceedings of the International Conference on Learning Representations. Retrieved from https://openreview.net/forum?id=S1Bb3D5gg.
[4]
Salem Mohamed S. Busen and Che Su Mustaffa. 2014. The role of interactive advertisements in developing consumer-based brand equity: A conceptual discourse. Procedia-Soc. Behav. Sci. 155 (2014), 98–103. DOI:
[5]
Verolien Cauberghe and Patrick De Pelsmacker. 2006. Opportunities and thresholds for advertising on interactive digital TV. J. Interact. Advert. 7, 1 (2006), 2–23. DOI:
[6]
Qibin Chen, Junyang Lin, Yichang Zhang, Ming Ding, Yukuo Cen, Hongxia Yang, and Jie Tang. 2019. Towards knowledge-based recommender dialog system. In Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, 1803–1813. DOI:
[7]
Keith Cheverst, Nigel Davies, Keith Mitchell, and Adrian Friday. 2000. Experiences of developing and deploying a context-aware tourist guide: The GUIDE project. In Proceedings of the 6th Annual International Conference on Mobile Computing and Networking) (MobiCom’00). Association for Computing Machinery, New York, NY, 20–31. DOI:
[8]
Paul Covington, Jay Adams, and Emre Sargin. 2016. Deep neural networks for YouTube recommendations. In Proceedings of the 10th ACM Conference on Recommender Systems) (RecSys’16). Association for Computing Machinery, New York, NY, 191–198. DOI:
[9]
Jeffrey Dalton, Laura Dietz, and James Allan. 2014. Entity query feature expansion using knowledge base links. In Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR’14). Association for Computing Machinery, New York, NY, 365–374. DOI:
[10]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 4171–4186. DOI:
[11]
Siyu Duan, Wei Li, Jing Cai, Yancheng He, and Yunfang Wu. 2021. Query-variant advertisement text generation with association knowledge. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management (CIKM’21). Association for Computing Machinery, New York, NY, 412–421. DOI:
[12]
Yong-Yi Fanjiang and Yu-Yu Wang. 2017. Context-aware services delivery framework for interactive mobile advertisement. Comput. Commun. 99 (2017), 63–76. DOI:
[13]
Carlos A. Gomez-Uribe and Neil Hunt. 2015. The Netflix recommender system: Algorithms, business value, and innovation. ACM Trans. Manag. Inf. Syst. 6, 4 (2015), 1–19.
[14]
Maria Guinea, Isabel Litton, Rigel Smiroldo, Irma Nitsche, and Eric Sax. 2020. A proactive context-aware recommender system for in-vehicle use. In Proceedings of the 4th International Conference on Vision, Image and Signal Processing (ICVISP’20). Association for Computing Machinery, New York, NY. DOI:
[15]
Nor Hazlina Hashim, Normalini, and Norhazlina Sajali. 2018. The influence factors towards mobile advertising message content on consumer purchase intention. Glob. Busin. Rev. 19, 5 (2018), 1187–1206. DOI:
[16]
Elaine M. Huang, Anna Koster, and Jan Borchers. 2009. Overcoming assumptions and uncovering practices: When does the public really look at public displays? In Proceedings of the 6th International Conference on Pervasive Computing (Pervasive’08). Springer-Verlag, Berlin, 228–243. DOI:
[17]
Dongyeop Kang, Anusha Balakrishnan, Pararth Shah, Paul Crook, Y.-Lan Boureau, and Jason Weston. 2019. Recommendation as a communication game: Self-supervised bot-play for goal-oriented dialogue. In Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, 1951–1961. DOI:
[18]
Dimitrios Kastrinakis and Yannis Tzitzikas. 2010. Advancing search query autocompletion services with more and better suggestions. In Proceedings of the 10th International Conference on Web Engineering (ICWE’10). Springer-Verlag, Berlin, 35–49.
[19]
Matěj Kocián, Jakub Náplava, Daniel Štancl, and Vladimír Kadlec. 2022. Siamese BERT-based model for web search relevance ranking evaluated on a new Czech dataset. In Proceedings of the AAAI Conference on Artificial Intelligence. 12369–12377.
[20]
Kazunori Komatani and Shogo Okada. 2019. Osaka University Multimodal Dialogue Corpus (Hazumi). DOI:
[21]
Kai Li and Timon C. Du. 2012. Building a targeted mobile advertising system for location-based services. Decis. Supp. Syst. 54, 1 (2012), 1–8.
[22]
Raymond Li, Samira Kahou, Hannes Schulz, Vincent Michalski, Laurent Charlin, and Chris Pal. 2018. Towards deep conversational recommendations. In Proceedings of the 32nd International Conference on Neural Information Processing Systems (NIPS’18). Curran Associates Inc., Red Hook, NY, 9748–9758.
[23]
Yanen Li, Anlei Dong, Hongning Wang, Hongbo Deng, Yi Chang, and ChengXiang Zhai. 2014. A two-dimensional click model for query auto-completion. In Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR’14). Association for Computing Machinery, New York, NY, 455–464. DOI:
[24]
Yahui Liu, Wei Bi, Jun Gao, Xiaojiang Liu, Jian Yao, and Shuming Shi. 2018. Towards less generic responses in neural conversation models: A statistical re-weighting method. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2769–2774. DOI:
[25]
Zhibin Liu, Zheng-Yu Niu, Hua Wu, and Haifeng Wang. 2019. Knowledge aware conversation generation with explainable reasoning over augmented graphs. In Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, 1782–1792. DOI:
[26]
Zeming Liu, Haifeng Wang, Zheng-Yu Niu, Hua Wu, Wanxiang Che, and Ting Liu. 2020. Towards conversational recommendation over multi-type dialogs. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 1036–1049. DOI:
[27]
Nurul Lubis, Sakriani Sakti, Koichiro Yoshino, and Satoshi Nakamura. 2019. Positive emotion elicitation in chat-based dialogue systems. IEEE/ACM Trans. Audio, Speech Lang. Process. 27, 4 (2019), 866–877. DOI:
[28]
Wenchang Ma, Ryuichi Takanobu, and Minlie Huang. 2021. CR-Walker: Tree-structured graph reasoning and dialog acts for conversational recommendation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 1839–1851. DOI:
[29]
Sean MacAvaney, Andrew Yates, Arman Cohan, and Nazli Goharian. 2019. CEDR: Contextualized embeddings for document ranking. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’19). Association for Computing Machinery, New York, NY, 1101–1104. DOI:
[30]
Rishi Madhok, Shashank Mujumdar, Nitin Gupta, and Sameep Mehta. 2018. Semantic understanding for contextual in-video advertising. In Proceedings of the AAAI Conference on Artificial Intelligence.
[31]
Jörg Müller, Florian Alt, Daniel Michelis, and Albrecht Schmidt. 2010. Requirements and design space for interactive public displays. In Proceedings of the 18th ACM International Conference on Multimedia (MM’10). Association for Computing Machinery, New York, NY, 1285–1294. DOI:
[32]
Rodrigo Nogueira and Kyunghyun Cho. 2019. Passage re-ranking with BERT. arXiv preprint arXiv:1901.04085 (2019).
[33]
Ramith Padaki, Zhuyun Dai, and Jamie Callan. 2020. Rethinking query expansion for BERT reranking. In Proceedings of the 42nd European Conference on IR Research: Advances in Information Retrieval. Springer, 297–304.
[34]
Terry R. Payne, Esther David, Nicholas R. Jennings, and Matthew Sharifi. 2006. Auction mechanisms for efficient advertisement selection on public displays. In Proceedings of the 4th European Workshop on Multi-Agent Systems.
[35]
Ajax Persaud and Irfan Azhar. 2012. Innovative mobile marketing via smartphones. Market. Intell. Plan. 30, 4 (2012), 418–443.
[36]
Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. arxiv:1908.10084 [cs.CL]
[37]
Wataru Sakata, Tomohide Shibata, Ribeka Tanaka, and Sadao Kurohashi. 2019. FAQ retrieval using query-question similarity and BERT-based query-answer relevance. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’19). Association for Computing Machinery, New York, NY, 1113–1116. DOI:
[38]
Ryoichi Shibata, Shoya Matsumori, Yosuke Fukuchi, Tomoyuki Maekawa, Mitsuhiko Kimoto, and Michita Imai. 2022. Utilizing core-query for context-sensitive Ad generation based on dialogue. In Proceedings of the 27th International Conference on Intelligent User Interfaces (IUI’22). Association for Computing Machinery, New York, NY, 734–745. DOI:
[39]
Masahiro Shiomi, Kazuhiko Shinozawa, Yoshifumi Nakagawa, Takahiro Miyashita, Toshio Sakamoto, Toshimitsu Terakubo, Hiroshi Ishiguro, and Norihiro Hagita. 2013. Recommendation effects of a social robot for advertisement-use context in a shopping mall. Int. J. Soc. Robot. 5, 2 (2013), 251–262. DOI:
[40]
Milad Shokouhi. 2013. Learning to personalize query auto-completion. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’13). Association for Computing Machinery, New York, NY, 103–112. DOI:
[41]
Yueming Sun and Yi Zhang. 2018. Conversational recommender system. In Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR’18). Association for Computing Machinery, New York, NY, 235–244. DOI:
[42]
Shiree Treleaven-Hassard, Joshua Gold, Steven Bellman, Anika Schweda, Joseph Ciorciari, Christine Critchley, and Duane Varan. 2010. Using the P3a to gauge automatic attention to interactive television advertising. J. Econ. Psychol. 31, 5 (2010), 777–784. DOI:
[43]
Paraskevi Vennou, Evangelia Mantzari, and George Lekakos. 2011. Evaluating program-embedded advertisement format in interactive digital TV. In Proceedings of the 9th European Conference on Interactive TV and Video (EuroITV’11). Association for Computing Machinery, New York, NY, 145–154. DOI:
[44]
Oriol Vinyals and Quoc Le. 2015. A neural conversational model. arXiv preprint arXiv:1506.05869 (2015).
[45]
Tung Vuong, Salvatore Andolina, Giulio Jacucci, and Tuukka Ruotsalo. 2021. Spoken conversational context improves query auto-completion in web search. ACM Trans. Inf. Syst. 39, 3 (2021). DOI:
[46]
Hao-Chuan Wang, Dan Cosley, and Susan R. Fussell. 2010. Idea expander: Supporting group brainstorming with conversationally triggered visual thinking stimuli. In Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW’10). Association for Computing Machinery, New York, NY, 103–106. DOI:
[47]
Po-Wei Wang, J. Zico Kolter, Vijai Mohan, and Inderjit S. Dhillon. 2018. Realtime query completion via deep language models. In Proceedings of the SIGIR Workshop On eCommerce. Retrieved from https://openreview.net/forum?id=By3VrbbAb.
[48]
Kirsty Williamson. 2018. Research Concepts (2nd ed.). Chandos Publishing. 3–25. DOI:
[49]
Chenyan Xiong and Jamie Callan. 2015. Query expansion with freebase. In Proceedings of the International Conference on the Theory of Information Retrieval (ICTIR’15). Association for Computing Machinery, New York, NY, 111–120. DOI:
[50]
Jheng-Hong Yang, Sheng-Chieh Lin, Chuan-Ju Wang, Jimmy Lin, and Ming-Feng Tsai. 2019. Query and answer expansion from conversation history. In Proceedings of the 28th Text REtrieval Conference(NIST Special Publication, Vol. 1250). National Institute of Standards and Technology (NIST). Retrieved from https://trec.nist.gov/pubs/trec28/papers/CFDA_CLIP.C.pdf.
[51]
Wei Yang, Yuqing Xie, Aileen Lin, Xingyu Li, Luchen Tan, Kun Xiong, Ming Li, and Jimmy Lin. 2019. End-to-end open-domain question answering with BERTserini. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 72–77. DOI:
[52]
Wei Yang, Haotian Zhang, and Jimmy Lin. 2019. Simple applications of BERT for ad hoc document retrieval. arXiv preprint arXiv:1903.10972 (2019).
[53]
Xiaoyao Zheng, Yonglong Luo, Liping Sun, Ji Zhang, and Fulong Chen. 2018. A tourism destination recommender system using users’ sentiment and temporal dynamics. J. Intell. Inf. Syst. 51, 3 (2018), 557–578.
[54]
Kun Zhou, Yuanhang Zhou, Wayne Xin Zhao, Xiaoke Wang, and Ji-Rong Wen. 2020. Towards topic-guided conversational recommender system. In Proceedings of the 28th International Conference on Computational Linguistics. International Committee on Computational Linguistics, 4128–4139. DOI:.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Interactive Intelligent Systems
ACM Transactions on Interactive Intelligent Systems  Volume 13, Issue 3
September 2023
263 pages
ISSN:2160-6455
EISSN:2160-6463
DOI:10.1145/3623489
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 September 2023
Online AM: 23 March 2023
Accepted: 25 February 2023
Revised: 25 February 2023
Received: 21 June 2022
Published in TIIS Volume 13, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Dialogue
  2. context
  3. advertisement
  4. query generation
  5. mask prediction

Qualifiers

  • Research-article

Funding Sources

  • JSPS KAKENHI
  • JST CREST

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 550
    Total Downloads
  • Downloads (Last 12 months)122
  • Downloads (Last 6 weeks)17
Reflects downloads up to 25 Feb 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media