Skip to main content

An Approach to Decentralized Hybrid Question Answering Systems

  • Conference paper
  • First Online:
Computational Science and Its Applications – ICCSA 2023 Workshops (ICCSA 2023)

Abstract

Question answering (QA) systems are sequence-to-sequence model based programs that find the most accurate answer to a query by using given texts. In today’s world, QA system software is run on different platforms by various institutions. This means that users have to use different QA system software, developed with different technologies on various platforms, to find the most accurate answer to their queries. However, there is a lack of systems that allow these types of systems to be used in a hybrid manner on a single interface. To address this issue, this research investigates a software architecture that will enable QA systems trained with different datasets on various platforms to be used with a single programming interface. To demonstrate the feasibility and usefulness of the proposed hybrid question answering system framework software architecture, a prototype software has been developed. The performance of the developed prototype software has been compared with standalone QA system software based on the execution time performance metric. The obtained results demonstrate that the proposed framework software architecture has negligible processing overheads.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. McMahan, B., Ramage, D.: Google Ai Blog. Communication-Efficient Learning with Federated Learning: An Overview (2020). https://ai.googleblog.com/2020/05/communication-efficient-learning-with.html

  2. Tensorflow Federated: Machine Learning on Decentralized Data (2020). https://www.tensorflow.org/federated/. Accessed 16 Apr 2023

  3. Federated AI Ecosystem-Collaborative Learning and Knowledge Transfer With Data Protection (2020). https://www.fedai.org/. Accessed 16 Apr 2023

  4. PySyft: A Library for Encrypted, Privacy Preserving Machine Learning (2020). https://github.com/OpenMined/PySyft. Accessed 16 Apr 2023

  5. PaddleFL: Federated Deep Learning in PaddlePaddle (2020). https://github.com/PaddlePaddle/PaddleFL. Accessed 16 Apr 2023

  6. Nvidia Developer Blog: Federated Learning Powered by Nvidia Clara (2020). https://developer.nvidia.com/blog/federated-learning-clara/. Accessed 16 Apr 2023

  7. McMahan, B., Moore, E., Ramage, D., Hampson, S., Arcas, B.: Communication efficient learning of deep networks from decentralized data. In: Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (AISTATS) (2017)

    Google Scholar 

  8. Ekmefjord, M., et al.: Scalable federated machine learning with FEDN. In: 22nd IEEE International Symposium on Cluster, Cloud and Internet Computing (CCGrid) (2022). https://doi.org/10.1109/CCGrid54584.2022.00065

  9. Hard, A., et al.: Federated learning for mobile keyboard prediction (2019). ArXiv:1811.03604

  10. Zhao, Y., Li, M., Lai, L., Suda, N., Civin, D., Chandra, V.: Federated learning with non-IID data. ArXiv:1806.00582 (2018)

  11. Bonawitz, K., et al.: Towards federated learning at scale: System design. ArXiv: 1902.01046 (2019)

  12. Bakir, D., Aktas, M.: A systematic literature review of question answering: research trends, datasets, methods and frameworks. In: The 22nd International Conference on Computational Science and Its Applications (ICCSA), Malaga, Spain, 4–07 July 2022, pp. 1–16 (2022)

    Google Scholar 

  13. Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. arXiv:1409.0473 (2014)

  14. Chen, D., Bolton, J., Manning, C.D.: A thorough examination of the CNN/daily mail reading comprehension task. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), In ACL, pp. 2358–2367 (2016)

    Google Scholar 

  15. Seo, M.J., et al.: Bidirectional attention flow for machine comprehension. ICLR. arxiv:1611.01603 (2017)

  16. Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bidirectional encoder representations from transformers. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 4171–4186. Association for Computational Linguistics (2019)

    Google Scholar 

  17. Liu, Y., Liu, D., Li, D., Lv, Y.: Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692 (2019)

  18. Qi, Y., Wang, W., Zhang, B., Dauphin, Y.: A Lite BERT for Self-supervised Learning of Language Representations. arXiv preprint arXiv:2004.10948 (2020)

  19. Xu, K., Zhu, W., Yang, Z., Bai, X.: Efficiently Learning an Encoder that Classifies Token Replacements Accurately. arXiv preprint arXiv:2009.13258 (2020)

  20. Raffel, C., et al.: Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv preprint arXiv:1910.10683 (2019)

  21. Ghazvininejad, M., Levy, O., Liu, Y., Zettlemoyer, L.: A Knowledge-Grounded Autoencoder for Commonsense Inference. In: Proceedings of the 57th Conference of the Association for Computational Linguistics, pp. 5669–5674

    Google Scholar 

  22. Baeth, M.J., Aktas, M.S.: An approach to custom privacy policy violation detection problems using big social provenance data. Concurr. Comput. Pract. Exp. 30(21) (2018)

    Google Scholar 

  23. Aktas, M.S., Fox, G.C., Pierce, M., Oh, S.: XML metadata services. Concurr. Comput. Pract. Exp. 20(7), 801–823 (2008)

    Article  Google Scholar 

  24. Aktas, M.S., Pierce, M.: High-performance hybrid information service architecture. Concurr. Comput. Pract. Exp. 22(15), 2095–2123 (2010)

    Google Scholar 

  25. Fox, G.C., et al.: Real time streaming data grid applications. In: Davoli, F., Palazzo, S., Zappatore, S. (eds.) Distributed Cooperative Laboratories: Networking, Instrumentation, and Measurements. Signals and Communication Technology, pp. 253–267. Springer, Boston, MA (2006). https://doi.org/10.1007/0-387-30394-4_17

  26. Tufek, A., Gurbuz, A., Ekuklu, O.F., Aktas, M.S.: provenance collection platform for the weather research and forecasting model. In: 2018 14th International Conference on Semantics, Knowledge and Grids (2018)

    Google Scholar 

  27. Aktas, M.S., Fox, G.C., Pierce, M.: Fault tolerant high performance information services for dynamic collections of grid and web services. Futur. Gener. Comput. Syst. 23(3), 317–337 (2007)

    Article  Google Scholar 

  28. Aydin, G., et al.: Building and applying geographical information system Grids. Concurr. Comput. Pract. Exp. 20(14), 1653–1695 (2008)

    Article  Google Scholar 

  29. Fox, G.C., et al.: Algorithms and the Grid. Comput. Vis. Sci. 12, 115–124 (2009)

    Article  Google Scholar 

  30. Aktas, M., et al.: ISERVO: implementing the international solid earth research virtual observatory by integrating computational grid and geographical information Web Services. Comput. Earthq. Phys. Simul. Anal. Infrastruct. Part II, 2281–2296 (2007)

    Google Scholar 

  31. Aydin, G., Aktas, M.S., Fox, G.C., Gadgil, H., Pierce, M., Sayar, A.: SERVOGrid complexity computational environments CCE integrated performance analysis. In: The 6th IEEE/ACM International Workshop on Grid Computing (2005)

    Google Scholar 

  32. Pierce, M.E., et al.: The QuakeSim project: Web services for managing geophysical data and applications. Earthq. Simul. Sourc. Tsunamis. 635–651 (2008)

    Google Scholar 

  33. Uygun, Y., Oguz, R.F., Olmezogullari, E., Aktas, M.S.: On the large-scale graph data processing for user interface testing in big data science projects. In: 2020 IEEE International Conference on Big Data (Big Data), pp. 2049–2056 (2020)

    Google Scholar 

  34. Sahinoglu, M., Incki, K., Aktas, M.S.: Mobile application verification: a systematic mapping study. In: Computational Science and Its Applications-ICCSA: 15th International Conference, Banff, AB, Canada, June 22–25, 2015, Proceedings. Part V, vol. 15(2015)

    Google Scholar 

  35. Kapdan, M., Aktas, M., Yigit, M.: On the structural code clone detection problem: a survey and software metric based approach. In: Computational Science and Its Applications-ICCSA,: 14th International Conference, Guimarães, Portugal, June 30-July 3, 2014, Proceedings. Part V, vol. 14 (2014)

    Google Scholar 

  36. Olmezogullari, E., Aktas, M.S.: Pattern2Vec: representation of clickstream data sequences for learning user navigational behavior. Concurr. Comput. Pract. Exp. 34(9) (2022)

    Google Scholar 

  37. Olmezogullari, E., Aktas, M.S.: Representation of click-stream datasequences for learning user navigational behavior by using embeddings. In: 2020 IEEE International Conference on Big Data (Big Data), pp. 3173–3179 (2020)

    Google Scholar 

  38. Nacar, M.A.et al.: VLab: collaborative Grid services and portals to support computational material science. Concurr. Comput. Pract. Exp. 19(12), 1717–1728 (2007)

    Google Scholar 

  39. Dundar, B., Astekin, M., Aktas, M.S.: A big data processing framework for self-healing internet of things applications. In: 2021 IEEE International Conference on Big Data (Big Data), pp. 2353–2361 (2021)

    Google Scholar 

  40. Baeth, M.J., Aktas, M.S.: Detecting misinformation in social networks using provenance data. In: 2017 13th International Conference on Semantics, Knowledge and Grids (2017)

    Google Scholar 

  41. Aktas, M., et al.: Implementing geographical information system grid services to support computational geophysics in a service-oriented environment. NASA Earth-Sun System Technology Conference, University of Maryland, Adelphi, Maryland (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mehmet S. Aktas .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bakır, D., Aktas, M.S. (2023). An Approach to Decentralized Hybrid Question Answering Systems. In: Gervasi, O., et al. Computational Science and Its Applications – ICCSA 2023 Workshops. ICCSA 2023. Lecture Notes in Computer Science, vol 14112. Springer, Cham. https://doi.org/10.1007/978-3-031-37129-5_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-37129-5_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-37128-8

  • Online ISBN: 978-3-031-37129-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics