Abstract
As the volume of data continues to surge, researchers are confronted with the challenge of extracting meaningful insights from this wealth of information. Despite rapid advancements in Natural Language Processing (NLP) techniques in the AI industry, there remain gaps and opportunities for further exploration, particularly in the realm of data recombination techniques and methods. This paper proposes a novel text recombination method to facilitate the generation of recombined words from a given text. The process commences with a ’stanza’ model, which identifies and compiles Named Entity Recognitions (NERs) into a list. These NERs are then cross-referenced with Wikipedia pages to retrieve relevant information, thereby enhancing entity understanding and analysis. The ensuing step involves preprocessing the output text from the previous stage, generating a list of unique words while eliminating stop words. This preprocessing stage serves to remove noise and focus on meaningful words, laying the groundwork for more effective clustering. To enable clustering, we employ vector embeddings, representing words in a 2-dimensional space, rendering them suitable for clustering techniques. Notably, the proposed method further enhances results by re-clustering words after applying K-Means, thereby identifying the most fitting candidate words for recombination. Comparatively, this method outperforms large language models (LLMs) due to its incorporation of NER information, utilization of Wikipedia pages, and effective preprocessing techniques. Unlike LLMs, which operate as resource-intensive black boxes on static data, this method benefits from real-time information access and knowledge base updates. Furthermore, each stage of the process is visualized to control the progress correctly. Thus, due to the plots of word clusterization, the proposed text recombination approach showed positive results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ramos, F.O., Pinto, D.: Proposal for named entities recognition and classification (NERC) and the automatic generation of rules on Mexican news. Computación y Sistemas 24(2), 533–538 (2020)
Mi, C., Xie, L., Zhang, Y.: Improving data augmentation for low resource speech-to-text translation with diverse paraphrasing. Neural Netw., 194–205 (2022)
Zhou, X., Huang, L., Zhang, Y., Yu, M.: A hybrid approach to detecting technological recombination based on text mining and patent network analysis. Scientometrics 121(2), 699–737 (2019). https://doi.org/10.1007/s11192-019-03218-5
Gallardo, G.R., Beltrán, B., Vilariño, D., Zepeda, C., Martínez, R.: Comparison of clustering algorithms in text clustering tasks. Computación y Sistemas 24(2), 429–437 (2020)
Butt, S., Ashraf, N., Siddiqui, M.H.F., Sidorov, G., Gelbukh, A.: Transformer-based extractive social media question answering on TweetQA. Computación y Sistemas 25(1), 23–32 (2021)
Qiu, L., Shaw, P., Pasupat, P., Nowak, P., Linzen, T., Sha, F., Toutanova, K.: Improving compositional generalization with latent structure and data augmentation. In: Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 4341–4362 (2022)
Zhang, L., Yang, Z., Yang, D.: Compositional constituency-based data augmentation for natural language understanding. In: Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics, pp. 5243–5258 (2022)
Fang, F., Luo, F., Zhang, H.-P., Zhou, H.-J., Chow, A.L.H., Xiao, C.-X.: A comprehensive pipeline for complex text-to-image synthesis. J. Comput. Sci. Technol. 35(3), 522–537 (2020). https://doi.org/10.1007/s11390-020-0305-9
Lam, T.K., Schamoni, S., Riezler, S.: Leveraging audio alignments for data augmentation in end-to-end speech translation. In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, pp. 245–254 (2022)
Zhai J., Guo Y., Zhang H., Ding J.: TextRank keyword extraction method weighted by multivariate quantitative indexes. In: 2022 4th International Conference on Applied Machine Learning (ICAML), pp. 151–155. IEEE (2022). https://doi.org/10.1109/ICAML57167.2022.00036
Li, H: Multi-publisher news corpus construction via text recombination. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence (IJCAI), vol. 12156, pp. 110–118 (2021). https://doi.org/10.1117/12.2626538
Liu, L., Ding, B., Bing, L., Joty, S., Si, L., Miao, C.: A multilingual data augmentation framework for low-resource cross-lingual NER. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, vol. 1: Long Papers, pp. 5834–5846 (2021). https://doi.org/10.18653/v1/2021.acl-long.453
Beguš, G.: CiwGAN and fiwGAN: encoding information in acoustic data to model lexical learning with generative adversarial networks. Neural Netw. 139, 305–325 (2021). https://doi.org/10.1016/j.neunet.2021.03.017
Zhang, X., Shi, S., Guo, Z., Chen, G., Wei, H., Tang, Y., Yu, L.: Controlled text style transfer via noise enhancement of deep learning transformer. In: International Conference on Neural Networks, Information, and Communication Engineering (NNICE), vol. 12258, pp. 63–69 (2022). https://doi.org/10.1117/12.2639492
Liu, S.-T., Hsu, S.-C., Huang, Y.-H.: Data paradigm shift in cross-media IoT system. In: Yamamoto, S., Mori, H. (eds.) HCII 2020. LNCS, vol. 12185, pp. 479–490. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50017-7_36
Sohn H., Park B.: Robust and informative text augmentation (RITA) via constrained worst-case transformations for low-resource named entity recognition. In: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 1616–1624 (2022)
Gimaletdinova, G., Khalitova, L., Solovyev, V., Bochkarev, V.: Lexicographic study of synonymy: clarifying semantic similarity between words. Computación y Sistemas 25(3), 667–675 (2021)
Pichardo-Lagunas, O., Martinez-Seis, B., Basurto-Carrillo, F.D.J.: Fernández-Flores D: data integration for the evaluation of cancer evolution in Mexico through data visualization. Computación y Sistemas 26(2), 1557–1567 (2022)
Sagingaliyev, B., Aitakhunova, Z., Shaimerdenova, A., Akhmetov, I., Pak, A., Jaxylykova, A: A bibliometric review of methods and algorithms for generating corpora for learning vector word embeddings. In: Mexican International Conference on Artificial Intelligence, pp. 148–162 (2022)
Acknowledgments
This research is funded by the Aerospace Committee of the Ministry of Digital Development, Innovations and Aerospace Industry of the Republic of Kazakhstan (BR11265420)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zhiyenbekov, Z., Omirbekova, Z., Mutanov, G., Tasbolatov, M. (2024). Visualizing the Cosmos: A Novel Method for Text Recombination with Space News. In: Calvo, H., Martínez-Villaseñor, L., Ponce, H. (eds) Advances in Soft Computing. MICAI 2023. Lecture Notes in Computer Science(), vol 14392. Springer, Cham. https://doi.org/10.1007/978-3-031-47640-2_1
Download citation
DOI: https://doi.org/10.1007/978-3-031-47640-2_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-47639-6
Online ISBN: 978-3-031-47640-2
eBook Packages: Computer ScienceComputer Science (R0)