Abstract
Given the iterative and collaborative nature of authoring and the need to adapt the documents for different audience, people end up with a large number of versions of their documents. These additional versions of documents increase the required cognitive effort for various tasks for humans (such as finding the latest version of a document, or organizing documents), and may degrade the performance of machine tasks such as clustering or recommendation of documents. To the best of our knowledge, the task of identifying and ordering the versions of documents from a collection of documents has not been addressed in prior literature. We propose a three-stage approach for the task of identifying versions and ordering them correctly in this paper. We also create a novel dataset for this purpose from Wikipedia, which we are releasing to the research community (https://github.com/natwar-modani/versions). We show that our proposed approach significantly outperforms state-of-the-art approach adapted for this task from the closest previously known task of Near Duplicate Detection, which justifies defining this problem as a novel challenge.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alsulami, B.S., Abulkhair, M.F., Eassa, F.E.: Near duplicate document detection survey. Int. J. Comput. Sci. Commun. Netw. 2(2), 147–151 (2012)
Broder, A.Z.: Identifying and filtering near-duplicate documents. In: Giancarlo, R., Sankoff, D. (eds.) CPM 2000. LNCS, vol. 1848, pp. 1–10. Springer, Heidelberg (2000). https://doi.org/10.1007/3-540-45123-4_1
Cho, K., et al.: Learning phrase representations using RNN encoder-decoder for statistical machine translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1724–1734 (2014)
Chowdhury, A., Frieder, O., Grossman, D., McCabe, M.C.: Collection statistics for fast duplicate document detection. ACM Trans. Inf. Syst. (TOIS) 20(2), 171–191 (2002)
Ekbal, A., Saha, S., Choudhary, G.: Plagiarism detection in text using vector space model. In: 2012 12th International Conference on Hybrid Intelligent Systems (HIS), pp. 366–371. IEEE (2012)
Elsayed, T., Lin, J., Oard, D.W.: Pairwise document similarity in large collections with mapreduce. In: Proceedings of ACL-08: HLT, Short Papers, pp. 265–268 (2008)
Ertl, O.: SuperMinHash - A New Minwise Hashing Algorithm for Jaccard Similarity Estimation. arXiv e-prints arXiv:1706.05698, June 2017
Gupta, D., Vani, K., Leema, L.: Plagiarism detection in text documents using sentence bounded stop word n-grams. J. Eng. Sci. Technol. 11(10), 1403–1420 (2016)
Hassanian-esfahani, R., Kargar, M.J.: Sectional minhash for near-duplicate detection. Expert Syst. Appl. 99, 203–212 (2018)
Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning, pp. 448–456. PMLR (2015)
Liu, X., Gong, Y., Xu, W., Zhu, S.: Document clustering with cluster refinement and model selection capabilities. In: Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 191–198 (2002)
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)
Lv, Y., Moon, T., Kolari, P., Zheng, Z., Wang, X., Chang, Y.: Learning to model relatedness for news recommendation. In: Proceedings of the 20th International Conference on World Wide Web, pp. 57–66 (2011)
Park, K., Lee, J., Choi, J.: Deep neural networks for news recommendations. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 2255–2258 (2017)
Sanchez-Perez, M.A., Sidorov, G., Gelbukh, A.F.: A winning approach to text alignment for text reuse detection at pan 2014. In: CLEF (Working Notes), pp. 1004–1011 (2014)
Sherkat, E., Nourashrafeddin, S., Milios, E.E., Minghim, R.: Interactive document clustering revisited: a visual analytics approach. In: 23rd International Conference on Intelligent User Interfaces, pp. 281–292 (2018)
Socher, R., Huang, E.H., Pennin, J., Manning, C.D., Ng, A.Y.: Dynamic pooling and unfolding recursive autoencoders for paraphrase detection. In: Advances in Neural Information Processing Systems, pp. 801–809 (2011)
Weng, S.S., Chang, H.L.: Using ontology network analysis for research document recommendation. Expert Syst. Appl. 34(3), 1857–1869 (2008)
Xu, X., et al.: Understanding user behavior for document recommendation. In: Proceedings of The Web Conference 2020. p. 3012–3018. WWW 2020. Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3366423.3380071
Yang, X., Lo, D., Xia, X., Bao, L., Sun, J.: Combining word embedding with information retrieval to recommend similar bug reports. In: 2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE), pp. 127–137. IEEE (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Modani, N., Maurya, A., Verma, G., Nair, I., Patil, V., Kanfade, A. (2021). Detecting Document Versions and Their Ordering in a Collection. In: Zhang, W., Zou, L., Maamar, Z., Chen, L. (eds) Web Information Systems Engineering – WISE 2021. WISE 2021. Lecture Notes in Computer Science(), vol 13081. Springer, Cham. https://doi.org/10.1007/978-3-030-91560-5_30
Download citation
DOI: https://doi.org/10.1007/978-3-030-91560-5_30
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-91559-9
Online ISBN: 978-3-030-91560-5
eBook Packages: Computer ScienceComputer Science (R0)