Skip to main content

Police Report Similarity Search: A Case Study

  • Conference paper
  • First Online:
Intelligent Systems (BRACIS 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14197))

Included in the following conference series:

  • 219 Accesses

Abstract

Several crimes occur daily, and the initial investigation begins with a police report. In cities with high crime rates, it is impractical to expect the police to read and analyze every crime narrative. Some police reports may involve multiple victims or the same crime may be reported more than once. Additionally, police reports may exhibit similarities due to a shared modus operandi. This study addresses the challenge of providing a police report and searching for the most similar report in the database. A similar police report can be either another report with overlapping words or one that shares a similar modus operandi. One potential solution is to represent each police report as a feature vector and compare these vectors using a similarity function. Different methods can be employed to represent the narrative, including embedding vectors and count-based approaches such as TF-IDF. This research explores the use of pre-trained embedding representations at both the word and sentence levels, such as Universal Sentence Encoder, Word2Vec, RoBERTa, Doc2Vec, among others. We determine the most effective representation for capturing semantic and lexical similarities between police reports by comparing different embedding models. Furthermore, we compare the effectiveness of available pre-trained embedding models with a model trained specifically on a corpus of police reports. Another contribution of this work is the development of trained embedding models specifically tailored for the domain of police reports.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Available at https://huggingface.co/neuralmind/bert-base-portuguese-cased.

  2. 2.

    Available at https://nilc.icmc.usp.br/embeddings.

  3. 3.

    https://shorturl.at/lmCXY.

References

  1. Akbik, A., Bergmann, T., Blythe, D., Rasul, K., Schweter, S., Vollgraf, R.: FLAIR: an easy-to-use framework for state-of-the-art NLP. In: Proceedings of NAACL (Demonstrations), pp. 54–59 (2019)

    Google Scholar 

  2. Boggust, A., Carter, B., Satyanarayan, A.: Embedding comparator: visualizing differences in global structure and local neighborhoods via small multiples. In: 27th International Conference on Intelligent User Interfaces, pp. 746–766 (2022)

    Google Scholar 

  3. Cer, D., et al.: Universal sentence encoder. arXiv preprint arXiv:1803.11175 (2018)

  4. Chollet, F.: Deep Learning with Python. Simon and Schuster (2021)

    Google Scholar 

  5. Conneau, A., Kiela, D., Schwenk, H., Barrault, L., Bordes, A.: Supervised learning of universal sentence representations from natural language inference data. In: Proceedings of the 2017 EMNLP, pp. 670–680 (2017)

    Google Scholar 

  6. Do, P., Pham, P.: W-KG2Vec: a weighted text-enhanced meta-path-based knowledge graph embedding for similarity search. Neural Comput. Appl. 33(23), 16533–16555 (2021)

    Article  Google Scholar 

  7. Feng, F., Yang, Y., Cer, D., Arivazhagan, N., Wang, W.: Language-agnostic BERT sentence embedding. arXiv preprint arXiv:2007.01852 (2020)

  8. Ghannay, S., Favre, B., Esteve, Y., Camelin, N.: Word embedding evaluation and combination. In: Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), pp. 300–305 (2016)

    Google Scholar 

  9. Harris, Z.S.: Distributional structure. Word 10(2–3), 146–162 (1954)

    Article  Google Scholar 

  10. Hartmann, N., Fonseca, E., Shulby, C., Treviso, M., Silva, J., Aluísio, S.: Portuguese word embeddings: evaluating on word analogies and natural language tasks. In: Proceedings of the 11th STIL, pp. 122–131 (2017)

    Google Scholar 

  11. Hjaltason, G.R., Samet, H.: Properties of embedding methods for similarity searching in metric spaces. IEEE Trans. Pattern Anal. Mach. Intell. 25(5), 530–549 (2003)

    Article  Google Scholar 

  12. Imtiaz, Z., Umer, M., Ahmad, M., Ullah, S., Choi, G.S., Mehmood, A.: Duplicate questions pair detection using siamese MaLSTM. IEEE Access 8, 21932–21942 (2020)

    Article  Google Scholar 

  13. Kenton, J.D.M.W.C., Toutanova, L.K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of NAACL-HLT, pp. 4171–4186 (2019)

    Google Scholar 

  14. Kiros, R., et al.: Skip-thought vectors. In: Advances in Neural Information Processing Systems (NIPS), pp. 3294–3302 (2015)

    Google Scholar 

  15. Le, Q., Mikolov, T.: Distributed representations of sentences and documents. In: Proceedings of the 31st International Conference on Machine Learning (ICML), pp. 1188–1196. PMLR (2014)

    Google Scholar 

  16. Liu, Y., et al.: RoBERTa: A robustly optimized BERT pretraining approach. arXiv preprint arXiv:1907.11692 (2019)

  17. Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems (NIPS), pp. 3111–3119 (2013)

    Google Scholar 

  18. Naili, M., Chaibi, A.H., Ghezala, H.H.B.: Comparative study of word embedding methods in topic segmentation. Procedia Comput. Sci. 112, 340–349 (2017)

    Article  Google Scholar 

  19. Pennington, J., Socher, R., Manning, C.D.: GloVe: global vectors for word representation. In: Proceedings of the 2014 EMNLP, pp. 1532–1543 (2014)

    Google Scholar 

  20. Qiu, Y., Li, H., Li, S., Jiang, Y., Hu, R., Yang, L.: Revisiting correlations between intrinsic and extrinsic evaluations of word embeddings. In: Sun, M., Liu, T., Wang, X., Liu, Z., Liu, Y. (eds.) CCL/NLP-NABD -2018. LNCS (LNAI), vol. 11221, pp. 209–221. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01716-3_18

    Chapter  Google Scholar 

  21. Reimers, N., Gurevych, I.: Sentence-BERT: Sentence embeddings using siamese BERT-networks. arXiv preprint arXiv:1908.10084 (2019)

  22. Rodrigues, A.C., Marcacini, R.M.: Sentence similarity recognition in Portuguese from multiple embedding models. In: 2022 21st IEEE International Conference on Machine Learning and Applications (ICMLA), pp. 154–159. IEEE (2022)

    Google Scholar 

  23. Shahmirzadi, O., Lugowski, A., Younge, K.: Text similarity in vector space models: a comparative study. In: 2019 18th IEEE ICMLA, pp. 659–666. IEEE (2019)

    Google Scholar 

  24. Souza, F., Nogueira, R., Lotufo, R.: BERTimbau: pretrained BERT models for Brazilian Portuguese. In: 9th BRACIS (2020)

    Google Scholar 

  25. Toshevska, M., Stojanovska, F., Kalajdjieski, J.: Comparative analysis of word embeddings for capturing word similarities. arXiv preprint arXiv:2005.03812 (2020)

  26. Zhai, M., Tan, J., Choi, J.: Intrinsic and extrinsic evaluations of word embeddings. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 30 (2016)

    Google Scholar 

Download references

Acknowledgments

The research reported in this work received support from the FUNCAP project titled “Big Data Platform to Accelerate the Digital Transformation of Ceará State" 04772551/2020. Part of the results presented in this work were also obtained through the UFC-FASTEF 31/2019.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ticiana L. Coelho da Silva .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Araújo, J.A.F., Coelho da Silva, T.L., da Rocha, A.R., de Lira, V.C.M. (2023). Police Report Similarity Search: A Case Study. In: Naldi, M.C., Bianchi, R.A.C. (eds) Intelligent Systems. BRACIS 2023. Lecture Notes in Computer Science(), vol 14197. Springer, Cham. https://doi.org/10.1007/978-3-031-45392-2_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-45392-2_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-45391-5

  • Online ISBN: 978-3-031-45392-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics