Skip to main content
SpringerLink
Log in

Methodology for Data and Information Quality Assessment in the Context of Emergency Situational Awareness

  • Long paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

Situation Assessment (SA) approaches aim to provide powerful resources to support decision makers in enhancing their Situational Awareness (SAW). The process of SA in emergency response systems is of utmost importance once the information acquired and inferred from human reports is used to support the deployment of tactics and resources to attend incidents. However, operators of such systems may face informational barriers leading to an erroneous SAW and consequently jeopardize the assessment process if they are not handled. One of such barriers in this context is the presence of low-quality data or information. Hence, a challenging issue in this field is to determine how to generate, score, update and represent data and information quality cues to support operators to reason under uncertainties and improve their understanding about an ongoing situation. The state of the art in this area presents a research gap regarding methodologies for the information quality assessment which can be used in the emergency management domain. Also, there is a lack of approaches that interface with different levels of situational information during an assessment routine. Hence, in order to enhance operators situational awareness, a new methodology is presented to improve the capabilities of SA systems by enriching knowledge about situations with reliable metadata. Such methodology, named Information Quality Assessment Methodology in the Context of Emergency situational awareness, is composed by: elicitation of data and information quality requirements; definition of functions and metrics to quantify quality dimensions, such as completeness, timeliness, consistency, relevance and uncertainty; and the representation of situational information by the instantiation of a situation model, which can be consumed by an ontology. Finally, a case study is addressed to verify the applicability of the methodology using data and information from a robbery event. The results obtained show situational models with qualified information that feed SA systems, enabling them to be aware of information quality.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. GDTA—requirements elicitation technique derived from task analysis which reveals tasks to be done, decisions to be made and information needed to perform decisions, classified under the SAW levels

References

  1. Endsley, M.R.: Designing for Situation Awareness: An Approach to User-Centered Design. CRC Press, New York (2011)

    Book  Google Scholar 

  2. Todoran, I., Lecornu, L., Khenchaf, A., Caillec, J.L.: A methodology to evaluate important dimensions of information quality in systems. J. Data Inf. Qual. 6(23), 1–23 (2015)

    Google Scholar 

  3. Ciaramella, A., Cimino, M., Marcelloni, F., Straccia, U.: Combining Fuzzy Logic and Semantic Web to Enable Situation-Awareness in Service Recommendation. Database and Expert Systems Applications. Springer, Berlin (2010)

    Google Scholar 

  4. Mescherin, S., Kirillov, I., Klimenko, S.: Ontology of emergency shared situation awareness and crisis interoperability. International Conference on Cyberworlds (2013)

  5. Baumgartner, N., Gittesheim, W., Mitsch, S., Retschitzegger, W., Schwinger, W.: Be Aware! situation awareness, the ontology-driven way. Data Knowl. Eng. 69(11), 1181–1193 (2010)

    Article  Google Scholar 

  6. Blasch, E., Llinas, J., Lambert, D., Valin, P., Das, S., Chong, Chee, Kokar, M., Shahbazian, E.: High level information fusion developments, issues, and grand challenges: fusion 2010 panel discussion. 13th Conference on Information Fusion (FUSION) (2010)

  7. Matheus,C.J., Kokar,M.M., Backawski,K., Letkowski,J., Call,C., Hinman,M., Salerno, J., Boulware., D.: SAWA: An assistant for higher-level fusion and situation awareness. Defense and Security. International Society for Optics and Photonics (2005)

  8. Batini, C., Daniele, B., Frederico, C., Simone, G.A.: Data quality methodology for heterogeneous data. Int. J. Database Manage. Syst. 3(1), 6079 (2011)

    Google Scholar 

  9. Batini, C., Francalanci, C., Maurino, A.: Methodologies for data quality assessment and improvement. ACM Computing Surveys (CSUR) (2009)

  10. Lee, Y.W., Strong, D.M., Kahn, B.K., Wang, R.Y.: AIMQ: A methodology for information quality assessment. Inf. Manage. 40(2), 133146 (2002)

    Article  Google Scholar 

  11. Wang, R.Y.: A product perspective on total data quality management. Commun. ACM 41(2), 58–65 (1998)

    Article  Google Scholar 

  12. Wang, R., Strong, D.: Beyond accuracy: what data quality means to data consumers. J. Manage. Inf. Syst. 12(4), 533 (1996)

    Google Scholar 

  13. Scannapieco, M., Missier, P., Batini, C.: Data quality at a glance. Datenbank-Spektrum 14, 6–14 (2005)

    Google Scholar 

  14. Cong, G., Fan, W., Geerts, F., Jia, X., Ma, S.: Improving data quality: consistency and accuracy. In: Proceedings of the 33rd International Conference on Very Large Data Bases, pp. 315–326. VLDB Endowment (2007)

  15. Winkler, W.E.: Methods for evaluating and creating data quality. Inf. Syst. 29(7), 531–550 (2004)

    Article  Google Scholar 

  16. Bobrowski, M., Marr, M., Yankelevich, D.A.: Homogeneous framework to measure data quality. Fourth Conference on Information Quality, p. 115124 (1999)

  17. Lee, Y., Strong, D., Kahn, B., Wang, R.: AIMQ: a methodology for information quality assessment. Inf. Manage. 40(2), 133–146 (2002)

    Article  Google Scholar 

  18. De Amicis, F., Batini, C.: A methodology for data quality assessment on financial data. Stud. Commun. Sci. 4(2), 115–136 (2004)

    Google Scholar 

  19. Batini, C., Barone, D., Mastrella, M., Maurino, A., Ruffini, C.: A framework and a methodology for data quality assessment and monitoring. In: ICIQ, pp. 333–346 (2007)

  20. Bowen, P.: Managing data quality accounting information systems: a stochastic clearing system approach. Unpublished Ph.D. dissertation, University of Tennessee (1993)

  21. Al-Hiyari, A., Al-Mashregy, M.H.H., Mat, N., Alekam, J.M.: Factors that affect accounting information system implementation and accounting information quality: A survey in University Utara Malaysia. Am. J. Econ. 3(1), 2731 (2013)

    Google Scholar 

  22. Tee, S.W., Bowen, P.L., Doyle, P., Rohde, F.H.: Factors influencing organizations to improve data quality in their information systems. Acc. Financ. 47(2), 335355 (2007)

    Article  Google Scholar 

  23. Haug, A., Zachariassen, F., Liempd, D.V.: The costs of poor data quality. J. Ind. Eng. Manag. 4(2), 168193 (2011)

    Google Scholar 

  24. Grabski, S.V., Leech, S.A., Schmidt, P.J.: A review of ERP research: a future agenda for accounting information systems. J. Inf. Syst. 25(1), 3778 (2011)

    Google Scholar 

  25. Umble, E.J., Haft, R.R., Umble, M.M.: Enterprise resource planning: implementation procedures and critical success factors. Eur. J. Oper. Res. 146, 241257 (2003)

    Article  MATH  Google Scholar 

  26. Zhang, L., Lee, M.K.O., Zhang, Z., Banerjee, P.: Critical success factors of enterprise resource planning systems implementation success in China. In: Proceedings of the 36th Hawaii International Conference on System Sciences (HICSS03) (2003)

  27. Wand, Y., Wang, R.Y.: Anchoring data quality dimensions in ontological foundations. Commun. ACM 39(11), 8695 (1996).s

    Article  Google Scholar 

  28. Bradley, J.: Management based critical success factors in the implementation of enterprise resource planning systems. Int. J. Acc. Inf. Syst. 9(3), 175200 (2008)

    Article  Google Scholar 

  29. Daoud, H., Triki, M.: Accounting information systems in an ERP environment and Tunisian firm performance. Int. J. Digit. Acc. Res. 13, 135 (2013)

    Google Scholar 

  30. OBrien, J.: Sistemas de Informao e as Decises Gerenciais na Era da Internet.2.ed.So Paulo: Saraiva, vol. 2, p. 431 (2004)

  31. Agre, J., Vassiliou, M.S., Kramer, C.: Science and Technology Issues Relating to Data Quality in C2 Systems. Institute for Defense Analyses (2011)

  32. Laudon, K.C.: Data quality and due process in large interorganizational record systems. Communications of the ACM (1986)

  33. Bureau of Justice Statistics: U. S. Assessing completeness and accuracy of criminal history record systems: audit guide. Bureau of Justice Statistics. U.S. Department of Justice, Office of Justice Programs, Ed, Indiana, p. 65 (1992)

  34. Koudas, N., Sarawagi, S., Srivastava, D.: Record linkage: similarity measures and algorithms. In: Proceedings of the 2006 ACM SIGMOD International Conference on Management of Data, pp. 802–803. ACM, New York (2006)

  35. Cummings, M.L., Ryan, J.C.: Shared Authority Concerns in Automated Driving Applications (2014)

  36. Kim, W., Lee, S., Kim, Y., Choi, H.: Evaluating the Data Quality and the Uncertainty in Electroencephalogram Signals for a Neuromarketing Service which Computes Attentional Engagement, p. 6266 (2014)

  37. Philips, L.: The double metaphone search algorithm. C/C++ Users J 18(6), 38–43 (2000)

    MathSciNet  Google Scholar 

  38. Noy, N.F., McGuinness, D.L.: Ontology Development 101: A Guide to Creating Your First Ontology (2001)

  39. Matheus, C.J., Kokar,M.M., Backawski, K., Letkowski, J., Call, C., Hinman, M., Salerno, J., Boulware., D.: SAWA: An assistant for higher-level fusion and situation awareness. Defense and Security. International Society for Optics and Photonics (2005)

  40. Botega, L., Campos, M., Neris, V.P.A., Araújo, R.: SAW-oriented user interfaces for emergency dispatch systems. In: 17th International Conference on Human Computer Interaction, 2015, Los Angeles. Lecture Notes in Computer Science (LNCS) (2015)

  41. Junior, V., Sanches, M., Botega, L., Souza, J., Coneglian, C. S., Fusco, E., Campos, M., Arajo, R.: Multi-criteria fusion of heterogeneous information for improving situation awareness on military decision making system. In: 17th International Conference on Human Computer Interaction, 2015, Los Angeles. Lecture Notes in Computer Science (LNCS) (2015)

  42. Souza, J., Botega, L., Campos, M., Arajo, R.: Conceptual framework to enrich situation awareness of emergency dispatchers. In: 17th International Conference on Human Computer Interaction, 2015, Los Angeles. Lecture Notes in Computer Science (LNCS) (2015)

Download references

Acknowledgments

The authors would like to thank São Paulo Military State Police for the support in this project.

Author information

Authors and Affiliations

  1. Wireless Networking and Distributed Interactive Simulations Laboratory, Federal University of São Carlos, São Carlos, Brazil

    Leonardo Castro Botega, Jéssica Oliveira de Souza, Fábio Rodrigues Jorge, Caio Saraiva Coneglian, Márcio Roberto de Campos, Vânia Paula de Almeida Neris & Regina Borges de Araújo

Authors
  1. Leonardo Castro Botega
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jéssica Oliveira de Souza
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fábio Rodrigues Jorge
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Caio Saraiva Coneglian
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Márcio Roberto de Campos
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Vânia Paula de Almeida Neris
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Regina Borges de Araújo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Leonardo Castro Botega.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Botega, L.C., de Souza, J.O., Jorge, F.R. et al. Methodology for Data and Information Quality Assessment in the Context of Emergency Situational Awareness. Univ Access Inf Soc 16, 889–902 (2017). https://doi.org/10.1007/s10209-016-0473-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-016-0473-0

Keywords

Search

Navigation