Skip to main content
SpringerLink
Log in

A descriptive, practical, hybrid argumentation model to assist with the formulation of defensible assessments in uncertain sense-making environments: an initial evaluation

  • Original Article
  • Published:
Cognition, Technology & Work Aims and scope Submit manuscript

Abstract

This paper presents the preliminary results of our initial, descriptive, practical, hybrid argumentation model, designed for the use by criminal intelligence analysts (from now on referred to as analysts) working with sophisticated visual analytical software in uncertain sense-making environments. Analysts are required to create exhibits (as evidence) for a court of law or as input for decision-making in intelligence-led policing. These exhibits are required to be accurate, relevant and unbiased. Eight experienced criminal intelligence analysts from West Midlands police and the Belgium police evaluated a low-fidelity prototype resembling the first-order argumentation concepts of our initial argumentation model. The evaluation was to assess the applicability and practicality of the first-order argumentation concepts within our model. The preliminary results presented in this paper indicate that most of the first-order argumentation concepts are both applicable and practical and that the participants would use such concepts to construct their rationale from the onset of an analytical activity, if it were included as part of a software application.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  • Allen C, Taylor C, Nairns J (2015) Practical guide to evidence. Routledge, Abingdon

    Book  Google Scholar 

  • Attfield S, Blandford A (2011) Making sense of digital footprints in team-based legal investigations: the acquisition of focus. Hum Comput Interact 26(1–2):38–71

    Article  Google Scholar 

  • Bex F, Verheij B (2013) Legal stories and the process of proof. Artif Intell Law 21(3):253–278

    Article  Google Scholar 

  • Bex F, Prakken H, Verheij B (2006) Anchored narratives. Reason Evid Jurix 152:11–20. http://www.florisbex.com/papers/Jurix2006.pdf

  • Blueberry Software (2017) BB flashback recording software. https://www.flashbackrecorder.com/download/

  • Bruner J (2004) Making stories: law, literature, life. Harvard University Press, Cambridge (ISBN-13:978-0674010994$4)

    Google Scholar 

  • CENTREX (2007) Centrex practice advice: introduction to intelligence-led policing. http://www.fairplayforchildren.org/pdf/1291430265.pdf

  • Chapin L, Attfield S, Okoro EM (2013) Predictive coding, storytelling and god: narrative understanding in e-discovery. British Journal of Industrial Relations

  • Dadashi N, Golightly D, Sharples S (2017) Seeing the woods for the trees: the problem of information inefficiency and information overload on operator performance. Cogn Technol Work 19(4):561–570. https://doi.org/10.1007/s10111-017-0451-1

    Article  Google Scholar 

  • Gerber M, Wong BLW, Kodagoda N (2016) How analysts think: intuition, leap of faith and insight. In: Proceedings of the human factors and ergonomics society annual meeting. 60(1):173–177. Sage CA: Los Angeles, CA: SAGE Publications

  • Goodstein LP, Rasmussen J (1985) Decision support in supervisory control. In Analysis, Design and Evaluation of Man–Machine Systems pp. 79-90.

  • Groenewald C, Wong BLW, Attfield S, Passmore P, Kodagoda N (2017a) How analysts think: navigating uncertainty—aspirations, considerations and strategies. In: Proceedings of the 13th international conference on naturalistic decision making. Bath, United Kingdom. pp 56–64. https://www.researchgate.net/profile/Julie_Gore/publication/320146441_Naturalistic_Decision_Making_and_Uncertainty_Proceedings_of_the_13th_Bi-Annual_Naturalistic_Decision_Making_Conference_University_of_Bath_UK/links/59d0aeb30f7e9b4fd7f9fcbf/Naturalistic-Decision-Making-and-Uncertainty-Proceedings-of-the-13th-Bi-Annual-Naturalistic-Decision-Making-Conference-University-of-Bath-UK.pdf

  • Groenewald C, Wong BLW, Attfield S, Passmore P, Kodagoda N (2017b) How analysts think: how do criminal intelligence analysts recognise and manage significant Information? In: 2017 European intelligence and security informatics conference (EISIC). Athens. pp 47–53. https://doi.org/10.1109/EISIC.2017.15

  • Groenewald C, Attfield S, Passmore P, Wong BLW, Kodagoda N (2018) A descriptive, practical, hybrid argumentation model to assist with the formulation of defensible assessments in uncertain sense-making environments. In: Leventakis G, Haberfeld MR (eds) Community-oriented policing and technological innovations. Springer, New York, pp 64–84. https://doi.org/10.1007/978-3-319-89294-8

    Chapter  Google Scholar 

  • Kahneman D (2011). Thinking, fast and slow. Macmillan, Basingstoke

    Google Scholar 

  • Klein G, Klinger D (1991) Naturalistic decision making. http://www.au.af.mil/au/awc/awcgate/decision/nat-dm.pdf

  • Klein G, Ross KG, Moon BM, Klein DE, Hoffman RR, Hollnagel E (2003) Macrocognition. IEEE Intell Syst 18(3):81–85

    Article  Google Scholar 

  • Klein G, Feltovich PJ, Bradshaw JM, Woods DD (2005) Common ground and coordination in joint activity. Organ Simul 53:139–184

    Article  Google Scholar 

  • Klein G, Phillips JK, Rall EL, Peluso DA (2007) A Data-frame theory of sensemaking. In Hoffman RR (Ed.) Expertise out of context proceedings of the sixth international conference on NDM. pp 113–155. Erlbaum

  • Kussmaul P, Tirkkonen-Condit S (1995) Think-Aloud protocol analysis in translation studies. TTR: Traduction, Terminologie, Rédaction 8(1):pp 177–199. https://doi.org/10.7202/037201ar

    Article  Google Scholar 

  • Likert R (1935) A technique for the measurement of attitudes. Arch Psychology. 22(140):55

    Google Scholar 

  • Moore C, Dunham PJ (eds) (1995) Joint attention: Its origins and role in development. Lawrence Erlbaum Associates, Hillsdale

    Google Scholar 

  • Passmore PJ, Attfield S, Kodagoda N, Groenewald C, Wong BLW (2015) Supporting the externalisation of thinking in criminal intelligence analysis. In: Intelligence and security informatics conference (EISIC), 2015 European. pp 16–23. IEEE

  • Pennington N, Hastie R (1992) Explaining the evidence: tests of the story model for juror decision making. J Personal Soc Psychol 62(2):189

    Article  Google Scholar 

  • Pirolli P, Card K (2005) The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis. In Proceedings of international conference on intelligence analysis. 5:2-4

  • Rao S (2003) Making sense of making stories: law, literature, life. Law Libr J 95:455

    Google Scholar 

  • Rooney C, Attfield S, Wong BLW, Choudhury S (2014) INVISQUE as a tool for intelligence analysis: the construction of explanatory narratives. Int J Hum Comput Interact 30(9):703–717

    Article  Google Scholar 

  • Segel E, Heer J (2010) Narrative visualization: Telling stories with data. IEEE Trans Vis Comput Gr 16(6):1139–1148

    Article  Google Scholar 

  • Selvaraj N, Attfield S, Passmore P, Wong BLW (2016) How analysts think: think-steps as a tool for structuring sensemaking in criminal intelligence analysis. In: Intelligence and security informatics conference (EISIC), 2016 European. pp 68–75. IEEE

  • Toulmin SE (2003) The uses of argument. Cambridge University Press, Cambridge

    Book  Google Scholar 

  • Wagenaar W, Koppen P, Crombag H (1993). Anchored narratives: the psychology of criminal evidence. https://www.researchgate.net/publication/232456113_Anchored_Narratives_The_Psychology_of_Criminal_Evidence

  • Wigmore JH (1931) The principles of judicial proof or the process of proof as given by logic. psychology, and general experience, and illustrated in judicial trials, 2nd edn. Little, Brown and Company, Boston

    Google Scholar 

  • Wong BLW (2014) How analysts think (?): early observations. In: Intelligence and Security Informatics Conference (JISIC). pp. 296–299. IEEE

  • Wong BLW, Kodagoda N (2016) How analysts think: anchoring, laddering and associations. In: Proceedings of the human factors and ergonomics society annual meeting. 60(1):178–182. Sage CA: Los Angeles, CA: SAGE Publications

  • Wong BLW, Seidler P, Kodagoda N, Rooney C (2018) Supporting variability in criminal intelligence analysis: From expert intuition to critical and rigorous analysis. In: Leventakis G, Haberfeld MR (eds) Community-oriented policing and technological innovations. Springer, New York pp 64–84. https://doi.org/10.1007/978-3-319-89294-8

    Chapter  Google Scholar 

Download references

Acknowledgements

The research results reported here have received funding from the European Union Seventh Framework Programme (FP7/2007–2013) through Project VALCRI, European Commission Grant Agreement N° FP7-IP-608142, awarded to B.L. William Wong, Middlesex University and partners. We are also very grateful for the enthusiasm of the police analysts in sharing with us their experiences that made this report possible. A special thanks to Nadeem Qazi for his time and effort to get the evaluation data into a usable format.

Author information

Authors and Affiliations

  1. Middlesex University, NW4 4BT, London, UK

    Celeste Groenewald, Simon Attfield, Peter Passmore, B. L. William Wong, Nadeem Qazi & Neesha Kodagoda

Authors
  1. Celeste Groenewald
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Simon Attfield
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Peter Passmore
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. B. L. William Wong
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Nadeem Qazi
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Neesha Kodagoda
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Celeste Groenewald.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Groenewald, C., Attfield, S., Passmore, P. et al. A descriptive, practical, hybrid argumentation model to assist with the formulation of defensible assessments in uncertain sense-making environments: an initial evaluation. Cogn Tech Work 20, 529–542 (2018). https://doi.org/10.1007/s10111-018-0495-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10111-018-0495-x

Keywords

Search

Navigation