Abstract
Models of human habits in smart spaces can be expressed by using a multitude of representations whose readability influences the possibility of being validated by human experts. The visual analysis by domain experts allows to identify stages of human habits that could be automatized or simplified by redesigning the environment. In this paper, we present a visual analysis pipeline for graphically visualizing human habits, starting from the sensor log of a smart space,. We apply techniques borrowed from the area of business process automation and mining on a version of the sensor log preprocessed in order to translate raw sensor measurements into human actions. The proposed method is employed to automatically extract models to be reused for ambient intelligence. A user evaluation demonstrates the effectiveness of the approach, and compares it with respect to a relevant state-of-the-art visual tool, namely Situvis.

























Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
cf. https://fluxicon.com/camp/2018/ for the last held edition at the time of this writing.
A printed version is available at https://drive.google.com/file/d/1m-zenwl-UGTdHPvFxLYm4Hq4uN_i3iZZ/view?usp=sharing.
References
Augusto JC, Nugent CD (2004) The use of temporal reasoning and management of complex events in smart homes. In: Proceedings of the 16th European conference on artificial intelligence, ECAI’04. IOS Press, Amsterdam, pp 778–782. http://dl.acm.org/citation.cfm?id=3000001.3000165
Augusto JC, Liu J, McCullagh P, Wang H, Yang JB (2008) Management of uncertainty and spatio-temporal aspects for monitoring and diagnosis in a smart home. Int J Comput Intell Syst 1(4):361–378. https://doi.org/10.1080/18756891.2008.9727632
Avci A, Bosch S, Marin-Perianu M, Marin-Perianu R, Havinga P (2010) Activity recognition using inertial sensing for healthcare, wellbeing and sports applications: a survey. In: Architecture of computing systems (ARCS), 23rd international conference. Springer, Berlin, pp 1–10
Aztiria A, Augusto JC, Basagoiti R, Izaguirre A, Cook DJ (2012) Discovering frequent user-environment interactions in intelligent environments. Pers Ubiquitous Comput 16(1):91–103. https://doi.org/10.1007/s00779-011-0471-4
Aztiria A, Izaguirre A, Basagoiti R, Augusto JC, Cook D (2010) Automatic modeling of frequent user behaviours in intelligent environments. In: Intelligent environments (IE), 2010 sixth international conference. IEEE, pp 7–12. https://doi.org/10.1109/IE.2010.9
Aztiria A, Izaguirre A, Basagoiti R, Augusto JC, Cook DJ (2009) Discovering frequent sets of actions in intelligent environments. In: Intelligent environments. iOS Press, Amsterdam, pp 153–160. https://doi.org/10.3233/978-1-60750-034-6-153
Bettini C, Brdiczka O, Henricksen K, Indulska J, Nicklas D, Ranganathan A, Riboni D (2010) A survey of context modelling and reasoning techniques. Pervasive Mob Comput 6(2):161–180. https://doi.org/10.1016/j.pmcj.2009.06.002
Chen H, Finin T, Joshi A (2003) An ontology for context-aware pervasive computing environments. Knowl Eng Rev 18(03):197–207. https://doi.org/10.1017/S0269888904000025
Clear AK, Holland T, Dobson S, Quigley A, Shannon R, Nixon P (2010) Situvis: a sensor data analysis and abstraction tool for pervasive computing systems. Pervasive Mob Comput 6(5):575–589. https://doi.org/10.1016/j.pmcj.2010.04.002
Cook DJ (2012) Learning setting-generalized activity models for smart spaces. IEEE Intell Syst 27(1):32–38
Dumas M, La Rosa M, Mendling J, Reijers HA (2018) Fundamentals of business process management, 2nd edn. Springer, Berlin Heidelberg
García-Bañuelos L, Dumas M, La Rosa M, De Weerdt J, Ekanayake CC (2014) Controlled automated discovery of collections of business process models. Inf Syst 46:85–101. https://doi.org/10.1016/j.is.2014.04.006
Gini C (1921) Measurement of inequality of incomes. Econ J 31(121):124–126. https://doi.org/10.2307/2223319
Gottfried B, Guesgen H, Hubner S (2006) Spatiotemporal reasoning for smart homes. In: Augusto J, Nugent C (eds) Designing smart homes, lecture notes in computer science, vol 4008. Springer, Berlin, pp 16–34
Gu T, Pung HK, Zhang DQ (2005) A service-oriented middleware for building context-aware services. J Netw Comput Appl 28(1):1–18. https://doi.org/10.1016/j.jnca.2004.06.002
Günther CW, Van Der Aalst WM (2007) Fuzzy mining–adaptive process simplification based on multi-perspective metrics. In: Business process management. Springer, Berlin Heidelberg, pp 328–343. https://doi.org/10.1007/978-3-540-75183-0_24
Hagras H (2018) Toward human-understandable, explainable AI. IEEE Comput 51(9):28–36. https://doi.org/10.1109/MC.2018.3620965
Helaoui R, Riboni D, Stuckenschmidt H (2013) A probabilistic ontological framework for the recognition of multilevel human activities. In: Proceedings of the 2013 ACM international joint conference on pervasive and ubiquitous computing. ACM, pp 345–354. https://doi.org/10.1145/2493432.2493501
Henricksen K, Indulska J (2006) Developing context-aware pervasive computing applications: models and approach. Pervasive Mob Comput 2(1):37–64. https://doi.org/10.1016/j.pmcj.2005.07.003
Jorbina K, Rozumnyi A, Verenich I, Di Francescomarino C, Dumas M, Ghidini C, Maggi FM, La Rosa M, Raboczi S (2017) Nirdizati: a web-based tool for predictive process monitoring. In: Proceedings of the BPM demo track with 15th international conference on business process modeling (BPM 2017), Barcelona, Spain, September 13, 2017. http://ceur-ws.org/Vol-1920/BPM_2017_paper_202.pdf
Lee JG, Han J, Whang KY (2007) Trajectory clustering: a partition-and-group framework. In: Proceedings of the 2007 ACM SIGMOD international conference on management of data, pp 593–604. https://doi.org/10.1145/1247480.1247546
Leotta F, Mecella M, Mendling J (2015) Applying process mining to smart spaces: perspectives and research challenges. In: Advanced information systems eng.ing workshops. Springer, Cham, pp 298–304. https://doi.org/10.1007/978-3-319-19243-7_28
Loke SW (2004) Logic programming for context-aware pervasive computing: language support, characterizing situations, and integration with the web. In: Proceedings of the 2004 IEEE/WIC/ACM international conference on web intelligence, pp 44–50. https://doi.org/10.1109/WI.2004.10035
Loke SW (2010) Incremental awareness and compositionality: a design philosophy for context-aware pervasive systems. Pervasive Mob Comput 6(2):239–253. https://doi.org/10.1016/j.pmcj.2009.03.004
Poppe R (2010) A survey on vision-based human action recognition. Image Vis Comput 28(6):976–990. https://doi.org/10.1016/j.imavis.2009.11.014
Ranganathan A, McGrath R, Campbell R, Mickunas M (2003) Use of ontologies in a pervasive computing environment. Knowl Eng Rev 18(03):209–220. https://doi.org/10.1017/S0269888904000037
Rashidi P, Cook DJ (2013) Com: a method for mining and monitoring human activity patterns in home-based health monitoring systems. ACM Trans Intell Syst Technol (TIST) 4(4):64. https://doi.org/10.1145/2508037.2508045
Riboni D, Bettini C (2009) Context-aware activity recognition through a combination of ontological and statistical reasoning. In: Ubiquitous intelligence and computing, pp 39–53. https://doi.org/10.1007/978-3-642-02830-4_5
Riboni D, Sztyler T, Civitarese G, Stuckenschmidt H (2016) Unsupervised recognition of interleaved activities of daily living through ontological and probabilistic reasoning. In: Proceedings of the 2016 ACM international joint conference on pervasive and ubiquitous computing. ACM, New York, pp 1–12. https://doi.org/10.1145/2971648.2971691
Russell SJ, Norvig P (2010) Artificial intelligence—a modern approach (3. internat. ed.). Pearson Education, Upper Saddle River, NJ, USA
Tax N, Alasgarov E, Sidorova N, Haakma R (2016a) On generation of time-based label refinements. In: Proceedings of the 25th international workshop on concurrency, specification and programming, Rostock, Germany, September 28–30, 2016, CEUR-WS.org, CEUR Workshop Proceedings, vol 1698, pp 25–36. http://ceur-ws.org/Vol-1698/CS&P2016_03_Tax&Alasgarov&Sidorova&Haakma_On-Generation-of-Time-based-Label-Refinements.pdf
Tax N, Sidorova N, Haakma R, van der Aalst WM (2016b) Event abstraction for process mining using supervised learning techniques. In: Proceedings of SAI intelligent systems conference. Springer, Cham, pp 251–269. https://doi.org/10.1007/978-3-319-56994-9_18
Tax N, Verenich I, La Rosa M, Dumas M (2017) Predictive business process monitoring with LSTM neural networks. In: Advanced information systems engineering---29th international conference, CAiSE 2017, Essen, Germany, June 12–16, 2017, proceedings, pp 477–492. https://doi.org/10.1007/978-3-319-59536-8_30
van der Aalst WM (2016) Process mining. Data science in action. Springer, Berlin Heidelberg
Ye J, Coyle L, Dobson S, Nixon P (2007) Ontology-based models in pervasive computing systems. Knowl Eng Rev 22(4):315–347. https://doi.org/10.1017/S0269888907001208
Ye J, Dobson S, McKeever S (2012) Situation identification techniques in pervasive computing: a review. Pervasive Mob Comput 8(1):36–66. https://doi.org/10.1016/j.pmcj.2011.01.004
Acknowledgements
Results in this paper have been obtained with an academic license of Disco freely provided by Fluxicon. The work of Daniele Sora has been partly supported by the Lazio regional project SAPERI & Co (FILAS-RU-2014-1113), the work of Francesco Leotta has been partly supported by the Lazio regional project Sapientia (FILAS-RU-2014-1186), all the authors have been also partly supported by Italian project Social Museum e Smart Tourism (CTN01-00034-23154), Italian project NEPTIS (PON03PE-00214-3) and Italian project RoMA–Resilence of Metropolitan Areas (SCN-00064).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix A: Jaccard similarity measure
Appendix A: Jaccard similarity measure
In this paper, we use the Jaccard similarity factor in three different variants: (i) the weighted algorithm on the same subset of nodes, (ii) the weighted algorithm on the same subset of edges, and (iii) a non weighted version (i.e., considering only the graph structure or topology) that, on the same subset of nodes, computes how many edges are in common.
The weighted version is as it follows: given two graphs \(G_1\) and \(G_2\) with the same nodes (i.e., the same event types), the weighted Jaccard similarity \(J(G_1,G_2)\) between the two graphs is given by:
where \(G_k(n_i, n_j)\) is the weight assigned to the arc from \(n_i\) to \(n_j\) in \(G_k\) (if the arc is absent the weight is 0), \(G_k(n_i)\) is the weight assigned to node \(n_i\) in graph \(G_k\), and min (resp. max) are binary operators returning the minimum (resp. the maximum) between two operands. By definition the value of J is always a positive real number minor or equal to 1.
Conversely the non weighted Jaccard coefficient is defined as it follows: given two graphs \(G_1 = \left\langle E_1, V_1 \right\rangle\) and \(G_2 = \left\langle E_2, V_2 \right\rangle\) with \(E_i\) and \(V_i\) respectively the set of the edges and the set of the nodes of graph \(G_i\), the Jaccard similarity coefficient J between them is computed as \(J = {{E_1 \cap E_2}\over {E1 \cup E_2}}\), on \(V_1 \cap V_2\). In other terms, on common sub-graph’s nodes between the two graphs, Jaccard coefficient J indicates if there are the same connections between the same nodes of the graphs.
Rights and permissions
About this article
Cite this article
Leotta, F., Mecella, M. & Sora, D. Visual process maps: a visualization tool for discovering habits in smart homes. J Ambient Intell Human Comput 11, 1997–2025 (2020). https://doi.org/10.1007/s12652-019-01211-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-019-01211-7