Skip to main content
SpringerLink
Log in

Semantic event relationships identification and representation using HyperGraph in multimedia digital ecosystem

  • Published:
Journal of Intelligent Information Systems Aims and scope Submit manuscript

Abstract

Nowadays, multimedia-based digital ecosystem (e.g., social media sites) has become a great source of user-contributed multimedia documents for many types of real-world events. Very often social media posts about events are multimedia (e.g., image, video, text, and others), multi-features (e.g., 5W1H), and multi-sources. Such events might be related to each other, implying that they can be linked by different kinds of relationships (e.g., spatial, temporal, and causal relations). Additionally, a single event may contain two or more than two parts of event and some event relationships may involve more than two events. The traditional pairwise graphical representation method is insufficient to capture this complicated event structure. Thus, the problem of how to represent such complex events in an inclusive representation remains unsolved. To address this, we proposed a comprehensive event representation model based on advanced hypergraph notation. Our event hypergraph contains different kinds of nodes and links between them. Specifically, we first detect real-world events including their elements based on event-only descriptive features from social media documents. Using these detected events, we identify temporal, spatial, and causal relationships between events by comparing their associated dimensions. Finally, each node type is linked together using different kinds of relationships in the form of hierarchical hypergraph structure. Experimental results demonstrate the potential of our method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data availability

The MediaEval 2013 corpus is available from the official website. The causal corpus for this research is included in (Kayesh et al., 2019). The temporal and spatial relationship data sets are available from the corresponding author on reasonable request.

Notes

  1. https://github.com/dair-iitd/OpenIE-standalone

  2. https://www.sciencedirect.com/science/article/abs/pii/S0306457316303259?dgcid=raven_sd_recommender_email

  3. https://www.twitter.com

  4. https://www.youtube.com

  5. http://www.flickr.com

References

  • Abebe, M. A., Tekli, J., Getahun, F., Chbeir, R., & Tekli, G. (2020). Generic metadata representation framework for social-based event detection, description, and linkage. Knowledge-Based Systems, 188, 104817. https://doi.org/10.1016/j.knosys.2019.06.025

    Article  Google Scholar 

  • Allen, J. F. (1983). Maintaining knowledge about temporal intervals. Communications of the ACM, 26(11), 832–843. https://doi.org/10.1145/182.358434

    Article  MATH  Google Scholar 

  • Alsaedi, N., Burnap, P., & Rana, O. F. (2014). A combined classification-clustering framework for identifying disruptive events. In Proceedings of the 2014 ASE SocialCom Conference (pp. 1–10). Stanford University.

    Google Scholar 

  • Amigó, E., Gonzalo, J., Artiles, J., & Verdejo, F. (2009). A comparison of extrinsic clustering evaluation metrics based on formal constraints. Information Retrieval, 12(4), 461–486. https://doi.org/10.1007/s10791-008-9066-8

    Article  Google Scholar 

  • Barrière, C. (2016). Natural language understanding in a semantic web context. Springer.

    Book  MATH  Google Scholar 

  • Becker, H., Naaman, M., & Gravano, L. (2010). Learning similarity metrics for event identification in social media. In Proceedings AAAI conference on weblogs and social media (pp. 291–300). New York, NY, USA. https://doi.org/10.1145/1718487.1718524

  • Becker, H., Naaman, M., & Gravano, L. (2011). Beyond trending topics: Real-world event identification on twitter. In Proceedings of the International AAAI Conference on Web and Social Media, 5(1), 438–441. https://doi.org/10.7916/D81V5NVX

  • Charbel, N., Tekli, J., Chbeir, R., & Tekli, G. (2015). Resolving XML Semantic Ambiguity. In Proceedings of the 18th International Conference on Extending Database Technology, EDBT, pp. 277–288. https://doi.org/10.5441/002/edbt.2015.25

  • Chbeir, R., & Spyratos, N. (2019). Management of Resources in Digital EcoSystems. Journal of Intelligent Information Systems, 53(3), 405–585. Springer, Special Issue. https://doi.org/10.1007/s10844-019-00585-6

    Article  Google Scholar 

  • Chopde, N. R., & Nichat, M. (2013). Landmark based shortest path detection by using A* and Haversine formula. International Journal of Innovative Research in Computer and Communication Engineering, 1(2), 298–302.

    Google Scholar 

  • Choudhury, S., & Alani, H. (2014). Personal life event detection from social media. In Proceedings of the 25th ACM Hypertext and Social Media Conference, Santiago, pp.1–4.

  • Crabtree, D., Andreae, P., & Gao, X. (2007). Qc4-a clustering evaluation method. In In Pacific-Asia Conference on Knowledge Discovery and Data Mining (pp. 59–70). Springer.

    Chapter  Google Scholar 

  • Gottschalk, S., & Demidova, E. (2019). EventKG – the hub of event knowledge on the web – and biographical timeline generation. Semantic Web, 10(6), 1039–1070. https://doi.org/10.3233/sw-190355

    Article  Google Scholar 

  • Kayesh, H., Islam, M., & Wang, J. (2019). On event causality detection in tweets. arXiv preprint arXiv:1901.03526. https://doi.org/10.48550/arXiv.1901.03526

  • Kidanu, S. A., Cardinale, Y., Tekli, G., & Chbeir, R. (2015). A Multimedia-Oriented Digital Ecosystem: a new collaborative environment. In In 2015 IEEE/ACIS 14th International Conference on Computer and Information Science (ICIS) (pp. 411–416). IEEE.

    Google Scholar 

  • Kim, K., Hur, Y., Kim, G., & Lim, H. (2020). GREG: A global level relation extraction with knowledge graph embedding. Applied Sciences, 10(3), 1181. https://doi.org/10.3390/app10031181

    Article  Google Scholar 

  • Kolya, A. K., Ekbal, A., & Bandyopadhyay, S. (2010). Event-event relation identification: A CRF based approach. In In Proceedings of the 6th International Conference on Natural Language Processing and Knowledge Engineering (NLPKE-2010) (pp. 1–8). IEEE. https://doi.org/10.1109/nlpke.2010.5587774

    Chapter  Google Scholar 

  • Li, Q., Nourbakhsh, A., Shah, S., & Liu, X. (2017). Real-time novel event detection from social media. In In 2017 IEEE 33Rd International Conference on Data Engineering (ICDE) (pp. 1129–1139). IEEE.

    Google Scholar 

  • Miller, G. A. (1995). WordNet: a lexical database for English. Communications of the ACM, 38(11), 39–41.

    Article  Google Scholar 

  • Mirza, P. (2014). Extracting temporal and causal relations between events. In Proceedings of the ACL 2014 Student Research Workshop, pp. 10–17. ACL.

  • Papadopoulos, S., Troncy, R., Mezaris, V., Huet, B., & Kompatsiaris, I. (2011). Social Event Detection at MediaEval 2011: Challenges, dataset and evaluation. In Working Notes Proceedings of the MediaEval Workshop, 807. Santa Croce in Fossabanda, Pisa, Italy.

  • Pustejovsky, J., Verhagen, M., Nianwen, X., Gaizauskas, R., Hepple, M., Schilder, F., ... & Im, S. (2009). Tempeval2: Evaluating events, time expressions and temporal relations. In SemEval Task Proposal, 52.

  • Raad, E. J., & Chbeir, R. (2014). Foto2events: From photos to event discovery and linking in online social networks. In In 2014 IEEE Fourth International Conference on Big Data and Cloud Computing (pp. 508–515). IEEE.

    Google Scholar 

  • Reuter, T., Cimiano, P., Drumond, L., Buza, K., & Schmidt-Thieme, L. (2011). Scalable event-based clustering of social media via record linkage techniques. In Proceedings of the Fifth International AAAI Conference on Weblogs and Social Media, 5(1), 313–320.

  • Strehl, A., & Ghosh, J. (2002). Cluster ensembles---a knowledge reuse framework for combining multiple partitions. Journal of Machine Learning Research, 3, 583–617.

    MATH  MathSciNet  Google Scholar 

  • Sutanto, T. E., & Nayak, R. (2013). Admrg@ mediaeval 2013 social event detection. In In Proceedings of the MediaEval 2013 Multimedia Benchmark Workshop [CEUR Workshop Proceedings] (1043rd ed., pp. 1–2). Sun SITE Central Europe.

    Google Scholar 

  • Tekli, J., Charbel, N., & Chbeir, R. (2016). Building semantic trees from XML documents. Journal of Web Semantics, 37, 1–24. https://doi.org/10.1016/j.websem.2016.03.002

    Article  Google Scholar 

  • Vinh, N. X., Epps, J., & Bailey, J. (2010). Information theoretic measures for clusterings comparison: Variants, properties, normalization and correction for chance. Journal of Machine Learning Research, 11, 2837–2854.

    MATH  MathSciNet  Google Scholar 

  • Vo, D. T., Al-Obeidat, F., & Bagheri, E. (2020). Extracting temporal and causal relations based on event networks. Information Processing & Management, 57(6), 102319. https://doi.org/10.1016/j.ipm.2020.102319

    Article  Google Scholar 

  • Zuo, X., Cao, P., Chen, Y., Liu, K., Zhao, J., Peng, W., & Chen, Y. (2021). Improving Event Causality Identification via Self-Supervised Representation Learning on External Causal Statement. In Findings of the Association for Computational Linguistics: ACL-IJCNLP, pp. 2162–2172. https://aclanthology.org/2021.findings-acl.190/

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Addis Ababa University, 1176, Addis Ababa, Ethiopia

    Siraj Mohammed & Fekade Getahun

  2. University of Pau and Pays Adour, E2S UPPA, LIUPPA, 64600, Anglet, France

    Richard Chbeir

Authors
  1. Siraj Mohammed
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fekade Getahun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Richard Chbeir
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the study conception and design. In detail: S. Mohammed mainly contributed in conceptualization, methodology, coding/experimentation and writing the manuscript. F. Getahun and R. Chbeir were involved in conceptualization, methodology, manuscript preparation and supervision. All authors agreed the results and contributed to the final manuscript.

Corresponding author

Correspondence to Siraj Mohammed.

Ethics declarations

Ethical approval and consent to participate

No applicable.

Consent for publication

No applicable.

Competing interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mohammed, S., Getahun, F. & Chbeir, R. Semantic event relationships identification and representation using HyperGraph in multimedia digital ecosystem. J Intell Inf Syst 60, 463–493 (2023). https://doi.org/10.1007/s10844-022-00732-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10844-022-00732-6

Keywords

Search

Navigation