Skip to main content

Migration-Related Semantic Concepts for the Retrieval of Relevant Video Content

  • Conference paper
  • First Online:
Intelligent Technologies and Applications (INTAP 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1382))

Included in the following conference series:

  • 629 Accesses

Abstract

Migration, and especially irregular migration, is a critical issue for border agencies and society in general. Migration-related situations and decisions are influenced by various factors, including the perceptions about migration routes and target countries. An improved understanding of such factors can be achieved by systematic automated analyses of media and social media channels, and the videos and images published in them. However, the multifaceted nature of migration and the variety of ways migration-related aspects are expressed in images and videos make the finding and automated analysis of migration-related multimedia content a challenging task. We propose a novel approach that effectively bridges the gap between a substantiated domain understanding - encapsulated into a set of Migration-related semantic concepts - and the expression of such concepts in a video, by introducing an advanced video analysis and retrieval method for this purpose.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    http://pubdocs.worldbank.org/en/275841490966525495/Theme-Taxonomy-and-definitions.pdf.

  2. 2.

    https://migrationdataportal.org/themes/gender-and-migration.

  3. 3.

    https://www-nlpir.nist.gov/projects/tv2015/index.html#sin.

References

  1. Bakewell, O., Jolivet, D.: Broadcasting Migration Outcomes, pp. 183–204. Palgrave Macmillan, London (2016)

    Google Scholar 

  2. Borjas, G.J.: Economic theory and international migration. Int. Migr. Rev. 23(3), 457–485 (1989)

    Article  Google Scholar 

  3. Castelli, F.: Drivers of migration: why do people move? J. Travel Med. 25(1), 1–7 (2018). https://doi.org/10.1093/jtm/tay040

    Article  MathSciNet  Google Scholar 

  4. Cho, K., et al.: Learning phrase representations using RNN encoder-decoder for statistical machine translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1724–1734 (2014)

    Google Scholar 

  5. Cohen, P., Bains, H.S.: Multi-Racist Britain. Macmillan International Higher Education, London (1988)

    Google Scholar 

  6. Cohen, R.: The New Helots: Migrants in the International Division of Labour (Research in Ethnic Relations Series). Gower Pub Co, Farnham (1987)

    Google Scholar 

  7. Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)

  8. Dong, J., Li, X., Snoek, C.G.M.: Predicting visual features from text for image and video caption retrieval. IEEE Trans. Multimedia (TMM) 20(12), 3377–3388 (2018)

    Article  Google Scholar 

  9. Dong, J., et al.: Dual encoding for zero-example video retrieval. In: Proceedings of IEEE Conference on CVPR 2019, pp. 9346–9355 (2019)

    Google Scholar 

  10. Eriksson, K.: Concept determination as part of the development of knowledge in caring science. Scand. J. Caring Sci. 24, 2–11 (2010)

    Article  Google Scholar 

  11. Faghri, F., Fleet, D.J., Kiros, J.R., Fidler, S.: VSE++: improving visual-semantic embeddings with hard negatives. In: Proceedings of the British Machine Vision Conference (BMVC) (2018)

    Google Scholar 

  12. Galanopoulos, D., Mezaris, V.: Attention mechanisms, signal encodings and fusion strategies for improved ad-hoc videosearch with dual encoding networks. In: Proceedings of the ACM International Conference on Multimedia Retrieval (ICMR 2020). ACM (2020)

    Google Scholar 

  13. de Haas, H., Castles, S., Miller, M.: The Age of Migration, 6th edn. International Population Movements in the Modern World. Guilford Publications, New York (2019)

    Google Scholar 

  14. de Haas, H.: The determinants of international migration. IMI Working Papers (2011)

    Google Scholar 

  15. Habibian, A., Mensink, T., Snoek, C.G.: Video2vec embeddings recognize events when examples are scarce. IEEE Trans. Pattern Anal. Mach. Intell. 39(10), 2089–2103 (2017)

    Article  Google Scholar 

  16. Hear, N.V., Bakewell, O., Long, K.: Push-pull plus: reconsidering the drivers of migration. J. Ethnic Migr. Stud. 44(6), 927–944 (2018)

    Article  Google Scholar 

  17. Lee, E.S.: A theory of migration. Demography 3(1), 47–57 (1966)

    Article  Google Scholar 

  18. Li, Y., et al.: TGIF: a new dataset and benchmark on animated GIF description. In: Proceedings of IEEE CVPR 2016, pp. 4641–4650 (2016)

    Google Scholar 

  19. Markatopoulou, F., Galanopoulos, D., Mezaris, V., Patras, I.: Query and keyframe representations for ad-hoc video search. In: Proceedings of the 2017 ACM International Conference on Multimedia Retrieval, (ICMR 2017), pp. 407–411. ACM (2017)

    Google Scholar 

  20. Markatopoulou, F., Ioannidou, A., Tzelepis, C., et al.: ITI-CERTH participation to TRECVID 2015. In: Proceedings of the TRECVID 2015 Workshop, Gaithersburg, MD, USA, November 2015

    Google Scholar 

  21. Markatopoulou, F., Mezaris, V., Patras, I.: Deep multi-task learning with label correlation constraint for video concept detection. In: Proceedings of the 24th ACM International Conference on Multimedia (MM 2016), pp. 501–505 (2016)

    Google Scholar 

  22. Markatopoulou, F., Moumtzidou, A., Tzelepis, C., et al.: ITI-CERTH participation to TRECVID 2013. In: Proceedings of the TRECVID 2013 Workshop, Gaithersburg, MD, USA, November 2013

    Google Scholar 

  23. Mikolov, T., Corrado, G., Chen, K., Dean, J.: Efficient estimation of word representations in vector space. In: 1st International Conference on Learning Representations, Workshop Track Proceedings. ICLR 2013 (2013)

    Google Scholar 

  24. Moon, B.: Paradigms in migration research: exploring ‘moorings’ as a schema. Prog. Hum. Geogr. 19(4), 504–524 (1995)

    Article  Google Scholar 

  25. Over, P., Awad, G., Fiscus, J., Sanders, G., Shaw, B.: TRECVID 2013-an introduction to the goals, tasks, data, evaluation mechanisms, and metrics. In: Proceedings of the TRECVID 2013 Workshop, Gaithersburg, MD, USA (2013)

    Google Scholar 

  26. Portes, A., Böröcz, J.: Contemporary immigration: theoretical perspectives on its determinants and modes of incorporation. Int. Migr. Rev. 23(3), 606–630 (1989)

    Google Scholar 

  27. Portes, A., Rumbaut, R.G.: Immigrant America: A Portrait, 4th edn. University of California Press, Berkeley (2014)

    Google Scholar 

  28. Sassen, S.: The Mobility of Labor and Capital. Cambridge University Press, New York (1988)

    Google Scholar 

  29. Timmerman, C., De Clerck, M.L., Hemmerechts, K., Willems, R.: Imagining Europe from the Outside: the Role of Perceptions of Human Rights in Europe in Migration Aspirations in Turkey, Morocco, Senegal and Ukraine, pp. 220–247. Palgrave Macmillan, London, January 2014

    Google Scholar 

  30. Xu, J., Mei, T., Yao, T., Rui, Y.: MSR-VTT: a large video description dataset for bridging video and language. In: Proceedings of IEEE CVPR 2016, pp. 5288–5296 (2016)

    Google Scholar 

Download references

Acknowledgments

This work was supported by the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 832921 (MIRROR).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Damianos Galanopoulos .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Elejalde, E., Galanopoulos, D., Niederée, C., Mezaris, V. (2021). Migration-Related Semantic Concepts for the Retrieval of Relevant Video Content. In: Yildirim Yayilgan, S., Bajwa, I.S., Sanfilippo, F. (eds) Intelligent Technologies and Applications. INTAP 2020. Communications in Computer and Information Science, vol 1382. Springer, Cham. https://doi.org/10.1007/978-3-030-71711-7_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-71711-7_34

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-71710-0

  • Online ISBN: 978-3-030-71711-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics