Skip to main content
Springer Nature Link
Log in

Ten Years of Living Machines Conferences: Transformers-Based Automated Topic Grouping

  • Conference paper
  • First Online:
Biomimetic and Biohybrid Systems (Living Machines 2022)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13548))

Included in the following conference series:

Abstract

The overwhelming growth in the number of scientific publications has its drawbacks: it is difficult to cope with it. Researchers need to constantly process the information contained in a very large and increasing number of articles to be up-to-date with their research community. This is especially difficult when interdisciplinary research requires knowledge of the state of the art in different fields. High interdisciplinarity is at the heart of the Living Machines conferences, which bring together scientists from different fields of biology, neuroscience, physics, robotics, artificial intelligence and other engineering fields. Here, using algorithmic AI methods, we analyze the publications of the ten “Living Machines” conferences to automatically discover clusters of research topics. We show that neural networks for natural language processing can find a set of thematic clusters that correspond to different research topics within this community.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://github.com/pymupdf/PyMuPDF.

References

  1. Beltagy, I., Lo, K., Cohan, A.: Scibert: a pretrained language model for scientific text. arXiv preprint arXiv:1903.10676 (2019)

  2. Boorman, L.W., Damianou, A.C., Martinez-Hernandez, U., Prescott, T.J.: Extending a hippocampal model for navigation around a maze generated from real-world data. In: Wilson, S.P., Verschure, P.F.M.J., Mura, A., Prescott, T.J. (eds.) LIVINGMACHINES 2015. LNCS (LNAI), vol. 9222, pp. 441–452. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-22979-9_44

    Chapter  Google Scholar 

  3. Bortoletto, R., Sartori, M., He, F., Pagello, E.: Simulating an elastic bipedal robot based on musculoskeletal modeling. In: Prescott, T.J., Lepora, N.F., Mura, A., Verschure, P.F.M.J. (eds.) Living Machines 2012. LNCS (LNAI), vol. 7375, pp. 26–37. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-31525-1_3

    Chapter  Google Scholar 

  4. Cazenille, L., Bredeche, N., Halloy, J.: Evolutionary optimisation of neural network models for fish collective behaviours in mixed groups of robots and zebrafish. In: Vouloutsi, V., et al. (eds.) Living Machines 2018. LNCS (LNAI), vol. 10928, pp. 85–96. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-95972-6_10

    Chapter  Google Scholar 

  5. Daltorio, K.A., Horchler, A.D., Shaw, K.M., Chiel, H.J., Quinn, R.D.: Stable heteroclinic channels for slip control of a peristaltic crawling robot. In: Lepora, N.F., Mura, A., Krapp, H.G., Verschure, P.F.M.J., Prescott, T.J. (eds.) Living Machines 2013. LNCS (LNAI), vol. 8064, pp. 59–70. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39802-5_6

    Chapter  Google Scholar 

  6. Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)

  7. van Dinter, R., Tekinerdogan, B., Catal, C.: Automation of systematic literature reviews: a systematic literature review. Inf. Softw. Technol. 136, 106589 (2021)

    Article  Google Scholar 

  8. Duff, A., Lepora, N.F., Mura, A., Prescott, T.J., Verschure, P.F.: Biomimetic and biohybrid systems. In: Third International Conference, Living Machines 2014, Milan, Italy, July 30-August 1, 2014, Proceedings, vol. 8608. Springer,, Cham (2014).https://doi.org/10.1007/978-3-030-64313-3

  9. Follador, M., et al.: Octopus-inspired innovative suction cups. In: Lepora, N.F., Mura, A., Krapp, H.G., Verschure, P.F.M.J., Prescott, T.J. (eds.) Living Machines 2013. LNCS (LNAI), vol. 8064, pp. 368–370. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39802-5_37

    Chapter  Google Scholar 

  10. Giannaccini, M.E., Whyle, S., Lepora, N.F.: Force sensing with a biomimetic fingertip. In: Lepora, N.F.F., Mura, A., Mangan, M., Verschure, P.F.M.J.F.M.J., Desmulliez, M., Prescott, T.J.J. (eds.) Living Machines 2016. LNCS (LNAI), vol. 9793, pp. 436–440. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-42417-0_43

    Chapter  Google Scholar 

  11. Gou, M.S., Vouloutsi, V., Grechuta, K., Lallée, S., Verschure, P.F.M.J.: Empathy in Humanoid robots. In: Duff, A., Lepora, N.F., Mura, A., Prescott, T.J., Verschure, P.F.M.J. (eds.) Living Machines 2014. LNCS (LNAI), vol. 8608, pp. 423–426. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-09435-9_50

    Chapter  Google Scholar 

  12. Grootendorst, M.: Bertopic: leveraging bert and C-TF-IDF to create easily interpretable topics. (2020). https://doi.org/10.5281/zenodo.4381785, https://doi.org/10.5281/zenodo.4381785

  13. Hoinville, T., Harischandra, N., Krause, A.F., Dürr, V.: Insect-inspired tactile contour sampling using vibration-based robotic antennae. In: Duff, A., Lepora, N.F., Mura, A., Prescott, T.J., Verschure, P.F.M.J. (eds.) Living Machines 2014. LNCS (LNAI), vol. 8608, pp. 118–129. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-09435-9_11

    Chapter  Google Scholar 

  14. Kano, T., Matsui, N., Ishiguro, A.: 3D movement of snake robot driven by Tegotae-based control. In: Martinez-Hernandez, J.M., et al. (eds.) Living Machines 2019. LNCS (LNAI), vol. 11556, pp. 346–350. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-24741-6_35

    Chapter  Google Scholar 

  15. Lepora, N.F., Mura, A., Krapp, H.G., Verschure, P.F., Prescott, T.J.: Biomimetic and Biohybrid Systems: Second International Conference, Living Machines 2013, London, UK, July 29-August 2, 2013, Proceedings, vol. 8064. Springer, Cham (2013). https://doi.org/10.1007/978-3-319-63537-8

  16. Lepora, N.F., Mura, A., Mangan, M., Verschure, P.F., Desmulliez, M., Prescott, T.J.: Biomimetic and biohybrid systems. In: 5th International Conference, Living Machines 2016, Edinburgh, UK, July 19–22, 2016. Proceedings, vol. 9793. Springer, Cham (2016). https://doi.org/10.1007/978-3-030-64313-3

  17. Lepora, N.F., Verschure, P., Prescott, T.J.: The state of the art in biomimetics. Bioinsp. Biomimet. 8(1), 013001 (2013)

    Article  Google Scholar 

  18. López-Serrano, L.L., Vouloutsi, V., Escudero Chimeno, A., Mathews, Z., Verschure, P.F.M.J.: Insect-like odor classification and localization on an autonomous robot. In: Prescott, T.J., Lepora, N.F., Mura, A., Verschure, P.F.M.J. (eds.) Living Machines 2012. LNCS (LNAI), vol. 7375, pp. 371–372. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-31525-1_47

    Chapter  Google Scholar 

  19. Maffei, G., Puigbò, J.-Y., Verschure, P.F.M.J.: Learning modular sequences in the striatum. In: Mangan, M., Cutkosky, M., Mura, A., Verschure, P.F.M.J., Prescott, T., Lepora, N. (eds.) Living Machines 2017. LNCS (LNAI), vol. 10384, pp. 574–578. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-63537-8_52

    Chapter  Google Scholar 

  20. Mangan, M., Cutkosky, M., Mura, A., Verschure, P.F., Prescott, T., Lepora, N.: Biomimetic and biohybrid systems. In: 6th International Conference, Living Machines 2017, Stanford, CA, USA, July 26–28, 2017, Proceedings, vol. 10384. Springer, Cham (2017). https://doi.org/10.1007/978-3-030-64313-3

  21. Manti, M., Hassan, T., Passetti, G., d’Elia, N., Cianchetti, M., Laschi, C.: An under-actuated and adaptable soft robotic gripper. In: Wilson, S.P., Verschure, P.F.M.J., Mura, A., Prescott, T.J. (eds.) LIVINGMACHINES 2015. LNCS (LNAI), vol. 9222, pp. 64–74. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-22979-9_6

    Chapter  Google Scholar 

  22. Martinez-Hernandez, U., et al.: Biomimetic and biohybrid systems. In: 8th International Conference, Living Machines 2019, Nara, Japan, July 9–12, 2019, Proceedings, vol. 11556. Springer (2019). https://doi.org/10.1007/978-3-030-64313-3

  23. McInnes, L., Healy, J., Astels, S.: hdbscan: hierarchical density based clustering. J. Open Sour. Softw. 2(11), 205 (2017)

    Article  Google Scholar 

  24. McInnes, L., Healy, J., Melville, J.: Umap: uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426 (2018)

  25. Mitchinson, B., Prescott, T.J.: MIRO: a robot mammal with a biomimetic brain-based control system. In: Lepora, N.F.F., Mura, A., Mangan, M., Verschure, P.F.M.J.F.M.J., Desmulliez, M., Prescott, T.J.J. (eds.) Living Machines 2016. LNCS (LNAI), vol. 9793, pp. 179–191. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-42417-0_17

    Chapter  Google Scholar 

  26. Morrow, C., Bolen, B., Hunt, A.J.: Optimization of artificial muscle placements for a humanoid bipedal robot. In: Living Machines 2020. LNCS (LNAI), vol. 12413, pp. 257–269. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-64313-3_25

    Chapter  Google Scholar 

  27. Paszke, A., G et al.: Pytorch: an imperative style, high-performance deep learning library. In: 32th Proceedings of the International Conference on Advances in Neural information Processing Systems (2019)

    Google Scholar 

  28. Prescott, T.T., Lepora, N.F., Mura, A., Verschure, P.F.: Biomimetic and Biohybrid Systems: First International Conference, Living Machines 2012, Barcelona, Spain, July 9–12, 2012, Proceedings, vol. 7375. Springer (2012). https://doi.org/10.1007/978-3-319-63537-8

  29. Ramos, J., et al.: Using TF-IDF to determine word relevance in document queries. In: Proceedings of the First Instructional Conference on Machine Learning, vol. 242, pp. 29–48. Citeseer (2003)

    Google Scholar 

  30. Reidsma, D., et al.: The EASEL project: towards educational human-robot symbiotic interaction. In: Lepora, N.F.F., Mura, A., Mangan, M., Verschure, P.F.M.J.F.M.J., Desmulliez, M., Prescott, T.J.J. (eds.) Living Machines 2016. LNCS (LNAI), vol. 9793, pp. 297–306. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-42417-0_27

    Chapter  Google Scholar 

  31. Scharzenberger, C., Mendoza, J., Hunt, A.: Design of a canine inspired quadruped robot as a platform for synthetic neural network control. In: Martinez-Hernandez, U., Vouloutsi, V., Mura, A., Mangan, M., Asada, M., Prescott, T.J., Verschure, P.F.M.J. (eds.) Living Machines 2019. LNCS (LNAI), vol. 11556, pp. 228–239. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-24741-6_20

    Chapter  Google Scholar 

  32. Suzuki, S., Owaki, D., Fukuhara, A., Ishiguro, A.: Quadruped gait transition from walk to pace to rotary gallop by exploiting head movement. In: Lepora, N.F.F., et al. (eds.) Living Machines 2016. LNCS (LNAI), vol. 9793, pp. 532–539. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-42417-0_58

    Chapter  Google Scholar 

  33. Szczecinski, N.S., Zill, S.N., Dallmann, C.J., Quinn, R.D.: Modeling the dynamic sensory discharges of insect campaniform sensilla. In: Living Machines 2020. LNCS (LNAI), vol. 12413, pp. 342–353. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-64313-3_33

    Chapter  Google Scholar 

  34. Vannucci, L., Falotico, E., Tolu, S., Dario, P., Lund, H.H., Laschi, C.: Eye-head stabilization mechanism for a humanoid robot tested on human inertial data. In: Lepora, N.F.F., Mura, A., Mangan, M., Verschure, P.F.M.J.F.M.J., Desmulliez, M., Prescott, T.J.J. (eds.) Living Machines 2016. LNCS (LNAI), vol. 9793, pp. 341–352. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-42417-0_31

    Chapter  Google Scholar 

  35. Vaswani, A., et al.: Attention is all you need. In:30th Proceedings of the international Conference on Advances in Neural Information Processing Systems (2017)

    Google Scholar 

  36. Vouloutsi, V., et al.: Biomimetic and Biohybrid Systems. In: 7th International Conference, Living Machines 2018, Paris, France, July 17–20, 2018, Proceedings, vol. 10928. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-63537-8

  37. Vouloutsi, V., Mura, A., Tauber, F., Speck, T., Prescott, T.J., Verschure, P.F.: Biomimetic and biohybrid systems. In: 9th International Conference, Living Machines 2020, Freiburg, Germany, July 28–30, 2020, Proceedings, vol. 12413. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-64313-3

  38. Wang, L.L., Lo, K.: Text mining approaches for dealing with the rapidly expanding literature on Covid-19. Brief. Bioinform. 22(2), 781–799 (2021)

    Article  Google Scholar 

  39. Webster, V.A., Hawley, E.L., Akkus, O., Chiel, H.J., Quinn, R.D.: Fabrication of electrocompacted aligned collagen morphs for cardiomyocyte powered living machines. In: Wilson, S.P., Verschure, P.F.M.J., Mura, A., Prescott, T.J. (eds.) LIVINGMACHINES 2015. LNCS (LNAI), vol. 9222, pp. 429–440. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-22979-9_43

    Chapter  Google Scholar 

  40. Wilson, S.P., Verschure, P.F., Mura, A., Prescott, T.J.: Biomimetic and biohybrid systems. In: 4th International Conference, Living Machines 2015, Barcelona, Spain, July 28–31, 2015, Proceedings, vol. 9222. Springer, Cham (2015).https://doi.org/10.1007/978-3-030-64313-3

  41. Wolf, T., et al.: Transformers: State-of-the-art natural language processing. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pp. 38–45 (2020)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Université Paris Cité, CNRS, LIED UMR 8236, 75006, Paris, France

    Théophile Carniel, Leo Cazenille & José Halloy

  2. Agoranov, Paris, France

    Théophile Carniel & Jean-Michel Dalle

  3. Sorbonne Université, Paris, France

    Jean-Michel Dalle

  4. École Polytechnique, Palaiseau, France

    Jean-Michel Dalle

Authors
  1. Théophile Carniel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Leo Cazenille
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jean-Michel Dalle
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. José Halloy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Théophile Carniel .

Editor information

Editors and Affiliations

  1. Portland State University, Portland, OR, USA

    Alexander Hunt

  2. Technology Innovation Institute, Masdar City, United Arab Emirates

    Vasiliki Vouloutsi

  3. Case Western Reserve University, Cleveland, OH, USA

    Kenneth Moses

  4. Case Western Reserve University, Cleveland, OH, USA

    Roger Quinn

  5. Institute for Bioengineering of Cataloni, Barcelona, Spain

    Anna Mura

  6. University of Sheffield, Sheffield, UK

    Tony Prescott

  7. Radboud University, Nijmegen, The Netherlands

    Paul F. M. J. Verschure

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Carniel, T., Cazenille, L., Dalle, JM., Halloy, J. (2022). Ten Years of Living Machines Conferences: Transformers-Based Automated Topic Grouping. In: Hunt, A., et al. Biomimetic and Biohybrid Systems. Living Machines 2022. Lecture Notes in Computer Science(), vol 13548. Springer, Cham. https://doi.org/10.1007/978-3-031-20470-8_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-20470-8_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-20469-2

  • Online ISBN: 978-3-031-20470-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics