Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: Daniel Ponte 1 ; Eduardo Aguilar 1 ; 2 ; Mireia Ribera 1 and Petia Radeva 3 ; 1

Affiliations: 1 Dept. de Matemàtiques i Informàtica, Universitat de Barcelona, Gran Via de les Corts Catalanes 585, Barcelona, Spain ; 2 Dept. de Ingeniería de Sistemas y Computación, Universidad Católica del Norte, Angamos 0610, Antofagasta, Chile ; 3 Computer Vision Center, Cerdanyola (Barcelona), Spain

Keyword(s): Food Ontology, Food Image Analysis, Multitask Learning.

Abstract: The food analysis from images is a challenging task that has gained significant attention due to its multiple applications, especially in the field of health and nutrition. Ontology-driven deep learning techniques have shown promising results in improving model performance. Food ontology can leverage domain-specific information to guide model learning and thus substantially enhance the food analysis. In this paper, we propose a new ontology-driven multi-task learning approach for food recognition. To this end, we deal multi-modal information, text and images, in order to extract from the text the food ontology, which represents prior knowledge about the relationship of food concepts at different semantic levels (e.g. food groups and food names), and apply this information to guide the learning of the multi-task model to perform the task at hand. The proposed method was validated on the public food dataset named MAFood-121, specifically on dishes belonging to Mexican cuisine, outperfo rming the results obtained in single-label food recognition and multi-label food group recognition. Moreover, the proposed integration of the ontology into the deep learning framework allows providing more consistent results across the tasks. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 18.191.148.200

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Ponte, D., Aguilar, E., Ribera, M. and Radeva, P. (2024). Ontology-Driven Deep Learning Model for Multitask Visual Food Analysis. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: VISAPP; ISBN 978-989-758-679-8; ISSN 2184-4321, SciTePress, pages 624-631. DOI: 10.5220/0012388200003660

@conference{visapp24,
author={Daniel Ponte and Eduardo Aguilar and Mireia Ribera and Petia Radeva},
title={Ontology-Driven Deep Learning Model for Multitask Visual Food Analysis},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: VISAPP},
year={2024},
pages={624-631},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012388200003660},
isbn={978-989-758-679-8},
issn={2184-4321},
}

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: VISAPP
TI - Ontology-Driven Deep Learning Model for Multitask Visual Food Analysis
SN - 978-989-758-679-8
IS - 2184-4321
AU - Ponte, D.
AU - Aguilar, E.
AU - Ribera, M.
AU - Radeva, P.
PY - 2024
SP - 624
EP - 631
DO - 10.5220/0012388200003660
PB - SciTePress