An Image Recognition System of Aboriginal Artefact for Knowledge Sharing using Machine Learning
Loading...
Date
2022
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Acquiring knowledge about indigenous artefacts is difficult without prior experience. Due to the scarcity of digitally preserved artefacts, the new online generations are not exposed to even the most basic concepts. This paper demonstrates the feasibility of Image recognition technology for providing an app to describe aboriginal artefacts. By using Microsoft Custom Vision Service to classify and train the data, the predictive API of the model is called from a progressive web app developed to take photos of artefacts and retrieve their classification and description. We have divided aboriginal artefacts into the categories of tools or paintings for detection and description by machine learning systems. We test the trained model by taking new photos of artefacts already known to the system with the app camera. This performance was tested and compared with human classification to determine its usability. The results of the testing of our app show that the identification of aboriginal artefacts is applicable in certain cases.
Description
CCS Concepts: Applied Computing --> Computers in other domains; Digital libraries and archives
@inproceedings{10.2312:gch.20221217,
booktitle = {Eurographics Workshop on Graphics and Cultural Heritage},
editor = {Ponchio, Federico and Pintus, Ruggero},
title = {{An Image Recognition System of Aboriginal Artefact for Knowledge Sharing using Machine Learning}},
author = {Ma, Yajun and Karim, Asif and Haque, A. S. M. Farhan Al},
year = {2022},
publisher = {The Eurographics Association},
ISSN = {2312-6124},
ISBN = {978-3-03868-178-6},
DOI = {10.2312/gch.20221217}
}