loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Masahiro Mitsuhara ; Hiroshi Fukui ; Yusuke Sakashita ; Takanori Ogata ; Tsubasa Hirakawa ; Takayoshi Yamashita and Hironobu Fujiyoshi

Affiliation: Chubu University, Kasugai, Aichi, Japan

Keyword(s): Visual Explanation, Human-in-the-Loop, Attention Mechanism, Object Recognition, Fine-grained Recognition.

Abstract: The conventional method to embed human knowledge has been applied for non-deep machine learning. Meanwhile, it is challenging to apply it for deep learning models due to the enormous number of model parameters. In this paper, we propose a novel framework for optimizing networks while embedding human knowledge. The crucial factors are an attention map for visual explanation and an attention mechanism. A manually edited attention map, in which human knowledge is embedded, has the potential to adjust recognition results. The proposed method updates network parameters so that the output attention map corresponds to the edited ones. As a result, the trained network can output an attention map that takes into account human knowledge. Experimental results with ImageNet, CUB-200-2010, and IDRiD demonstrate that it is possible to obtain a clear attention map for a visual explanation and improve the classification performance.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 18.222.155.58

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Mitsuhara, M.; Fukui, H.; Sakashita, Y.; Ogata, T.; Hirakawa, T.; Yamashita, T. and Fujiyoshi, H. (2021). Embedding Human Knowledge into Deep Neural Network via Attention Map. In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP; ISBN 978-989-758-488-6; ISSN 2184-4321, SciTePress, pages 626-636. DOI: 10.5220/0010335806260636

@conference{visapp21,
author={Masahiro Mitsuhara. and Hiroshi Fukui. and Yusuke Sakashita. and Takanori Ogata. and Tsubasa Hirakawa. and Takayoshi Yamashita. and Hironobu Fujiyoshi.},
title={Embedding Human Knowledge into Deep Neural Network via Attention Map},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP},
year={2021},
pages={626-636},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010335806260636},
isbn={978-989-758-488-6},
issn={2184-4321},
}

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP
TI - Embedding Human Knowledge into Deep Neural Network via Attention Map
SN - 978-989-758-488-6
IS - 2184-4321
AU - Mitsuhara, M.
AU - Fukui, H.
AU - Sakashita, Y.
AU - Ogata, T.
AU - Hirakawa, T.
AU - Yamashita, T.
AU - Fujiyoshi, H.
PY - 2021
SP - 626
EP - 636
DO - 10.5220/0010335806260636
PB - SciTePress