loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: Sravan Jagadeesh ; René Schuster and Didier Stricker

Affiliation: DFKI – German Research Center for Artificial Intelligence, Kaiserslautern, Germany

Keyword(s): Semantic Segmentation, Instance Segmentation, Panoptic Segmentation, Part Segmentation, Part-Aware Panoptic Segmentation.

Abstract: In this paper, we introduce a novel network that generates semantic, instance, and part segmentation using a shared encoder and effectively fuses them to achieve panoptic-part segmentation. Unifying these three segmentation problems allows for mutually improved and consistent representation learning. To fuse the predictions of all three heads efficiently, we introduce a parameter-free joint fusion module that dynamically balances the logits and fuses them to create panoptic-part segmentation. Our method is evaluated on the Cityscapes Panoptic Parts (CPP) and Pascal Panoptic Parts (PPP) datasets. For CPP, the PartPQ of our proposed model with joint fusion surpasses the previous state-of-the-art by 1.6 and 4.7 percentage points for all areas and segments with parts, respectively. On PPP, our joint fusion outperforms a model using the previous top-down merging strategy by 3.3 percentage points in PartPQ and 10.5 percentage points in PartPQ for partitionable classes.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.15.218.254

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Jagadeesh, S.; Schuster, R. and Stricker, D. (2023). Multi-task Fusion for Efficient Panoptic-Part Segmentation. In Proceedings of the 12th International Conference on Pattern Recognition Applications and Methods - ICPRAM; ISBN 978-989-758-626-2; ISSN 2184-4313, SciTePress, pages 15-26. DOI: 10.5220/0011616000003411

@conference{icpram23,
author={Sravan Jagadeesh. and René Schuster. and Didier Stricker.},
title={Multi-task Fusion for Efficient Panoptic-Part Segmentation},
booktitle={Proceedings of the 12th International Conference on Pattern Recognition Applications and Methods - ICPRAM},
year={2023},
pages={15-26},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011616000003411},
isbn={978-989-758-626-2},
issn={2184-4313},
}

TY - CONF

JO - Proceedings of the 12th International Conference on Pattern Recognition Applications and Methods - ICPRAM
TI - Multi-task Fusion for Efficient Panoptic-Part Segmentation
SN - 978-989-758-626-2
IS - 2184-4313
AU - Jagadeesh, S.
AU - Schuster, R.
AU - Stricker, D.
PY - 2023
SP - 15
EP - 26
DO - 10.5220/0011616000003411
PB - SciTePress