Loading [a11y]/accessibility-menu.js
Weakly Supervised Exaggeration Transfer for Caricature Generation With Cross-Modal Knowledge Distillation | IEEE Journals & Magazine | IEEE Xplore

Weakly Supervised Exaggeration Transfer for Caricature Generation With Cross-Modal Knowledge Distillation


Abstract:

Caricature generation aims to translate portrait photos into caricatures with exaggerated and hand-drawn artistic styles. Previous methods faced challenges in creating di...Show More

Abstract:

Caricature generation aims to translate portrait photos into caricatures with exaggerated and hand-drawn artistic styles. Previous methods faced challenges in creating diverse and meaningful exaggeration effects, yielding unsatisfactory and uncontrollable results. To overcome this, we proposed ETCari, a novel weakly supervised exaggeration transfer network. ETCari enables the learning of diverse exaggeration caricature styles from various artists, better meeting individual customization requirements and achieving diversified exaggeration while retaining identity features. Specifically, we use the TPS control point deformation field as the ground truth, serving as the loss for weakly supervised learning to address the challenge of no labels. We convert input to an intermediate modality for domain adaptation, training a teacher model. Subsequently, we perform cross-modal knowledge distillation to train the student model, simplifying preprocessing during inference and avoiding the impact of face parser errors. Experiments on the WebCaricature dataset demonstrate that ETCari effectively performs exaggeration transfer, generating appealing caricatures.
Published in: IEEE Computer Graphics and Applications ( Volume: 44, Issue: 4, July-Aug. 2024)
Page(s): 98 - 112
Date of Publication: 17 April 2024

ISSN Information:

PubMed ID: 38630562

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.