Language-driven Diversified Image Retargeting
Article No.: 19, Pages 1 - 2
Abstract
Content-aware image resizing could automatically retarget an image to different aspect ratios while preserving visually salient contents. However, it is difficult for users to interact with the retargeting process and control the results. In this paper, we propose a language-driven diversified image retargeting (LDIR) method that allows the users to control the retargeting process by providing additional textual descriptions. Taking the original image and user-provided texts as inputs, LDIR retargets the image into the desired resolution while preserving the content indicated by texts. Following a self-play reinforcement learning pipeline, a multimodel reward function is proposed by considering both the visual quality and language guidance. Preliminary experiments manifest that LDIR can achieve diversified image retargeting guided by texts.
References
[1]
Nobukatsu Kajiura, Satoshi Kosugi, Xueting Wang, and Toshihiko Yamasaki. 2020. Self-Play Reinforcement Learning for Fast Image Retargeting. In Proceedings of the 28th ACM International Conference on Multimedia. Association for Computing Machinery, New York, NY, USA, 1755–1763.
[2]
Si Liu, Zhen Wei, Yao Sun, Xinyu Ou, Junyu Lin, Bin Liu, and Ming-Hsuan Yang. 2018. Composing Semantic Collage for Image Retargeting. IEEE Transactions on Image Processing 27, 10 (2018), 5032–5043.
[3]
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, 2021. Learning transferable visual models from natural language supervision. In International Conference on Machine Learning. PMLR, 8748–8763.
[4]
Michael Rubinstein, Ariel Shamir, and Shai Avidan. 2009. Multi-operator media retargeting. ACM Transactions on Graphics 28, 3, Article 23 (jul 2009), 11 pages.
[5]
Yu Song, Fan Tang, Weiming Dong, Xiaopeng Zhang, Oliver Deussen, and Tong-Yee Lee. 2018. Photo Squarization by Deep Multi-Operator Retargeting. In Proceedings of the 26th ACM International Conference on Multimedia. 1047–1055.
Index Terms
- Language-driven Diversified Image Retargeting
Index terms have been assigned to the content through auto-classification.
Recommendations
Artist friendly facial animation retargeting
This paper presents a novel facial animation retargeting system that is carefully designed to support the animator's workflow. Observation and analysis of the animators' often preferred process of key-frame animation with blendshape models informed our ...
Rig-space motion retargeting
EG '16: Proceedings of the 37th Annual Conference of the European Association for Computer Graphics: PostersThis paper presents a framework for transferring rig parameters from a source animation to a target model, allowing artists to further refine and adjust the animation. Most previous methods only transfer animations to meshes or joint parameters. However,...
Artist friendly facial animation retargeting
SA '11: Proceedings of the 2011 SIGGRAPH Asia ConferenceThis paper presents a novel facial animation retargeting system that is carefully designed to support the animator's workflow. Observation and analysis of the animators' often preferred process of key-frame animation with blendshape models informed our ...
Comments
Information & Contributors
Information
Published In
Copyright © 2022 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 December 2022
Check for updates
Qualifiers
- Poster
- Research
- Refereed limited
Funding Sources
- Open Projects Program of NLPR
- National Natural Science Foundation of China
- Ministry of Science and Technology, Taiwan
Conference
SA '22
Sponsor:
Acceptance Rates
Overall Acceptance Rate 178 of 869 submissions, 20%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 86Total Downloads
- Downloads (Last 12 months)22
- Downloads (Last 6 weeks)3
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
Cited By
View allView Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format