research-article

Learning Highlight Separation of Real High Resolution Portrait Image

Authors:

Ruikang Ju,

Dongdong Weng,

Bin LiangAuthors Info & Claims

ICCCV '21: Proceedings of the 4th International Conference on Control and Computer Vision

Pages 18 - 23

https://doi.org/10.1145/3484274.3484278

Published: 23 November 2021 Publication History

Get Access

References

[1]

Jian Shi, Yue Dong, Hao Su, Stella X. Yu. 2017. Learning Non-lambertian Object Intrinsics across Shapenet Categories. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Hawaii, USA, 1685-1694.

Crossref

Google Scholar

[2]

Renjiao Yi, Ping Tan, Stephen Lin. 2020. Leveraging Multi-View Image Sets for Unsupervised Intrinsic Image Decomposition and Highlight Separation. In Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, 34(07), 12685-12692. https://doi.org/10.1609/aaai.v34i07.696.

Crossref

Google Scholar

[3]

S. Lombardi and K. Nishino. 2016. Reflectance and Illumination Recovery in the Wild. IEEE Transactions on Pattern Analysis and Machine Intelligence, 129-141.

Crossref

Google Scholar

[4]

Renjiao Yi, Chenyang Zhu, Ping Tan and Stephen Lin. 2018. Faces as Lighting Probes via Unsupervised Deep Highlight Extraction. In Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany, 317-333.

Digital Library

Google Scholar

[5]

Chen Li, Kun Zhou, Stephen Lin. 2015. Simulating Makeup Through Physics-Based Manipulation of Intrinsic Image Layers. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, USA, 4621-4629.

Crossref

Google Scholar

[6]

Soumyadip Sengupta, Angjoo Kanazawa, Carlos D. Castillo, David W. Jacobs. 2018. SfSNet: Learning Shape, Reflectance and Illuminance of Faces in the Wild. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, Utah, USA, 6296-6305.

Crossref

Google Scholar

[7]

Zhixin Shu, Ersin Yumer, Sunil Hadap, Kalyan Sunkavalli, Eli Shechtman, Dimitris Samaras. 2017. Neural Face Editing with Intrinsic Image Disentangling. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Hawaii, USA, 5541-5550.

Crossref

Google Scholar

[8]

Hao Zhou, Sunil Hadap, Kalyan Sunkavalli, David W. Jacobs. 2019. Deep Single-Image Portrait Relighting. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea, 7194-7202.

Crossref

Google Scholar

[9]

Steven A. Shafer. 1985. Using Color to Separate Reflection Components. J. Color Research and Application, 10, 4 (Winter 1985), 210-218.

Crossref

Google Scholar

[10]

Klinker, G.J., Shafer, S.A. and Kanade, T. 1988. The Measurement of Highlights in Color Images. Int J Comput Vision2, 7–32 (1988). https://doi.org/10.1007/BF00836279.

Crossref

Google Scholar

[11]

PingTan Lin, Long Quan and Heung-Yeung Shum. 2003. Highlight Removal by Illumination-Constrained Inpainting. Proceedings of the Ninth IEEE International Conference on Computer Vision, Nice, France, 164-169.

Crossref

Google Scholar

[12]

Yuanliu Liu, Zejian Yuan, Nanning Zheng, Yang Wu. 2015. Saturation-Preserving Specular Reflection Separation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, USA, 3725-3733.

Google Scholar

[13]

Tan R.T., Ikeuchi K. 2008. Separating Reflection Components of Textured Surfaces Using A Single Image. In Proceedings of the Digitally Archiving Cultural Objects. Springer, Boston, MA, 353-384. https://doi.org/10.1007/978-0-387-75807_17.

Crossref

Google Scholar

[14]

Huiliang Shen and Zhihuan Zheng. 2013. Real-time Highlight Removal Using Intensity Ratio. Appl. Opt. 52, 4483-4493. https://doi.org/10.1364/AO.52.004483.

Crossref

Google Scholar

[15]

Hyeongwoo Kim, Hailin Jin, Sunil Hadap, Inso Kweon. 2015. Specular Reflection Separation Using Dark Channel Prior. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, Oregon, 1460-1467.

Google Scholar

[16]

Yoichi Sato and Katsushi Ikeuchi. 1994. Temporal-Color Space Analysis of Reflection. J. Opt. Soc. Am. A 11, 2990-3002. https://doi.org/10.1364/JOSAA.11.002990.

Crossref

Google Scholar

[17]

Lin S., Li Y., Kang S.B., Tong X., Shum HY. 2002. Diffuse-Specular Separation and Depth Recovery from Image Sequences. Proceedings of the Computer Vision — ECCV 2002, Springer, Berlin, Heidelberg, 210-224. https://doi.org/10.1007/3-540-47977-5_14.

Crossref

Google Scholar

[18]

Wolff L B, Boult T E. 1993. Constraining Object Features Using A Polarization Reflectance Model. J. Phys. Based Vis. Princ. Pract. Radiom, 1993, 1: 167.

Google Scholar

[19]

Nayar, S.K., Fang, XS. & Boult, T. 1997. Separation of Reflection Components Using Color and Polarization. International Journal of Computer Vision 21, 163–186 (1997). https://doi.org/10.1023/A:1007937815113.

Digital Library

Google Scholar

[20]

Ma W.-C., Hawkins T., Peers P., Chabert C.-F., Weiss M., Debevec P. 2007. Rapid Acquisition of Specular and Diffuse Normal Maps from Polarized Spherical Gradient Illumination. Proceedings of the 18th Euro graphics Conference on Rendering Techniques, EGSR’07, Euro graphics Association, 183–194.

Google Scholar

[21]

Kampouris C, Zafeiriou S, Ghosh A. 2018. Diffuse-Specular Separation Using Binary Sphere Gradient Illumination. Proceedings of the Eurographics Symposium on Rendering: Experimental Ideas & Implementations.2018(7): 1-10.

Digital Library

Google Scholar

[22]

Paul Debevec, Tim Hawkins, Chris Tchou, Haarm-Pieter Duiker, Westley Sarokin, and Mark Sagar. 2000. Acquiring the Reflectance Field of A Human Face. Proceedings of the 27th annual conference on Computer graphics and interactive techniques (SIGGRAPH '00). ACM Press/Addison-Wesley Publishing Co., USA, 145-156. https://doi.org/10.1145/344779.344855

Digital Library

Google Scholar

[23]

Tim Hawkins, Jonathan Cohen, and Paul Debevec. 2001. A Photometric Approach to Digitizing Cultural Artifacts. Proceedings of the 2001 conference on Virtual reality, archeology, and cultural heritage (VAST '01). Association for Computing Machinery, New York, NY, USA, 333–342.https://doi.org/10.1145/584993.585053.

Digital Library

Google Scholar

[24]

Paul Debevec, Andreas Wenger, Chris Tchou, Andrew Gardner, Jamie Waese, and Tim Hawkins. 2002. A Lighting Reproduction Approach to Live-Action Compositing. ACM Trans. Graph. 21, 3 (July 2002), 547–556. https://doi.org/10.1145/566654.566614.

Digital Library

Google Scholar

[25]

Andreas Wenger, Andrew Gardner, Chris Tchou, Jonas Unger, Tim Hawkins, and Paul Debevec. 2005. Performance Relighting and Reflectance Transformation with Time-Multiplexed Illumination. ACM Trans. Graph. 24, 3 (July 2005), 756–764. https://doi.org/10.1145/1073204.1073258.

Digital Library

Google Scholar

[26]

Abhijeet Ghosh, Graham Fyffe, Borom Tunwattanapong, Jay Busch, Xueming Yu, and Paul Debevec. 2011. Multiview Face Capture Using Polarized Spherical Gradient Illumination. Proceedings of the 2011 SIGGRAPH Asia Conference (SA '11). Association for Computing Machinery, New York, NY, USA, Article 129, 1–10. https://doi.org/10.1145/2024156.2024163.

Digital Library

Google Scholar

[27]

Liang, B., Weng, D., Bao, Y., Tu, Z., & Luo, L. 2019. Reconstructing HDR Image from A Single Filtered LDR Image Base on a Deep HDR Merger Network. 2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, 2019: 257-258.

Google Scholar

[28]

Bin, L., Weng, D., Bao, Y., Tu, Z., & Luo, L. 2020. Method for Reconstructing A High Dynamic Range Image Based on A Single-Shot Filtered Low Dynamic Range Image. Optics Express, 2020, 28(21): 31057-31075.

Google Scholar

Cited By

View all

Zheng HXu WWang ZLu XXiao C(2025)Facial Highlight Removal With Cross-Context Attention and Texture EnhancementIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.347187535:2(1519-1533)Online publication date: Feb-2025
https://doi.org/10.1109/TCSVT.2024.3471875

Index Terms

Learning Highlight Separation of Real High Resolution Portrait Image

Index terms have been assigned to the content through auto-classification.

Recommendations

The Application of Deep Learning in Image Deblurring
CAIBDA '24: Proceedings of the 2024 4th International Conference on Artificial Intelligence, Big Data and Algorithms

Images are an important medium for people to obtain information. In the process of acquiring images, it is inevitable that images will become blurred due to various reasons. Image restoration is a technical method that uses algorithms to enhance image ...
Super Resolution Using Neural Network
AMS '08: Proceedings of the 2008 Second Asia International Conference on Modelling & Simulation (AMS)

Super resolution imaging refers to inferring the missing high resolution image from low resolution image(s). Super resolution methods are generally classified into reconstruction based and learning based methods. The learning based methods fully learn ...
Deep learning for multisensor image resolution enhancement
GeoAI '17: Proceedings of the 1st Workshop on Artificial Intelligence and Deep Learning for Geographic Knowledge Discovery

We describe a deep learning convolutional neural network (CNN) for enhancing low resolution multispectral satellite imagery without the use of a panchromatic image. For training, low resolution images are used as input and corresponding high resolution ...

Comments

Information & Contributors

Information

Published In

ICCCV '21: Proceedings of the 4th International Conference on Control and Computer Vision

August 2021

207 pages

ISBN:9781450390477

DOI:10.1145/3484274

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 November 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICCCV'21

ICCCV'21: 2021 4th International Conference on Control and Computer Vision

August 13 - 15, 2021

Macau, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
72
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zheng HXu WWang ZLu XXiao C(2025)Facial Highlight Removal With Cross-Context Attention and Texture EnhancementIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.347187535:2(1519-1533)Online publication date: Feb-2025
https://doi.org/10.1109/TCSVT.2024.3471875

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

References

Cited By

Index Terms

Recommendations

The Application of Deep Learning in Image Deblurring

Super Resolution Using Neural Network

Deep learning for multisensor image resolution enhancement

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations