DeFlare-Net: Flare Detection and Removal Network

Abstract

In this paper, we propose DeFlare-Net to detect, and remove flares. Typically, flares in hand-held devices are inherent due to internal reflection of light and forward scattering of lens material. The distortions due to flares limit the applications in the field of computer vision. Research challenges towards detection and removal of flare persist due to multiple occurrences of flare with varying intensities. The performance of existing flare removal methods are sensitive to the assumption of underlying physics and geometry, leading to artefacts in the deflared image. The current approaches for deflaring involve elimination of light-source implicitly, whilst removal of flare from the image leading to loss of information. Towards this, we propose DeFlare-Net for detection, and removal of flares, while retaining light-source. In this framework, we include Light Source Detection (LSD) module for detection of light-source, and Flare Removal Network (FRN) to remove the flares. Unlike state-of-the-art methods, we propose a novel loss function and call it as DeFlare loss $L_{DeFlare}$. The loss $L_{DeFlare}$ includes flare loss $L_{flare}$, light-source loss $L_{ls}$, and reconstruction loss $L_{recon}$ towards removal of flare. We demonstrate the results of proposed methodology on benchmark datasets in comparison with SOTA techniques using appropriate quantitative metrics.