A two-phase image restoration method based upon total variation regularization combined with an L¹-data-fitting term for impulse noise removal and deblurring is proposed. In the first phase, suitable noise detectors are used for identifying image pixels contaminated by noise. Then, in the second phase, based upon the information on the location of noise-free pixels, images are deblurred and denoised simultaneously. For efficiency reasons, in the second phase a superlinearly convergent algorithm based upon Fenchel-duality and inexact semismooth Newton techniques is utilized for solving the associated variational problem. Numerical results prove the new method to be a significantly advance over several state-of-the-art techniques with respect to restoration capability and computational efficiency.