In this paper, we propose a novel solution for continuous acoustic feedback neutralization in the digital hearing aids. The proposed method is based on two adaptive filters working in tandem. The error signal of the first adaptive filter is used as a desired response for the second adaptive filter being excited by a low-level (constant) probe signal. Initially at the start up, the first adaptive filter gives a fast convergence, however, its input and desired response are correlated with each other and it may converge to a biased solution at the steady-state. On the other hand, the second adaptive filter, though converging slowly being excited by a low-level probe signal, would give a good steady-state estimate of the acoustic feedback path. A novel strategy is proposed to exchange the weights between the two adaptive filters, such that the misconvergence of the first adaptive filter is avoided, as well as the initial convergence of the second adaptive filter is improved. Computer simulations demonstrate the improved performance of the proposed method.