In this paper, we are concerned about the frequency domain noise canceller to decrease the number of calculation for its realization. In order to treat the long delay and multi-reflection impulse responses of room, we propose a new method of Frequency Bin Adaptive Filtering (FBAF). Each frequency bin of the FFT data is fed in an independent Tapped Delay Line (TDL) to be processed by the extended complex LMS algorithm. The computer simulation results indicate that the proposed FBAF method has better performance than a simple frequency domain adaptive filter. Especially, when a long term delay is considered the robustness, fast convergency and stability in performance will be obvious. Another merit of FBAF method is the short delay between input and output of the system as a result of utilization of short length window function. The number of calculation is comparable with the one of frequency domain filter and much less than the one of time domain adaptive filter. So that, it is convenient to realize the FBAF method by using a few chips of DSP.