In continuous annealing process, strip tension is an important factor that decides whether the continuous annealing line could work steadily and promptly or not. However, the tension fluctuations are inevitable as the continuous annealing process requires accelerating and decelerating frequently. In this situation, the synchronous response of the roll-speed helps to reduce this type of tension fluctuations. So here, based on the developed object model close to the actual process, a new adaptive control method with two compensations, feedforward compensation and gain scheduling adaptive compensation has been proposed to compensate the axletree friction and the strip inertia's influences to the tension control respectively. The simulation and application results show that this method is helpful to restrain the tension fluctuations caused by the mismatch of the adjacent roll speed, and is beneficial to the stability of tension control.