A general tracking control problem is solved for a chaotic system (Duffing oscillator) with unknown parameters, under the additional requirement that the tracking error must remain inside an imposed hard constraint. The barrier Lyapunov functions technique is applied in an adaptive backstepping scheme. Several system properties are investigated and benefits coming from state variable constraints are discussed. The same approach may be used for chaos synchronization and chaotification.