This paper presents a new method for controlling a group of nonholonomic mobile robots to achieve predetermined formations without using global knowledge. Based on the dynamic leader-follower model, a reactive tracking controller is proposed to make each following robot maintain a desired pose to its leader, and the stability property of this controller is discussed using Lyapunov theory. By employing such controllers, the N-robot formation control problem can be decomposed into decentralized tracking problems between N-l followers and designated leaders. Additionally, graph theory is introduced to formalize general formation patterns in a simple but effective way and two types of switching between these formations are also proposed. Numerical simulations and physical robots experiments show the effectiveness of our approach.