In this paper, we evaluate the steady state tracking EMSEs for the LMS based and the RLS based homogeneous adaptive networks using the popular random walk model for time-varying systems. Subsequently, we extend this treatment to a “heterogeneous” network that deploys both LMS and RLS based nodes, with each node having approximately equal share of LMS and RLS based neighbors. We use intuitive arguments to show that the proposed heterogeneous network will have enhanced tracking capability as compared to its homogeneous counterparts. The claims made are validated by detailed simulation studies.