Fiber tractography using diffusion weighted MRI (DWI) is a primary tool for mapping structural connectivity in the human brain in vivo. However, this method suffers from a number of inherent limitations that have a significant impact on its capability in faithfully constructing fiber bundles for specific function. In this paper, a novel tractography algorithm combining DWI and functional MRI (fMRI) was proposed. Specifically, a spatio-temporal correlation tensor that characterizes the anisotropy of fMRI signals in white matter was introduced to complement the estimation of fiber orientation density function from DWI. The proposed method has been demonstrated to identify functional pathways implicated in fMRI task. It can effectively follow tracts in the genu of the corpus callosum that connects to the frontal lobe cortex, obtain connections between the thalamus and the anterior insula under sensory simulation, and reconstruct optic radiations in the visual circuit under visual stimulation. Taken together, the method we proposed in this work may benefit our understanding of structure-function relations in the human brain.