We aim to compute the movement of permanent stranded implant brachytherapy radioactive sources (seeds) in the prostate from the planned seed distribution to the intraoperative fluoroscopic distribution, and then to the postimplant computed tomography (CT) distribution. We present a novel approach to matching the seeds in these distributions to the plan by grouping the seeds into needle tracks. First, we identify the implantation axis using a sample consensus algorithm. Then, we use a network flow algorithm to group seeds into their needle tracks. Finally, we match the needles from the three stages using both their transverse plane location and the number of seeds per needle. We validated our approach on eight clinical prostate brachytherapy cases, having a total of 871 brachytherapy seeds distributed in 193 needles. For the intraoperative and postimplant data, 99.31% and 99.41% of the seeds were correctly assigned, respectively. For both the preplan to fluoroscopic and fluoroscopic to CT registrations, 100% of the needles were correctly matched. We show that there is an average intraoperative seed displacement of 4.94 ± 2.42 mm and a further 2.97 ± 1.81 mm of postimplant movement. This information reveals several directional trends and can be used for quality control, treatment planning, and intraoperative dosimetry that fuses ultrasound and fluoroscopy.