In many face recognition tasks, the pose of the probe and gallery images are different. In other cases, multiple gallery or probe images may be available, each captured from a different pose. We propose a face recognition algorithm which can use any number of gallery images per subject, captured at arbitrary poses, and any number of probe images, again captured at arbitrary poses. The algorithm operates by estimating the eigen light-field of the subject's head from the input gallery or probe images. Matching between the probe and gallery is then performed using the eigen light-fields. We present results on the CMU (Carnegie-Mellon University) PIE (Pose, Illumination and Expression) and the FERET (FacE REcocnition Technology) face databases.