In this paper we present a technique that takes advantage of detected building façades and OpenStreetMaps data to improve the localization of an autonomous vehicle driving in an urban scenario. The proposed approach leverages images from a stereo rig mounted on the vehicle to produce a mathematical representation of the buildings' façades within the field of view. This representation is matched against the outlines of the surrounding buildings as they are available on OpenStreetMaps. The information is then fed into our probabilistic framework, called Road Layout Estimation, in order to produce an accurate lane-level localization of the vehicle. The experiments conducted on the well-known KITTI datasets prove the effectiveness of our approach.