Semantic segmentation in the context of traffic scenes has been vastly explored using different architectures for deep convolutional networks and color images. In the case of infrared images there is place for improvement and scientific contributions mainly due to the lack of data sets that contain baseline segmentations in the infrared domain. This paper proposes a method for real time infrared pedestrian segmentation using ERFNet. Within the context of the proposed method we study the effect of different basic image enhancement techniques on the performance of the segmentation. We enhance an existing dataset of infrared images with ground truth segmentations for pedestrians. Our experiments show that the proposed method is accurate and appropriate for real time applications.