Open Source Software (OOS) has become more and more popular during last a few years. Quality evaluation of OOS is still an issue and worth to investigate. In this work, we discussed the issues associated with open source software quality, and then conducted a review on the research work of quality evaluation approaches such as metrics and models. The impact of community involvement and quality assessment tools on the OSS quality assessment were also discussed.