Credit-risk evaluation is a very challenging and important problem in the domain of financial analysis. Many classification methods have been proposed in the literature to tackle this problem. Statistical and neural network based approaches are among the most popular paradigms. However, most of these methods produce so called "hard" classifiers, those generate decisions without any accompanying confidence measure. In contrast, "soft" classifiers, such as those designed using fuzzy set theory produce a measure of support for the decision (and also alternative decisions) that provide the analyst with greater insight. In this paper we propose a method of building credit scoring models using a fuzzy rule based classifier. The rule base is learned from the training data using a SOM based method. Further the classifier incorporates fuzzy k-NN rule for contextual classification as well as employ data reduction technique using SOM for creating a smaller set of reference points to search the k neighbors from. A method of seamlessly integrating business constraints into the model is also demonstrated.