Humans cannot provide feedback on millions/billions of computer-calculated measures. This paper finds a way to adjust a large number of the calculated skill similarity pairs based on qualitative human expert feedback. The experts do not explicitly quantify millions of similarities. They only indicate what cluster a skill belongs to. This paper describes methods to correct a large similarity matrix corresponding to the expert recommended skill clusters.