Evaluating user quality and business value of applications using semantic knowledge technology

Purpose – The paper introduces methods for the evaluation of new software applications that build on semantic knowledge technology for use in information‐ and knowledge‐intensive application domains. Design/methodology/approach – While user‐centred design is a mature and proven field, the new knowledge‐centred applications also require that information quality is assessed in a more profound manner than was considered previously, and the business value generated by semantic knowledge technology is quantified. The methods to be used in different phases of the development cycle are described. Findings – The approaches used in ongoing RTD projects and in different user organizations are described. Research limitations/implications – The analysis of organisational aspects of knowledge management and the benefits of improvements in cooperation mechanisms provide further challenges for methodological development. Practical implications – Recommendations and suggestions for similar innovative research and application development projects are given. Originality/value – While some of the methods are proven and well documented, there is a need to collect further experience with the user validation of applications using semantic knowledge technology.