Comparative Evaluation of Reliabilities on Semantic Search Functions: Auto-complete and Entity-Centric Unified Search

Abstract

Although users require increased reliabilities on the function and information that Web information services offer, there are few studies in the Semantic Web applications on reliability and usability evaluation on semantic service functions owing to the lack of successful use cases and technological immaturity. This research is originated from a previous lesson that reliabilities needs to be assured in ways of improving service functions as well as retrieved information, particularly, in the services giving new user experiences such as semantic search services. We comparatively evaluated reliabilities of ‘autocomplete’ and ‘entity-centric unified search’ functions in semantic services with the following two criteria: the one is ‘precision and satisfaction scores’ on the functions and retrieved information that the user rates, and the other is ‘precision in task performance’ as a quantitative analysis and reliability of expectation- result as a qualitative analysis that an observer assesses. The experimental results indicate that precision is closely related with satisfaction in the view point of the user, and further