Sound Visualization and Retrieval Technique for Assisting Hearing Memory of Patrol Worker

Abstract

In this paper, we propose a system to support equipment check patrol. One of the most difficult tasks for patrol worker is discriminating the difference of equipment sound in the check spot. The main purpose of our system is to support human hearing by automatic segmentation, visualization and retrieval of equipment sound. Automatic segmentation function is realized using a new video shot segmentation method. The method uses fluctuating thresholds according to time transition of visual changes, and performs automatic segmentation of recorded sound according to the step of check work. The visualization and the retrieval functions are based on the spectrum subtraction method and analyzing technology of the temporal frequency map. This paper shows the evaluation result of the segmentation method using equipment check video. And it also shows the effectiveness of the proposed visualizing and retrieval method through an example of electric discharge sound.