Abstract
Saliency map can express the position of eye trace, which is a key factor to evaluate the perception quality of video or image. Many saliency detection methods have been proposed based on the human vision system characteristics, but they are time-consuming or with low accuracy. Spectrum residual based algorithm is one typical saliency detection method. It calculates the saliency map of image effectively. The SR method can’t detect the saliency in video sequences due to the intrinsic property difference between image and video.
In this paper, we propose a saliency detection method for video. According to the extensive simulation results, we find amplitude difference and phase difference are very important for saliency map detection. On the basis of the spectrum features of the adjacent frames in video, we take spectrum difference between current test frame and its adjacent frame into account to calculate the saliency map. The proposed algorithm using the video sequences with one eye track point. The results indicate that the method proposed in this paper is more effective than others.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ninassi, A., Meur, O.L., Callet, P.L., Barba, D.: Does where you gaze on an image affect your perception of quality? Applying visual attention to image quality metric. In: Proc. ICIP, pp. 732–735. IEEE, San Antonio (2007)
Lu, Z.K., Lin, W., Yang, X.K., Ong, E., Yao, S.: Modeling visual atten-tion’s modulatory aftereffects on visual sensitivity and quality evaluation. IEEE Trans. Image Process. 14(11), 1928–1942 (2005)
Koch, C., Ullman, S.: Shifts in selective visual attention: towards the un-derlying neural circuit. Hum. Neurobiol. 4, 219–235 (1985)
Itti, L., Koch, C., Niebur, E., et al.: A Model of Saliency-based Visual At-tention for Rapid Scene Analysis. IEEE Transaction on Pattern Analysis and Machine Intelligence 20(11), 1254–1259 (1998)
Guo, C., Ma, Q., Zhang, L.: Spatio-temporal Saliency Detection Using Phase Spectrum of Quaternion Fourier Transform. In: Computer Vision and Pattern Recognition, CVPR, pp. 1–8 (2008)
Hou, X., Zhang, L.: Saliency Detection: A Spectral Residual Approach. In: Hou, X., Zhang, L. (eds.) Computer Vision and Pattern Recognition, Proc. CVPR, pp. 1–8. IEEE, New York (2007)
Li, C., Gao, Y., Lu, K., Qu, Z.: Saliency detection method based on phase spectrum and amplitude spectrum tuning. Journal of Image and Graph-ics 17(7), 821–827 (2012)
Itti, L., Koch, C.: A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research 40(10-12), 1489–1506 (2000)
Itti, L., Koch, C.: Computational Modeling of Visual Attention. Nature Reviews Neuroscience 2(3), 194–203 (2001)
Collaborative Research in Computational Neuroscience – Data sharing, http://crcns.org
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer International Publishing Switzerland
About this paper
Cite this paper
Yin, H., Tan, J., Pan, C., Guan, S. (2013). Video Saliency Detection Algorithm Based on Phase and Amplitude Joint Spectrum Difference. In: Huet, B., Ngo, CW., Tang, J., Zhou, ZH., Hauptmann, A.G., Yan, S. (eds) Advances in Multimedia Information Processing – PCM 2013. PCM 2013. Lecture Notes in Computer Science, vol 8294. Springer, Cham. https://doi.org/10.1007/978-3-319-03731-8_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-03731-8_17
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-03730-1
Online ISBN: 978-3-319-03731-8
eBook Packages: Computer ScienceComputer Science (R0)