Abstract
Nowadays mobile devices such as smartphones are widely used all over the world. Moreover, the performance of image recognition has dramatically increased by deep learning technologies. From these backgrounds, we think that the following scenario of information services could be realized in the near future: users take a photo and send it to a server, who recognizes the location in the photo and returns the users some information about the recognized location. However, this kind of client-server-based image recognition can cause a privacy issue because image recognition results are sometimes privacy sensitive. To tackle the privacy issue, in this paper, we propose a novel framework for privacy-preserving image recognition in which the server cannot uniquely identify the recognition result but users can do so. An overview of the proposed framework is as follows: First users extract a visual feature from their taken photo and transform it so that the server cannot uniquely identify the recognition result. Then users send the transformed feature to the server, who returns a candidate set of recognition results to the users. Finally, the users compare the candidates and the original visual feature for obtaining the final result. Our experimental results demonstrate the effectiveness of the proposed framework.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Deng, L., Yu, D.: Deep learning: methods and applications. Found. Trends Sig. Process. 7(3–4), 197–387 (2014)
Zeng, Y., Chan, Y., Lin, T., Shih, M., Hsieh, P., Chao, G.: Scene feature recognition-enabled framework for mobile service information query system. In: Proceedings of the 17th International Conference on Human Interface and the Management of Information (2015)
Cavallaro, A., Steiger, O., Ebrahimi, T.: Semantic video analysis for adaptive content delivery and automatic description. IEEE Trans. Circ. Syst. Video Technol. 15(10), 1200–1209 (2005)
Chinomi, K., Nitta, N., Ito, Y., Babaguchi, N.: PriSurv: privacy protected video surveillance system using adaptive visual abstraction. In: Proceedings of the 14th International Conference on MultiMedia Modeling (MMM2008), pp. 144–154 (2008)
Mitsugami, I., Mukunoki, M., Kawanishi, Y., Hattori, H., Minoh, M.: Privacy-protected camera for the sensing web. In: Proceedings of the International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems (2010)
Frome, A., Cheung, G., Abdulkader, A., Zennaro, M., Wu, B., Bissacco, A., Adam, H., Neven, H., Vincent, L.: Large-scale privacy protection in Google Street View. In: Proceedings of the International Conference on Computer Vision, pp. 2373–2380 (2009)
Flores, A., Belongie, S.: Removing pedestrians from Google Street View images. In: Proceedings of the International Workshop on Mobile Vision, pp. 53–58 (2010)
Zhang, Y., Lu, Y., Nagahara, H., Taniguchi, R.: Anonymous camera for privacy protection. In: Proceedings of the 22nd International Conference on Pattern Recognition (2014)
Lu, W., Swaminathan, A., Varna, A.L., Wu, M.: Enabling search over encrypted multimedia databases. In: Proceedings of the SPIE Conference on Media Forensics and Security, vol. 7254, pp. 18–29 (2009)
Zhang, L., Jung, T., Feng, P., Liu, K., Li, X., Liu, Y.: PIC: enable large-scale privacy preserving content-based image search on cloud. In: Proceedings of the 44th International Conference on Parallel Processing (2015)
Chu, W., Chang, F.: A privacy-preserving bipartite graph matching framework for multimedia analysis and retrieval. In: Proceedings of the 5th ACM International Conference on Multimedia Retrieval, pp. 243–250 (2015)
Erkin, Z., Franz, M., Guajardo, J., Katzenbeisser, S., Lagendijk, I., Toft, T.: Privacy-preserving face recognition. In: Proceedings of the 9th International Symposium on Privacy Enhancing Technologies, pp. 235–253 (2009)
Sadeghi, A., Schneider, T., Wehrenberg, I.: Efficient privacy-preserving face recognition. In: Proceedings of the 12th International Conference on Information Security and Cryptology, pp. 229–244 (2009)
Bringer, J., Chabanne, H., Patey, A.: Privacy-preserving biometric identification using secure multiparty computation: an overview and recent trends. IEEE Sig. Process. Mag. 30(2), 42–52 (2013)
Weng, L., Amsaleg, L., Morton, A., Marchand-Maillet, S.: A privacy-preserving framework for large-scale content-based information retrieval. IEEE Trans. Inf. Forensics Secur. 10(1), 152–167 (2015)
Fanti, G., Finiasz, M., Friedland, G.: Toward efficient, privacy-aware media classification on public databases. In: Proceedings of the International Conference on Multimedia Retrieval (2014)
Liu, C., Shang, Z., Tangc, Y.Y.: An image classification method that considers privacy-preservation. Neurocomputing 208(5), 80–98 (2016)
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T.: Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the 22nd ACM International Conference on Multimedia, pp. 675–678 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Fujii, K., Nakamura, K., Nitta, N., Babaguchi, N. (2017). A Framework of Privacy-Preserving Image Recognition for Image-Based Information Services. In: Amsaleg, L., Guðmundsson, G., Gurrin, C., Jónsson, B., Satoh, S. (eds) MultiMedia Modeling. MMM 2017. Lecture Notes in Computer Science(), vol 10132. Springer, Cham. https://doi.org/10.1007/978-3-319-51811-4_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-51811-4_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-51810-7
Online ISBN: 978-3-319-51811-4
eBook Packages: Computer ScienceComputer Science (R0)