skip to main content
10.1145/3394171.3418551acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
tutorial

Deep Learning for Privacy in Multimedia

Published:12 October 2020Publication History

ABSTRACT

We discuss the design and evaluation of machine learning algorithms that provide users with more control on the multimedia information they share. We introduce privacy threats for multimedia data and key features of privacy protection. We cover privacy threats and mitigating actions for images, videos, and motion-sensor data from mobile and wearable devices, and their protection from unwanted, automatic inferences. The tutorial offers theoretical explanations followed by examples with software developed by the presenters and distributed as open source.

References

  1. M.S. Cross, A. Cavallaro. 2020. Privacy as a feature for body worn cameras. Signal Processing Magazine, 37 (4), doi: 10.1109/MSP.2020.2989686.Google ScholarGoogle Scholar
  2. A.S. Shamsabadi, R.S. Matilla, A. Cavallaro. 2020. ColorFool: Semantic Adversarial Colorization. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, Washington, USA.Google ScholarGoogle ScholarCross RefCross Ref
  3. G. Abebe Tadesse, O. Bent, L. Marcenaro, K. Weldemariam, A. Cavallaro. 2020. Privacy-aware human activity recognition from a wearable camera. Signal Processing Magazine, 37 (3), doi: 10.1109/MSP.2020.2976158.Google ScholarGoogle Scholar
  4. A.S. Shamsabadi, C. Oh, A. Cavallaro. 2020. EdgeFool: An Adversarial Image Enhancement Filter. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.Google ScholarGoogle ScholarCross RefCross Ref
  5. R. S. Matilla, C. Y. Li, A. S. Shamsabadi, R. Mazzon, A. Cavallaro. 2020. Exploiting vulnerabilities of deep neural networks for privacy protection. IEEE Transactions on Multimedia, 22 (7), doi: 10.1109/TMM.2020.2987694.Google ScholarGoogle Scholar
  6. A. S. Shamsabadi, A. Gascon, H. Haddadi, A. Cavallaro. 2020. PrivEdge: From Local to Distributed Private Training and Prediction. IEEE Transactions on Information Forensics and Security, 15, doi: 10.1109/TIFS.2020.2988132.Google ScholarGoogle Scholar
  7. S. A. Osia, A. S. Shamsabadi, S. Sajadmanesh, A. Taheri, K. Katevas, H. R. Rabiee, N. D. Lane, H. Haddadi. 2020. A Hybrid Deep Learning Architecture for Privacy-Preserving Mobile Analytics. IEEE Internet of Things Journal.Google ScholarGoogle Scholar
  8. M. Malekzadeh, R. G. Clegg, A. Cavallaro, H. Haddadi. 2020. Privacy and Utility Preserving Sensor Data Transformations. Pervasive and Mobile Computing, Volume 63, Article 101132.Google ScholarGoogle ScholarCross RefCross Ref
  9. M. Malekzadeh, D. Athanasakis, H. Haddadi, B. Livshits. 2020. Privacy-Preserving Bandits. In Proceedings of the Conference on Machine Learning and Systems (MLSys), Huston, Texas, USA.Google ScholarGoogle Scholar
  10. O. Sarwar, B. Rinner, A. Cavallaro. 2019. A privacy-preserving filter for oblique face images based on adaptive hopping Gaussian mixtures. IEEE Access, 7, doi: 10.1109/ACCESS.2019.2944861.Google ScholarGoogle Scholar
  11. C. Y. Li, A. S. Shamsabadi, R. S. Matilla, R. Mazzon, A. Cavallaro. 2019. Scene Privacy Protection. In Proc. of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, UK.Google ScholarGoogle ScholarCross RefCross Ref
  12. M. Malekzadeh, R. G. Clegg, A. Cavallaro, H. Haddadi. 2019. Mobile Sensor Data Anonymization. In Proc. of the IEEE/ACM International Conference on Internet of Things Design and Implementation (IoTDI), Montreal, Canada.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. A. S. Shamsabadi, H. Haddadi, A. Cavallaro. 2018. Distributed One-Class Learning. In Proceedings of the IEEE International Conference on Image Processing (ICIP), Athens, Greece.Google ScholarGoogle ScholarCross RefCross Ref
  14. S. A. Osia, A. Taheri, A. S. Shamsabadi, K. Katevas, H. Haddadi, H. R. Rabiee. 2018. Deep Private-Feature Extraction. IEEE Transactions on Knowledge and Data Engineering.Google ScholarGoogle Scholar
  15. S. A. Osia, A. S. Shamsabadi, A. Taheri, H. R. Rabiee, H. Haddadi. 2018. Private and Scalable Personal Data Analytics using Hybrid Edge-Cloud Deep Learning. IEEE Computer, Special Issue on Mobile and Embedded Deep Learning.Google ScholarGoogle Scholar
  16. M. Malekzadeh, R. G. Clegg, A. Cavallaro, H. Haddadi. 2018. Protecting Sensory Data Against Sensitive Inferences. In Proc. of the 1st ACM Workshop on Privacy by Design in Distributed Systems (W-P2DS), Porto, Portugal.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. M. Malekzadeh, R. G. Clegg, H. Haddadi. 2018. Replacement Autoencoder: A Privacy-Preserving Algorithm for Sensory Data Analysis. In Proceedings of the IEEE/ACM International Conference on Internet-of-Things Design and Implementation (IoTDI), Orlando, Florida, USA.Google ScholarGoogle ScholarCross RefCross Ref
  18. O. Sarwar, A. Cavallaro, B. Rinner. 2018. Temporally smooth privacy protected airborne videos. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Deep Learning for Privacy in Multimedia

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          MM '20: Proceedings of the 28th ACM International Conference on Multimedia
          October 2020
          4889 pages
          ISBN:9781450379885
          DOI:10.1145/3394171

          Copyright © 2020 Owner/Author

          Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 12 October 2020

          Check for updates

          Qualifiers

          • tutorial

          Acceptance Rates

          Overall Acceptance Rate995of4,171submissions,24%

          Upcoming Conference

          MM '24
          MM '24: The 32nd ACM International Conference on Multimedia
          October 28 - November 1, 2024
          Melbourne , VIC , Australia

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader