skip to main content
10.1145/2660267.2660358acmconferencesArticle/Chapter ViewAbstractPublication PagesccsConference Proceedingsconference-collections
research-article

Watching the Watchers: Automatically Inferring TV Content From Outdoor Light Effusions

Authors Info & Claims
Published:03 November 2014Publication History

ABSTRACT

The flickering lights of content playing on TV screens in our living rooms are an all too familiar sight at night --- and one that many of us have paid little attention to with regards to the amount of information these diffusions may leak to an inquisitive outsider. In this paper, we introduce an attack that exploits the emanations of changes in light (e.g., as seen through the windows and recorded over 70 meters away) to reveal the programs we watch. Our empirical results show that the attack is surprisingly robust to a variety of noise signals that occur in real-world situations, and moreover, can successfully identify the content being watched among a reference library of tens of thousands of videos within several seconds. The robustness and efficiency of the attack can be attributed to the use of novel feature sets and an elegant online algorithm for performing index-based matches.

References

  1. M. Backes, M. Durmuth, and D. Unruh. Compromising reflections-or-how to read LCD monitors around the corner. In Proceedings of the IEEE Symposium on Security and Privacy, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. J. L. Bentley. Multidimensional binary search trees used for associative searching. Communications of the ACM, 18(9): 509--517, 1975. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. A. Buades, B. Coll, and J.-M. Morel. A review of image denoising algorithms, with a new one. Multiscale Modeling & Simulation, 4(2):490--530, 2005.Google ScholarGoogle ScholarCross RefCross Ref
  4. M. Enev, S. Gupta, T. Kohno, and S. N. Patel. Televisions, video privacy, and powerline electromagnetic interference. In Proceedings of the 18th ACM conference on Computer and communications security, pages 537--550. ACM, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. C. Faloutsos, M. Ranganathan, and Y. Manolopoulos. Fast subsequence matching in time-series databases. ACM International Conference on Management of Data (SIGMOD), 23(2), 1994. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. D. Gomery. As the dial turns. The Wilson Quarterly, pages 41--46, 1993.Google ScholarGoogle Scholar
  7. U. Greveler, B. Justus, and D. Loehr. Multimedia content identification through smart meter power usage profiles. Computers, Privacy and Data Protection, 2012.Google ScholarGoogle Scholar
  8. G. E. Healey and R. Kondepudy. Radiometric ccd camera calibration and noise estimation. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 16(3):267--276, 1994. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. M. G. Kuhn. Compromising emanations of lcd tv sets. Electromagnetic Compatibility, IEEE Transactions on, 55(3): 564--570, 2013.Google ScholarGoogle Scholar
  10. B. Langmead, C. Trapnell, M. Pop, S. L. Salzberg, et al. Ultrafast and memory-efficient alignment of short dna sequences to the human genome. Genome Biol, 10(3):R25, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  11. J. Liu, Z. Huang, H. Cai, H. T. Shen, C. W. Ngo, and W. Wang. Near-duplicate video retrieval: Current research and future trends. ACM Computing Surveys (CSUR), 45(4): 44, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Y.-S. Moon, K.-Y. Whang, and W.-S. Han. General match: a subsequence matching method in time-series databases based on generalized windows. In Proceedings of the 2002 ACM SIGMOD international conference on Management of data, pages 382--393. ACM, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. R. Raguram, A. M. White, Y. Xu, J.-M. Frahm, P. Georgel, and F. Monrose. On the privacy risks of virtual keyboards: automatic reconstruction of typed input from compromising reflections. Dependable and Secure Computing, IEEE Transactions on, 10(3):154--167, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. A. Torralba and W. T. Freeman. Accidental pinhole and pinspeck cameras: revealing the scene outside the picture. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 374--381. IEEE, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Y. Tsin, V. Ramesh, and T. Kanade. Statistical calibration of ccd imaging process. In Computer Vision, 2001. ICCV 2001. Proceedings. Eighth IEEE International Conference on, volume 1, pages 480--487. IEEE, 2001.Google ScholarGoogle ScholarCross RefCross Ref
  16. B. Widrow and I. Kollár. Quantization noise: roundoff error in digital computation, signal processing, control, and communications. Cambridge University Press, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Y. Xu, J. Heinly, A. M. White, F. Monrose, and J.-M. Frahm. Seeing double: reconstructing obscured typed input from repeated compromising reflections. In Proceedings of the 2013 ACM SIGSAC conference on Computer & communications security, pages 1063--1074. ACM, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. L. Zhang and Y. Rui. Image search--from thousands to billions in 20 years. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), 9(1s):36, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Watching the Watchers: Automatically Inferring TV Content From Outdoor Light Effusions

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        CCS '14: Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security
        November 2014
        1592 pages
        ISBN:9781450329576
        DOI:10.1145/2660267

        Copyright © 2014 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 3 November 2014

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        CCS '14 Paper Acceptance Rate114of585submissions,19%Overall Acceptance Rate1,261of6,999submissions,18%

        Upcoming Conference

        CCS '24
        ACM SIGSAC Conference on Computer and Communications Security
        October 14 - 18, 2024
        Salt Lake City , UT , USA

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader