skip to main content
10.1145/3488933.3488987acmotherconferencesArticle/Chapter ViewAbstractPublication PagesaiprConference Proceedingsconference-collections
research-article

Siamese Networks for Image Comparison and Discrepancy Localization: Siamese Networks in Exam Proctoring

Published: 25 February 2022 Publication History

Abstract

With the prevalence of online learning and exams, a side camera view overlooking a student's computer screen and work area is recommended to compare the expected view on exam screen to that of student's screen and identify cheating. This work proposes a novel architecture of Siamese convolutional neural networks to automate the proctoring process by simultaneously detecting disallowed activities on computer screen and localizing the region in cases where such activities are carried out in a portion of screen only. While the proposed Siamese detector compares the base image to test image to detect features in the entire image to ascertain discrepancy, the Siamese localizer splits the image area in sections to perform regional feature comparisons to yield discrepant regions. Both components run in a single-shot mode and avoid multi-shot regressions. On a public web screenshot database, the proposed Siamese detector and localizer both achieve impressive results with detector achieving 96.4% accuracy on 20-way full-screen discrepancy detection task and localizer achieving 94.4% accuracy along with mean overall IoU of 0.72 over discrepant segments.

References

[1]
Alexander Matros, Eren Bilena. Online cheating amid Covid-19. Journal of Economic Behavior Organization Volume 182, February 2021, Pages 196-211.
[2]
National Science Bowl. NSB info for coaches, 2021. Page 7, https://science.osti.gov/-/media/wdts/nsb/pdf/coordinator-resources/NSB-Info-for-Coaches-120220.pdf?la=en&hash=6F178AC6390691770C17E51C6AFF42231BA02637 .
[3]
J. Bromley, I. Guyon, Y. Lecun, E. Sckinger, and R. Shah. Sig-nature verification using a ”siamese” time delay neural network,1994. NIPS Proc.
[4]
D. Chicco. Siamese neural networks: An overview, 2021.
[5]
Haoran Wu, Zhiyong Xu, Jianlin Zhang, Wei Yan, and Xiao Ma. Face recognition based on convolution Siamese networks. In201710th International Congress on Image and Signal Processing, Bio-Medical Engineering and Informatics (CISP-BMEI), pages 1–5. IEEE, 2017.
[6]
Xingping Dong and Jianbing Shen. Triplet loss in Siamese network for object tracking. In Proceedings of the European conference on computer vision (ECCV), pages 459–474, 2018.
[7]
Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 779–788, 2016.
[8]
Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. FasterR-CNN: Towards real-time object detection with region proposal networks. arXiv preprint arXiv:1506.01497, 2015.
[9]
K. He, G. Gkioxari, P. Dollar, and R. Girshick. Mask R-CNN, 2018.
[10]
MS-COCO dataset. https://cocodataset.org/.
[11]
OpenCV. https://opencv.org/.
[12]
Richard Hartley and Andrew Zisserman, Multiple View Geometry in Computer Vision. Cambridge University Press, New York, NY,USA, 2 edition, 2003.
[13]
Roboflow. Website screenshots dataset. https://public.roboflow.com/object-detection/website-screenshots/1 .
[14]
G. Koch, R. Zemel, and R. Salakhutdinov. Signature verification using a” Siamese” time delay neural network, 2015. ICML deep-learning workshop, vol. 2. 2015.

Cited By

View all

Index Terms

  1. Siamese Networks for Image Comparison and Discrepancy Localization: Siamese Networks in Exam Proctoring
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        AIPR '21: Proceedings of the 2021 4th International Conference on Artificial Intelligence and Pattern Recognition
        September 2021
        715 pages
        ISBN:9781450384087
        DOI:10.1145/3488933
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 25 February 2022

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. CNN
        2. Siamese networks
        3. image comparison
        4. localization

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Conference

        AIPR 2021

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 59
          Total Downloads
        • Downloads (Last 12 months)7
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 13 Jan 2025

        Other Metrics

        Citations

        Cited By

        View all

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media