Ishan Chatterjee
Olga Khvan
Shwetak Patel
ABSTRACT
Debugging printed circuit boards (PCBs) requires frequent context switching and spatial pattern matching between software design files and physical boards. To reduce this overhead, we conduct a series of interviews with electrical engineers to understand their workflows, around which we design a set of AR interaction techniques, we call Augmented Silkscreen, to streamline identification, localization, annotation, and measurement tasks. We then run a set of remote user studies with illustrative video sketches and simulated PCB tasks to compare our interactions with current practices, finding that our techniques reduce completion times. Based on these quantitative results, as well as qualitative feedback from our participants, we offer design recommendations for the implementation of these interactions on a future, deployable AR system.
Supplemental Material
Available for Download
- [n.d.]. Allegro PCB Designer. https://www.cadence.com/en_US/home/tools/pcb-design-and-analysis/pcb-layout/allegro-pcb-designer.htmlGoogle Scholar
- [n.d.]. Altium Designer 20 - PCB Design Software. https://www.altium.com/altium-designer/Google Scholar
- [n.d.]. EAGLE | PCB Design And Electrical Schematic Software | Autodesk. https://www.autodesk.com/products/eagle/overview?plc=F360&term=1-YEAR&support=ADVANCED&quantity=1Google Scholar
- [n.d.]. EasyEDA - Online PCB design & circuit simulator. https://easyeda.com/Google Scholar
- [n.d.]. inspectAR Augmented Reality PCB Tools. https://www.inspectar.com/Google Scholar
- [n.d.]. KiCad EDA - Schematic Capture & PCB Design Software. https://kicad-pcb.org/Google Scholar
- [n.d.]. Mascot | Robotas. https://www.robotas.com/mascot/Google Scholar
- [n.d.]. PCB Design Software - PCB Design Tool - CADSTAR - Zuken US. https://www.zuken.com/us/product/cadstar/Google Scholar
- [n.d.]. PCB Design Software | OrCAD | Cadence. https://www.orcad.com/Google Scholar
- Ronald T. Azuma. 1997. A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 6, 4 (8 1997), 355–385. https://doi.org/10.1162/pres.1997.6.4.355Google ScholarDigital Library
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (1 2006), 77–101. https://doi.org/10.1191/1478088706qp063oaGoogle Scholar
- T.P. Caudell and D.W. Mizell. 1992. Augmented reality: an application of heads-up display technology to manual manufacturing processes. In Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences. IEEE, 659–669. https://doi.org/10.1109/HICSS.1992.183317Google ScholarCross Ref
- Joshua Chan, Tarun Pondicherry, and Paulo Blikstein. 2013. LightUp. In Proceedings of the 12th International Conference on Interaction Design and Children. ACM, New York, NY, USA, 491–494. https://doi.org/10.1145/2485760.2485812Google ScholarDigital Library
- Bettina Conradi, Verena Lerch, Martin Hommer, Robert Kowalski, Ioanna Vletsou, and Heinrich Hussmann. 2011. Flow of electrons. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces - ITS ’11. ACM Press, New York, New York, USA, 182. https://doi.org/10.1145/2076354.2076389Google ScholarDigital Library
- Daniel Drew, Julie L. Newcomb, William McGrath, Filip Maksimovic, David Mellis, and Björn Hartmann. 2016. The Toastboard. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 677–686. https://doi.org/10.1145/2984511.2984566Google ScholarDigital Library
- Steven Feiner, Blair Macintyre, and Dorée Seligmann. 1993. Knowledge-based augmented reality. Commun. ACM 36, 7 (7 1993), 53–62. https://doi.org/10.1145/159544.159587Google ScholarDigital Library
- Pragun Goyal, Harshit Agrawal, Joseph A. Paradiso, and Pattie Maes. 2013. BoardLab. In Proceedings of the adjunct publication of the 26th annual ACM symposium on User interface software and technology - UIST ’13 Adjunct. ACM Press, New York, New York, USA, 19–20. https://doi.org/10.1145/2508468.2514936Google ScholarDigital Library
- Jürgen Hahn, Bernd Ludwig, and Christian Wolff. 2015. Augmented reality-based training of the PCB assembly process. In Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia, Vol. 30-Novembe. ACM, New York, NY, USA, 395–399. https://doi.org/10.1145/2836041.2841215Google ScholarDigital Library
- Yoonji Kim, Youngkyung Choi, Hyein Lee, Geehyuk Lee, and Andrea Bianchi. 2019. VirtualComponent. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300407Google ScholarDigital Library
- David Mercer. 2019. Internet of Things Now Numbers 22 Billion Devices But Where Is The Revenue?Technical Report. Newsroom>Press Releases pages. https://news.strategyanalytics.com/press-release/iot-ecosystem/strategy-analytics-internet-things-now-numbers-22-billion-devices-whereGoogle Scholar
- Oliver J. Muensterer, Martin Lacher, Christoph Zoeller, Matthew Bronstein, and Joachim Kübler. 2014. Google Glass in pediatric surgery: An exploratory study. International Journal of Surgery 12, 4 (4 2014), 281–289. https://doi.org/10.1016/j.ijsu.2014.02.003Google ScholarCross Ref
- Yoichi Ochiai. 2014. Visible Breadboard: System for Dynamic, Programmable, and Tangible Circuit Prototyping with Visible Electricity. In Virtual, Augmented and Mixed Reality. Applications of Virtual and Augmented Reality. VAMR 2014. Lecture Notes in Computer Science. Vol. 8526 LNCS. Springer, Cham, 73–84. https://doi.org/10.1007/978-3-319-07464-1_7Google ScholarDigital Library
- Bjorn Schwerdtfeger and Gudrun Klinker. 2008. Supporting order picking with Augmented Reality. In 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE, 91–94. https://doi.org/10.1109/ISMAR.2008.4637331Google ScholarDigital Library
- Evan Strasnick, Maneesh Agrawala, and Sean Follmer. 2017. Scanalog: Interactive Design and Debugging of Analog Circuits with Programmable Hardware. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 321–330. https://doi.org/10.1145/3126594.3126618Google ScholarDigital Library
- Evan Strasnick, Sean Follmer, and Maneesh Agrawala. 2019. Pinpoint. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–11. https://doi.org/10.1145/3290605.3300278Google ScholarDigital Library
- Arthur Tang, Charles Owen, Frank Biocca, and Weimin Mou. 2003. Comparative effectiveness of augmented reality in object assembly. In Proceedings of the conference on Human factors in computing systems - CHI ’03. ACM Press, New York, New York, USA, 73. https://doi.org/10.1145/642611.642626Google ScholarCross Ref
- L. Vertelney. 1989. Using video to prototype user interfaces. ACM SIGCHI Bulletin 21, 2 (10 1989), 57–61. https://doi.org/10.1145/70609.70615Google ScholarDigital Library
- Pierre Wellner. 1993. Interacting with paper on the DigitalDesk. Commun. ACM 36, 7 (7 1993), 87–96. https://doi.org/10.1145/159544.159630Google ScholarDigital Library
- Te-Yen Wu, Hao-Ping Shen, Yu-Chian Wu, Yu-An Chen, Pin-Sung Ku, Ming-Wei Hsu, Jun-You Liu, Yu-Chih Lin, and Mike Y. Chen. 2017. CurrentViz. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 343–349. https://doi.org/10.1145/3126594.3126646Google ScholarDigital Library
Recommendations
ARDW: An Augmented Reality Workbench for Printed Circuit Board Debugging
UIST '22: Proceedings of the 35th Annual ACM Symposium on User Interface Software and TechnologyDebugging printed circuit boards (PCBs) can be a time-consuming process, requiring frequent context switching between PCB design files (schematic and layout) and the physical PCB. To assist electrical engineers in debugging PCBs, we present ARDW, an ...
The Second Workshop on Multiple Input Modalities and Sensations for VR/AR Interactions (MIMSVAI)
UbiComp/ISWC '22 Adjunct: Adjunct Proceedings of the 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2022 ACM International Symposium on Wearable ComputersWith the advance of VR/AR technology, more and more VR/AR applications are emerging and have been popular among new users. Interacting with virtual reality and augmented reality technologies will require the development of alternative input modalities ...
Experiencing 3D interactions in virtual reality and augmented reality
EUSAI '04: Proceedings of the 2nd European Union symposium on Ambient intelligenceWe demonstrate basic 2D and 3D interactions in both a Virtual Reality (VR) system, called the Personal Space Station, and an Augmented Reality (AR) system, called the Visual Interaction Platform. Since both platforms use identical (optical) tracking ...
Comments