Abstract
Many studies show the possibilities and benefits of combining physical and digital information through augmented paper. Furthermore, the rise of Augmented Reality hardware and software for annotating the physical world with information is becoming more commonplace as a new computing paradigm. But so far, this has not been commercially applied to paper in a way that publishers can control. In fact, there is currently no standard way for book publishers to augment their printed products with digital media, short of using QR codes or creating custom AR apps. In this paper we outline a new publishing ecosystem for the creation and consumption of augmented books, and report the lab and field evaluation of a first commercial travel guide to use this. This is based simply on the use of the standard EPUB3 format for interactive e-books that forms the basis of a new ‘a-book’ file format and app.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Hillesund, T.: Digital reading spaces: how expert readers handle books, the web and electronic paper. First Monday (2010)
Jeong, H.: A comparison of the influence of electronic books and paper books on reading comprehension, eye fatigue, and perception. Electron. Libr. 30(3), 390–408 (2012)
Mangen, A., Walgermo, B.R., Brønnick, K.: Reading linear texts on paper versus computer screen: effects on reading comprehension. Int. J. Educ. Res. 58, 61–68 (2013)
Levy, M.D.: Scrolling Forward: Making Sense of Documents in the Digital Age. Arcade Publishing, New York (2001)
Sellen, A.J., Harper, R.H.: The Myth of the Paperless Office. MIT Press, Cambridge (2003)
Clark, D.T., Goodwin, S.P., Samuelson, T., Coker, C.: A qualitative assessment of the Kindle e, Äêbook reader: results from initial focus groups. Perform. Meas. Metrics 9(2), 118–129 (2008)
Chen, S., Granitz, N.: Adoption, rejection, or convergence: consumer attitudes toward book digitization. J. Bus. Res. 65(8), 1219–1225 (2012)
Zhang, Y., Kudva, S.: E-books versus print books: readers’ choices and preferences across contexts. J. Am. Soc. Inf. Sci. 65(8), 1695–1706 (2014)
Jenkins, H., Ford, S., Green, J.: Spreadable Media: Creating Value and Meaning in a Networked Culture. NYU Press (2013)
Schrøder, K.C., et al.: Audiences are inherently cross-media: audience studies and the cross-media challenge. CM Komunikacija i mediji. 6(18), 5–27 (2011)
Cope, B., Kalantzis, M.: “Multiliteracies”: New literacies, new learning. Pedagogies Int. J. 4(3), 164–195 (2009)
Luff, P., Heath, C., Norrie, M., Signer, B., Herdman, P.: Only touching the surface: creating affinities between digital content and paper. In: Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work, CSCW ‘04. New York, NY, USA, pp. 523–532. Association for Computing Machinery (2004). https://doi.org/10.1145/1031607.1031695
Wellner, P.: Interacting with paper on the digital desk. Commun. ACM 36(7), 87–96 (1993)
Billinghurst, M., Kato, H., Poupyrev, I.: The magicbook - moving seamlessly between reality and virtuality. IEEE Comput. Graphics Appl. 21(3), 6–8 (2001)
Erol, B., Antúnez, E., Hull, J.J.: Hotpaper: multimedia interaction with paper using mobile phones. In: Proceedings of the 16th ACM International Conference on Multimedia, MM ‘08. New York, NY, USA, pp. 399–408. ACM (2008)
Liao, C., Liu, Q., Liew, B., Wilcox, L.: Pacer: fine-grained interactive paper via camera touch hybrid gestures on a cell phone. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2010. New York, NY, USA, pp. 2441–2450. ACM (2010)
Back, M., Cohen, J., Gold, R., Harrison, S., Minneman, S.: Listen reader: an electronically augmented paper-based book. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 23–29 (2001)
Klemmer, S.R., Graham, J., Wolff, G.J., Landay, J.A.: Books with voices: paper transcripts as a physical interface to oral histories. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ‘03. New York, NY, USA, pp. 89–96. ACM (2003)
Chen, N.S., Teng, D.C.E., Lee, C.H., Kinshuk: Augmenting paper-based reading activity with direct access to digital materials and scaffolded questioning. Comput. Educ. 57(2), 1705–1715 (2011)
Frohlich, D.M., et al.: Designing interactive newsprint. Int. J. Hum. Comput. Stud. 104, 36–49 (2017)
Georgiadou, E., Margaritopoulos, M.: The application of augmented reality in print media. J. Print Media Technol. Res. 8(1), 43–55 (2019)
Signer, B., Norrie, M.C.: Interactive paper: past, present and future. In: Proceedings of the 12th ACM International Conference on Ubiquitous Computing (UbiComp'10). Copenhagen, Denmark (2010)
Signer, B., Norrie, M.C., Weibel, N., Ispas, A.: Advanced authoring of paper-digital systems. Multimedia Tools Appl. 70(2), 1309–1332 (2014)
Lu, X., Lu, Z.: A publishing framework for digitally augmented paper documents: towards cross-media information integration. In: Zhuang, Y., Yang, S.Q., Rui, Y., He, Q. (eds.) Advances in Multimedia Information Processing - PCM 2006, pp. 494–501. Heidelberg, Springer (2006)
Guimbretière, F.: Paper augmented digital documents. In: Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology, pp. 51–60 (2003)
Yeh, R.B., Paepcke, A., Klemmer, S.R.: Iterative design and evaluation of an event architecture for pen-and-paper interfaces. In: Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology, pp. 111–120 (2008)
Heinrichs, F., Steimle, J., Schreiber, D., Mühlhäuser, M.: Letras: an architecture and framework for ubiquitous pen-and-paper interaction. In: Proceedings of the 2nd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 193–198 (2010)
Mackay, W.E., Pothier, G, Letondal, C., Bøegh, K., Sørensen, H.E.: The missing link: Augmenting biology laboratory notebooks. In: Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology, UIST ’02, New York, NY, USA, pp. 41–50. ACM (2002)
Cornwall, F.K., the Isles of Scilly (3rd Edition). Bradt Travel Guides (2019)
Bairaktaris, G., Frohlich, D., Sporea, R.: Printed light tags and the magic bookmark: using light to augment paper objects. In: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–5 (2021)
Bairaktaris, G., Siderov, H., Celebiler, D., Kolii, C., Frohlich, D.M., Sporea, R.A.: Magic bookmark: a nonintrusive electronic system for functionalizing physical books. Adv. Intell. Syst. 4(3), 2100138 (2022)
Bairaktaris, G., Le Borgne, B., Turkani, V., Corrigan-Kavanagh, E., Frohlich, D.M., Sporea, R.A.: Augmented books: hybrid electronics bring paper to life. IEEE Pervasive Comput. 21(4), 88–95 (2022)
Corrigan-Kavanagh, E., Frohlich, D.M., Scarles, C.: Re-invigorating the photo album: augmenting printed photobooks with digital media. Pers. Ubiquit. Comput. 27(2), 467–480 (2023)
Frohlich, D., et al.: The Cornwall a-book: an augmented travel guide using next generation paper. J. Electron. Publ. 22(1) (2019)
Corrigan-Kavanagh, E., Scarles, C., Revill, G., Beynon, M., van Duppen, J.: Explorations on the future of the book from the Next Generation Paper Project. Publishing History 83, 35–54 (2020)
Corrigan-Kavanagh, E., Frohlich, D., Yuan, H., Bober, M.: Designing for the next generation of augmented books. J. Des. Res. 18(5–6), 356–374 (2020)
Husain, S.S., Bober, M.: Improving large-scale image retrieval through robust aggregation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 39(9), 1783–1796 (2016)
Corbin, J., Strauss, A.: Strategies for qualitative data analysis. Basics Qualit. Res. Tech. Proc. Dev. Grounded Theory 3(10), 4135 (2008)
Acknowledgments
This work was funded by the UK Engineering and Physical Sciences Research Council (EPSRC) as part of the Digital Economy programme under grant number EP/P02579X/1. This was in response to a call entitled ‘Content creation and consumption in the digital economy’. We also thank travel writer Kirsty Fergusson and CEO Adrian Phillips and his staff at Bradt Travel Guides Ltd for their collaboration to create the augmented Cornwall guide.
Funding
The authors have no competing interests to declare that are relevant to the content of this article.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Frohlich, D.M. et al. (2024). A Market-Ready Ecosystem for Publishing and Reading Augmented Books. In: Wei, J., Margetis, G. (eds) Human-Centered Design, Operation and Evaluation of Mobile Communications. HCII 2024. Lecture Notes in Computer Science, vol 14738. Springer, Cham. https://doi.org/10.1007/978-3-031-60487-4_5
Download citation
DOI: https://doi.org/10.1007/978-3-031-60487-4_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-60486-7
Online ISBN: 978-3-031-60487-4
eBook Packages: Computer ScienceComputer Science (R0)