Realistic electronic books

https://doi.org/10.1016/j.ijhcs.2012.02.003Get rights and content

Abstract

We describe a software book model that emulates a range of properties associated with physical books—analog page turning, visual location cues, bookmarks and annotations—and, furthermore, incorporates many advantages of digital environments—hyperlinks, multimedia, full-text search, automatic identification of synonyms, cross-referencing of key terms with an online encyclopedia, and an automatically generated back-of-the-book index. Usability studies were conducted to compare performance using these books for various reading tasks with HTML, PDF and physical books. Participants completed the tasks more efficiently with the new interface without any loss in accuracy; they also preferred it.

Highlights

► We describe a novel electronic book whose form is far more realistic than others. ► It provides an unprecedented range of reading, browsing, and annotation facilities. ► It incorporates a unique incremental search that simultaneously searches synonyms. ► It incorporates automatically created encyclopedia cross-referencing and subject index. ► User studies compare performance with alternatives (HTML, PDF) including physical books.

Introduction

The electronic book industry is burgeoning. Libraries and other content providers are digitizing documents to allow readers around the world to access them online. The Open Content Alliance and Google are creating collections of tens of millions of volumes accessible through the Internet Archive and Google Books respectively. Manufacturers compete to produce reading devices that are light and mobile, with high resolution displays and many other features—Barnes and Noble's Nook, Amazon's Kindle, and the Sony Reader are typical examples. However, neither the underlying document representation nor interaction with electronic books has evolved significantly—apart from a few superficial visual effects. As a result, although users are increasingly willing to read documents sequentially on-screen, most still prefer to print them when they want to study them intensively (Nicholas et al., 2008, Gorman and Crawford, 1995, Crawford, 1998).

The use of books to store knowledge has a long tradition—books are arguably the most mature user interface ever devised for presenting information. People have acquired a variety of strategies and manipulation techniques, such as using fingers as bookmarks or riffling through pages while browsing (Severinson et al., 1996, Kerr, 1986). Compare a medieval book with a modern one: the same principles are still at work. Readers need only learn these conventions once, and can use them for the rest of their lives.

Current electronic document systems offer great added value over paper books: authors can revise information quickly and incorporate hyperlinks and multimedia, and readers can locate words or phrases through full-text search. However, electronic book applications fail to provide adequate cues about the reader's location in a document, and do not support interactions that are readily achieved with physical books without disrupting the ongoing reading activity (Dillon, 1992, O'Hara and Sellen, 1997, Conklin, 1987, Edwards and Hardman, 1989, McDonald and Stevenson, 1998). These interactions are exactly the features that physical books have evolved to support.

Opinion on the importance of emulating the appearance of printed books in the electronic environment is divided. Some researchers argue that it is unnecessary to paginate documents or maintain their printed page layout (Rowland et al., 1995, Nielsen, 1998, Kol and Schcolnik, 2000, Shneiderman, 1998, McKnight et al., 1991). They believe that with training and practice, users will no longer rely on the book model to locate information. Others contend that users are dissatisfied with digital document systems because they do not embed familiar book metaphors (Benest, 1990, Henke, 1998, Landoni et al., 2000, Crestani and Ntioudis, 2001, Barker et al., 1994). Their studies show that all participants, regardless of computing experience, find the book metaphor easy to use and understand, and that people can utilize their familiarity with paper documents to navigate and obtain information from digital text.

In order to investigate whether digital books can capitalize on reader experience with physical documents to enhance electronic reading, we have developed a software model called Realistic Books that is designed to combine the advantages of physical and electronic documents, and implemented a way of creating such books automatically from any HTML or PDF file. We have also compared performance using the new interface with existing electronic reading interfaces, and with the original physical form itself—the humble book.

Over nearly three decades, researchers have developed various electronic document representations, such as Book Emulator (Benest, 1990), XLibris (Schilit et al., 1998), and 3Book (Card et al., 2004, Card et al., 2004). Most are claimed to have glowing potential, but their proponents rarely make objective empirical comparisons of user behavior and performance with conventional representations. Because these new representations are not available for others to use, we cannot compare their performance with that of Realistic Books, nor with HTML, PDF and physical books.

After defining the scope of the investigation, this paper reviews the historical development of document systems and their effect on reading strategies and behavior, in order to identify, in Section 4, aspects of both printed and electronic documents that might enhance reading performance. Section 5 describes how documents are presented as Realistic Books, and the functions that are supported. Section 6 explains how Wikipedia can be used as an encyclopedic knowledge base to automatically identify key terms and phrases in book text, provide on-demand definitions, and search related pages in the book. Finally, we evaluate system responsiveness and present the results of user studies that compare people's browsing, searching and annotation performance and behavior in simulated books with the HTML, PDF, and physical representations.

Section snippets

Scope of the investigation

Despite its quotidian familiarity, reading includes a range of activities, is done for various purposes, and is embedded within many other document-based activities. People read for different reasons and in different ways: locating information, checking facts, acquiring new knowledge, analysing text, recreation. Studying a textbook is not like reading a science fiction novel.

Adler and van Doren (1972) and Schilit et al. (1999) characterize reading along two dimensions: the reader's engagement

Evolution of the book form

Are books adequately represented by their content, independent of their form? The book form conveys abundant information using well established conventions that everyone is accustomed to and can interpret intuitively. The conventions for book layout and design are the legacy of a long period of evolution. Their familiarity renders a book's graphical elements and functionality practically invisible. The “codex”—a book with pages that turn rather than a scroll that is read by unrolling—is one of

Design considerations

Navigation and personalization in digital reading both present many usability issues: accessing and opening the book; knowing where one is in it; providing and accessing supplementary information; navigating within it; locating information by full-text searching or an index; and personalization with annotation or bookmarks. This section briefly reviews research findings on these—findings that are often contradictory.

Realistic books

To investigate whether book models with realistic page turning offer measurable advantages over physical books and other electronic forms, a lightweight Adobe Flash-based application, called Realistic Books, was constructed. Flash was chosen because it is widely installed, and minimizes both download time and compatibility issues (Millburn Survey, 2010). Realistic Books communicate with a PHP application server to save the reader's annotations.

A key challenge when simulating physical books is

Enriched document representation

The information explosion powered by the World-Wide Web has led to a huge increase in skim-reading (Goldsborough, 2000). People scan documents for keywords, tables and illustrations in order to obtain a quick overview of their contents, and only read in depth when something catches their attention.

The background material that a document should provide obviously depends on the reader's prior knowledge (Shneiderman, 1989). To allow people with different backgrounds to understand a book, authors

System responsiveness

Responsiveness is the speed with which a system responds to a user's action, and significantly affects user satisfaction, engagement and reading performance (Hansen and Haas, 1988). To investigate the responsiveness of Realistic Books, we recorded the average time required to load a document, turn a page and perform a text search on 25 books with 500–2500 pages (with no blank pages), and 1100 words per page, at two different screen sizes (800×600 and 1440×900). To display an open book with

Usability studies

One way of determining whether electronic books actually improve people's reading is to compare their performance with commonly used document representations, and with physical books, on tasks that represent likely situations in which the system will be used (Gould, 1988). The typographical features, logical structure and page layout of the electronic text should all be equivalent to the paper material. Moreover, evaluations should be designed not only to show whether the new system improves

Conclusion

People rarely read books linearly; they skip around. They may search for things they have seen before and for things they have not, browse for new information, and assess a book's quantity and coverage of information without regard to the details (Canter et al., 1985). They rely on orientation cues provided by the document interface to know their current position, the size of the document, where to go next and how to visit parts that are not in view. Although much of a book's physical design is

Acknowledgments

We acknowledge the entire New Zealand Digital Library Project team for their unstinting work in providing an environment that makes this kind of research meaningful—and fun. This research is funded in part by Google.

References (132)

  • A. Dillon et al.

    Human factors of journal usage and design of electronic texts

    Interacting with Computers

    (1989)
  • S. McDonald et al.

    Navigation in hyperspace: an evaluation of the effects of navigational tools and subject matter expertise on browsing and information retrieval in hypertext

    Interacting with Computers

    (1998)
  • A. Adler et al.

    A diary study of work-related reading: design implications for digital reading devices

    Computer–Human Interaction

    (1998)
  • M.J. Adler et al.

    How to Read a Book

    (1972)
  • R. Ajmera et al.

    Papyrus—design and evaluation of a dual display notebook PC form factor enabling writing/annotation and parallel tasking

    HP Lab

    (2009)
  • Apple, 2010. iBooks: A Novel Way to Buy and Read Books. Available at...
  • J. Baines

    Literacy and ancient Egyptian society

    Man

    (1983)
  • Barker, P., Richard, S., Benest, I., 1994. Human–computer interface design for electronic books. In: Proceedings of the...
  • Benest, I.D., 1990. A hypertext system with controlled hype. Hypertext: State of the Art, pp....
  • C. Berkenkotter et al.

    Rethinking genre from a sociocognitive perspective

    Written Communication

    (1993)
  • Bjork, S., 2001. The ScrollSearcher technique: using scrollbars to explore search results. In: INTERACT'01, pp....
  • British Library, 2006. Turning the Pages. Available at...
  • Buchanan, G., Pearson, J., 2008. Improving placeholders in digital documents. In: ECDL 2008, pp....
  • Burbules, N.C., 1998. Rhetorics of the Web: Hyperreading and Critical Literacy. Page to Screen: Taking Literacy into...
  • D. Canter et al.

    Characterizing user navigation through complex data structures

    Behaviour and Information Technology

    (1985)
  • Card, S.K., Hong, L., Mackinlay, J.D., Chi, E.H., 2004. 3Book: a 3D electronic smart book. In: Proceedings of the...
  • Card, S.K., Hong, L., Mackinlay, J.D., Chi, E.H., 2004. 3Book: a scalable 3D virtual book. In: Extended Abstracts of...
  • Card, S.K., Robertson, G.G., York, W., 1996. The WebBook and the WebForager: an information workspace for the...
  • C. Chen

    Individual differences in a spatial-semantic virtual environment

    Journal of the American Society for Information Science

    (2000)
  • Chen, N., Guimbretiere, F., Dixon, M., Lewis, C., Agrawala, M., 2008. Navigation techniques for dual-display e-book...
  • Choi, K., 2010. Significance of Trade. Available at...
  • Chu, Y.-C., Bainbridge, D., Jones, M., Witten, I.H., 2004. Realistic books: a bizarre homage to an obsolete medium? In:...
  • Chu, Y.-C., Witten, I.H., Lobb, R., Bainbridge, D., 2003. How to turn the page. In: JCDL '03: Proceedings of the Third...
  • Cipolla, C.M., 1969. Literacy and Development in the West. Harmondsworth:...
  • Cockburn, A., 2004. In: Proceedings of the 5th Australian user Interface Conference, pp....
  • A. Cockburn et al.

    Issues of page representation and organization in Web browser's revisitation tools

    Australian Journal of Information Systems

    (1999)
  • Cockburn, A., McKenzie, B., 2001. 3D or not 3D? Evaluating the effect of the third dimension in a document management...
  • Cockburn, A., McKenzie, B., 2002. Evaluating the effectiveness of spatial memory in 2D and 3D physical and virtual...
  • Conklin, J., 1987. Hypertext: An Introduction and Survey. IEEE Comput.,...
  • Crane, G., 2002. Cultural heritage digital libraries: needs and components. In: Proceedings of the Sixth European...
  • Crawford, W., 1998. Paper persists: why physical library collections still matter. Online Magazine, pp....
  • Crestani, F., Ntioudis, S.P., 2001. User centred evaluation of an automatically constructed Hyper-TextBook. Journal of...
  • W.H. Cushman

    Reading from microfiche, VDT and the printed page: subjective fatigue and performance

    Human Factors

    (1986)
  • Czerwinski, M., vanDantzich, M., Robertson, G., Hoffman, H., 1999. The contribution of thumbnail image, mouse-over text...
  • A. Dillon

    Reading from paper versus screens: a critical review of the empirical literature

    Ergonomics

    (1992)
  • A. Dillon

    Spatial-semantics: how users derive shape from information space

    Journal of the American Society for Information Science

    (2000)
  • A. Dillon et al.

    Reading from paper versus reading from screens

    Computer Journal

    (1988)
  • D. Diringer

    The Hand-Produced Book

    (1953)
  • A. Dix et al.

    Human–Computer Interaction

    (2003)
  • Drucker, J., 2006. The virtual codex from page space to e-space. Available at...
  • Dumas, C., Jourdan, F., Plenacoste, P., 2002. Libraries: comparisons between the real and the virtual in 3D, 2D...
  • Dunn, J., 2006. Discovering writing. Available at...
  • Easley, M.F., 2008. Dead sea scrolls coming to N.C. museum of natural sciences. Available at...
  • Edwards, D., Hardman, L., 1989. Lost in hyperspace: cognitive mapping and navigation in a hypertext environment....
  • Fuller, D., 2006. Honors scholars get a world lesson exploring books in human culture. Available at...
  • G. Furnas et al.

    The vocabulary problem in human–system communication

    Communications of the ACM

    (1987)
  • Gaur, A., 1984. A History of Writing. British Library,...
  • Genuth, I., 2007. E-paper History: An Interview with Nick Sheridon, Father of e-paper. Available at...
  • R. Goldsborough

    Text demands respect on the Web

    Advertising Age

    (2000)
  • Gomez, L., C.C., L., T.K., L., 1990. All the right words: finding what you want as a function of richness of indexing...
  • Cited by (23)

    • Cognitive map or medium materiality? Reading on paper and screen

      2017, Computers in Human Behavior
      Citation Excerpt :

      Such spatial knowledge helps a reader to locate text one has seen before (Liesaputra & Witten, 2012), and support more effective retention and comprehension of the content (Chun & Jiang, 1998; Li et al., 2013; Morineau et al., 2005). In contrast to paper books, screens, in general, weaken the spatial cues about a reader's location in a text (Dillon, 1992; O'Hara & Sellen, 1997; Liesaputra & Witten, 2012; McDonald & Stevenson, 1998), and they impede the reader in forming an effective cognitive map (Jabr, 2013; Li et al., 2013). When the cognitive map is not effectively constructed, a reader employs greater cognitive resources to navigate texts and to retain information, which leaves the reader less cognitive capacity for information recall and comprehension (Li et al., 2013).

    • Marginalia in the digital age: Are digital reading devices meeting the needs of today's readers?

      2017, Library and Information Science Research
      Citation Excerpt :

      Pearson et al. found that readers were three times as likely to use these virtual post-its as they were to use annotations in a traditional PDF viewer. Liesaputra and Witten (2012) created the Realistic Books software that employs features of physical books such as animated page turning, visual location cues, bookmarks, and annotations to improve the user experience. In a user study, they found that “many users preferred Realistic Books over physical ones because they could move, edit and search the annotations” but that “40% preferred physical books because they are more familiar and feel more comfortable—particularly with regard to the fluidity of scribbling” (p. 606).

    • Touching annotations: A visual metaphor for navigation of annotation in digital documents

      2013, International Journal of Human Computer Studies
      Citation Excerpt :

      The aim is to identify how the manner in which they are presented might impact upon the efficiency of document navigation via those annotations. The first (Tab condition) will exemplify the use of real-world metaphors and natural affordances to facilitate navigation (Pearson et al., 2011; Liesaputra and Witten, 2012). The second (Scrollbar condition) will draw from traditional document navigation interfaces (Buchanan and Owen, 2008; Cockburn et al., 2006).

    • Charagraph: Interactive Generation of Charts for Realtime Annotation of Data-Rich Paragraphs

      2023, Conference on Human Factors in Computing Systems - Proceedings
    View all citing articles on Scopus
    View full text