Design and application of augmented reality query-answering system in mobile phone information navigation

doi:10.1016/j.eswa.2014.07.050

Expert Systems with Applications

Volume 42, Issue 2, 1 February 2015, Pages 810-820

https://doi.org/10.1016/j.eswa.2014.07.050 Get rights and content

Highlights

•
An augmented reality query-answering system (AR-QAS) is designed and implemented in this study.
•
The average question classification accuracy in an artificial neural network was 98.76%.
•
AR-QAS can provide a fast and convenient mobile information navigation service for users.
•
Language variety, timely feedback, and personal focus improve behavioral intentions to us AR-QAS.
•
This study confirms that the new model combining TAM and MRT can be applied to relevant AR research.

Abstract

This study proposed an augmented reality query-answering system (AR-QAS) based on mobile cloud computing to provide natural language informational navigation services. Empirical research was performed to examine the effectiveness of the system in actual use. This study confirms that the new model developed by combining technology acceptance model (TAM), media richness theory, and the factors of self-efficacy can be applied to relevant AR research. The experiment results revealed that the average question classification accuracy of QAS when combined with artificial neural network and ontology was 98.76%. Moreover, the perceived media richness was found to be positively related to self-efficacy, perceived usefulness, perceived ease of use, user attitude, and use intention. Furthermore, this study reveals that combining the TAM and media richness theory provides a stronger explanation than does the TAM alone. Before new systems are created, designers are suggested to consider the four factors of media richness theory (i.e., multiple cues, language variety, timely feedback, and personal focus), to greatly improve user attitudes toward and behavioral intentions to use new technologies.

Introduction

In recent years, mobile devices and services have become ubiquitous. For consumer electronics techniques, with the rise in popularity of mobile devices installed with integrated cameras, such as iPhones, Android phones, or tablet computers, augmented reality (AR) and query-answering system (QAS) have been discussed for and implemented in interactive mobile services. Copious literature has explored the technology and use of AR, but most studies have focused on computer vision methods or the design and use of AR service interfaces and systems (Carmigniani et al., 2011, Lee et al., 2008, Verbelen et al., 2011). Studies have examined QASs (e.g., SIRI by Apple Inc.) that automatically reply to user questions by using natural language (García-Cumbreras et al., 2012, García-Santiago and Olvera-Lobo, 2012, Song et al., 2011). However, few studies have focused on the use of AR and QAS in mobile information navigation. Therefore, this study proposes and implements an AR-QAS that includes mobile devices and cloud servers. Mobile devices provide AR functions to recognize camera images and to present 3D objects on device screens. A cloud server provides a QAS based on data mining and expert system techniques to analyze the mobile device messages and to reply to questions. This paper presents a case study of a mobile phone informational navigation service based on an AR-QAS.

For user behavior analysis, the current study combines the technology acceptance model (TAM) (Davis, Bagozzi, & Warshaw, 1989) and media richness theory (Daft & Lengel, 1984) to explore whether using AR positively benefits informational navigation. Specifically, a natural language query AR navigation system was designed in this study, and user attitudes and behavioral intentions to use the system were examined. The study comprised the design of the natural language query AR navigation system and the use of empirical research to determine the acceptance of and behavioral intention toward the system, which was used as an informational navigation guide at a museum.

The remainder of the paper is organized as follows. Related technologies and the background to the study are discussed in Section 2. In Section 3, an AR-QAS is presented and evaluated. In Section 4, the TAM and media richness theory are employed to explore user attitudes and behavioral intentions toward AR-QAS. Finally, conclusions and suggestions are provided in Section 5.

Section snippets

Literature review

The research background and relevant technology are discussed as follows: (1) AR, (2) mobile cloud (MC), (3) QAS, (4) TAM, (5) media richness theory, and (6) hypotheses.

Design and evaluation of the AR-QAS

In this section, the architecture of the AR-QAS is presented. Experimental results that evaluate the question classification accuracy of AR-QAS are then revealed. Finally, a case study is provided to evaluate a user’s experience with the AR-QAS.

User attitudes and behavioral intentions toward AR-QAS

For user behavior analysis, a questionnaire survey was conducted. The questionnaire survey is a research method that involves the use of a series of questions for gathering information from people. The advantage of the questionnaire survey is the ability to collect information from large samples of the target population within a short period at relatively low cost, whereas the disadvantage of the questionnaire survey is that researchers cannot obtain certain information from respondents such as

Conclusions and suggestions

A natural language QAS was designed in this study and used in AR informational navigation in mobile phones. Empirical research was performed to examine the effectiveness of the system in actual use. A discussion of the research results follows:

An AR-QAS combined with mobile devices and cloud servers was designed and implemented in this study. The AR-QAS can recognize the image of an advertisement flyer and return it in the form of a 3D object onto the mobile device screen of a user. The user

Acknowledgments

This study was supported by the National Science Council of Taiwan under Grant Nos. NSC 101-2420-H-009-004-DR, NSC 102-2410-H009-028-MY2, and NSC 102-2410-H009-052-MY3. This work was also supported by Aiming for the Top University Program of the National Chiao Tung University and Ministry of Education of Taiwan.

References (48)

M. Armbrust et al.
A view of cloud computing
Communications of the ACM
(2010)
A. Bandura
Self-efficacy: Toward a unifying theory of behavior change
Psychological Review
(1977)
A. Bandura
Self-efficacy in changing societies
(1995)
D.R. Berryman
Augmented reality: A review
Medical References Services Quarterly
(2012)
J. Carmigniani et al.
Augmented reality technologies, systems and applications
Multimedia Tools and Applications
(2011)
C.H. Chen et al.
Traffic speed estimation based on normal location updates and call arrivals from cellular networks
Simulation Modelling Practice and Theory
(2013)
C.H. Chen et al.
A green positioning algorithm for campus guidance system
International Journal of Mobile Communications
(2012)
C.H. Chen et al.
A cloud-based recommender system – A case study of delicacy recommendation
Procedia Engineering
(2011)
W. Cheung et al.
Multimedia learning system and its effect on self-efficacy in database modeling and design: An exploratory study
Computers & Education
(2003)
H.H. Chiang et al.
Analyzing behaviors influencing use of mobile coupons from the perspective of transaction utility
Social Behavior & Personality: An International Journal
(2013)

D. Compeau et al.

Computer self-efficacy: Development of a measure and initial test

MIS Quarterly

(1995)

R.L. Daft et al.

Information richness: A new approach to managerial behavior and organizational design

Research in Organizational Behavior

(1984)

R.L. Daft et al.

Organizational information requirements, media richness and structural design

Management Science

(1986)

R.L. Daft et al.

Message equivocality, media selection and manager performance. Implications for information systems

MIS Quarterly

(1987)

F.D. Davis et al.

User acceptance of computer technology: A comparison of two theoretical models

Management Science

(1989)

J. Dean et al.

Mapreduce. Simplified data processing on large clusters

Communication of ACM

(2008)

J.W. Fan et al.

Semantic classification of biomedical concepts using distributional similarity

Journal of the American Medical Informatics Association

(2007)

C.R. Fornell et al.

Structural equation models with unobservable variables and measurement error

Journal of Marketing Research

(1981)

M.Á. García-Cumbreras et al.

Architecture and evaluation of BRUJA, a multilingual question answering system

Information Retrieval

(2012)

L. García-Santiago et al.

Analysis of automatic translation of questions for question-answering systems

Information Research: An International Electronic Journal

(2012)

J.H. Heinrichs et al.

Testing an integrated model of e-learning adoption decision

American Journal of Business Research

(2008)

Ishii, N., Murai, T., Yamada, T., & Bao, Y. (2006). Text classification by combining grouping, LSA and kNN. In Paper...

C. Jacob et al.

Media richness and internet exploration

International Journal of Tourism Research

(2010)

K.G. Jöreskog et al.

LISREL 7: A guide to the program and application

(1988)

Cited by (35)

Usage of augmented reality (AR) and development of e-learning outcomes: An empirical evaluation of students’ e-learning experience
2022, Computers and Education
Citation Excerpt :
Chiang et al. (2014) added that AR mobile learning applications provide students with more useful information and allow them to share such information with their colleagues. Other aspects (i.e. critical thinking, cognitive load and self-efficacy) were also reported as key consequences of using AR learning applications (Chao et al., 2016; Lin & Chen, 2015). In their experimental study, Chang and Hwang (2018) were also able to prove that students who actively use AR.LRP have better project performance along with enhanced critical thinking skills and self-efficacy.
This study aims to examine students' experience of augmented reality learning applications (AR.LRP). Uses and gratifications theory was proposed as a theoretical foundation of the current study's conceptual model. Four dimensions of UGT benefits were proposed as key antecedences of the students' experience with AR.LRP: personal interactive benefits, social interactive benefits, affective benefits, and cognitive benefits. The model was also extended by considering the role of telepresence. Further, technostress was proposed on the current study to moderate the relationship between the aspects of UGT and e-learning experience. A sample size of 500 undergraduate students from the four largest Universities in Saudi Arabia was used in the current study survey. The statistical results largely support the significant impact of personal interactive benefits, affective benefits, and cognitive benefits, and telepresence on student experience with AR.LRP. Technostress was also found to significantly moderate the relationship between UGT dimensions and student experience with AR.LRP. Further, results support a significant relationship between student experience with AR.LRP and students' learning performance. This study has contributed to the perspectives of researchers and practitioners by highlighting the most important aspects and characteristics that ensure a distinctive and positive students' experience of the drum with applications with AR.LRP.
The role of virtual reality on information sharing and seeking behaviors
2021, Journal of Hospitality and Tourism Management
Citation Excerpt :
All measurement constructs and items were adapted from previous studies for validity and reliability and were operationalized with multi-items on a 5-point Likert-type scale ranging from 1: strongly disagree to 5: strongly agree. In particular, six items of vividness (Yim et al., 2017), three items of interactivity (Wu, 2005; Yim et al., 2017), four items of media richness (Lin & Chen, 2015), two items of information sharing (Bilgihan, Peng, & Kandampully, 2014; Chow & Chan, 2008), and two items of information seeking (Bilgihan et al., 2014; Kiel & Layton, 1981) were adopted with minor wording changes to accommodate the VR research context. The detailed measurement items are shown in Table 1.
One of the most popular forms of technological applications in the hospitality and tourism industry is virtual reality (VR). Extending the current literature on VR, this study investigates the effects of VR's vividness and interactivity on customers' perceived media richness, which further influences information search and sharing behaviors. The results of this study confirm the importance of vividness and interactivity as contributing factors to media richness. Findings also identify media richness positively influences customers' information search and sharing behaviors. This study bridges the gap between the application of media richness to VR and offers industry implications for enhancing VR features to increase favorable customers' behaviors.
Impacts of an augmented reality-based flipped learning guiding approach on students’ scientific project performance and perceptions
2018, Computers and Education
Citation Excerpt :
The above examples of the implementation of AR in education research indicate that AR can effectively increase students' learning motivation and learning results; hence, students' interaction and collaboration with peers can be improved. In addition, several researchers have indicated that the use of AR in school settings has good potential for improving learners' motivation (Cheng, 2017), critical thinking (Chao, Chang, Lan, & Sung, 2016), cognitive load (Cheng, 2017; Hsu, 2017), and self-efficacy (Lin & Chen, 2015). Therefore, this study attempts to measure students’ learning motivation, critical thinking, cognitive load, and self-efficacy in an activity, in which image-based AR was adopted to guide students to conduct electromagnetic experiments.
In recent years, flipped learning has received increasing emphasis; it engages students in deriving basic knowledge through instructional videos before the class, and hence more time is available for practicing, applying knowledge, or student-teacher interaction in class. Many scholars have pointed out that, with such a learning approach, teachers can design more effective in-class activities by guiding students to have higher order thinking as well as interactions with peers and teachers. In the meantime, researchers have also indicated that employing proper educational technologies or learning strategies could further improve students’ performance. Therefore, in this study, an Augmented Reality (AR)-based learning guiding mode is proposed for developing a flipped learning system. To examine the effectiveness of the proposed approach, an experiment was conducted in a natural science learning activity of an elementary school using the developed system. The participants were four classes of 111 fifth graders. Two classes were assigned to the experimental group, while the others were the control group. Those learning in the experimental group used the AR-based flipped learning mode, while those in the control group learned with the conventional flipped learning mode. From the experimental results, it was found that the AR-based flipped learning guiding approach not only benefited the students in terms of promoting their project performance, but also improved their learning motivation, critical thinking tendency, and group self-efficacy.
Enhancing the online decision-making process by using augmented reality: A two country comparison of youth markets
2017, Journal of Retailing and Consumer Services
Citation Excerpt :
The paper further ends with theoretical and managerial implications and proposals for future researches. The recent progresses in information and communication technologies provide the opportunity to develop new environments enriched with digital technologies, in order to extend the possibilities offered by the physical word, where real and virtual objects are successfully integrated (or combined) (Pantano and Servidio, 2012; Lee and Park, 2014; Rese et al., 2014; Lin and Chen, 2015). Augmented reality is defined as a real-time view of the physical world enhanced (augmented) with virtual computer generated information, such as digital images or video stream, etc. (Azuma, 1997; Carmigiani et al., 2011).
Although online stores extend the traditional offer of the brick and mortar ones, the limited possibilities to virtually try the product before the effective buying makes the online purchase decision a complex process for consumers. Therefore, online retailers face new challenges for supporting consumers consisting of the introduction of advanced technologies such as augmented reality systems. The present study investigates the effect of augmented reality technologies on consumer behaviour within the online retail environments, by comparing two different cultural settings. Drawing upon the technology acceptance model (TAM), new constructs related to the technology characteristics (e.g. quality of information, aesthetic quality, interactivity, and response time) developed a new conceptual model. This model has been tested for a new technology for virtual try-on (a smart mirror for virtual glasses). Focusing on young consumers, data collected in Italy and Germany yielding a total of 318 participants was used. Findings across these two markets reflect cross-market similarities, but also dissimilarities, related to consumers’ motivation to employ augmented reality systems for supporting their online purchase decision. These insights should prove helpful to retailers in better manage the online channels, that could be easily extended to the mobile one.
Tourists’ Adoption of Extended Reality Technologies: A MetaAnalytical Structural Equation Modeling
2024, Journal of Hospitality and Tourism Research
Research on the acceptance of ChatGPT among different college student groups based on latent class analysis
2024, Interactive Learning Environments

View all citing articles on Scopus

View full text

Design and application of augmented reality query-answering system in mobile phone information navigation

Highlights

Abstract

Introduction

Section snippets

Literature review

Design and evaluation of the AR-QAS

User attitudes and behavioral intentions toward AR-QAS

Conclusions and suggestions

Acknowledgments

A view of cloud computing

Communications of the ACM

Self-efficacy: Toward a unifying theory of behavior change

Psychological Review

Self-efficacy in changing societies

Augmented reality: A review

Medical References Services Quarterly

Augmented reality technologies, systems and applications

Multimedia Tools and Applications

Traffic speed estimation based on normal location updates and call arrivals from cellular networks

Simulation Modelling Practice and Theory

A green positioning algorithm for campus guidance system

International Journal of Mobile Communications

A cloud-based recommender system – A case study of delicacy recommendation

Procedia Engineering

Multimedia learning system and its effect on self-efficacy in database modeling and design: An exploratory study

Computers & Education

Analyzing behaviors influencing use of mobile coupons from the perspective of transaction utility

Social Behavior & Personality: An International Journal

Computer self-efficacy: Development of a measure and initial test

MIS Quarterly

Information richness: A new approach to managerial behavior and organizational design

Research in Organizational Behavior

Organizational information requirements, media richness and structural design

Management Science

Message equivocality, media selection and manager performance. Implications for information systems

MIS Quarterly

User acceptance of computer technology: A comparison of two theoretical models

Management Science

Mapreduce. Simplified data processing on large clusters

Communication of ACM

Semantic classification of biomedical concepts using distributional similarity

Journal of the American Medical Informatics Association

Structural equation models with unobservable variables and measurement error

Journal of Marketing Research

Architecture and evaluation of BRUJA, a multilingual question answering system

Information Retrieval

Analysis of automatic translation of questions for question-answering systems

Information Research: An International Electronic Journal

Testing an integrated model of e-learning adoption decision

American Journal of Business Research

Media richness and internet exploration

International Journal of Tourism Research

LISREL 7: A guide to the program and application