research-article

Language teaching in a mixed reality games environment

Authors:

David MW Powers,

Richard Leibbrandt,

Darius Pfitzner,

Martin Luerssen,

Arman Abrahamyan,

Kate StevensAuthors Info & Claims

PETRA '08: Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments

Article No.: 70, Pages 1 - 7

https://doi.org/10.1145/1389586.1389668

Published: 16 July 2008 Publication History

Abstract

How do you develop a game that is provably educational, that is engaging from pre-school to adult, and that independently targets different language ability and world experience/maturity?

Our purpose is to teach students of German or English as a Second Language in the same way that a baby learns a First Language. Children acquire language automatically without overt teaching, without conjugating verbs, looking up dictionaries or taking complex classes in syntax and morphology. They acquire through being immersed in an environment in which they have to learn to communicate in the language in order to achieve a variety of social and personal goals.

In this project we provide a mixed environment with real toys for the learner to play with, and a simulated environment and a simulated teacher/caregiver to interact with. Whilst young children may be happy building towers and bridges out of wooden blocks, older children and adults cannot be expected to find motivating goals from the same tasks as a baby tackles as s/he simultaneously learns about the world and his/her language, culture and society.

This paper explores the methodology we are developing to independently control for degree of language knowledge and degree of world experience.

References

[1]

Ahl, David (1978). Basic Computer Games. //www.atariarchives.org/basicgames/showpage.php?page=78 last accessed 8 March 2008

Digital Library

[2]

Bloom, B S. (1984). The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring. Educational Researcher, 13(6), 4--16.

[3]

Bradski, G. R. (1998). Computer Vision Face Tracking For Use in a Perceptual User Interface. Intel Technology Journal, 1998, Q2, 15

[4]

Davis, C, Kim, J. Kuratate, T. & Burnham, D. (2007). Making a thinking-talking head. Proceedings of the International Conference on Auditory-Visual Speech Processing (AVSP 2007). Hilvarenbeek. The Netherlands. Aug 31--Sep 3, 2007.

[5]

Kalawsky, R. S. (1999). VRUSE-a computerised diagnostic tool: for usability evaluation of virtual/synthetic environment systems. Applied Ergonomics 30:11--25.

[6]

Kindler, A. (2002). Survey of the states' limited English proficient students and available educational programs and services, 2000-2001 summary report. National Clearinghouse for English Language Acquisition & Language Instruction Educational Programs.

[7]

Krashen, S. D. (1981). Principles and Practice in Second Language Acquisition. English Language Teaching series. London: Prentice-Hall International (UK) Ltd.

[8]

Leibbrandt, R. Luerssen, M., Matsumoto, T., Treharne, K., Lewis, T., and Powers, D. M. W. (2008) An Immersive Game-like Teaching Environment with Simulated Teacher and Hybrid World, Proc. Computer Games and Allied Technologies (CGAT'08), Singapore, April 28--30, 2008, pp215--222.

[9]

Lienhart, R. & Maydt, J.(2002) An Extended Set of Haar-like Features for Rapid Object Detection, IEEE ICIP 2002, 1, pp900--903

[10]

Li Santi, M., Leibbrandt, R. E. & Powers, D. M. W. 2007. Developing 3D Worlds for Language Learning, Australian Society for Cognitive Science Conference, Adelaide, Australia.

[11]

Lucas, T. (1993). Secondary schooling for students becoming bilingual. In M. B. Arias & U. Casanova (Eds.). Bilingual education: politics, practice and research (pp. 113--143). University of Chicago Press

[12]

Luerssen, M. H., Lewis, T. W., Leibbrandt, R. and Powers, D. M. W. (in press), Adaptive Multimodal Perception for a Virtual Museum Guide. 3^rd Workshop on Artificial Intelligence Techniques for Ambient Intelligence (AITAmI'08), 18^th European Conference on Artificial Intelligence (ECAI'08).

[13]

MacWhinney, B. (1997). Second language acquisition and the Competition Model. In A. M. B. de Groot & J. Kroll (Eds.), Tutorials in bilingualism: Psychological perspectives (pp. 169--199). Mahwah, NJ: Erlbaum.

[14]

Montessori, M. (1907). House of children: a planet without schools or teachers. http://www.montessori.edu/maria.html (accessed 15 Feb 2008).

[15]

Piaget, J. (1928/2001). Judgment and reasoning in the child. New York: Harcourt, Brace and Company.

[16]

Powers, D. M. W., Leibbrandt, R. E., Li Santi, M. & Luerssen, M. H. (2007). A multimodal environment for immersive language learning - space, time, viewpoint and physics, Joint HCSNet-HxI Workshop on Human Issues in Interaction and Interactive Interfaces, Sydney, Australia.

[17]

Powers, D. M. W, Leibbrandt, R., Luerssen, M. Lewis, T., Lawson, M. (in press), PETA --- a Pedagogical Embodied Teaching Agent, PETRAe workshop on Pervasive Technologies in e/m-Learning and Internet Experiments, ACM (8pp), Athens July 15--19, 2008.

Digital Library

[18]

Powers, D. M. W. (2003). Recall and Precision versus the Bookmaker. International Conference on Cognitive Science, pp529--534. http://david.wardpowers.info/BM/BMPaper.pdf accessed 11 May 2008.

[19]

Powers, D. M. W. (2007), Evaluation: From Precision, Recall and F-Factor to ROC, Informedness, Markedness & Correlation, School of Informatics and Engineering, Flinders University Adelaide Australia, Technical Report SIE-07-001, December 2007

[20]

Powers, D. M. W. (in press), Evaluation Evaluation, ECAI 21--25 July 2008.

Digital Library

[21]

Powers, D. M. W. & Turk, C. 1989. Machine Learning of Natural Language, Research Monograph, New York/Berlin: Springer-Verlag.

Digital Library

[22]

Prendinger, H., Mori, J., & Ishizuka, M. (2005), Using human physiology to evaluate subtle expressivity of a virtual quizmaster in a mathematical game. International Journal of Human-Computer Studies, 62(2) 231--245.

Digital Library

[23]

Roussou, M., Gillingham, M., Moher, T. (1999) Evaluation of an Immersive Collaborative Virtual Learning Environment for K-12 Education. American Educational Research Association Annual Meeting (AERA), San Diego, CA,

[24]

Treharne, K., Pfitzner, D. Leibbrandt, R. & Powers, DMW. (in press), A Lean Online Approach to Human Factors Research, PETRAe workshop on Pervasive Technologies in e/m-Learning and Internet Experiments, ACM (8pp), Athens July 15--19, 2008.

Digital Library

[25]

Viola, P. A. & Jones, M. J. (2001) Rapid object detection using a boosted cascade of simple features. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR'01), IEEE Computer Society, 2001, 511--518

Cited By

Everri MHeitmayer M(2024)Cyborg Children: A Systematic Literature Review on the Experience of Children Using Extended RealityChildren10.3390/children1108098411:8(984)Online publication date: 14-Aug-2024
https://doi.org/10.3390/children11080984
Canossa ALozano Angulo ALaris Pardo L(2022)Validating Learning Games, a Case StudyHCI in Games10.1007/978-3-031-05637-6_25(399-413)Online publication date: 26-Jun-2022
https://dl.acm.org/doi/10.1007/978-3-031-05637-6_25
Teng ZHanwu HYueming WHe'en CYongbin C(2017)Mixed Reality Application: A Framework of Markerless Assembly Guidance System with Hololens Glass2017 International Conference on Virtual Reality and Visualization (ICVRV)10.1109/ICVRV.2017.00110(433-434)Online publication date: Oct-2017
https://doi.org/10.1109/ICVRV.2017.00110
Show More Cited By

Index Terms

Language teaching in a mixed reality games environment
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Sound-based input / output
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Sound-based input / output
      2. Touch screens
    2. Interaction paradigms
      1. Graphical user interfaces
      2. Natural language interfaces

Recommendations

PETA: a pedagogical embodied teaching agent
PETRA '08: Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments

We describe a hybrid real and virtual system that monitors and teaches children in an everyday classroom environment without requiring any special virtual reality set ups or any knowledge that there is a computer involved. This system is truly pervasive ...
A Virtual Reality Game as a Tool for Psychotherapy With OCD Patients

The treatment of several types of obsessions/compulsions for people with Obsessive-Compulsive Disorders (OCD) can be done using virtual environments (VE). These people experience intrusive, unwanted thoughts that cause anxiety, which trigger ...
Design of a Mixed Reality-Based Immersive Virtual Environment System for Social Interaction and Behavioral Studies
Intelligent Human Computer Interaction
Abstract
The advancements in immersive technologies allow us to create more sophisticated environments designed to help engage users by merging the physical world with a digital or simulated reality. These can range from completely immersive virtual ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '08: Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments

July 2008

607 pages

ISBN:9781605580678

DOI:10.1145/1389586

Editors:
Fillia Makedon
University of Texas at Arlington
,
Lynne Baillie
Telecom Research Center Vienna (FTW), Austria
,
Grammati Pantziou
TEI of Athens (Department of Informatics), Greece
,
Ilias Maglogiannis
University of Central Greece (Department of Computer Science and Biomedical Informatics), Greece

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Motorola: Motorola
NSF
SERC: SERC
NIST: National Institute of Standards & Technology

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 July 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Australian Research Council

Conference

PETRA '08

Sponsor:

Motorola
SERC
NIST

PETRA '08: The 1st International Conference on PErvasive Technologies Related to Assistive Environments

July 16 - 18, 2008

Athens, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
671
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Everri MHeitmayer M(2024)Cyborg Children: A Systematic Literature Review on the Experience of Children Using Extended RealityChildren10.3390/children1108098411:8(984)Online publication date: 14-Aug-2024
https://doi.org/10.3390/children11080984
Canossa ALozano Angulo ALaris Pardo L(2022)Validating Learning Games, a Case StudyHCI in Games10.1007/978-3-031-05637-6_25(399-413)Online publication date: 26-Jun-2022
https://dl.acm.org/doi/10.1007/978-3-031-05637-6_25
Teng ZHanwu HYueming WHe'en CYongbin C(2017)Mixed Reality Application: A Framework of Markerless Assembly Guidance System with Hololens Glass2017 International Conference on Virtual Reality and Visualization (ICVRV)10.1109/ICVRV.2017.00110(433-434)Online publication date: Oct-2017
https://doi.org/10.1109/ICVRV.2017.00110
Chen GChang C(2009)A Task-Based Role-Playing Game with Educational Robots for Learning LanguageProceedings of the 4th International Conference on E-Learning and Games: Learning by Playing. Game-based Education System Design and Development10.1007/978-3-642-03364-3_58(483-488)Online publication date: 31-Jul-2009
https://dl.acm.org/doi/10.1007/978-3-642-03364-3_58
Powers DLeibbrandt R(2009)Rough Diamonds in Natural Language LearningProceedings of the 4th International Conference on Rough Sets and Knowledge Technology10.1007/978-3-642-02962-2_2(17-26)Online publication date: 1-Jul-2009
https://dl.acm.org/doi/10.1007/978-3-642-02962-2_2
Powers D(2008)Minors as minersProceedings of the 7th Australasian Data Mining Conference - Volume 8710.5555/2449288.2449290(3-14)Online publication date: 27-Nov-2008
https://dl.acm.org/doi/10.5555/2449288.2449290

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten