Abstract
Evaluation is one of the most important activities in the didactic materials development process since it allows developers to check if the obtained material satisfies all requirements and it also provides developers with reliable information about material’s utility, validating if the obtained material can be effective support in the achievement of the educational goals which it intends to support. Evaluation results provide valuable information for the material redesign in such cases when the requirements or educational goals are not satisfied. Nevertheless its importance, the evaluation has been often neglected in most of the approaches related to the development of didactic materials, which are more focused on issues such as interoperability or reusability. In this paper we present the MD2 evaluation framework based on a general evaluation procedure that include a set of criteria and measures for the two more important evaluation objectives of IMS LD-based didactic material: its usability and pedagogical usefulness.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Botafogo, R.A., Rivlin, E., Shneiderman, B.: Structural Analysis of Hypertexts: Identifying Hierarchies and Useful Metrics. ACM Transactions on Information Systems 10(2), 142–180 (1992)
CopperAuthor project website (retrieved February 3, 2006), from http://www.copperauthor.org/
Díaz, P.: Usability of hypermedia educational e-books. D-Lib Magazine 9(3) (2003), Disponible en http://www.dlib.org/dlib/march03/diaz/03diaz.html
Díaz, P., Sicilia, M.A., Aedo, I.: Evaluation of hypermedia educational systems: Criteria and imperfect measures. In: ICCE 2002. International Conference on Computers in Education, Auckland (Nueva Zelanda), December 2002, pp. 621–626. IEEE Press, New York (2002)
Garzotto, F., Mainetti, L., Paolini, P.: Hypermedia Design, Analysis and Evaluation Issues. Communications of the ACM 38(8), 74–86 (1995)
Herrera, F., Herrera-Viedma, E.: Aggregation Operators for Linguistic Weighted Information in IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 27(5) (September 1997)
Hutchings, G.A., Brigss, J., Hammond, N.V., Kibby, M.R., Mc Knight, C., Ridley, D.: Authoring and evaluation of hypermedia for education. Computers& Education 18(1-3), 171–177 (1992)
IEEE LTSC: Learning Object definition. Technical report, LTSC Learning Technology Standards Committee of the Institute of Electrical and Electronics Engineers (IEEE) (October 2005)
IMS-LD: IMS Learning Design. Version 1.0 - final specification (retrieved April 2005), from http://www.imsglobal.org/learningdesign/index.html
IMS-LD-Best-Practice: IMS Learning Design Best Practice and Implementation Guide, http://www.imsglobal.org/learningdesign/ldv1p0/imsld_bestv1p0.html#1507607
IMS Meta-data Best Practice Guide for IEEE 1484.12.1-2002 Standard for Learning Object Metadata Version 1 (2005) (retrieved April 2005), from http://www.imsglobal.org/metadata/mdv1p3pd/imsmd_bestv1p3pd.html
IMS Question and Test Interoperability: Information Model (2005) (retrieved April 2005), from http://www.imsglobal.org/question/index.html
Ivory, M.Y.: Web TANGO: Towards Automated Comparison of Information-centric Web Site Designs. In: CHI 2000. Proc. of ACM Conference on Human Factors in Computing Systems, The Hague, Netherlands, April 2000, ACM Press, New York (2000)
Marsh, E.J., Kumar, D.D.: Hypermedia: a conceptual framework for science education and review of recent findings. Journal of Educational Multimedia and Hypermedia 1, 25–37 (1992)
Molenda, Michael, Pershing, James, A., Reigeluth, C.M.: Designing Instructional Systems. In: Craig, R.L. (ed.) The ASTD Training and Development Handbook, 4th edn., pp. 266–293. McGraw-Hill, New York (1996)
Mendes, M.E.X., Harrison, R., Hall, W.: Applying Metrics to the Evaluation of Educational Hypermedia Applications. Journal of Universal Computer Science (April 1998)
Nielsen, J.: Designing Web Usability: The Practice of Simplicity, 3rd edn. New Riders Publishing, Indianapolis (2002)
Padrón, C.L., Díaz, P., Aedo, I.: MD2 Method: The Didactic Materials Creation from a Model Based Perspective in Innovative Approaches for Learning and Knowledge Sharing. In: Nejdl, W., Tochtermann, K. (eds.) EC-TEL 2006. LNCS, vol. 4227, pp. 366–382. Springer, Heidelberg (2006)
RELOAD Reusable E-Learning Object Authoring and Delivery project (retrieved January 5, 2006), from http://www.reload.ac.uk/
Rosson, M.B., Carroll, J.M.: Usability engineering. Morgan Kauffmann Publisher, Seattle, Washington, USA (2002)
SCORM: Sharable Content Object Reference Model (SCORM) (2004), retrieved form http://www.adlnet.org/scorm/history/2004/documents.cfm
Smets, P.: Imperfect Information. In: Motro, A., Smets, P. (eds.) Imprecision-Uncertainty in Uncertainty Management in Information Systems: from Needs to Solutions, Kluwer Academics Publisher, Boston, MA (1999)
Yamada, S., Hong, J., Sugita, S.: Development and Evaluation of Hypermedia for Museum Education: Validation of Metrics. ACM Transactions on Computer-Human Interaction 2(4), 284–307 (1995)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Padrón, C.L., Díaz, P., Aedo, I. (2007). Towards an Effective Evaluation Framework for IMS LD-Based Didactic Materials: Criteria and Measures. In: Jacko, J.A. (eds) Human-Computer Interaction. HCI Applications and Services. HCI 2007. Lecture Notes in Computer Science, vol 4553. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73111-5_36
Download citation
DOI: https://doi.org/10.1007/978-3-540-73111-5_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73109-2
Online ISBN: 978-3-540-73111-5
eBook Packages: Computer ScienceComputer Science (R0)