skip to main content
article

A system for automatic testing of embedded software in undergraduate study exercises

Published: 01 October 2005 Publication History

Abstract

As student numbers in embedded systems lab courses increase, it becomes more and more time-consuming to verify the correctness of their homework and exam programs. Automatic verification can vastly improve the speed and quality of such tests. This paper describes a system that can carry out black-box tests to verify whether the embedded software running on a target system meets predefined requirements. To this aim, we employ a special test board using an ATmega128 microcontroller which is connected to both the target system and to a host computer. Tests can be selected and started remotely, the results are presented to the user on the host. Monitoring and control via Internet is also easily possible. A special meta-language is used to describe the correct behavior of the tested program, and this description is compiled and downloaded to the test system via a standard RS-232 interface, where the test is executed. The same interface is used to control the tests and for transfer of data and end results.

References

[1]
{1} W. Wolf and J. Madsen, "Embedded systems education for the future," Proceedings of the IEEE, vol. 88, no. 1, pp. 23-30, Jan. 2000.
[2]
{2} M. W. Mutka and A. Bakic, "Teaching undergraduate computer science and engineering students techniques for the design and analysis of real-time applications," in 28th Annual Frontiers in Education Conference, vol. 3, Nov. 4-7, 1998, pp. 1079-1084.
[3]
{3} B. Haberman and M. Trakhtenbrot, "An undergraduate program in embedded systems engineering," in 18th Conference on Software Engineering Education and Training, Apr. 18-20, 2005, pp. 103-110.
[4]
{4} J. Sztipanovits, G. Biswas, K. Frampton, A. Gokhale, L. Howard, G. Karsai, T. J. Koo, X. Koutsoukos, and D. Schmidt, "Introducing embedded software and systems education and advanced learning technology in engineering curriculum," ACM Transactions of Embedded Computing Systems, Special Issue on Education, 2005.
[5]
{5} A. Benso, P. L. Civera, M. Rebaudengo, and M. S. Reorda, "A low-cost programmable board for speeding-up fault injection in microprocessor-based systems," in Annual Reliability and Maintainability Symposium (RAMS'99), 1999, pp. 171-177.
[6]
{6} A. Sung and B. Choi, "An interaction testing technique between hard-ware and software in embedded systems," in 9th Asia Pacific Software Engineering Conference (APSEC'02), 2002, pp. 457-464.
[7]
{7} W.-T. Tsai, Y. Na, R. J. Paul, F. Lu, and A. Saimi, "Adaptive scenario-based object-oriented test frameworks for testing embedded systems," in 26th International Computer Software and Applications Conference on Prolonging Software Life: Development and Redevelopment, 2002, pp. 321-326.
[8]
{8} A. Fin, F. Fummi, M. Martignano, and M. Signoretto, "SystemC: A homogenous environment to test embedded systems," in International Conference on Hardware Software Codesign, 2001, pp. 17-22.
[9]
{9} H. J. Zainzinger, "Testing embedded systems by using a C++ script interpreter," in 11th Asian Test Symposium (ATS'02), 2002, pp. 380-385.
[10]
{10} J. D. Lofgren, "A generic test and maintenance node for embedded system test," in IEEE International Test Conference on TEST: The Next 25 Years, 1994, pp. 143-153.
[11]
{11} V. Legourski, "Test system for embedded software," Bachelor Thesis, Vienna University of Technology, Institute of Computer Engineering, 2005.

Cited By

View all
  • (2016)Learning to prioritize GUI test cases for Android laboratory programsProceedings of the International Conference on Artificial Intelligence and Robotics and the International Conference on Automation, Control and Robotics Engineering10.1145/2952744.2952755(1-5)Online publication date: 13-Jul-2016
  • (2010)A global curriculum design framework for embedded system educationProceedings of 2010 IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications10.1109/MESA.2010.5552036(65-69)Online publication date: Jul-2010
  • (2009)NexosACM SIGBED Review10.1145/1534480.15344876:1(1-10)Online publication date: 1-Jan-2009
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM SIGBED Review
ACM SIGBED Review  Volume 2, Issue 4
Special issue: The first workshop on embedded system education (WESE)
October 2005
74 pages
EISSN:1551-3688
DOI:10.1145/1121812
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2005
Published in SIGBED Volume 2, Issue 4

Check for updates

Author Tags

  1. automatic testing
  2. black-box testing
  3. embedded software education

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)0
Reflects downloads up to 23 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2016)Learning to prioritize GUI test cases for Android laboratory programsProceedings of the International Conference on Artificial Intelligence and Robotics and the International Conference on Automation, Control and Robotics Engineering10.1145/2952744.2952755(1-5)Online publication date: 13-Jul-2016
  • (2010)A global curriculum design framework for embedded system educationProceedings of 2010 IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications10.1109/MESA.2010.5552036(65-69)Online publication date: Jul-2010
  • (2009)NexosACM SIGBED Review10.1145/1534480.15344876:1(1-10)Online publication date: 1-Jan-2009
  • (2007)TOWARDS USAGE OF COMBINED EXERCISES IN LEARNING OF LOW COST CONTROLLERSIFAC Proceedings Volumes10.3182/20070213-3-CU-2913.0002040:1(114-119)Online publication date: 2007

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media