skip to main content
10.1145/2414639.2414654acmconferencesArticle/Chapter ViewAbstractPublication PagessplashConference Proceedingsconference-collections
short-paper

Empirical software engineering for agent programming

Published: 21 October 2012 Publication History

Abstract

Empirical software engineering is a branch of software engineering in which empirical methods are used to evaluate and develop tools, languages and techniques. In this position paper we argue for the use of empirical methods to advance the area of agent programming. Through that we will complement the solid theoretical foundations of the field with a thorough understanding of how our languages and platforms are used in practice, what the main problems and effective solutions are, and how to improve our technology based on empirical findings. Ultimately, this will pave the way for establishing multi-agent systems as a mature and recognized software engineering paradigm with clearly identified advantages and application domains.

References

[1]
V. R. Basili and L. C. Briand, editors. Empirical Software Engineering: An International Journal. Springer, 2012. http://www.springer.com/computer/swe/journal/10664.
[2]
S. S. Benfield, J. Hendrickson, and D. Galanti. Making a strong business case for multiagent technology. In Proceedings of the fifth international joint conference on Autonomous agents and multiagent systems (AAMAS'06), pages 10--15. ACM, 2006.
[3]
R. H. Bordini, M. Dastani, J. Dix, and A. El Fallah Seghrouchni. Multi-Agent Programming: Languages, Platforms and Applications. Springer, Berlin, 2005.
[4]
R. H. Bordini, M. Dastani, J. Dix, and A. El Fallah Seghrouchni. Multi-Agent Programming: Languages, Tools and Applications. Springer, Berlin, 2009.
[5]
K. Eisenhardt. Building theories from case study research. The Academy of Management Review, 14 (4): 532--550, 1989.
[6]
J. Gemrot, Z. Hlávka, and C. Brom. Does high-level behavior specification tool make production of virtual agent behaviors better? In Proceedings of the International Workshop on Cognitive Agents for Virtual Environments (CAVE'12), 2012.
[7]
K. V. Hindriks. Debugging is explaining. In phPrinciples of Practice in Multi-Agent Systems (PRIMA'12), volume 7455 of LNAI, pages 31--45. Springer, 2012.
[8]
K. V. Hindriks, M. B. van Riemsdijk, and C. M. Jonker. An empirical study of patterns in agent programs. In Principles of Practice in Multi-Agent Systems (PRIMA'10), volume 7057 of LNAI, pages 196--211. Springer, 2011. Best paper award (runner up).
[9]
H. R. Jordan and R. Collier. Evaluating agent-oriented programs: Towards multi-paradigm metrics. In Proceedings of the Eigth International Workshop on Programming Multiagent Systems (ProMAS'10), volume 6599 of LNCS, pages 63--78. Springer, 2012.
[10]
M. N. Marshall. Sampling for qualitative research. Family Practice, (3): 522--525, 1996.
[11]
S. Miles, M. Winikoff, S. Cranefield, C. D. Nguyen, A. Perini, P. Tonella, M. Harman, and M. Luck. Why testing autonomous agents is hard and what can be done about it. URL http://www.pa.icar.cnr.it/cossentino/AOSETF10/docs/miles.pdf. AOSE Technical Forum 2010 Working Paper.
[12]
R. Píbil, P. Novák, C. Brom, and J. Gemrot. Notes on pragmatic agent-programming with jason. In Proceedings of the Nineth International Workshop on Programming Multiagent Systems (ProMAS'11), volume 7217 of LNCS, pages 58--73. Springer, 2012.
[13]
D. Poutakidis, M. Winikoff, L. Padgham, and Z. Zhang. Debugging and testing of multi-agent systems using design artefacts. In R. H. Bordini, M. Dastani, J. Dix, and A. El Fallah Seghrouchni, editors, Multi-Agent Programming: Languages, Tools and Applications, pages 215--258. Springer, Berlin, 2009.
[14]
P. Runeson and M. Höst. Guidelines for conducting and reporting case study research in software engineering. Empirical Software Engineering, 14 (2): 131--164, 2009.
[15]
D. J. Sollenberger and M. P. Singh. Kokomo: an empirically evaluated methodology for affective applications. In Proceedings of the tenth international joint conference on autonomous agents and multiagent systems (AAMAS'11), pages 293--300. IFAAMAS, 2011.
[16]
P. R. Telang and M. P. Singh. Comma: a commitment-based business modeling methodology and its empirical evaluation. In Proceedings of the eleventh international joint conference on autonomous agents and multiagent systems (AAMAS'12), pages 1073--1080. IFAAMAS, 2012.
[17]
J. Thangarajah, G. Jayatilleke, and L. Padgham. Scenarios for system requirements traceability and testing. In 10th International Conference on Autonomous Agents and Multiagent Systems (AAMAS'11), pages 285--292. IFAAMAS, 2011.
[18]
I. van de Kieft, C. M. Jonker, and M. B. van Riemsdijk. Explaining negotiation: Obtaining a shared mental model of preferences. In 24th International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems (IEA/AIE'11), volume 6704 of LNCS, pages 120--129. Springer, 2011.
[19]
M. B. van Riemsdijk and K. V. Hindriks. An empirical study of agent programs: A dynamic blocks world case study in GOAL. In J.-J. Yang, M. Yokoo, T. Ito, Z. Jin, and P. Scerri, editors, Principles of Practice in Multi-Agent Systems, volume 5925 of LNAI, pages 200--215. Springer, 2009. Best paper award.
[20]
M. B. van Riemsdijk, K. V. Hindriks, and C. M. Jonker. An empirical study of cognitive agent programs. Multiagent and Grid Systems (MAGS), 8 (2): 187--222, 2012.

Cited By

View all
  • (2015)Modeling Healthcare Processes Using Commitments: An Empirical EvaluationPLOS ONE10.1371/journal.pone.014120210:11(e0141202)Online publication date: 5-Nov-2015

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
AGERE! 2012: Proceedings of the 2nd edition on Programming systems, languages and applications based on actors, agents, and decentralized control abstractions
October 2012
150 pages
ISBN:9781450316309
DOI:10.1145/2414639
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 October 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. agent programming languages
  2. empirical software engineering
  3. metrics
  4. software quality

Qualifiers

  • Short-paper

Conference

SPLASH '12
Sponsor:

Acceptance Rates

Overall Acceptance Rate 19 of 35 submissions, 54%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2015)Modeling Healthcare Processes Using Commitments: An Empirical EvaluationPLOS ONE10.1371/journal.pone.014120210:11(e0141202)Online publication date: 5-Nov-2015

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media