EARCT- ENVIRONMENT FOR AUTOMATED RANK BASED CONTINUOUS AGENT TESTING
DOI:
https://doi.org/10.47839/ijc.11.3.562Keywords:
Agents Testing Autonomous Ranking.Abstract
Testing MAS (Multi-agent System) is a challenging task because these systems are distributed, complex and autonomous in nature. Agents exist in an open environment having their own locus of control and they require context awareness. So due to these agent’s characteristics, testing MAS system using existing testing techniques becomes a very tedious job. Agents also pose problems regarding message communication and semantic interoperability, as well as synchronization with other agents existing in the environment. All these features are known to be hard not only to design and to code, but also to test. In this paper we will propose a unique environment EARCT to test MAS keeping in mind the essential software engineering paradigms such as effort consumed, errors revealed etc.References
Tiryaki A.M., Oztuna S., Dikenelli O., and Erdur Sunit R., A unit testing framework for test driven development of multi-agent systems, In 7th International Workshop on Agent Oriented Software Engineering, 2006.
Roberta Coelho A.S., Kulesza U and Lucena C., Unit testing in multi-agent systems using mock agents and aspects, International Workshop on Software Engineering for Large-scale Multi-Agent Systems, May 2006.
Blaya J. A. B., Hernansaez J. M., and Gomez Skarmeta A. F., Towards and approach for debugging multi-agent systems through the analysis of agent messages” Comput. Syst. Sci. Eng., (20) 4 (2005).
Cossentino M., From requirements to code with PASSI methodology, In Vijayan Sugumaran (Ed.), Intelligent Information Technologies: Concepts, Methodologies, Tools, and Applications, USA, 2008.
Pavon J., Gomez-Sanz J., and Fuentes-Fernandez R., The INGENIAS methodology and tools, In Agent Oriented Methodologies (eds. Henderson-Sellers and Giorgini), Idea group, (2005), pp. 236-276.
Huget M., and Demazeau Y., Evaluating multi agent systems: a record/replay approach, Intelligent Agent Technology, IAT 2004, Proceedings IEEE/WIC/ACM International Conference, (2004), pp. 536-539.
Jennings N.R., An agent-based approach for building complex software systems, Communications of the ACM, (44) 4 (2001), pp. 35-41.
Rouff C., A Test Agent for Testing Agents and Their Communities, IEEE, 2002.
Sommerville I., Software Engineering, 9th edition, Addison Wesley, 2011.
Zhang Z., Thangarajah J., and Padgham L., Automated unit testing for agent systems, 2nd International Working Conference on Evaluation of Novel Approaches to Software Engineering, ENASE’07, Spain, (2007), pp. 10-18.
Ekinci E., Tiryaki M., Cetin O., and Dikenelli O., Goal-oriented agent testing revisited, Proceeding of the 9th International Workshop on Agent-Oriented Software Engineering, (2008), pp. 85-96.
Caire G., Cossentino M., Negri A., and Poggi A., Multi-agent systems implementation and testing, Proceedings of the 7th European Meeting on Cybernetics and Systems Research – EMCSR2004, Vienna, Austrian Society for Cybernetic Studies, (2004), pp. 14-16.
Lam D., and Barber K., Debugging agent behavior in an implemented agent system, 2nd International Workshop, ProMAS, Springer, Berlin, (2005), pp. 104-125.
Nunez M., Rodriguez I., and Rubio F., Specification and testing of autonomous agents in e-commerce systems, Software Testing, Verification and Reliability, (15) 4 (2005), pp. 211-233.
Coelho R., Kulesza U., Staa A., and Lucena C., Unit testing in multi-agent systems using mock agents and aspects, Proceedings of the international workshop on Software engineering for large-scale multi-agent systems, ACM Press, New York, (2006), pp. 83-90.
Gamma E., and Beck K., JUnit: a regression testing framework, http://www.junit.org, 2000.
Tiryaki A.M., Oztuna S., Dikenelli O., and Erdur Sunit R., A unit testing framework for test driven development of multi-agent systems, In 7th International Workshop on Agent Oriented Software Engineering, 2006.
Dikenelli O., Erdur R., and Gumus O., Seagent: a platform for developing semantic web based multi agent systems, AAMAS’05 Proceedings of the fourth International Joint Conference on Autonomous agents and multi-agent systems, ACM Press, New York, (2005), pp. 1271-1272.
Gomez-Sanz J., Botia J., Serrano E., and Pavon J., Testing and debugging of MAS interactions with INGENIAS, Agent-Oriented Software Engineering IX, Springer, Berlin, (2009), pp. 199-212.
Houhamdi Z., Test suite generation process for agent testing, Indian Journal of Computer Science and Engineering, (2) 2 (2011).
Knublauch H., Extreme programming of multi-agent systems, International Joint Conference on Autonomous Agent and Multi-Agent Systems, Bologna. ACM Press, (2002), pp. 704-711.
Gamma E., and Beck K., JUnit: a regression testing framework, http://www.junit.org, 2000.
Botia J., Lopez-Acosta A., and Skarmeta G., ACLAnalyser: a tool for debugging multi-agent systems, Proceeding of the 16th European Conference on Artificial Intelligence, IOS Press, (2004), pp. 967-968.
TILAB, Java agent development framework, http://jade.tilab.com/. Accessed on 17th May 2011.
Padgham L., Winikoff M., and Poutakidis D., Adding debugging support to the Prometheus methodology, Engineering Applications of Artificial Intelligence, (18) 2 (2005), pp. 173-190.
Rodrigues L., Carvalho G., Barros P., and Lucena C., Towards an integration test architecture for open MAS, 1st Workshop on Software Engineering for Agent-Oriented Systems/SBES, (2005), pp. 60-66.
Nguyen C., Perini A., and Tonella P., Goal-oriented testing for MAS, Agent-Oriented Software Engineering VIII, Lecture Notes in Computer Science, (4951) (2008), pp. 58-72.
Houhamdi Z., and Athamena B., Structured system test suite generation process for multi-agent system, International Journal on Computer Science and Engineering, (3) 4 (2011), pp.1681-1688.
Foundations for Intelligent Physical Agents, FIPA-specifications. http://www.fipa.org/ specifications. Accessed on 29th Nov, 2011.
Mills H. D., Dyer M. D., and Linger R. C., Cleanroom software engineering, IEEE Software, (4) 5 (1987), pp. 19-25.
Fosse P. Thevenod and Waeselynck H., Statemate: applied to statistical software testing, In Proc. of the Int. Symposium on Software Testing and Analysis (ISSTA), (June 1993), pp. 78-81.
DeMillo R. A., Lipton R. J., and Sayward F. G., Hints on test data selection: help for the practicing programmer, IEEE Computer, (11) 4 (1978), pp. 34-41.
Hamlet R. G., Testing programs with the aid of a compiler, IEEE Transactions on Software Engineering, (3) 4 (1977), pp. 279-290.
Wegener J., Stochastic algorithms: foundations and applications, In Evolutionary Testing Techniques, Springer Berlin, Heidelberg, Chapter 9, 2005, pp. 82-94.
McMinn P., and Holcombe M., The state problem for evolutionary testing, Proceedings of the International Conference on Genetic and Evolutionary Computation, Springer, Berlin, (2003), pp. 2488-2498.
Downloads
Published
How to Cite
Issue
Section
License
International Journal of Computing is an open access journal. Authors who publish with this journal agree to the following terms:• Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
• Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
• Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
