The Multi-Agent Systems Evaluation Repository

This page contains data, pointers, and resources related to multi-agent systems evaluation. Issues include evaluation methodology, quantitative and qualitative measures, task and domain dependence (or independence), modeling, experimentation, etc. The page also include links to data-set repositories, research groups and projects investigating these issues. It is offered as a service to the multi-agent research community.

We invite contributions and comments from visitors. Please contact Gal Kaminka (galk@cs.biu.ac.il) (See the bottom of the page for full contact details).

If you publish material based on data obtained from this repository, then please note in your acknowledgements the assistance you received by using this repository. This will help others to obtain the same data sets and replicate your experiments. We suggest the following pseudo-APA reference format for referring to this repository:

Kaminka, G. A. (1998). The RoboCup Multi-Agent Systems Evaluation Repository,
http://www.cs.biu.ac.il/~galk/Eval/ Computer Science Department, Bar Ilan University

The appropriate BiBTeX entry is:

@Misc{eval-repos,
author = "Kaminka, Gal A.",
year = "1998",
title = "The Multi-Agent Systems Evaluation Repository",
howpublished = "http://www.cs.biu.ac.il/$\sim$galk/Eval/",
institution = "Computer Science Department, Bar Ilan University"
}

Data-Sets

• The RoboCup Simulator Team Evaluation Data 1998 presents the data from the RoboCup simulation scientific evaluation sessions. Teams were rigorously tested for their adaptive capacity in Teamwork, coordination, and robustness.
• The RoboCup Simulator Evaluation Data 1999 presents the data from the RoboCup simulation scientific evaluation sessions. Phase 1-4 are a repeat of the 1998 test. Phase 5-7 are testing for team performance under changes to the perception uncertainty (normal, zero, and twelve times the uncertainty). 21 Megs.

Researchers, Research Groups, Projects

• MIKE, a real-time commentator system for RoboCup games, and a statistical analysis tool
• The ISAAC Team Analyzer.

Contact information:

Mailing address:
Gal A. Kaminka
Computer Science Department
Bar Ilan University
Ramat Gan 52900
ISRAEL

Acknowledgements

This document is modeled after the home page of the U.C. Irvine Machine Learning Repository.