Principles, practice and pragmatics of measurement in experimental computer science


Project Leader: Justin Zobel
Staff: Alistair Moffat, Timothy Baldwin, Yvette Graham
Sponsors: Australian Research Council
Primary Contact: Justin Zobel (jzobel@unimelb.edu.au)
Keywords: knowledge discovery
Disciplines: Computing and Information Systems
Domains: Networks and data in society

We aim to develop and empirically demonstrate principles and processes for measuring the outcomes of Computer Science experiments. Measurement is well-understood in the traditional physical sciences, and our work is intended to extend that strong foundation and robustness to the computational sciences. In particular, we aim to examine and critique current methodologies for measuring outcomes in a number of research-based computational tasks, and to develop improved systems of measurement that should be used when accurate knowledge of the performance of computational methods is of critical importance, for example, when those methods will be embedded in widely-used or mission critical software tools.