Do doctors always agree on diagnoses of patients? Do professors agree in their evaluations of students? Comparing ratings of experts is difficult if they are not in full agreement. Various statistics have been suggested, but they do not tell the full story. They also tend to concentrate on pairs of experts, although often there may be three or even more. Graphics offer additional insight and this paper reviews various visualization possibilities and makes some recommendations.

Keywords: Experts; Fluctuation diagrams; Agreement

Biography: Antony Unwin is the Professor of ComputerOriented Statistics and Data Analysis at the University of Augsburg in Germany. His research interests are in visualization and the development of software for interactive graphical analyses. Members of his group are responsible for the software packages collectively known as the Augsburg Impressionists (including MANET, KLIMT, GAUGUIN, SEURAT and MONDRIAN).