Use of Kendall's coefficient of concordance to assess agreement among observers of very high resolution imagery

Ground-based vegetation monitoring methods are expensive, time-consuming and limited in sample size. Aerial imagery is appealing to managers because of the reduced time and expense and the increase in sample size. One challenge of aerial imagery is detecting differences among observers of the same imagery. Six observers analysed a set of 1-mm ground sample distance aerial imagery for graminoid species composition and important ground-cover characteristics. Kendall's coefficient of concordance (W) was used to measure agreement among observers. The group of six observers was concordant when assessed as a group. When each of the observers was assessed independently against the other five, lack of agreement was found for those graminoid species that were difficult to identify in the aerial images.