The impact of inter-observer variability on the accuracy, precision and utility of a commonly-used grassland condition index

Goodenough, Anne E ORCID: 0000-0002-7662-6670, Carpenter, William S ORCID: 0009-0001-9031-5561, McTavish, Lynne, Blades, Bryony, Clarke, Emily, Griffiths, Shaun, Harding, Nadine ORCID: 0009-0007-2083-8600, Scott, Rebekah, Walsh, Emily, Wilson, Louisa and Hart, Adam G ORCID: 0000-0002-4795-9986 (2020) The impact of inter-observer variability on the accuracy, precision and utility of a commonly-used grassland condition index. Ecological Indicators, 117. Art No 106664. doi:10.1016/j.ecolind.2020.106664

Preview

Text (Peer-reviewed version) 8516-Goodenough-(2020)-The-impact-of-inter-observer-variability.pdf - Accepted Version Available under License Creative Commons Attribution Non-commercial No Derivatives 4.0. Download (350kB) | Preview

Abstract

Inter-observer variability in ecological surveying can reduce the robustness and reliability of measures used to inform habitat management. Grassland management is important across southern Africa. The Veld Condition Index (VCI) is a technique that combines field data on the relative abundance of grasses identified during a standardised survey with knowledge of how different grass species respond to grazing. This allows calculation of an Ecological Condition Index (ECI) for a particular site. The ECI value is related to threshold values to indicate grazing pressure. Here, for the first time, the effects of inter-observer variation in trained surveyors on condition assessment and resultant management recommendations are examined. There was substantial and statistically significant inter-observer variation in ECI values, driven primarily by differences in the number of times an observer identified grasses within the sample transect as being one of the species listed in the “Decreaser” category of the standardised protocol (i.e. species that decrease with grazing). Variation was random with respect to observers rather than being due to systematic (and thus predicable and potentially correctable) differences between observers. In 44% of sites, inter-observer variation resulted in important differences in assessment of grassland condition because the assessment spanned outcome threshold categories. In such cases, this could result in unnecessary or detrimental management being recommended by some observers including inappropriate burning, needlessly translocating or culling herbivores, or failing to align herbivore populations to the carrying capacity with negative effects on both grazers and veld. We recommend that a cautious approach be taken in using VCI/ECI to inform management and that identification training be focused on species in the Decreaser ecological category that drive inter-individual variation in overall ECI.

Item Type:	Article
Article Type:	Article
Uncontrolled Keywords:	Veld condition index; VCI; Ecological monitoring; Observer variability; Southern Africa; Grassland management
Subjects:	G Geography. Anthropology. Recreation > GE Environmental Sciences S Agriculture > SB Plant culture > SB183 Field crops including cereals, forage, grasses, legumes, root crops, sugar plants, textile plants
Divisions:	Schools and Research Institutes > School of Education and Science
Research Priority Areas:	Place, Environment and Community
Depositing User:	Rhiannon Goodland
Date Deposited:	01 Jul 2020 09:17
Last Modified:	03 Nov 2023 10:15
URI:	https://eprints.glos.ac.uk/id/eprint/8516

University Staff: Request a correction | Repository Editors: Update this record