Glob Change Biol. 2024;30:e17119. | 1 of 13 https://doi.org/10.1111/gcb.17119 wileyonlinelibrary.com/journal/gcb Received:26June2023 | Accepted:2December2023 DOI:10.1111/gcb.17119 RESEARCH ARTICLE Modelling the probability of meeting IUCN Red List criteria to support reassessments Etienne G. Henry1,2 | Luca Santini3 | Stuart H. M. Butchart4,5 | Manuela González- Suárez6 | Pablo M. Lucas3,7 | Ana Benítez- López8 | Giordano Mancini3 | Martin Jung9 | Pedro Cardoso10,16 | Alexander Zizka11 | Carsten Meyer1,12,13 | H. Reşit Akçakaya14,15 | Alex J. Berryman4 | Victor Cazalis1,17 | Moreno Di Marco3 This is an open access article under the terms of the CreativeCommonsAttribution-NonCommercial License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes. ©2024TheAuthors.Global Change Biology published by John Wiley & Sons Ltd. VictorCazalisandMorenoDiMarcocontributedequally. ForAffiliationreferpageon10 Correspondence EtienneG.Henry,ÉcoleNormale Supérieure, 45 rue d'Ulm, Paris 75005, France. Email: etienne.henr[email protected] Victor Cazalis, Leipzig University, Ritterstraße 26, 04109 Leipzig, Germany. Email:
[email protected] Funding information DeutscheForschungsgemeinschaft, Grant/AwardNumber:FZT118- 202548816 Abstract Comparative extinction risk analysis—which predicts species extinction risk from correlation with traits or geographical characteristics—has gained research attention asapromisingtooltosupportextinctionriskassessmentintheIUCNRedListof Threatened Species. However, its uptake has been very limited so far, possibly because existing models only predict a species' Red List category, without indicating which Red List criteria may be triggered. This prevents such approaches to be integrated into Red List assessments. We overcome this implementation gap by developing models that predict the probability of species meeting individual Red List criteria. Using dataontheworld'sbirds,weevaluatedthepredictiveperformanceofourcriterion- specificmodelsandcompareditwiththetypicalcriterion-blindmodellingapproach. We compiled data on biological traits (e.g. range size, clutch size) and external drivers (e.g. change in canopy cover) often associated with extinction risk. For each specific criterion, we modelled the relationship between extinction risk predictors and species' Red List category under that criterion using ordinal regression models. We found criterion-specificmodelswerebetteratidentifyingthreatenedspeciescomparedto acriterion-blindmodel(highersensitivity),butlessgoodatidentifyingnotthreatenedspecies(lowerspecificity).Asexpected,differentcovariateswereimportantfor predicting extinction risk under different criteria. Change in annual temperature was important for criteria related to population trends, while high forest dependency was important for criteria related to restricted area of occupancy or small population size. Ourcriteria-specificmethodcansupportRedListassessorsbyproducingoutputs that identify species likely to meet specific criteria, and which are the most important predictors.Thesespeciescanthenbeprioritisedforre-evaluation.Weexpectthis
2 of 13 | HENRY et al. 1 | INTRODUCTION Over recent decades, the IUCN Red List of Threatened species (henceforth ‘Red List’) has become the global standard for species' extinction risk assessments (Betts et al., 2020; Mace et al., 2008; Rodrigues et al., 2006).ARedListassessmentisbasedonatleast oneoffivecomplementarycriteriawithquantitativethresholdsrelating to population and distribution size, structure and trends to assignspeciestocategoriesofextinctionrisk(IUCN,2012; Mace et al., 2008). The Red List now includes assessments for over 150,000speciesofanimals,fungiandplants(IUCN,2022), but, despite its great importance for conservation action and policy (Betts et al., 2020; Hoffmann et al., 2010; Williams et al., 2021), it is insufficientlyfunded(Juffe-Bignolietal.,2016).Asaconsequence,the Red List faces important challenges in keeping assessments up to date (i.e. <10 yearsold)andreducingtheproportionofdatadeficient species (Cazalis et al., 2022; Rondinini et al., 2014). Different methods have been developed to support Red List assessments and address the above challenges (e.g. Bachman et al., 2019; Buchanan et al., 2008; Cazalis et al., 2023; Santini et al., 2019; see Cazalis et al., 2022foranoverview).Amongthem, comparative extinction risk models link extinction risk (i.e. Red List categories) with species' biological traits (e.g. body mass, habitat specialisation, range size) and external drivers of risk (e.g. human density, land-use change, climate change; Chichorro et al., 2019, 2022; Purvis et al., 2000). The models are then used to predict the Red List categories of species that have not yet been assessed for theRedList(Darrahetal.,2017;Zizkaetal.,2021),thatareData Deficient(Bland&Böhm,2016; Luiz et al., 2016) or that need updating(DiMarcoetal.,2014; Lucas et al., 2023), with the objective of accelerating and helping to prioritise the work of Red List assessors by providing additional information on species' extinction risk. These comparative extinction risk models predict that Red List categories met under any of the five possible criteria (based on e.g. distribution, abundance, population trends), thus ignoring potential differencesintheirdrivingforces.This‘criterion-blind’approachassumes all criteria can be predicted from the same covariates, while in reality, the criteria address different sources of risk that are spatially structured (Figure S1), and some are likely easier to predict than others. For instance, predicting species threatened under criterion B1 (restricted extent of occurrence combined with some subcriteria) is relatively easy using range size, while it may be harder to find relevant covariates to predict species threatened under criterion A3(futurepopulationdecline).Thissuggeststhatspeciesclassified under different criteria might have different risk correlates and face different prediction uncertainties, which might have contributed to thelowperformanceofsomecriterion-blindmodelswhentestedon independentsamplesofspecies(DiMarco,2022).Insomecases,a covariate could even have opposite effects on different criteria. For instance, species with large body mass tend to have low population density (Santini et al., 2022;Silva&Downing,1995) and might be more likely to trigger criterion C1 (small population size and decline), butsuchspeciestendtohavelargeranges(Newsomeetal.,2020) hencearelesslikelytotriggercriterionB.Importantly,ignoringthe diversity of criteria limits the uptake of comparative extinction risk modelsbyassessors,whoneedcriteria-specificinformation(Cardillo & Meijaard, 2012; Cazalis et al., 2022). Here,weaimtoovercomethisresearch-implementationgapby developingcriterion-specificextinctionriskmodelsandcomparing theirperformanceandapplicabilitytoaclassiccriterion-blindmodel. While the latter estimates the probability of a species to be threatenedunderanycriterion,ourcriterion-specificmodelestimatessuch aprobabilityindependentlyforeachindividualcriterion(A1,A2,A3, etc).Whilebenefitingfromthepowerofthemulti-speciescomparisons, this approach better encompasses the diversity of reasons that mayqualifyaspeciesasthreatenedontheRedListandprovides assessors with an output that is directly related to the information needed for assessments. We use birds as a study group to test our approach as they are the most consistently assessed group across Red List criteria (Cazalis et al., 2022), with very few data deficient species (0.4%), they have been used in many previous comparative extinctionriskanalyses(e.g.Olahetal.,2018; Richards et al., 2021; White & Bennett, 2015), and they present great variation in their response to human pressure (Cazalis, 2022; Lees et al., 2022). 2 | METHODS We compiled data on avian biological traits associated with extinction risk (e.g. range size, clutch size) as well as external risk drivers operating within species ranges (e.g. change in forest canopy cover, distance to cities). We modelled the relationship between extinction risk predictors and each species' Red List category met under each specific criterion, using ordinal regression models that best match the ordinal structure of the Red List categories (Lucas et al., 2019, 2023; Luiz et al., 2016), and combined these models into a single final prediction. We then compared the performance of these criterion-specificmodelswithacriterion-blindapproach,aswellas new approach to increase the uptake of extinction risk models in Red List assessments,bridgingalong-standingresearch-implementationgap. KEYWORDS assessment,Aves,biodiversityconservation,birds,comparativeanalysis,extinctionrisk, functional traits 13652486, 2024, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/gcb.17119 by Universidad De Sevilla, Wiley Online Library on [31/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
| 3 of 13 HENRY et al. the importance of different predictors in each approach. Finally, we evaluatedthepotentialconservationapplicationsofthecriterion- specificapproach.AllanalyseswereconductedinRversion4.0.2(R Core Team, 2020). 2.1 | Extinction risk predictors For each of the 11,162 bird species included in the Red List version 2021-3(BirdLifeInternational,2022), we gathered information on species biological traits that are associated with extinction risk (e.g. Olahetal.,2018; Ripple et al., 2017; Tobias & Pigot, 2019), considering five types (see details and rationale in Table S1): morphological (bodymass,beaklength,hand-wingindex),behavioural(nocturnality, migratory status), life history traits (clutch size, generation length), ecological (trophic niche, forest dependency, habitat breadth) and geographical (insularity, range size). However, species' intrinsic traits alone cannot predict extinction risk (Chichorro et al., 2022; González-Suárezetal.,2013), and it is key to include measurements oftheimpactofhumanactivitieswithinthespecies'range(DiMarco et al., 2014; Murray et al., 2014). We thus also included proxies for habitat alteration and degradation (extent and change of cropland and forest cover), human encroachment (human density and trends, proportion of rural population, travel time to the nearest city) and past and contemporary climate change (difference in precipitation and temperature) within each species range (see details in Table S1). 2.1.1 | Speciestraitsandcharacteristics WeusedthedistributionmapspublishedinBirdLifeInternational and Handbook of the Birds of the World (2021), filtering polygons with a high probability of presence (‘extant’) and of ‘native’ origin during the breeding season (‘resident’ and ‘breeding season’), while removing polygons coded with other presence (e.g. extinct), origin (e.g. introduced, vagrant) and season (e.g. non-breeding, passage) attributes. As most of the available data on predictors of extinction risk are terrestrial, we removed marine species from our study (N = 365,asdefinedbyBirdLifeInternational). We calculated range size as the area of the filtered distribution maptransformedintoaMollweideequal-areaprojection.Inaddition, fourpredictorswereextractedfromBirdLifeInternational(2022): generation length, migratory status, forest dependency and habitat breadth (calculated as the number of major habitat types that are coded as suitable for each species). Morphological traits relating to beak length (from tip to nares), body mass and hand-wing index were extracted from AVONET (Tobias et al., 2022), alongside ecological information on trophic niches (aggregated into four classes: herbivore, omnivore, invertivore and carnivore; Table S1).Insularityandclutchsizewereobtained from Tobias and Pigot (2019), and information on the diurnal/ nocturnal activity of birds was obtained from Wilman et al. (2014). To address taxonomic mismatches, we matched all taxa to the taxonomyusedbyBirdLifeInternational,usingthesynonymtable from Tobias et al. (2022). The remaining 200 taxonomic mismatches were then corrected manually using the synonyms documented in BirdLifeInternational(2022).Atableofthesematchesisincludedin theExtendedDataS1 provided with this article. 2.1.2 | Extrinsicfactors Similarly to the range size calculation, we only considered breeding range when measuring extrinsic variables for consistency among migratory and resident species. We used a raster layer of percentagetreecanopycoverin2018andchangesincoverduring2000– 2018at300-mresolutionfromRemelgadoandMeyer(2023; using Landsat data to correct some biases in global forest cover maps). We extracted the median value of these predictors within the range ofeachspecies.Similarly,wecalculatedthemedianvalueofrange- wide cropland coverage (in 2019) and cropland changes from 2003 to 2019 obtained from Potapov et al. (2022). We also calculated the median human population density within each species' range, and the difference between median density in 2015 versus 2000 (Global Human Settlement [GHS]; Schiavina et al., 2019), used as a proxy for human direct pressure, although some species are well adapted to it (Cazalis et al., 2021). To account for the direct pressures that species can face in the rural environment (as defined by the GHS product), we also calculated the proportion of the human population living in rural areas within each species' range (Schiavina et al., 2019).Ashumanaccessibilitycanalsodetermine the level of disturbance to which species are exposed, we extracted data from the global map of travel time to cities (Weiss et al., 2018) and calculated the median value of pixels contained within each species' distribution. Finally, we extracted the countries of occurrence of each species from BirdLife International (2022) andcalculatedtheresultingmediangrossdomesticproduct(GDP) per capita from WorldBank data (Worldbank, 2021) as an index of human population development. Inordertoaccountforclimaticcorrelatesofrisk,weextracted the current value and difference between past and current valuesfortwovariablesfromtheCHELSAcrutsdatabaseversion1.0 (Karger et al., 2017;Karger&Zimmermann,2018), choosing mean annual temperature and annual precipitation for their relevance in influencing species' distributions and their ease of interpretation (Supplementary Methods S1). Using data from another study predicting Red List categories (Lucas et al., 2023), we calculated the average value of both bioclimatic variables over two periods based onCHELSAdata(Kargeretal.,2017):1965–1995,torepresentthe pastclimate,and2005–2014,torepresentthecurrentclimate.We then extracted the median value of each variable within the species' range at both periods. We finally calculated the difference between both time periods as a proxy of recent climate change experienced by the species within their geographic range. We extracted raster values within species' distribution polygons usingtheRpackage‘exactextractr’(Baston&ISciences,LLC,2022). 13652486, 2024, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/gcb.17119 by Universidad De Sevilla, Wiley Online Library on [31/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
4 of 13 | HENRY et al. Polygons were reprojected according to each raster's original coordinate system before extraction in order to minimise raster reprojection. Variables that followed a skewed distribution were log-transformed,andallnumericvariableswerescaled(Table S1). Weremoved1864speciesforwhichwecouldnotextractand calculate all predictors (mainly due to gaps for clutch size, insularity[1400speciesmissingdata]anddiurnality[1183speciesmissing data]),leavingafinaldatasetcomposedof8695species.Weensured that the absence of 20% of the data did not introduce any bias into the distribution of species within the Red List categories (Figure S3). 2.2 | IUCN Red List framework WeextractedfromBirdLifeInternational(2022) the Red List category assigned to each species under each criterion (see below), as well as the final listed category (Figure 1; see Figure S1 for spatial distribution of these criteria). For birds, generally all Red List criteria have been evaluated for all species (with the exception of criterion E, which is excludedfromourstudy).Forthreatenedbirdspecies(i.e.thosequalifying as Critically Endangered, Endangered and Vulnerable), all criteria thatqualifyaspeciesasthreatenedshouldbereportedinBirdLife International(2022), not just the one resulting in the highest risk category, although this may be omitted in some specific cases. However, thisisnotthecaseforspeciesqualifyingasNearThreatened(e.g.data are not available on whether a species classified as Endangered under B1qualifiesasNearThreatenedunderB2).Toaccountforthis,wefollowedtwoapproaches.Inthefirst,weclassifiedacriterionas‘missing data’ if not explicitly listed; the results presented in the main text, Figure 1 and Table S2correspondtothatassumption.Inthesecond, we assumed that the species was Least Concern under a criterion unlessitwasexplicitlylisted.Asaconsequence,allmodelswererunon thesamesetofspecies.Theseresultswerequalitativelyequivalent with those obtained from our original model (the performances of individualcriterion-specificmodelswereevenslightlypoorer;Table S4). This sensitivity analysis demonstrates the limited impact of sample size differences on our model outcomes. OnlythreespeciesqualifiedasthreatenedunderA1,hencethe criterion has been excluded from the analysis. 2.3 | Extinction risk modelling Wedevelopeda‘criterion-specific’modellingapproachinwhichwe fitted a separate model for each Red List criterion. Each criterion is thus considered independently, and the Red List category met under that criterion is contrasted with the same set of extinction predictors.Forcomparison,wealsofitteda‘criterion-blind’model,astypically done in comparative extinction risk analyses, using the single listed species' Red List category as the response variable. To investigate the relationship between species traits, extrinsic factors and extinction risk, we used cumulative link models (CLM, also known as ordinal regression models) from the R package ‘ordinal’ (Christensen, 2019), which allow preservation of the ordinal structure of the Red List categories (Lucas et al., 2019, 2023; Luiz et al., 2016). Moreover, CLMs have been demonstrated to be the best algorithms to deal with the ordinal structure of Red List categories when compared to other algorithms traditionally used in comparative models of extinction risk, such as Random Forest, Neural networks or Phylogenetic Generalised Linear Models (PGLS) (Lucas et al., 2023). CLM does not allow to include phylogenetic information in a way as PGLS does to account for potentialnon-independenceinspeciesextinctionrisk,butoverallCLM has demonstrated to predict significantly better than PGLS, possibly due to the necessity of PGLS to transform Red List categories into a binary or discrete variable, losing important information from the original ordinal variable (Lucas et al., 2023). We therefore considered the Red List category as an ordered categorical factor (LC < NT < VU < EN < CR;excludingallspecieswithcategoriesEX, EWandDD),useditastheresponsevariableandcontrastedthis with the predictors. Models varied from n = 7060forcriterionB2ton = 7702for criterionC2,withatotalof8695speciesincludedintheanalysis. We checked that predictors were not highly correlated (Pearson FIGURE 1 Proportionofthe8695bird species included in our analysis currently qualifyingineachRedListcategoryfor each criterion. CR, Critically Endangered; EN,Endangered;VU,Vulnerable;NT,Near Threatened; LC, Least Concern. ‘Missing’ appliestospeciesqualifyingasthreatened for which the given criterion is not explicitly listed. The number of species per criterion is given in Table S2. 13652486, 2024, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/gcb.17119 by Universidad De Sevilla, Wiley Online Library on [31/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
| 5 of 13 HENRY et al. correlationorKruskal-gammacoefficients > |0.70|;Figure S2). To adjust for unbalanced data (Figure 1), we calculated the proportion of threatened and not threatened species under each criterion and weighted our models by the proportion of species in theoppositecategory(i.e.specieswithcategoriesVU,ENorCR were weighted by the proportion of not threatened species, and specieswithcategoriesLCorNTwereweightedbytheproportionofthreatenedspecies).Abackwardstepwisemodelselection was performed using the step function from the R package ‘stats’ (R Core Team, 2020) in order to find the subset of variables that minimisetheAkaikeInformationCriterionforeachcriterion.The proportional odds assumption of a linear relationship was not always met, but this should not impact our results substantially (see Supplementary Methods S2). AsthenumberofspecieslistedinENandCRcategorieswasvery small for some criteria (Figure 1), we anticipated predicting specific categories could be challenging (Table S5); thus, for validation, we focused on a simplified prediction: whether a species was classified as threatened or not. We used a method of taxonomic block validation in which we iteratively excluded one taxonomic family from the data used to train the model and then used the model to predict the Red Listbinarythreatlevelofthespeciesintheleft-outfamily.Aspecies was predicted as threatened under a given criterion if the sum of the probabilitiestobeCR,ENandVUwas>0.5 and predicted as not threatened otherwise. We then compared the predictions with the actual Red List categorisation under that specific criterion (assuming that the current Red List category of each species is correct for each criterion). Specificity and sensitivity were defined, respectively, as thepercentageof notthreatenedspecies(LC, NT)correctly classifiedassuchandthepercentageofthreatenedspecies(VU,EN, CR)correctlyclassifiedassuch.FollowingRedListguidelines(IUCN Standards and Petitions Committee, 2022), we assigned a ‘combined’ categorytoeachspeciesbasedontheninecriterion-specificmodels asthehighestcategorypredictedamongmodels;consequently,a species was classified as not threatened only because it was not predictedasthreatenedinanyofthecriterion-specificmodels.Wealso report the models' performance in predicting the specific Red List category for each species (assigning to each species the category with the highest probability; Table S5). To measure and compare the overall performance of both modelling approaches, we used the True Skill Statistic (TSS), defined as: sensitivity + specificity − 1.TSStakesintoaccountbothomissionand commission errorsandrangesfrom −1to+1, where +1 indicates perfect agreement, values greater than 0.5 indicate a good performance and values of 0 (or less) indicate a performance no better (or worse)thanrandom(Alloucheetal.,2006). Finally, our models were employed to predict the most probable Red List category for all species, which was then transformed into a binary prediction (threatened/not threatened) and compared with the actual Red List category. The mismatches thus identified serve as flags for prioritising reassessments of a specific list of species, as classicallydoneincomparativeextinctionriskanalyses(DiMarco et al., 2014; Lucas et al., 2023). 3 | RESULTS 3.1 | Model performance Models' performance in predicting extinction risk greatly varies among criteria (Figure 2).ThemodelpredictingcriterionD2,related to population structure, had the highest TSS score (0.91), followed bycriteriaB1,D1,B2,C2andC1(0.88–0.69).Allthesemodelshad TSSscoreshigherthanthecriterion-blindapproach(0.61),meaning that models are better at predicting extinction risk for single criteria than for the overall categories. For most criteria, these high TSS scores were the result of both higher specificity and higher sensitivity (Figure 2).Conversely,modelspredictingcriteriaA2–A4,related to population declines, showed the lowest TSS scores among all criteria(0.52–0.59),andtheywereslightlylowerthanthecriterion- blind model. Following Red List guidelines, we assigned a ‘combined’ category to each species as the highest extinction risk category from any of thenineindividualcriterion-specificmodelsandfoundthatthissubstantially reduced the TSS (0.52) compared with applying the models individuallyforeachcriterion(averagemodelTSS = 0.72;Figure 2a). Thisislargelyduetolowerspecificitycomparedto thecriterion- blindapproach(0.68vs.0.83probabilityofcorrectlyclassifyinga not threatened species. Figure 2c; Table S2), this is partly explained because a species had to be classified as not threatened under each ofthenineappliedcriterion-explicitmodelsinordertofallinthis group overall. In contrast, using a criterion-specific approach resultedina0.84probabilityofcorrectlyclassifyingthreatenedspecies,comparedwith0.79forthecriterion-blindapproach(Figure 2b; Table S2). Considering ‘missing’ criterion-specific categories as LC (Table S4) or predicting at the category level rather than binarily contrasting threatened versus not threatened (Table S5) resulted in respectivelyequivalentorlowerperformances. 3.2 | Drivers of extinction risk Thecriterion-blindapproachshowedpositiverelationshipsbetween extinction risk and body mass, carnivore trophic niche, high forest dependency and cropland cover, while showing negative relationships with insularity, range size or percentage canopy cover (Figure 3). Someoftheserelationshipswerealsodetectedbycriteria-specific models. For instance, carnivorous species were generally associated with higher levels of extinction risk, while species with a larger range size or with distributions that had a high tree canopy coverage were less at risk on average. Incontrast,theimportanceandsignificanceofotherpredictors were idiosyncratic between criteria. For instance, body mass generally correlated positively with extinction risk for criteria related to rapidpopulationdeclinesorsmallpopulationsize(A2,A3,A4,C1, C2,D1),whileithadnoinfluenceoncriteriarelatedtorestricted geographic range (criteria B1, B2, D2). Conversely, high forest 13652486, 2024, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/gcb.17119 by Universidad De Sevilla, Wiley Online Library on [31/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
6 of 13 | HENRY et al. dependency was associated with increased extinction risk for criteria B1, B2 and C2, all relating to small population size, restricted area of occupancy and subpopulation structure, but did not, or slightly negatively, influence criteria based on rates of decline alone. Extrinsic factors were mainly important to predict criteria related topopulationreductions(A2,A3andA4);forinstance,changein annual temperature correlating positively with extinction risk for criteriaA2–A4andC2,andGDPpercapitacorrelatingpositivelywith criteriaA2–A4,B2andC1. 3.3 | Criterionspecific approach to prioritise reassessments The criterion-blind model predicts that 15% of species currently classified as not threatened (N = 1337)maybethreatened(Table 1), butthis percentage almostdoubled(to 28%,N = 2467) under the criterion-specificmodel.Conversely,wepredicted104threatened species as not threatened (199 with the criterion-blind model). Predictions for all models and all species are provided in Extended DataS2. 4 | DISCUSSION Inthisstudy,wedevelopedamodellingapproachthatpartitionsextinction risk according to individual Red List criteria and compared itwithacriterion-blindapproach.Onaverage,modellingindividual criteria performed better than the criterion-blind approach, with higherperformanceforsixcriteria(especiallycriteriaB1andD2), while three provided similar or marginally lower performance (criteria A2–A4). This result highlights that predicting extinction risk under some criteria may be intrinsically difficult, at least using the predictorsconsideredhere.Inparticular,criteriarelatedtopopulationtrends(especiallyA3relatedtofuturetrends)aremoredifficult to predict. With these models, we can enhance our understanding of the mechanisms underlying observed correlations and, ultimately, point to distinct drivers of risk. FIGURE 2 Comparisonofmodelperformances.Theleft-handsideofeachplotcomparestheperformanceofthecombinedcriterion- specificmodels(referredtoas‘CS’)withthatofthecriterion-blindapproachtocomparativeextinctionriskmodelling(referredtoas ‘CB’),whiletheright-handsidepresentstheperformanceofeachcriterion-specificmodel.(a)TrueSkillStatistic[−1,1];(b)sensitivity[0,1], proportionofthreatenedspeciescorrectlyclassified;(c)specificity[0,1],proportionofnotthreatenedspeciescorrectlyclassified.Dotted linesrepresentthemeanvalueobtainedfromthenineindependentcriteria-specificmodels. FIGURE 3 Heatmapofpredictorimportanceassociatedwithextinctionriskundereachcriterion.Rowsindicatepredictorsofextinction risk,andcolumnsrelatetocriterion-specificmodels.The‘CB’modeldescribesthecriterion-blindapproachtoextinctionriskmodelling. Colour indicates the sign (blue for negative and orange for positive), with darker tones indicating stronger relationships. Both positive and negativevaluesweredividedintofiveequalgroupsaccordingtotheintervals:−3.71,−0.97,−0.46,−0.27,−0.15and0fornegativeestimates and0,0.16,0.24,0.42,0.89and1.76forpositiveestimates(blanksindicatethatthepredictorhasnotbeenretainedintheoptimalmodel after predictor selection; see Section 2.3; estimates are detailed in Table S3).CLM,cumulativelinkmodels;GDP,grossdomesticproduct. 13652486, 2024, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/gcb.17119 by Universidad De Sevilla, Wiley Online Library on [31/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
| 7 of 13 HENRY et al. Combining the nine criteria-specific models to obtain a single prediction per species led to substantially greater sensitivity (i.e. more likely identification of threatened species as threatened, Figure 2b)butlowerspecificitythantheclassicalcriterion-blindapproach(see,forexample,Orange-frontedParakeetEupsittula canicularis in Figure 4a). Because one of the primary goals of automated 13652486, 2024, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/gcb.17119 by Universidad De Sevilla, Wiley Online Library on [31/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
8 of 13 | HENRY et al. extinction risk methods is to identify species likely to be at risk of extinction (but not currently recognised as such) to prioritise their reassessment (Cardillo & Meijaard, 2012), a model with high sensitivity will be more valuable than a model with similar TSS and higher specificity (Cazalis et al., 2022). Previous extinction risk models have typically predicted threatened species less accurately than not threatenedspecies(DiMarco,2022; Murray et al., 2014).Ourresults show that a reason behind this observation may be the omission of the diversity of reasons why a species is considered threatened on the Red List, which is represented by the multiple Red List criteria. However, combiningninecriterion-specificmodelsdecreasedthe overall specificity of the prediction (see, for example, Gray's Lark Ammomanopsis grayi in Figure 4b), resulting in an overestimation of the proportion of threatened species and a slightly lower TSS in comparisonwiththecriterion-blindapproach(Figure 2a). This result is explained by the fact that, following Red List guidelines, a species was classified as not threatened only if predicted as such by all ninecriterion-specificmodels.ThisiswellalignedwiththeRedList process and a precautionary approach, but it makes our approach sensitive to misclassification. Hence, increasing the specificity of criterion-specificmodelsisapriorityforthefuture.Possiblewaysof achieving this include improving the performance of the individual models with additional covariates (for example, relating to hunting/ trappingpressureforcriteriaA2–A4),accountingforsharedevolutionary history using phylogenetic models (Purvis, 2008) or developing an approach to combine individual models that accumulates fewer errors from individual models that misclassify a species as threatened under a given criterion. Inaccordancewithpreviousstudies,ourcriterion-blindmodel identified extinction risk as correlating positively with for example, body mass, carnivorous niche, high forest dependency and lower tree canopy cover, and negatively with for example, clutch size, range size and distance to cities (Gaston & Blackburn, 1995; Olahetal.,2018; Richards et al., 2021; Ripple et al., 2017; Tobias & Pigot, 2019; White & Bennett, 2015).Ourfindingshighlightthe importance of considering separately the multiple processes underlying patterns of extinction (Figure 3; Figure S1). They reveal that increases in annual temperature across species' ranges are of particular importance for criteria related to population decline (A2–A4,andtosomeextentC2),consistentlywiththepredicted role of climate change in driving declines in abundance and increasesinspecies'extinctionrisk(Şekercioğluetal.,2012; Mancini et al., 2023). Additionally,body massisof particularimportance for criteria related to population trends and population sizes (A1–A4,C1–C2,D1),suggestingthatspecieswithhighbodymass are more likely to be declining and to have small population sizes (Carvajal-Quinteroetal.,2023). The diversity of relationships between predictors and criteria, along with their ecological meaning, emphasises the importance of accounting for heterogeneity in the predictability of Red List criteria, rather than considering them as equallypredictableasassumedincriterion-blindcomparativeextinctionriskanalyses.Theyalsohighlightthatourcriterion-specific approach can help better understand the diverse mechanisms associated with extinction risk. Further, a better approximation of the causal relationships underlying species classification under different Red List categories can improve our ability to forecast status change based on changes in the drivers. By modelling criteria separately, we increase the applicability of comparative extinction risk models (Cazalis et al., 2022; Owens&Bennett,2000; Ripple et al., 2017). Red List assessors arerequiredtoassesseachspeciesagainstallcriteriaforwhich there is sufficient information (IUCN Standards and Petitions Committee, 2022). Therefore, while our models' outputs do not fundamentallychangethered-listingprocess,theyallowforvarious sources of information to be considered by assessors. As these models are contingent on the availability of life history and distributional data, their use for helping reassess data deficient species—for which these are often unavailable—is likely to be limited. We contend them to be most suited to help prioritise efforts to reassess threatened and non-threatened species for which underlying data are available and to identify knowledge gaps and opportunities for future research. For instance, the Least ConcernRufous-belliedChachalacaOrtalis wagleri (Figure 4c) is predictedtobethreatened(VU)byboththecriterion-blindand thecriterion-specificapproaches.However,whilethecriterion- blind model offers no additional insight, our criterion-specific approach provides assessors with relevant information about why this species might be VU—namely, that it might meet criteria A2,A3,A4,C1andC2.Assessorscouldusethisinformationto focus efforts on investigating past and future population trends to assess criteria A2–A4 and population size and structure to assess criteria C1 and C2, which could be complemented with the specific contributions of different covariates that led to this prediction.Ifthesedataarenotavailable,determiningvaluesfor these parameters may be considered a priority for fieldwork and research. Comparative extinction risk models have often been promoted as useful tools to provide a first prediction of extinction risk for IUCN Red List Prediction criterionblind Prediction criterionspecific Not threatened Threatened Not threatened Threatened Notthreatened 6380(73%) 1337 (15%) 5250 (60%) 2467(28%) Threatened 199 (2%) 779 (9%) 104 (1%) 874(10%) Note:Thepredictionforthecriterion-specificmethodcorrespondstothepredictionafter combining results from the nine individual criterion models. TABLE 1 RedListcategoryprediction ofcriterion-blindandcriterion-specific models compared with the current binarised category (Threatened for Vulnerable, Endangered and Critically Endangered;NotthreatenedforLeast Concern;andNearThreatened). 13652486, 2024, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/gcb.17119 by Universidad De Sevilla, Wiley Online Library on [31/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
| 9 of 13 HENRY et al. speciesnotyetincludedintheRedList(Darrahetal.,2017;Zizka, Andermann,etal.,2022;Zizka,Barratt,etal.,2022), for data deficientspecies(Bland&Böhm,2016; Borgelt et al., 2022; Cazalis et al., 2023; He et al., 2021; Luiz et al., 2016) or to prioritise reassessments(DiMarcoetal.,2014; Lucas et al., 2023). But so far, these have remained largely unmet promises, with hardly any uptake of these modelling approaches in the Red List (Cazalis et al., 2022). By focusing on reassessments and informing the assessors about the specificcriteriaunderwhichaspeciesislikelytoqualify,criterion- specific models could help accelerate the rate of Red List assessments, guide data collection efforts and facilitate the growth and update of the Red List so that it can best inform conservation FIGURE 4 Comparisonofoutputs forselectedspeciesfromacriterion- blindapproachandacriterion-specific approach to comparative extinction risk analysis. The three panels show different species, with their current categories in the Red List, the categories predicted by the models and the criteria triggered for thecriterion-specificapproach.Panel(a) shows a threatened species predicted as suchbythecriterion-specificapproach only;panel(b)showsanon-threatened speciespredictedassuchbythecriterion- blind approach only; and panel (c) shows anon-threatenedspeciespredicted as threatened by both approaches. IllustrationbyÀ.Jutglar,T.Worfolk. Source: © 2022 Cornell University. 13652486, 2024, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/gcb.17119 by Universidad De Sevilla, Wiley Online Library on [31/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License