It will be taught using a combination of live (synchronous) sessions on Zoom and Slack.
The live sessions will be recorded and available to the participants for a limited period of time. However, attendance at the live sessions is required.
Species distribution models are commonly evaluated with metrics such as the area under the receiver operating characteristic (ROC) curve (AUC), the true skill statistic (TSS), Cohen’s kappa, sensitivity, specificity, or the overall classification accuracy or correct classification rate.
These metrics assess discrimination and/or classification capacity, i.e., the ability of the model to distinguish and classify localities with and without presence records. However, this is only one limited aspect of model performance. Other aspects, such as calibration or reliability (i.e., how predicted presence probabilities relate to observed occurrence frequencies), are also very important, albeit often overlooked, aspects of model performance. In addition, common discrimination metrics are often deceivingly high for rare species and naturally lower for generalist species, which do not clearly discriminate “good” from “bad” habitat.
Model quality should thus be assessed with a comprehensive set of evaluation measures, appropriate for species with different ecological and biogeographical traits.
In this short course, we will use R to compute a wide range of model evaluation metrics, encompassing discrimination, classification, explanatory power and calibration. We will also see different ways to validate models outside their training area, including spatial block cross-validation.
he course will be highly interactive and will include both theoretical and practical sessions. Participants are encouraged to bring their own models with observed and predicted values, though they can also work with example models that will be provided
Participants should have previous basic experience with R, a computer (Linux, Windows or MacOS) preferably with a webcam, and a good internet connection. A recent version of R will be needed, and RStudio is also recommended.