Literatur vom gleichen Autor/der gleichen Autor*in
plus bei Google Scholar

Bibliografische Daten exportieren
 

Sample Size Planning for Classification Models

Titelangaben

Beleites, Claudia ; Neugebauer, Ute ; Bocklitz, Thomas ; Krafft, Christoph ; Popp, Jürgen:
Sample Size Planning for Classification Models.
In: Analytica Chimica Acta. Bd. 760 (2013) . - S. 25-33.
ISSN 1873-4324
DOI: https://doi.org/10.1016/j.aca.2012.11.007

Volltext

Link zum Volltext (externe URL): Volltext

Abstract

In biospectroscopy, suitably annotated and statistically independent samples (e.g. patients, batches, etc.) for classifier training and testing are scarce and costly. Learning curves show the model performance as function of the training sample size and can help to determine the sample size needed to train good classifiers. However, building a good model is actually not enough: the performance must also be proven. We discuss learning curves for typical small sample size situations with 5–25 independent samples per class. Although the classification models achieve acceptable performance, the learning curve can be completely masked by the random testing uncertainty due to the equally limited test sample size. In consequence, we determine test sample sizes necessary to achieve reasonable precision in the validation and find that 75–100 samples will usually be needed to test a good but not perfect classifier. Such a data set will then allow refined sample size planning on the basis of the achieved performance. We also demonstrate how to calculate necessary sample sizes in order to show the superiority of one classifier over another: this often requires hundreds of statistically independent test samples or is even theoretically impossible. We demonstrate our findings with a data set of ca. 2550 Raman spectra of single cells (five classes: erythrocytes, leukocytes and three tumour cell lines BT-20, MCF-7 and OCI-AML3) as well as by an extensive simulation that allows precise determination of the actual performance of the models in question.

Weitere Angaben

Publikationsform: Artikel in einer Zeitschrift
Begutachteter Beitrag: Ja
Keywords: Small sample size; Design of experiments; Multivariate; Learning curve; Classification; Training; Validation
Institutionen der Universität: Fakultäten > Fakultät für Mathematik, Physik und Informatik > Institut für Informatik > Lehrstuhl Künstliche Intelligenz in der Mikroskopie und Spektroskopie > Lehrstuhl Künstliche Intelligenz in der Mikroskopie und Spektroskopie - Univ.-Prof. Dr. Thomas Wilhelm Bocklitz
Titel an der UBT entstanden: Nein
Themengebiete aus DDC: 500 Naturwissenschaften und Mathematik > 530 Physik
Eingestellt am: 22 Mai 2023 12:37
Letzte Änderung: 22 Mai 2023 12:37
URI: https://eref.uni-bayreuth.de/id/eprint/76273