Title data
Böcking, Lars ; Müller, Leopold ; Kühl, Niklas:
Utilizing Data Fingerprints for Privacy-Preserving Algorithm Selection in Time Series Classification : Performance and Uncertainty Estimation on Unseen Datasets.
In:
Proceedings of the 58th Hawaii International Conference on System Sciences (HICSS). -
Hawaii, USA
,
2025
Abstract in another language
The selection of algorithms is a crucial step in designing AI services for real-world time series classification use cases. Traditional methods such as neural architecture search, automated machine learning, combined algorithm selection, and hyperparameter optimizations are effective but require considerable computational resources and necessitate access to all data points to run their optimizations. In this work, we introduce a novel data fingerprint that describes any time series classification dataset in a privacy-preserving manner and provides insight into the algorithm selection problem without requiring training on the (unseen) dataset. By decomposing the multi-target regression problem, only our data f ingerprints are used to estimate algorithm performance and uncertainty in a scalable and adaptable manner. Our approach is evaluated on the 112 University of California riverside benchmark datasets, demonstrating its effectiveness in predicting the performance of 35 state-of-the-art algorithms and providing valuable insights for effective algorithm selection in time series classification service systems, improving a naive baseline by 7.32% on average in estimating the mean performance and 15.81% in estimating the uncertainty.
Further data
Item Type: | Article in a book |
---|---|
Refereed: | Yes |
Keywords: | time series classification; performance estimation; quantification of model risk |
Institutions of the University: | Faculties > Faculty of Law, Business and Economics > Department of Business Administration Research Institutions Research Institutions > Affiliated Institutes Research Institutions > Affiliated Institutes > Branch Business and Information Systems Engineering of Fraunhofer FIT Research Institutions > Affiliated Institutes > FIM Research Center for Information Management |
Result of work at the UBT: | Yes |
DDC Subjects: | 000 Computer Science, information, general works > 004 Computer science 300 Social sciences > 330 Economics |
Date Deposited: | 30 Oct 2024 09:25 |
Last Modified: | 30 Oct 2024 09:25 |
URI: | https://eref.uni-bayreuth.de/id/eprint/90875 |