Literature by the same author
plus at Google Scholar

Bibliografische Daten exportieren
 

Utilizing Data Fingerprints for Privacy-Preserving Algorithm Selection in Time Series Classification : Performance and Uncertainty Estimation on Unseen Datasets

Title data

Böcking, Lars ; Müller, Leopold ; Kühl, Niklas:
Utilizing Data Fingerprints for Privacy-Preserving Algorithm Selection in Time Series Classification : Performance and Uncertainty Estimation on Unseen Datasets.
In: Proceedings of the 58th Hawaii International Conference on System Sciences (HICSS). - Hawaii, USA , 2025

Official URL: Volltext

Abstract in another language

The selection of algorithms is a crucial step in designing AI services for real-world time series classification use cases. Traditional methods such as neural architecture search, automated machine learning, combined algorithm selection, and hyperparameter optimizations are effective but require considerable computational resources and necessitate access to all data points to run their optimizations. In this work, we introduce a novel data fingerprint that describes any time series classification dataset in a privacy-preserving manner and provides insight into the algorithm selection problem without requiring training on the (unseen) dataset. By decomposing the multi-target regression problem, only our data f ingerprints are used to estimate algorithm performance and uncertainty in a scalable and adaptable manner. Our approach is evaluated on the 112 University of California riverside benchmark datasets, demonstrating its effectiveness in predicting the performance of 35 state-of-the-art algorithms and providing valuable insights for effective algorithm selection in time series classification service systems, improving a naive baseline by 7.32% on average in estimating the mean performance and 15.81% in estimating the uncertainty.

Further data

Item Type: Article in a book
Refereed: Yes
Keywords: time series classification; performance estimation; quantification of model risk
Institutions of the University: Faculties > Faculty of Law, Business and Economics > Department of Business Administration
Research Institutions
Research Institutions > Affiliated Institutes
Research Institutions > Affiliated Institutes > Branch Business and Information Systems Engineering of Fraunhofer FIT
Research Institutions > Affiliated Institutes > FIM Research Center for Information Management
Result of work at the UBT: Yes
DDC Subjects: 000 Computer Science, information, general works > 004 Computer science
300 Social sciences > 330 Economics
Date Deposited: 30 Oct 2024 09:25
Last Modified: 30 Oct 2024 09:25
URI: https://eref.uni-bayreuth.de/id/eprint/90875