bei Google ScholarTitelangaben
Schöffer, Jakob ; Jakubik, Johannes ; Vössing, Michael ; Kühl, Niklas ; Satzger, Gerhard:
On the Interdependence of Reliance Behavior and Accuracy in AI-Assisted Decision-Making.
In:
HHAI 2023: Augmenting Human Intellect : Proceedings of the Second International Conference on Hybrid Human-Artificial Intelligence. -
Amsterdam
: IOS Press
,
2023
. - S. 46-59
. - (Frontiers in Artificial Intelligence and Applications
; 368
)
ISBN 978-1-64368-394-2
DOI: https://doi.org/10.3233/FAIA230074
Abstract
In AI-assisted decision-making, a central promise of putting a human in the loop is that they should be able to complement the AI system by adhering to its correct and overriding its mistaken recommendations. In practice, however, we often see that humans tend to over- or under-rely on AI recommendations, meaning that they either adhere to wrong or override correct recommendations. Such reliance behavior is detrimental to decision-making accuracy. In this work, we articulate and analyze the interdependence between reliance behavior and accuracy in AI-assisted decision-making, which has been largely neglected in prior work. We also propose a visual framework to make this interdependence more tangible. This framework helps us interpret and compare empirical findings, as well as obtain a nuanced understanding of the effects of interventions (e.g., explanations) in AI-assisted decision-making. Finally, we infer several interesting properties from the framework: (i) when humans under-rely on AI recommendations, there may be no possibility for them to complement the AI in terms of decision-making accuracy; (ii) when humans cannot discern correct and wrong AI recommendations, no such improvement can be expected either; (iii) interventions may lead to an increase in decision-making accuracy that is solely driven by an increase in humans’ adherence to AI recommendations, without any ability to discern correct and wrong. Our work emphasizes the importance of measuring and reporting both effects on accuracy and reliance behavior when empirically assessing interventions.
Weitere Angaben
| Publikationsform: | Aufsatz in einem Buch |
|---|---|
| Begutachteter Beitrag: | Ja |
| Institutionen der Universität: | Fakultäten > Rechts- und Wirtschaftswissenschaftliche Fakultät > Fachgruppe Betriebswirtschaftslehre Fakultäten > Rechts- und Wirtschaftswissenschaftliche Fakultät > Fachgruppe Betriebswirtschaftslehre > Lehrstuhl Wirtschaftsinformatik > Lehrstuhl Wirtschaftsinformatik - Univ.-Prof. Dr.-Ing. Niklas Kühl Fakultäten Fakultäten > Rechts- und Wirtschaftswissenschaftliche Fakultät Fakultäten > Rechts- und Wirtschaftswissenschaftliche Fakultät > Fachgruppe Betriebswirtschaftslehre > Lehrstuhl Wirtschaftsinformatik |
| Titel an der UBT entstanden: | Ja |
| Themengebiete aus DDC: | 000 Informatik,Informationswissenschaft, allgemeine Werke > 004 Informatik 300 Sozialwissenschaften > 330 Wirtschaft |
| Eingestellt am: | 04 Mai 2023 11:37 |
| Letzte Änderung: | 22 Feb 2024 13:04 |
| URI: | https://eref.uni-bayreuth.de/id/eprint/76164 |