Literature by the same author
plus at Google Scholar

Bibliografische Daten exportieren
 

The Interdependence of Reliance Behavior and Accuracy in AI-Assisted Decision-Making

Title data

Schoeffer, Jakob ; Jakubik, Johannes ; Vössing, Michael ; Kühl, Niklas ; Satzger, Gerhard:
The Interdependence of Reliance Behavior and Accuracy in AI-Assisted Decision-Making.
In: Journal of Artificial Intelligence Research. (September 2024) .
ISSN 1943-5037

Abstract in another language

In AI-assisted decision-making, a central promise of putting a human in the loop is that
they should be able to complement the AI system by adhering to its correct and overriding
its mistaken recommendations. In practice, however, we often see that humans tend to over-
or under-rely on AI recommendations, meaning that they either adhere to wrong or over-
ride correct recommendations. Such reliance behavior is detrimental to decision-making
accuracy. In this work, we articulate and analyze the interdependence between reliance
behavior and accuracy in AI-assisted decision-making, which has been largely neglected
in prior work. We also propose a visual framework to make this interdependence more
tangible. We apply the framework to interpret and deepen the understanding of existing
empirical findings, as well as obtain a nuanced understanding of the effects of interventions (e.g., explanations) in AI-assisted decision-making. Finally, we infer several interesting properties from the framework: (i) when humans under-rely on AI recommendations,
there may be no possibility for them to complement the AI in terms of decision-making
accuracy; (ii) when humans cannot discern correct and wrong AI recommendations, no
such improvement can be expected either; (iii) interventions may lead to an increase in
decision-making accuracy that is solely driven by an increase in humans’ adherence to AI
recommendations, without any ability to discern correct and wrong. Our work emphasizes
the importance of measuring and reporting both effects on accuracy and reliance behavior
when empirically assessing interventions.

Further data

Item Type: Article in a journal
Refereed: Yes
Institutions of the University: Faculties > Faculty of Law, Business and Economics > Department of Business Administration
Faculties > Faculty of Law, Business and Economics > Department of Business Administration > Chair Business Informatics and Human-Centered Artificial Intelligence > Chair Business Informatics and Human-Centered Artificial Intelligence - Univ.-Prof. Dr.-Ing. Niklas Kühl
Result of work at the UBT: Yes
DDC Subjects: 000 Computer Science, information, general works > 004 Computer science
300 Social sciences > 330 Economics
Date Deposited: 03 Jul 2024 09:05
Last Modified: 03 Jul 2024 09:05
URI: https://eref.uni-bayreuth.de/id/eprint/89886