at Google ScholarTitle data
Schöffer, Jakob ; Jakubik, Johannes ; Vössing, Michael ; Kühl, Niklas ; Satzger, Gerhard:
On the Interdependence of Reliance Behavior and Accuracy in AI-Assisted Decision-Making.
In:
Hybrid Human Artificial Intelligence (HHAI2023). -
Heidelberg
,
2023
Abstract in another language
In AI-assisted decision-making, a central promise of putting a human in the loop is that they should
be able to complement the AI system by adhering to its correct and overriding its mistaken recommendations. In practice, however, we often see that humans tend to over- or under-rely on AI recommendations, meaning that they either adhere to wrong or override correct recommendations. Such
reliance behavior is detrimental to decision-making accuracy. In this work, we articulate and analyze
the interdependence between reliance behavior and accuracy in AI-assisted decision-making, which
has been largely neglected in prior work. We also propose a visual framework to make this interdependence more tangible. This framework helps us interpret and compare empirical findings, as well
as obtain a nuanced understanding of the effects of interventions (e.g., explanations) in AI-assisted
decision-making. Finally, we infer several interesting properties from the framework: (i) when
humans under-rely on AI recommendations, there may be no possibility for them to complement
the AI in terms of decision-making accuracy; (ii) when humans cannot discern correct and wrong
AI recommendations, no such improvement can be expected either; (iii) interventions may lead to
an increase in decision-making accuracy that is solely driven by an increase in humans’ adherence
to AI recommendations, without any ability to discern correct and wrong. Our work emphasizes
the importance of measuring and reporting both effects on accuracy and reliance behavior when
empirically assessing interventions.
Further data
| Item Type: | Article in a book |
|---|---|
| Refereed: | Yes |
| Institutions of the University: | Faculties > Faculty of Law, Business and Economics > Department of Business Administration Faculties > Faculty of Law, Business and Economics > Department of Business Administration > Chair Information Systems Management > Chair Information Systems Management - Univ.-Prof. Dr.-Ing. Niklas Kühl |
| Result of work at the UBT: | Yes |
| DDC Subjects: | 000 Computer Science, information, general works > 004 Computer science 300 Social sciences > 330 Economics |
| Date Deposited: | 04 May 2023 11:37 |
| Last Modified: | 04 May 2023 11:41 |
| URI: | https://eref.uni-bayreuth.de/id/eprint/76164 |