Titlebar

Export bibliographic data
Literature by the same author
plus on the publication server
plus at Google Scholar

 

The Human in the Infinite Loop : A Case Study on Revealing and Explaining Human-AI Interaction Loop Failures

Title data

Ou, Changkun ; Buschek, Daniel ; Mayer, Sven ; Butz, Andreas:
The Human in the Infinite Loop : A Case Study on Revealing and Explaining Human-AI Interaction Loop Failures.
In: Mensch und Computer 2022 : Tagungsband. - New York : ACM , 2022 . - pp. 1-16
DOI: https://doi.org/10.1145/3543758.3543761

Related URLs

Project information

Project title:
Project's official titleProject's id
AI Tools - Continuous Interaction with Computational Intelligence ToolsNo information

Project financing: Bayerisches Staatsministerium für Wissenschaft, Forschung und Kunst

Abstract in another language

Interactive AI systems increasingly employ a human-in-the-loop strategy. This creates new challenges for the HCI community when designing such systems. We reveal and investigate some of these challenges in a case study with an industry partner, and developed a prototype human-in-the-loop system for preference-guided 3D model processing. Two 3D artists used it in their daily work for 3 months. We found that the human-AI loop often did not converge towards a satisfactory result and designed a lab study (N=20) to investigate this further. We analyze interaction data and user feedback through the lens of theories of human judgment to explain the observed human-in-the-loop failures with two key insights: 1) optimization using preferential choices lacks mechanisms to deal with inconsistent and contradictory human judgments; 2) machine outcomes, in turn, influence future user inputs via heuristic biases and loss aversion. To mitigate these problems, we propose descriptive UI design guidelines. Our case study draws attention to challenging and practically relevant imperfections in human-AI loops that need to be considered when designing human-in-the-loop systems.

Further data

Item Type: Article in a book
Refereed: Yes
Keywords: human-in-the-loop machine learning; adaptive human-computer interaction; human error
Institutions of the University: Faculties > Faculty of Mathematics, Physics und Computer Science > Department of Computer Science
Faculties
Faculties > Faculty of Mathematics, Physics und Computer Science
Result of work at the UBT: Yes
DDC Subjects: 000 Computer Science, information, general works > 004 Computer science
Date Deposited: 12 Aug 2022 05:58
Last Modified: 12 Aug 2022 05:58
URI: https://eref.uni-bayreuth.de/id/eprint/71448