Investigating the Intelligibility of Plural Counterfactual Examples for Non-Expert Users: an Explanation User Interface Proposition and User Study - Laboratoire des Usages en Technologies de l'Information Numérique
Communication Dans Un Congrès Année : 2023

Investigating the Intelligibility of Plural Counterfactual Examples for Non-Expert Users: an Explanation User Interface Proposition and User Study

Résumé

Plural counterfactual examples have been proposed to explain the prediction of a classifier by offering a user several instances of minimal modifications that may be performed to change the prediction. Yet, such explanations may provide too much information, generating potential confusion for the end-users with no specific knowledge, neither on the machine learning, nor on the application domains. In this paper, we investigate the design of explanation user interfaces for plural counterfactual examples offering comparative analysis features to mitigate this potential confusion and improve the intelligibility of such explanations for non-expert users. We propose an implementation of such an enhanced explanation user interface, illustrating it in a financial scenario related to a loan application. We then present the results of a lab user study conducted with 112 participants to evaluate the effectiveness of having plural examples and of offering comparative analysis principles, both on the objective understanding and satisfaction of such explanations. The results demonstrate the effectiveness of the plural condition, both on objective understanding and satisfaction scores, as compared to having a single counterfactual example. Beside the statistical analysis, we perform a thematic analysis of the participants' responses to the open-response questions, that also shows encouraging results for the comparative analysis features on the objective understanding. CCS CONCEPTS • Human-centered computing → User studies.
Fichier principal
Vignette du fichier
_ACM_IUI_2023__Paper_1450 (1).pdf (5.55 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04160341 , version 1 (06-11-2023)

Licence

Identifiants

Citer

Clara Bove, Marie-Jeanne Lesot, Charles Albert Tijus, Marcin Detyniecki. Investigating the Intelligibility of Plural Counterfactual Examples for Non-Expert Users: an Explanation User Interface Proposition and User Study. 28th Annual Conference on Intelligent User Interface, Mar 2023, Sydney, Australia. pp.188-203, ⟨10.1145/3581641.3584082⟩. ⟨hal-04160341⟩
117 Consultations
79 Téléchargements

Altmetric

Partager

More