Assessing artificial trust in human-agent teams

ACM International Conference on Intelligent Virtual Agents (IVA), pp. 1–3

Abstract

As intelligent agents are becoming human's teammates, not only do humans need to trust intelligent agents, but an intelligent agent should also be able to form artificial trust, i.e. a belief regarding human's trustworthiness. We see artificial trust as the beliefs of competence and willingness, and we study which internal factors (krypta) of the human may play a role when assessing artificial trust. Furthermore, we investigate which observable measures (manifesta) an agent may take into account as cues for the human teammate's krypta. This paper proposes a conceptual model of artificial trust for a specific task during human-agent teamwork. Our model proposes observable measures related to human trustworthiness (ability, benevolence, integrity) and strategy (perceived cost and benefit) as predictors for willingness and competence, based on literature and a preliminary user study.

Authors 3

1. Carolina Centeio Jorge

   Delft University of Technology

   Affiliation as printed

   Delft University of Technology, Delft, Netherlands

2. Myrthe Lotte Tielman

   Delft University of Technology

   Affiliation as printed

   Delft University of Technology, Delft, Netherlands

3. Catholijn M. Jonker Aachen Delft Univ. of Tech

   Leiden University · Delft University of Technology

   Affiliation as printed

   Delft Univ. of Tech., Delft & Leiden Univ., Leiden, Netherlands