Abstract: Organizations increasingly deploy artificial intelligence to augment human decision-making in high-stakes domains, yet mounting evidence reveals that AI accuracy alone does not reliably translate into superior human-AI team outcomes. This article examines the critical but underexplored role of human mental models—specifically, users' understanding of when and where an AI system errs—in shaping the effectiveness of AI-advised decision-making. Drawing on foundational experimental research by Bansal, Nushi, Kamar, Lasecki, et al. (2019), the article unpacks three properties of AI systems and tasks—error boundary parsimony, stochasticity, and task dimensionality—that determine how readily humans learn to complement an AI teammate. Evidence-based organizational responses are presented, spanning system design, explainability strategy, update governance, and workforce development. The article concludes with forward-looking pillars for building durable human-AI collaboration capability, arguing that practitioners must optimize not only for what the AI gets right, but for how predictably humans can learn what it gets wrong.
Powered by the WRKdefined Podcast Network.
Sponsors
