A presentation by Prof. Merijn Bruijnes (Utrecht University). This event is part of the Digital Governance Research Colloquium hosted by the Centre for Digital Governance.
Police officers increasingly rely on AI recommendations in their decision-making processes. This event delves into the potential and challenges of AI in law enforcement, focusing on the role of Explainable AI (XAI) on appropriate reliance, where appropriate is neither stubbornly rejecting, nor complacently accepting AI recommendations. We will discuss recent XAI research findings and their implications for law enforcement, contrasting the limitations of both generalistic human-centred lab studies and application-grounded studies. Also, we will explore how XAI can impact the law enforcement environment, drawing from organisational and sociological literature, and from empirical examples from their research at the Netherlands Police Lab for Artificial Intelligence. These insights show that XAI is no silver bullet towards appropriate reliance but-when designed well-it is one of the factors in the context of a decision that pushes or pulls a person towards appropriate reliance. Ideally, XAI provides considerations to decide to follow, reject, or cross-check an AI’s recommendation. The talk proposes a contextual model to understand when and how XAI, along with other contextual factors, can facilitate appropriate reliance on AI recommendations in specific organisational settings.
Prof. Merijn Bruijnes is an assistant professor at Utrecht University School of Governance in the Netherlands. He is an interdisciplinary scholar who combines experience and knowledge from psychology, computer science and governance to study current societal technical challenges and pragmatically design solutions. Merijn is active in efforts towards good scientific practices such as leading the Open Science Foundation workgroup towards creating an Artificial Social Agent Evaluation Instrument. His interdisciplinary work has a wide audience with contributions to various international conferences from different scientific fields and publications in top-ranked journals such as Nature Scientific Report. His current research focuses on the responsible development and use of artificial intelligence by governmental organisations such as the police. He calls his current research line ‘AI for good’.
