论文标题

设计和评估以人为本的互动机器学习的简短指南

A Brief Guide to Designing and Evaluating Human-Centered Interactive Machine Learning

论文作者

Mathewson, Kory W., Pilarski, Patrick M.

论文摘要

交互式机器学习(IML)是一个研究领域,探讨了如何利用决策系统中的人类和计算能力。 IML代表了多个互补的人与机器智能系统之间的合作,每个系统都具有自己独特的能力和局限性。该团队合作可能意味着两个系统都同时或顺序采取行动。 IML领域的两个主要开放研究问题是:“我们应该如何设计能够随着时间的推移与人类互动做出更好决策的系统?”以及“我们应该如何评估此类系统的设计和部署?”缺乏对所涉及的人类的适当考虑会导致系统行为以及公平,问责制和透明度的问题。因此,这项工作的目标是介绍以人为本的指南设计和评估IML系统,同时降低风险。本指南旨在由负责互动人类的健康,安全和福祉的机器学习从业人员使用。公共互动责任的义务意味着以正直,诚实,公平和遵守适用的法律法规行事。考虑到这些价值观和原则,我们作为机器学习研究社区可以更好地实现增强人类技能和能力的目标。因此,该实用指南旨在支持IML系统的迭代设计,开发和传播中必要的许多负责任决策。

Interactive machine learning (IML) is a field of research that explores how to leverage both human and computational abilities in decision making systems. IML represents a collaboration between multiple complementary human and machine intelligent systems working as a team, each with their own unique abilities and limitations. This teamwork might mean that both systems take actions at the same time, or in sequence. Two major open research questions in the field of IML are: "How should we design systems that can learn to make better decisions over time with human interaction?" and "How should we evaluate the design and deployment of such systems?" A lack of appropriate consideration for the humans involved can lead to problematic system behaviour, and issues of fairness, accountability, and transparency. Thus, our goal with this work is to present a human-centred guide to designing and evaluating IML systems while mitigating risks. This guide is intended to be used by machine learning practitioners who are responsible for the health, safety, and well-being of interacting humans. An obligation of responsibility for public interaction means acting with integrity, honesty, fairness, and abiding by applicable legal statutes. With these values and principles in mind, we as a machine learning research community can better achieve goals of augmenting human skills and abilities. This practical guide therefore aims to support many of the responsible decisions necessary throughout the iterative design, development, and dissemination of IML systems.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源