跳到正文
原文
OpenAI News·· 2017-06-13AI 评分28

OpenAI 与 DeepMind 合作开发基于人类偏好学习的安全 AI 算法

Learning from human preferences

AI 导读

OpenAI 联合 DeepMind 安全团队推出一种新算法,通过让模型判断两种行为中哪个更优来推断人类意图。该方法旨在消除人工编写目标函数的需求,避免因使用简单代理或目标定义偏差导致的不安全行为,是构建安全 AI 系统的重要一步。

原文

One step towards building safe AI systems is to remove the need for humans to write goal functions, since using a simple proxy for a complex goal, or getting the complex goal a bit wrong, can lead to undesirable and even dangerous behavior. In collaboration with DeepMind’s safety team, we’ve developed an algorithm which can infer what humans want by being told which of two proposed behaviors is better.

来源:OpenAI News · openai.com