科學知識的攻守平衡：發表AI研究是否可以減少濫用？（CS Society）
- 2020 年 1 月 3 日
- 筆記
越來越多的人開始擔心可能人工智慧（AI）研究可能會被濫用。科學研究的發表導致對技術的濫用，但是也可以為防止濫用提供幫助。本文探討了這兩種影響之間的平衡。我們的理論框架闡明了研究發表是否對攻擊者或防禦者更具有用的因素，例如採取適當防禦措施的可能性，或科學界以外知識的獨立發現。平衡因科學領域而異。但是，我們表明，人工智慧內部的現有對話已從先前電腦安全性方面軟體漏洞的辯論中引入了概念和結論。雖然公開軟體漏洞通常有利於防禦，但AI研究無法假設這一點。人工智慧研究界應該從廣泛的相鄰領域考慮概念和政策，最終制定出適合其特定挑戰的政策。
原文題目：The Offense-Defense Balance of Scientific Knowledge: Does Publishing AI Research Reduce Misuse?
原文：There is growing concern over the potential misuse of artificial intelligence (AI) research. Publishing scientific research can facilitate misuse of the technology, but the research can also contribute to protections against misuse. This paper addresses the balance between these two effects. Our theoretical framework elucidates the factors governing whether the published research will be more useful for attackers or defenders, such as the possibility for adequate defensive measures, or the independent discovery of the knowledge outside of the scientific community. The balance will vary across scientific fields. However, we show that the existing conversation within AI has imported concepts and conclusions from prior debates within computer security over the disclosure of software vulnerabilities. While disclosure of software vulnerabilities often favours defence, this cannot be assumed for AI research. The AI research community should consider concepts and policies from a broad set of adjacent fields, and ultimately needs to craft policy well-suited to its particular challenges.
原文作者：Toby Shevlane,Allan Dafoe
原文地址：https://arxiv.org/abs/2001.00463
