{"id":1244,"date":"2018-07-27T04:40:16","date_gmt":"2018-07-27T04:40:16","guid":{"rendered":"http:\/\/163.180.4.222\/lab\/?p=1244"},"modified":"2019-10-15T19:19:56","modified_gmt":"2019-10-15T10:19:56","slug":"the-ethics-of-computer-science-this-researcher-has-a-controversial-proposal","status":"publish","type":"post","link":"https:\/\/biochemistry.khu.ac.kr\/lab\/?p=1244","title":{"rendered":"The ethics of computer science: this researcher has a controversial proposal"},"content":{"rendered":"

 <\/p>\n

 <\/p>\n

(\uc6d0\ubb38<\/a>)<\/p>\n

 <\/p>\n

 <\/p>\n

Nature talks to Brent Hecht, who says peer reviewers must ensure that researchers consider negative societal consequences of their work.<\/h6>\n

 <\/p>\n

 <\/p>\n

\n
\n
\"Multiple<\/div>\n<\/div>
\n

AI vehicle- and person-recognition software is at the centre of an ethical debate.\u00a0<\/span>Credit: Saul Loeb\/AFP\/Getty<\/p>\n<\/figcaption><\/figure>\n

 <\/p>\n

 <\/p>\n

In the midst of growing public concern over artificial intelligence (AI), privacy and the use of data,\u00a0Brent Hecht<\/a>\u00a0has a controversial proposal: the computer-science community should change its peer-review process to ensure that researchers disclose any possible negative societal consequences of their work in papers, or risk rejection.<\/p>\n

Hecht, a computer scientist, chairs the Future of Computing Academy (FCA), a group of young leaders in the field that\u00a0pitched the policy in March<\/a>. Without such measures, he says, computer scientists will blindly develop products without considering their impacts, and the field risks joining oil and tobacco as industries whose researchers history judges unfavourably.<\/p>\n

The FCA is part of the Association for Computing Machinery (ACM) in New York City, the world\u2019s largest scientific-computing society. It, too, is making changes to encourage researchers to consider societal impacts: on 17 July, it\u00a0published an updated version of its ethics code<\/a>, last redrafted in 1992. The guidelines call on researchers to be alert to how their work can influence society, take steps to protect privacy and continually reassess technologies whose impact will change over time, such as those based in machine learning.<\/p>\n

Hecht, who works at Northwestern University in Evanston, Illinois, spoke to\u00a0Nature<\/i>\u00a0about how his group\u2019s proposal might help.<\/p>\n

 <\/p>\n

 <\/p>\n

\n
\n
\"Brent<\/div>\n<\/div>
\n

Brent Hecht.\u00a0<\/span>Credit: Thomas Mildner<\/p>\n<\/figcaption><\/figure>\n

 <\/p>\n

 <\/p>\n

What does the peer-review proposal for computer scientists entail?<\/b><\/p>\n

It\u2019s pretty simple. When a peer reviewer is handed a paper for a journal or conference, they\u2019re asked to evaluate its intellectual rigour. And we say that this should include evaluating the intellectual rigour of the author\u2019s claims of impact. The idea is not to try to predict the future, but, on the basis of the literature, to identify the expected side effects or unintended uses of this technology. It doesn\u2019t sound that big, but because peer reviewers are the gatekeepers to all scholarly computer-science research, we\u2019re talking about how gatekeepers open the gate.<\/p>\n

And should publications reject a paper if the research has potentially negative impacts?<\/b><\/p>\n

No, we\u2019re not saying they should reject a paper with extensive negative impacts \u2014 just that all negative impacts should be disclosed. If authors don\u2019t do it, reviewers should write to them and say that, as a good scientist, they need to fully describe the possible outcomes before they will publish. For panels who decide on research funding, it\u2019s tougher and they might want to have different rules, and consider whether to fund a research proposal if there\u2019s a reasonable suspicion that it could hurt the country.<\/p>\n

What drove the Future of Computing Academy to make the proposal?<\/b><\/p>\n

In the past few years, there\u2019s been a sea-change in how the public views the real-world impacts of computer science, which doesn\u2019t align with how many in the computing community view our work. I\u2019ve been concerned about this since university. In my first ever AI class, we learned about how a system had been\u00a0developed to automate something<\/a>that had previously been a person\u2019s job. Everyone said, \u201cIsn\u2019t this amazing?\u201d \u2014 but I was concerned about who did these jobs. It stuck with me that no one else\u2019s ears perked up at the significant downside to this very cool invention. That scene has repeated itself over and over again throughout my career, whether that be how generative models \u2014 which create realistic audio and video from scratch \u2014 might threaten democracy, or the rapid decline in people\u2019s privacy.<\/p>\n

How did the field react to the proposal?<\/b><\/b><\/p>\n

A sizeable population in computer science thinks that this is not our problem. But while that perspective was common ten years ago, I hear it less and less these days. They more had an issue with the mechanism. A worry was that papers might be unfairly rejected because an author and reviewer might disagree over the idea of a negative impact. But we\u2019re moving towards a more iterative, dialogue-based process of review, and authors would need to cite rigorous reasons for their concerns, so I don\u2019t think that should be much of a worry. If a few papers get rejected and resubmitted six months later and, as a result, our field has an arc of innovation towards positive impact, then I\u2019m not too worried. Another critique was that it\u2019s so hard to predict impacts that we shouldn\u2019t even try. We all agree it\u2019s hard and that we\u2019re going to miss tonnes of them, but even if we catch just 1% or 5%, it\u2019s worth it.<\/p>\n

How can computer scientists go about predicting possible negative effects?<\/b><\/p>\n

Computer science has been sloppy about how it understands and communicates the impacts of its work, because we haven\u2019t been trained to think about these kinds of things. It\u2019s like a medical study that says, \u201cLook, we cured 1,000 people\u201d, but doesn\u2019t mention that it caused a new disease in 500 of them. But social scientists can really advance our understanding of how innovations impact the world, and we\u2019re going to need to engage with them to execute our proposal. There are some more difficult cases to consider \u2014 for instance, in the theory papers that are far from practice. We need to be saying, based on existing evidence, what is the confidence that a given innovation will have a side effect? And if it\u2019s above a certain threshold, we need to talk about it.<\/p>\n

What happens now? Are peer reviewers going to start doing this?<\/b><\/p>\n

We believe that in most cases, no changes are necessary for any peer reviewers to adopt our recommendations \u2014 it is already in their existing mandate to ensure intellectual rigour in all parts of the paper. It\u2019s just dramatically underused. So researchers can begin to implement it immediately. But a team from the FCA is also working on more top-down ways of getting reviewers across the field to adopt the proposal, and we hope to have an announcement on this front shortly.<\/p>\n

A lot of private technology companies do research that isn\u2019t published in academic outlets. How will you reach them?<\/b><\/p>\n

Then, the gatekeepers are the press, and it\u2019s up to them to ask what the negative impacts of the technology are. A couple of months after we released our post, Google came out with its AI principles for research, and we were really heartened to see that those principles echo a tonne of what we put in the post.<\/p>\n

If the peer-review policy only prompts authors to discuss negative consequences, how will it improve society?<\/b><\/p>\n

Disclosing negative impacts is not just an end in itself, but a public statement of new problems that need to be solved. We need to bend the incentives in computer science towards making the net impact of innovations positive. When we retire will we tell our grandchildren, like those in the oil and gas industry: \u201cWe were just developing products and doing what we were told\u201d? Or can we be the generation that finally took the reins on computing innovation and guided it towards positive impact?<\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

    (\uc6d0\ubb38)     Nature talks to Brent Hecht, who says peer reviewers must ensure that researchers consider negative societal consequences of their work.(more…)<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[32,35,29],"tags":[6,9,3],"class_list":["post-1244","post","type-post","status-publish","format-standard","hentry","category-essays-on-science","category-lets-do-computer-science","category-lets-do-science","tag-essays-on-science","tag-lets-do-computer-science","tag-lets-do-science"],"aioseo_notices":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":1432,"url":"https:\/\/biochemistry.khu.ac.kr\/lab\/?p=1432","url_meta":{"origin":1244,"position":0},"title":"An ethical way forward for AI","author":"biochemistry","date":"August 24, 2018","format":false,"excerpt":"\u00a0 \u00a0 (\uc6d0\ubb38: \uc5ec\uae30\ub97c \ud074\ub9ad\ud558\uc138\uc694~) \u00a0 Science\u00a0\u00a024 Aug 2018: Vol. 361, Issue 6404, pp. 763-765 DOI: 10.1126\/science.361.6404.763-q \u00a0 \u00a0 \u00a0 Artificial intelligence (AI) is becoming prevalent in everyday life. Within the next 5 years, an estimated 55% of households worldwide are expected to own a voice assistant. Furthermore, medical diagnostics,\u2026","rel":"","context":"In "Let's Do Computer Science!"","block_context":{"text":"Let's Do Computer Science!","link":"https:\/\/biochemistry.khu.ac.kr\/lab\/?cat=35"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1077,"url":"https:\/\/biochemistry.khu.ac.kr\/lab\/?p=1077","url_meta":{"origin":1244,"position":1},"title":"\uc624\ud508\uc18c\uc2a4 \uc18c\ud504\ud2b8\uc6e8\uc5b4\ub294 \uc65c \ub300\uc138\uac00 \ub410\ub098?","author":"biochemistry","date":"July 10, 2018","format":false,"excerpt":"\u00a0 \u00a0 (\uc6d0\ubb38: \uc5ec\uae30\ub97c \ud074\ub9ad\ud558\uc138\uc694~) \u00a0 \u00a0 \uacf5\uac1c\u00a0SW, \uc0c1\uc6a9\u00a0SW\u00a0\uac1c\ubc1c\uc758 \ud575\uc2ec...\uac1c\ubc1c \uae30\uac04 \ud68d\uae30\uc801\uc73c\ub85c \ub2e8\ucd95 \uacf5\uac1c\u00a0SW, \uae30\uc220\ud601\uc2e0 \uac00\uc18d\ud654...\ucd5c\uc2e0 \uae30\uc220 \ucd95\uc801 \uac00\ub2a5\ucf00 \ud558\uae30 \ub54c\ubb38 \uae30\uc5c5\ub4e4, \uacf5\uac1c\u00a0SW\u00a0\ud1b5\ud574 \uc790\uc0ac \uc800\ubcc0 \ud655\ub300...\uae30\uc220\ub825 \ud64d\ubcf4 \ud6a8\uacfc \uc788\uc5b4 \u00a0 \u00a0 \u200b \uad6c\uae00\uc740 2016\ub144 3\uc6d4 \ubc14\ub451 \uc778\uacf5\uc9c0\ub2a5 \ud504\ub85c\uadf8\ub7a8 '\uc54c\ud30c\uace0'\uc640 \uc774\uc138\ub3cc\uc758 \ub300\uad6d\uc744 \ud1b5\ud574 \uc138\uc0c1\uc744 \ub180\ub77c\uac8c \ud588\uc9c0\ub9cc, \uc774\ubbf8 \uadf8 \uc804\ud574\uc5d0 \ud2b9\ubcc4\ud55c \uc870\uce58\ub97c\u2026","rel":"","context":"In "Essays on Science"","block_context":{"text":"Essays on Science","link":"https:\/\/biochemistry.khu.ac.kr\/lab\/?cat=32"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":2991,"url":"https:\/\/biochemistry.khu.ac.kr\/lab\/?p=2991","url_meta":{"origin":1244,"position":2},"title":"AI for the M.D","author":"biochemistry","date":"March 29, 2019","format":false,"excerpt":"\u00a0 \u00a0 In 1970 in\u00a0The New England Journal of Medicine, William Schwartz predicted that by the year 2000, much of the intellectual function of medicine could be either taken over or at least substantially augmented by \u201cexpert systems\u201d\u2014a branch of artificial intelligence (AI). Schwartz hoped that the medical school curriculum\u2026","rel":"","context":"In "Essays on Science"","block_context":{"text":"Essays on Science","link":"https:\/\/biochemistry.khu.ac.kr\/lab\/?cat=32"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1369,"url":"https:\/\/biochemistry.khu.ac.kr\/lab\/?p=1369","url_meta":{"origin":1244,"position":3},"title":"India cracks down on plagiarism at universities","author":"biochemistry","date":"August 14, 2018","format":false,"excerpt":"\u00a0 \u00a0 (\uc6d0\ubb38) \u00a0 \u00a0 But some researchers say new rules don\u2019t go far enough. \u00a0 \u00a0 Researchers can be sacked for plagiarizing under the new rules.\u00a0Credit: Osmania Univ.\/Alamy \u00a0 \u00a0 India has for the first time introduced regulations to detect and punish acts of plagiarism at universities. Punishments for\u2026","rel":"","context":"In "Essays on Science"","block_context":{"text":"Essays on Science","link":"https:\/\/biochemistry.khu.ac.kr\/lab\/?cat=32"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":3094,"url":"https:\/\/biochemistry.khu.ac.kr\/lab\/?p=3094","url_meta":{"origin":1244,"position":4},"title":"\ube45\ub370\uc774\ud130\ub85c \ubc94\uc8c4 \uc608\uce21\u2026 \ud604\uc2e4\uc774 \ub41c ‘\ub9c8\uc774\ub108\ub9ac\ud2f0 \ub9ac\ud3ec\ud2b8’","author":"biochemistry","date":"March 31, 2019","format":false,"excerpt":"\u00a0 \u00a0 \uacfc\ud559 \uc774\uc57c\uae30 \uc601\ud654 \uc18d \uacfc\ud559 \uc5bc\uad74\u00b7\uc6b4\uc804\uc2b5\uad00\u00b7\uc778\ud130\ub137 \ud65c\ub3d9 \ub4f1 \ucca8\ub2e8 \ubcf4\uc548\uc2dc\uc2a4\ud15c\uc73c\ub85c \uac1c\uac1c\uc778 \uac10\uc2dc \uc911\uad6d\uc120 \uc774\ubbf8 \uad6c\ucd95\u2026\uad6d\ub0b4\ub3c4 \uac1c\ubc1c \u00a0 \u00a0 2054\ub144\uc758 \uc2dc\ubbfc\ub4e4\uc740 \ubc94\uc8c4\ub97c \ub450\ub824\uc6cc\ud558\uc9c0 \uc54a\ub294\ub2e4. \ubc94\uc778\uc774 \ub204\uad6c\uc778\uc9c0\ub294 \ubb3c\ub860 \uc0ac\uac74\uc774 \uc77c\uc5b4\ub0a0 \uc2dc\uac04\uacfc \uc7a5\uc18c\uae4c\uc9c0 \uc608\uce21\ud558\ub294 \u2018\ud504\ub9ac \ud06c\ub77c\uc784\u2019 \ub355\ubd84\uc774\ub2e4. \ubb38\uc81c \uc778\ubb3c\ub4e4\uc744 \uc0ac\uc804\uc5d0 \uac78\ub7ec\ub0b4\ub294 \uac8c \uc774 \uc2dc\uc2a4\ud15c\uc758 \ud2b9\uc9d5\uc774\ub2e4. \ud1b0 \ud06c\ub8e8\uc988 \uc8fc\uc5f0\uc758 \uc601\ud654 \u2018\ub9c8\uc774\ub108\ub9ac\ud2f0 \ub9ac\ud3ec\ud2b8\u2019\uc5d0\u2026","rel":"","context":"In "Essays on Science"","block_context":{"text":"Essays on Science","link":"https:\/\/biochemistry.khu.ac.kr\/lab\/?cat=32"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1512,"url":"https:\/\/biochemistry.khu.ac.kr\/lab\/?p=1512","url_meta":{"origin":1244,"position":5},"title":"EBS \ub274\uc2a4 – \uc2e4\ud328\ub97c \uc5f0\uad6c\ud558\ub294 \uc774\uc720(\uc720\ud29c\ube0c)","author":"biochemistry","date":"September 1, 2018","format":false,"excerpt":"\u00a0 https:\/\/www.youtube.com\/watch?reload=9&v=OnPV18QE_2M \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0","rel":"","context":"In "Essays on Science"","block_context":{"text":"Essays on Science","link":"https:\/\/biochemistry.khu.ac.kr\/lab\/?cat=32"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/img.youtube.com\/vi\/OnPV18QE_2M\/0.jpg?resize=350%2C200","width":350,"height":200},"classes":[]}],"jetpack_sharing_enabled":false,"jetpack_shortlink":"https:\/\/wp.me\/p9Xo1j-k4","_links":{"self":[{"href":"https:\/\/biochemistry.khu.ac.kr\/lab\/index.php?rest_route=\/wp\/v2\/posts\/1244","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/biochemistry.khu.ac.kr\/lab\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/biochemistry.khu.ac.kr\/lab\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/biochemistry.khu.ac.kr\/lab\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/biochemistry.khu.ac.kr\/lab\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1244"}],"version-history":[{"count":1,"href":"https:\/\/biochemistry.khu.ac.kr\/lab\/index.php?rest_route=\/wp\/v2\/posts\/1244\/revisions"}],"predecessor-version":[{"id":4411,"href":"https:\/\/biochemistry.khu.ac.kr\/lab\/index.php?rest_route=\/wp\/v2\/posts\/1244\/revisions\/4411"}],"wp:attachment":[{"href":"https:\/\/biochemistry.khu.ac.kr\/lab\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1244"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/biochemistry.khu.ac.kr\/lab\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1244"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/biochemistry.khu.ac.kr\/lab\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1244"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}