CAMBRIDGE, Mass. — Computer scientists who helped build the foundations of today’s artificial intelligence technology are warning of its dangers, but that doesn’t mean they agree on what those dangers are or how to prevent them.
Humanity’s survival is threatened when “smart things can outsmart us,” so-called Godfather of AI Geoffrey Hinton said at a conference Wednesday at the Massachusetts Institute of Technology.
“It may keep us around for a while to keep the power stations running,” Hinton said. “But after that, maybe not.”
kAmp7E6C C6E:C:?8 7C@> v@@8=6 D@ 96 4@F=5 DA62< >@C6 7C66=J[ E96 fd\J62C\@=5 w:?E@? D2:5 96’D C646?E=J 492?865 9:D G:6HD 23@FE E96 C62D@?:?8 42A23:=:E:6D @7 E96 4@>AFE6C DJDE6>D 96’D DA6?E 2 =:76E:>6 C6D62C49:?8]k^Am
kAm“%96D6 E9:?8D H:== 92G6 =62C?65 7C@> FD[ 3J C625:?8 2== E96 ?@G6=D E92E 6G6C H6C6 2?5 6G6CJE9:?8 |249:2G6==: 6G6C HC@E6[ 9@H E@ >2?:AF=2E6 A6@A=6[” w:?E@? D2:5[ 255C6DD:?8 E96 4C@H5 2EE6?5:?8 |x% %649?@=@8J #6G:6H’D t>%649 s:8:E2= 4@?76C6?46 7C@> 9:D 9@>6 G:2 G:56@] “tG6? :7 E96J 42?’E 5:C64E=J AF== =6G6CD[ E96J 42? 46CE2:?=J 86E FD E@ AF== =6G6CD]”k^Am
kAm“x H:D9 x 925 2 ?:46 D:>A=6 D@=FE:@? x 4@F=5 AFD9[ 3FE x 5@?’E[” 96 25565] “x’> ?@E DFC6 E96C6 :D 2 D@=FE:@?]”k^Am
kAmu6==@H px A:@?66C *@D9F2 q6?8:@[ 4@\H:??6C H:E9 w:?E@? @7 E96 E@A 4@>AFE6C D4:6?46 AC:K6[ E@=5 %96 pDD@4:2E65 !C6DD @? (65?6D52J E92E 96’D “AC6EEJ >F49 2=:8?65” H:E9 w:?E@?’D 4@?46C?D 3C@F89E @? 3J 492E3@ED DF49 2D r92Ev!% 2?5 C6=2E65 E649?@=@8J[ 3FE H@CC:6D E92E E@ D:>A=J D2J “(6’C6 5@@>65” :D ?@E 8@:?8 E@ 96=A]k^Am
kAm“%96 >2:? 5:776C6?46[ x H@F=5 D2J[ :D 96’D <:?5 @7 2 A6DD:>:DE:4 A6CD@?[ 2?5 x’> >@C6 @? E96 @AE:>:DE:4 D:56[” D2:5 q6?8:@[ 2 AC@76DD@C 2E E96 &?:G6CD:EJ @7 |@?EC62=] “x 5@ E9:?< E92E E96 52?86CD — E96 D9@CE\E6C> @?6D[ E96 =@?8\E6C> @?6D — 2C6 G6CJ D6C:@FD 2?5 ?665 E@ 36 E2<6? D6C:@FD=J 3J ?@E ;FDE 2 76H C6D62C496CD 3FE 8@G6C?>6?ED 2?5 E96 A@AF=2E:@?]”k^Am
kAm%96C6 2C6 A=6?EJ @7 D:8?D E92E 8@G6C?>6?ED 2C6 =:DE6?:?8] %96 (9:E6 w@FD6 92D 42==65 :? E96 rt~D @7 v@@8=6[ |:4C@D@7E 2?5 r92Ev!%\>2<6C ~A6?px E@ >66E %9FCD52J H:E9 ':46 !C6D:56?E z2>2=2 w2CC:D :? H92E’D 36:?8 56D4C:365 3J @77:4:2=D 2D 2 7C2?< 5:D4FDD:@? @? 9@H E@ >:E:82E6 3@E9 E96 ?62C\E6C> 2?5 =@?8\E6C> C:D<D @7 E96:C E649?@=@8J] tFC@A62? =2H>2<6CD 2C6 2=D@ 2446=6C2E:?8 ?68@E:2E:@?D E@ A2DD DH66A:?8 ?6H px CF=6D]k^Am
kAmqFE 2== E96 E2=< @7 E96 >@DE 5:C6 7FEFC6 52?86CD 92D D@>6 H@CC:65 E92E 9JA6 2C@F?5 DFA6C9F>2? >249:?6D — H9:49 5@?’E 6I:DE — :D 5:DEC24E:?8 7C@> 2EE6>AED E@ D6E AC24E:42= D2768F2C5D @? 4FCC6?E px AC@5F4ED E92E 2C6 =2C86=J F?C68F=2E65 2?5 92G6 366? D9@H? E@ 42FD6 C62=\H@C=5 92C>D]k^Am
kAm|2C82C6E |:E496==[ 2 7@C>6C =6256C @? v@@8=6’D px 6E9:4D E62>[ D2:5 D96’D FAD6E E92E w:?E@? 5:5?’E DA62< @FE 5FC:?8 9:D 564256 :? 2 A@D:E:@? @7 A@H6C 2E v@@8=6[ 6DA64:2==J 27E6C E96 a_a_ @FDE6C @7 AC@>:?6?E q=24< D4:6?E:DE %:>?:E v63CF[ H9@ 925 DEF5:65 E96 92C>D @7 =2C86 =2?8F286 >@56=D 367@C6 E96J H6C6 H:56=J 4@>>6C4:2=:K65 :?E@ AC@5F4ED DF49 2D r92Ev!% 2?5 v@@8=6’D q2C5]k^Am
kAm“xE’D 2 AC:G:=686 E92E 96 86ED E@ ;F>A 7C@> E96 C62=:E:6D @7 E96 AC@A282E:@? @7 5:D4C:>:?2E:@? ?@H[ E96 AC@A282E:@? @7 92E6 =2?8F286[ E96 E@I:4:EJ 2?5 ?@?4@?D6?DF2= A@C?@8C2A9J @7 H@>6?[ 2== @7 E96D6 :DDF6D E92E 2C6 24E:G6=J 92C>:?8 A6@A=6 H9@ 2C6 >2C8:?2=:K65 :? E649[” D2:5 |:E496==[ H9@ H2D 2=D@ 7@C465 @FE @7 v@@8=6 :? E96 27E6C>2E9 @7 v63CF’D 56A2CEFC6] “w6’D D<:AA:?8 @G6C 2== @7 E9@D6 E9:?8D E@ H@CCJ 23@FE D@>6E9:?8 72CE96C @77]”k^Am
kAmq6?8:@[ w:?E@? 2?5 2 E9:C5 C6D62C496C[ *2?? {6rF?[ H9@ H@C<D 2E u2463@@< A2C6?E |6E2[ H6C6 2== 2H2C565 E96 %FC:?8 !C:K6 :? a_`h 7@C E96:C 3C62<E9C@F89D :? E96 7:6=5 @7 2CE:7:4:2= ?6FC2= ?6EH@C<D[ :?DECF>6?E2= E@ E96 56G6=@A>6?E @7 E@52J’D px 2AA=:42E:@?D DF49 2D r92Ev!%]k^Am
kAmq6?8:@[ E96 @?=J @?6 @7 E96 E9C66 H9@ 5:5?’E E2<6 2 ;@3 H:E9 2 E649 8:2?E[ 92D G@:465 4@?46C?D 7@C J62CD 23@FE ?62C\E6C> px C:D<D[ :?4=F5:?8 ;@3 >2C<6E 56DE23:=:K2E:@?[ 2FE@>2E65 H62A@?CJ 2?5 E96 52?86CD @7 3:2D65 52E2 D6ED]k^Am
kAmqFE E9@D6 4@?46C?D 92G6 8C@H? C646?E=J[ =625:?8 q6?8:@ E@ ;@:? @E96C 4@>AFE6C D4:6?E:DED 2?5 E649 3FD:?6DD =6256CD =:<6 t=@? |FD< 2?5 pAA=6 4@\7@F?56C $E6G6 (@K?:2< :? 42==:?8 7@C 2 D:I\>@?E9 A2FD6 @? 56G6=@A:?8 px DJDE6>D >@C6 A@H6C7F= E92? ~A6?px’D =2E6DE >@56=[ v!%\c]k^Am
kAmq6?8:@ D2:5 (65?6D52J 96 36=:6G6D E96 =2E6DE px =2?8F286 >@56=D 2=C625J A2DD E96 “%FC:?8 E6DE” ?2>65 27E6C qC:E:D9 4@563C62<6C 2?5 px A:@?66C p=2? %FC:?8’D >6E9@5 :?EC@5F465 :? `hd_ E@ >62DFC6 H96? px 364@>6D :?5:DE:?8F:D923=6 7C@> 2 9F>2? — 2E =62DE @? E96 DFC7246]k^Am
kAm“%92E’D 2 >:=6DE@?6 E92E 42? 92G6 5C2DE:4 4@?D6BF6?46D :7 H6’C6 ?@E 42C67F=[” q6?8:@ D2:5] “|J >2:? 4@?46C? :D 9@H E96J 42? 36 6IA=@:E65 7@C ?672C:@FD AFCA@D6D E@ 56DE23:=:K6 56>@4C24:6D[ 7@C 4J36C2EE24<D[ 5:D:?7@C>2E:@?] *@F 42? 92G6 2 4@?G6CD2E:@? H:E9 E96D6 DJDE6>D 2?5 E9:?< E92E J@F’C6 :?E6C24E:?8 H:E9 2 9F>2?] %96J’C6 5:77:4F=E E@ DA@E]”k^Am
kAm(96C6 C6D62C496CD 2C6 =6DD =:<6=J E@ 28C66 :D @? 9@H 4FCC6?E px =2?8F286 DJDE6>D — H9:49 92G6 >2?J =:>:E2E:@?D[ :?4=F5:?8 2 E6?56?4J E@ 723C:42E6 :?7@C>2E:@? — >:89E 24EF2==J 86E D>2CE6C E92? 9F>2?D ?@E ;FDE :? >6>@C:K:?8 9F86 EC@G6D @7 :?7@C>2E:@?[ 3FE :? D9@H:?8 4C:E:42= C62D@?:?8 2?5 @E96C 9F>2? D<:==D]k^Am
kAmp:52? v@>6K H2D @?6 @7 E96 4@\2FE9@CD @7 E96 A:@?66C:?8 a_`f A2A6C E92E :?EC@5F465 2 D@\42==65 EC2?D7@C>6C E649?:BF6 — E96 “%” 2E E96 6?5 @7 r92Ev!% — 7@C :>AC@G:?8 E96 A6C7@C>2?46 @7 >249:?6\=62C?:?8 DJDE6>D[ 6DA64:2==J :? 9@H E96J =62C? 7C@> A2DD286D @7 E6IE] %96? ;FDE 2 a_\J62C\@=5 :?E6C? 2E v@@8=6[ v@>6K C6>6>36CD =2J:?8 @? 2 4@F49 2E E96 4@>A2?J’D r2=:7@C?:2 9625BF2CE6CD H96? 9:D E62> D6?E @FE E96 A2A6C 2C@F?5 b 2]>] H96? :E H2D 5F6]k^Am
kAm“p:52?[ E9:D :D 8@:?8 E@ 36 D@ 9F86[” 96 C6>6>36CD 2 4@==628F6 E6==:?8 9:>[ @7 E96 H@C< E92E’D D:?46 96=A65 =625 E@ ?6H DJDE6>D E92E 42? 86?6C2E6 9F>2?=:<6 AC@D6 2?5 :>286CJ]k^Am
kAm$:I J62CD =2E6C 2?5 ?@H rt~ @7 9:D @H? px 4@>A2?J 42==65 r@96C6[ H9:49 w:?E@? 92D :?G6DE65 :?[ v@>6K :D 6?E9FD65 23@FE E96 A@E6?E:2= 2AA=:42E:@?D @7 E96D6 DJDE6>D 3FE 3@E96C65 3J 762C>@?86C:?8 96 D2JD :D “56E24965 7C@> E96 C62=:EJ” @7 E96:C ECF6 42A23:=:E:6D 2?5 “C6=:6D @? 6IEC2@C5:?2CJ =62AD @7 :>28:?2E:@? 2?5 C62D@?:?8]”k^Am
kAm“%96 ?@E:@? E92E E96D6 >@56=D 2C6 D@>69@H 8@??2 86E 2446DD E@ @FC ?F4=62C H62A@?D 2?5 =2F?49 D@>6 D@CE @7 6IE:?4E:@?\=6G6= 6G6?E :D ?@E 2 AC@5F4E:G6 5:D4@FCD6 E@ 92G6[” v@>6K D2:5] “xE’D 92C>7F= E@ E9@D6 C62= AC28>2E:4 A@=:4J 677@CED E92E 2C6 ECJ:?8 E@ 5@ D@>6E9:?8 8@@5]”k^Am
kAmpD<65 23@FE 9:D :?G6DE>6?ED :? r@96C6 @? (65?6D52J :? =:89E @7 9:D 3C@256C 4@?46C?D 23@FE px[ w:?E@? D2:5 96 925 ?@ A=2?D E@ AF== 9:D :?G6DE>6?ED 3642FD6 E96C6 2C6 DE:== >2?J 96=A7F= 2AA=:42E:@?D @7 =2?8F286 >@56=D :? >65:4:?6 2?5 6=D6H96C6] w6 2=D@ D2:5 96 925?’E >256 2?J 325 564:D:@?D :? AFCDF:?8 E96 C6D62C49 96 DE2CE65 :? E96 `hf_D]k^Am
kAm“&?E:= G6CJ C646?E=J[ x E9@F89E E9:D 6I:DE6?E:2= 4C:D:D H2D 2 =@?8 H2J @77[” w:?E@? D2:5] “$@ x 5@?’E C62==J 92G6 2?J C68C6ED 23@FE H92E x 5:5]”k^Am
