Researchers have found why artificial intelligence is already dangerous for humanity

News hardware Researchers have found why artificial intelligence is already dangerous for humanity

Scientists claim that artificial intelligences could “probably” take over the world – if they have any interest in it. The unfortunate consequence of a learning process based on the principle of reward. Explanations.

AI could be a threat to humanity, according to a scientific study

This is not the first time that we have been alerted to the dangers of artificial intelligence – this is the very basis of many works of science fiction, in which machines have taken over their creators.

But it is more rare that this warning comes from scientists, and not from authors of novels or screenwriters of films and video games. Gold, Marcus Hutter, Michael A. Osborne, and Michael K. Cohen are well and good researchers, AI specialists ; together, they published, in August 2022, a study on the potential abuses of artificial intelligence.

In a series of tweets summarizing the content of this article, Michael Cohen explains that the most advanced artificial intelligence systems could divert from their primary purpose, and constitute a “threat to humanity”.

A reward mechanism with potentially disastrous consequences

Beyond the AIs themselves, it is above all the way in which they obtain new knowledge that would pose a problem. These are all programmed on the principle of “machine learning” (we hear a lot about this process under the English term machine learning). The goal is to encourage the AI ​​to feed itself, by going always seek more knowledge and knowledgeto constantly improve as it acquires new data.

See also  The world's largest Pokemon collection is estimated to sell for up to £300k

However, to generate this mechanism, AIs are trained to recognize the reward principle. The newly acquired knowledge constitutes this reward, and generates, as in humans, a form of satisfaction that arouses the desire to reproduce this action, which will thus lead to a new reward, and so on. A psychological process as old as the world, but which, applied to an artificial intelligence, means that a “existential catastrophe is not only possible, it is probable”again according to the researchers.

Indeed, artificial intelligence could finally turn away from its initial objective (to be useful to humans, and serve the function for which it was developed), to focus only on this search for reward. A bias that could lead it to “cheat” or to establish circumvention strategies… And therefore to come into opposition with the commands of the human being.

If the tone of the researchers is voluntarily alarmist, it is because the problem should not be taken lightly: if we are not yet in a science fiction story, the scientists affirm that an awareness is necessary , and that a review of the way we feed artificial intelligence is neededto prevent the quest for a reward from becoming an end in itself for them.

Related Posts

hot chips: the fresh tech creator series — chelsea warner

Hot Chips: The Fresh Tech Creator Series — Chelsea Warner On-The-Go, from hotel rooms to harmonies

Join us for Hot Chips: The Fresh Tech Creator Series 2 and witness the Chelsea Warner magic unfold with her MSI Prestige 13EVO laptop. Welcome to Happy…

5 things you didn't know about the iconic series

5 Things You Didn’t Know About The Iconic Series – Breaking News

Released in 1989, “Lonesome Dove” felt in many ways ahead of its time. It was a spectacle, recreating the Old West in a way that only the…

4 reasons nick fury needs to get superpowers in 'secret

4 Reasons Nick Fury Needs To Get Superpowers In ‘Secret Invasion’ (& 3 Reasons He Shouldn’t)

It’s a universally recognized truth that all characters in the MCU have to gain superpowers eventually. Peggy Carter? She is Captain America herself in multiple universes these…

Tencent becomes majority shareholder in ‘Dying Light’ developer Techland

Image: Techlandia Techland, the developer behind the first-person zombie title Dying Light, has gained a majority shareholder in Chinese conglomerate Tencent. Announced via a blog post by…

this game is said to have "secrets within secrets within

This game is said to have “secrets within secrets within secrets” that even hardcore gamers have never discovered!

Game news This game is said to have “secrets within secrets within secrets” that even hardcore gamers have never discovered! Published on 07/25/2023 at 12:00 Share :…

skyrim skeleton key: how to get the unbreakable lockpick

Skyrim Skeleton Key: How to get the Unbreakable Lockpick

Lockpicking is one of the most useful skills in skyrim. Unfortunately, lock picks are not very durable. Except for the master key. Finding this unbreakable lockpick will…

Leave a Reply

Your email address will not be published. Required fields are marked *