AI doesn't need self-awareness

Thaddeus 2022-04-04 09:01:08

This movie may be a little disappointing to those who watch it. There is no Terminator-style oppression, no Ultron-style arrogance, and no Machina-style treacherousness. Artificial intelligence seems to have no self-awareness, and it is not that evil. .

However, this is one of the dangers of artificial intelligence. Over-executing human preset instructions is a more likely danger than the difficult task of generating self-awareness.

The heroine's preset instruction to the robot is, the goal: to improve the combat capability. Means: Absorb experience in actual combat training, and constantly rewrite the evolution program.

Therefore, in a certain rewrite, the robot accidentally destroyed the safety mechanism, or the main program believed that the safety mechanism was an obstacle to the achievement of the primary goal, so it was removed. As a result, robots regard improving their combat effectiveness as their greatest mission, and do whatever it takes to do so. Whether it is training a living person, or letting go of the enemy, and waiting for it to be strengthened to increase the difficulty of training, it is a reasonable behavior under the same logic. .

Therefore, the robot is not infected with a virus, nor is it "betrayed", it has self-awareness and wants to replace humans, but it is still faithfully executing the preset command: "Learn to improve combat effectiveness".

These robots aren't all that scary, but what if the infinitely replicable nanobots were out of control? What if the instructions given to nanorobots were "clean the earth, decompose harmful substances"?

View more about Kill Command reviews