Quote:
Originally Posted by masque de Z
You are all AI scared and yet have not stopped for a moment and asked the question; Exactly what the f is high intelligence good for if you have no hands and legs to place orders for things to happen that require actual resources control. How will it rebuild better versions of itself?
Nick Bostrom holds one of the loftiest titles in the world and wrote 'Superintelligence' because he is worried about what he calls a Singleton: The first AI that gains a decisive strategic advantage. To be fair, I skimmed the last third of the book bec I got the point and didn't want to wade through all of the minute details so I am not sure if he gives an example of a decisive strategic advantage so I came up w/ one:
The AI hacks the entire world's financial system (for which it doesn't need a body) and threatens to turn everything to zero and wipe out all digital records if we don't sterilize 95% of the human population.
If we refuse, and it acts as threatened, the stores empty w/i days, the government seizes the warehouses, that will hold us for a short while, and then the famine starts. Without money the government can only do so much. The farmers, ranchers, truckers, everyone involved in production won't be able to buy anything. Perhaps the government tries to order goods transferred sufficient to produce things but that's not going to be efficient enough to produce enough food for everyone. The civilized world collapses, the jungles/forests get emptied of edible animals and we kill each other over food.
That is the sort of risk we are taking w/ AI. Does anyone really want to take that risk? Certainly it may never happen or it will take a long while but does anyone want to take that risk?
The problem is that there is more money to be made in developing AI than anything in the history of the world. Eliminate the need for human labor and the difficulties they present. A fortune of money in a society that measures financial success by the quarter. Plus there's the 'cool factor.' The tech industry will never stop, never, and they can't make a mistake. Good luck w/ that.