Highest Rated Comments


SometimesGood3 karma

Opinions have been voiced that research the areas artificial life and artificial intelligence should be regulated just as research in synthetic biology, cloning/embryonic stem cells and gene editing for the reason that the results might turn out to be beyond our control or misused. What are your thoughts on the urgency of such claims? In the long term, do you think controlling an artificial intelligence will be an easy problem to solve?

SometimesGood1 karma

Thanks for your answer.

You assume that there is no simple algorithm that yields AI (e.g. a simple combination of attention, control, reinforcement learning and a reward function like hunger), or you assume that such algorithms won't be computable for a long time. Predictions of the existence and complexity of algorithms are very difficult to make, so which observations give you so much confidence?

One more question: Do you expect AI to be easily controllable (e.g. by thoroughly testing it in an isolated simulation), or do you expect it to require considerable effort (e.g. to find ways to make it dependent on us or to program human values into it by hand).