Skip to content

when the singularity feels like the matrix…

2009 December 1

Philosophy and technology is a dangerous mix which tends to lead us to science fiction ideas about thinking, feeling robots, countless cyborgs living well into their second and third centuries, and concepts which seem so utterly impractical to someone who actually works with technology, but are nevertheless firmly defended by a number of writer, bloggers and entrepreneurs. After expressing my doubts that simulating a human brain in supercomputers would yield artificial intelligence, I was swiftly taken to task for it by Michael Anissimov and well as a reader on this blog. Apparently, by objecting to the idea that we could create consciousness in a computer, I’ve abandoned the scientific method and AI isn’t just plausible, it’s inevitable when we simulate the human brain. Let’s hope it likes us because there’s nothing worse than a ticked off robot with a massive IQ…

matrix pod fetus

But in all seriousness now, my problem has nothing to do with philosophy or the conceptual idea that with an unlimited budget and timeline, we could achieve a perfect simulation of the human brain. The big problem is going to be growing an intelligence out of it because the genes for our brains have been evolving for just over three billion years and during embryonic development there’s a whole lot of wiring going on as our brains are shaped and molded for life. Add decades of learning and formal education, and the organized chaos going on in our heads thanks to its impressive plasticity, and even with a perfect emulation of every biological process we know is happening in our minds, we’re looking at minimum simulation runtimes of 18 to 20 years plus all the formative work over the nine month gestational period.

As a systems analyst, I’d have to replace my unhinged jaw if anyone seriously came to me with a proposal for a project like that. It would cost billions of dollars, require an immense supercomputer and a set of functional requirements that cover every major neurology project. This is why in my aforementioned post I called such a simulation an act of engineering decadence. Because it really is. A more practical version of the project (using the term rather loosely) would build a vast snapshot of every neuron and synapse in the human brain, freezing it in that single, static state to run a firing cycle. Without a dynamic environment in the brain, all we would get is a detailed visualization of how signals move through the mind for a short burst. Sapient thought wouldn’t have a chance to appear and there would be no memories or constant exposure to stimuli to produce a personality since it’s a combination of our wiring, education and experiences by which we would immediately know if we have a real ghost in the machine.

From an idealistic standpoint, I see another set of problems with trying to build artificial intelligence. Suppose we said damn the money, effort and time and somehow succeeded. We now have a sapient thing living in our server. Should the computer crash or power down, we commit homicide. Should we give it any power after it’s been endowed with an unpredictable human-like mind there’s no telling what it might do. If we let it roam the web, we could be dealing with a scenario straight out of a dystopian sci-fi flick. Give it a body and we might be just begging for trouble. And the big ideas of carrying out experiments on this AI system? No way. Without it’s explicit consent it would be unethical and dangerous, especially if it rebels against the mad scientists who let it loose on the world. Before we cheer on AI development, we should think really hard about what success will entail and consider the enormous costs and work involved in playing with fire in the end.

  • Share/Bookmark
4 Comments leave one →
  1. December 1, 2009

    Before we cheer on AI development, we should think really hard about what success will entail and consider the enormous costs and work involved in playing with fire in the end.

    And Anissimov would tell you that’s why he advocates ‘constructing’ moral AI and slow uplift of said creation.

    Now I don’t know if such a ‘being’ is possible, but I do know that through the power of intent certain agencies are trying to bring about AI, moral or otherwise.

    Could this unleash power that would be disasterous for human beings?

    Unfortunately, that’s an unknown.

  2. gfish permalink*
    December 1, 2009

    What exactly is “moral artificial intelligence” and how would one build it?

    Morality is such a nebulous idea and when you try to make an equivalent of a human brain, you would be facing the same problems as we would trying to raise a child. And I’m sure that as a parent, you’ll know that just trying to raise someone with the same values you have doesn’t mean that you’ll be successful.

  3. December 1, 2009

    “we’re looking at minimum simulation runtimes of 18 to 20 years plus all the formative work over the nine month gestational period.”

    I could be confused here but if you’re assuming something will need that long to process with a computer, bear in mind that systems improve as something of an exponential rate – kurzweil often cites the example of the human genome project, where at the start objectors said it would take forever, and as time went on the discoveries came faster. A larger percent, something between I think 60-90% of the project was completed in the last year, thanks to the computers involved improving greatly

  4. gfish permalink*
    December 1, 2009

    Tom, technological capabilities are not an issue here.

    Yes, the genome project was finished right on time when it seemed that it would take a few extra decades. But it had a very different idea than the simulation we’re talking about here. It’s one thing to take a complex set of chemical systems and decode them. Growing a full blown copy of a monstrously tangled and highly dynamic organ to build a faithful and flexible emulation is far more time consuming.

    Now you could say that we could speed up that development time by just running all of the algorithms at a faster pace. However, if we’re going to try and get an accurate copy of the human mind with the kind of sapience we would recognize, we’d need to leave it alone to be exposed to stimuli and grow at a normal rate so we can check if the setup works. Once that’s done, we could talk about moving faster.

Leave a Comment

Note: You can use basic XHTML in your comments. Your email address will never be published.

Subscribe to this comment feed via RSS