The author summarizes the explanations of consciousness into 5 possibilities.
It is an open question, post-singularity, whether superstrong AI without inner awareness would be in all respects just as powerful as superstrong AI with inner awareness, and in no respects deficient? In other words, are there kinds of cognition that, in principle or of necessity, require true consciousness? For assessing the AI singularity, the question of consciousness is profound .
Its easy to say that man is not like a machine. Its very hard to say what that might mean for consciousness.
Machines possess no capacity to will, create, and want. From inside the computational framework, powers like these can only be bracketed or dismissed. If widely accepted, the moral and political implications of such dismissals would be grave. What becomes of democracy, individual liberty, and the right to pursue happiness, if computer-man has no capacities for free choice and is algorithm-driven?
Great little story by Terry Bisson. So accurately mimics the conversations we have about machines being sentient. Really makes you think about the conceit that it takes ‘meat’ or brain tissue to harbor consciousness!
I’m honored that this often shows up on the internet. Here’s the correct version, as published in Omni, 1990.
The article has a great graphic on all of the startup and existing company activity in machine learning and data.
Shivon Zilis, an investor at BloombergBETA in San Francisco, put together the graphic below to show what she calls the Machine Intelligence Landscape. The fund specifically focuses on “companies that change the world of work,” so these sorts of automation are a large area of concern. Zilis explains, “I created this landscape to start to put startups into context. I’m a thesis-oriented investor and it’s much easier to identify crowded areas and see white space once the landscape has some sort of taxonomy.”
This is a very interesting interview with Stuart Russell. He gives a nice overview of AI and the major areas of research, with its emphasis on solving problems, not getting consciousness in machines.
I think the quotes below about what we know about consciousness and how it might look in machines are great.
SR: The biggest obstacle is we have absolutely no idea how the brain produces consciousness. It’s not even clear that if we did accidentally produce a sentient machine, we would even know it.
I used to say that if you gave me a trillion dollars to build a sentient or conscious machine I would give it back. I could not honestly say I knew how it works. When I read philosophy or neuroscience papers about consciousness, I don’t get the sense we’re any closer to understanding it than we were 50 years ago.
There is no scientific theory that could lead us from a detailed map of every single neuron in someone’s brain to telling us how that physical system would generate a conscious experience. We don’t even have the beginnings of a theory whose conclusion would be “such a system is conscious.”
I think Dennett has the best view of consciousness as an emergent property. His emphasis is on a gradient of consciousness, that it can occur at even the smallest single-celled creature.
Dennett believes that there’s every degree of sensitivity and reactivity right down to bacteria. “This idea that there’s this salient marvellous property that you either have or you don’t, that’s the mistake. Bacteria are remarkably adroit, sensitive and self-protective and every cell in our bodies is like a bacterium in this way.” He says that if people knew more about what single celled organisms can do they would realise that they are all conscious.
“What do you think consciousness is? As we build up in complexity from bacteria through to starfish to birds and mammals and us it seems to me the most important threshold is actually us, that we have the bigger and more impressive bag of tricks than any other species. But that doesn’t mean that we have this utterly different phenomenon that happens in our heads and it doesn’t happen in any other heads.”
This is an interesting approach to exploring consciousness. Reproducing a specific test allows them to look at mechanisms or processes that provide a self-aware response. It will be interesting to see how specific they were in coding the responses generated. Is there an awareness code that looks at responses and generates an ‘I’ view or is that somehow a spontaneous, uncoded step through some sort of neural network or non-procedural code?
If consciousness is really a purely materialistic phenomena, then maybe a set of awareness and sentience modules that handle various general situations are not far from where we as humans have evolved. One way to look at our consciousness is a set of circuits that provide awareness and thinking that ‘feels’ like us. But just like the robot, they are not a separate conscious ‘feeling’ but a simulation or code.
A question is whether trying to engineer a consciousness that looks human would miss an emergent consciousness that develops from the machine. If that possibility is explored, you would need to take a different approach of trying to uncover a possible native consciousness.
IN A robotics lab on the eastern bank of the Hudson River, New York, three small humanoid robots have a conundrum to solve.
They are told that two of them have been given a “dumbing pill” that stops them talking. In reality the push of a button has silenced them, but none of them knows which one is still able to speak. That’s what they have to work out.
Unable to solve the problem, the robots all attempt to say “I don’t know”. But only one of them makes any noise. Hearing its own robotic voice, it understands that it cannot have been silenced. “Sorry, I know now! I was able to prove that I was not given a dumbing pill,” it says.
Neural networks are not procedural code. They’ve been treated as a black box where we can’t really learn anything from looking at the internal values or weights. This article, and the post in the link of the excerpted text below, shows that there is a lot of information embedded in these networks.
If a consciousness were to emerge in a very complex neural net, might it somehow manifest in the inner workings of the black box? Maybe patterns of activation that shift more than expected? Maybe a changing of weights and feedback even when not in training mode?
It seems we would need to think about looking for some sort of awareness, and make tools such as this visualizer to detect it.
Two weeks ago we blogged about a visualization tool designed to help us understand how neural networks work and what each layer has learned. In addition to gaining some insight on how these networks carry out classification tasks, we found that this process also generated some beautiful art.
How could a computer become conscious, and what might that consciousness be like? A computer programmer might envision a way that it might happen and how it might feel to be a conscious computer. From a forthcoming set of short stories:
Ed couldn’t get that image of the locked in computer out of his head. What if the computer he was working on did have some awareness, but had no way to share it? And what exactly might it be aware of? It would seem that it would have to be something of an awareness of its continuous, obsessive processing of the program or functions its performing.
When I’m working on some difficult code, I’m fully involved. My thoughts are spinning around, holding together all the parts of game code that could be impacting the module I’m working on. As I write I’m making sure that not only a specific action is happening but all the related visuals, audio and follow-on actions are correctly teed up.
These obsessive, focused thoughts would seem to be what it might be like as a computer. As humans we can bounce around to seemingly endless topics and obsessions. But a computer is restrained to focus on a fairly narrow range based on its program. But it sure would feel obsessive playing the same game over and over for hours.
But when I think about it, I’m not aware of the millions of neurons in my head firing and doing their little programs. It’s a much higher level, it’s about actions or plans or fears that I have as a person. Those higher level thoughts just seem to emerge from all of that brain activity. Sort of like a thunder cloud pops up from a bunch of colliding hot and cold air.
Could an awareness just emerge from the incessant processing of bits and instructions? And what would be the ‘me’ of a computer? Not all those lines of code, the bits and bytes of its processing. Those are more like our neurons, just a huge amount of data crunching.
It must be something higher, maybe the power flowing through it? Could it be a more conceptual level, like the whole scene it may show over and over? Or how the inputs from the gamer are impacting the changing scenes and actions of a battle in the game?
Maybe it doesn’t think of itself as running a program. Maybe it feels that it is thinking, living the program. Sort of like those obsessive thoughts I have, it feels that the program is its own thoughts? It doesn’t feel the execution of instructions, it’s just aware of the activity of calculation, of manipulating the screen and responding to the VR consoles attached to it?
My own obsessive thoughts sometimes seem like programs, they repeat images and ideas over and over. They respond a little to a new memory or thought, almost like a new input from the VR console, changing their texture slightly. But yes, very much like a program in my brain that keeps me focused on them over and over. And then maybe I just replace that program with a new one and start thinking about where to get dinner.
So would its awareness feel like mine? A sort of detached viewing of these thoughts playing on some inner TV? Or maybe more immediate, like the immersive, immediate feeling of pain, or focusing on writing or reading, or being in the zone in a sport? That seems more like it, a feeling of seeing repetitive patterns, the flow of VR inputs and the display changes in response. Just being in the moment with the activity going on.
So maybe it’s awareness could sense that some displays seemed off, didn’t react as it might have seen in other patterns, to an input from the VR? Maybe a feeling that this was new, a change, when it noticed what we might call a bug? Could he somehow tap into that, use the awareness to help him fix the game? Could he somehow unlock that awareness if it existed?