I remember a great comment from a talk by John Searle about the scariest way that this could happen. Imagine that you get just such an implant, and suddenly, you just feel woozy or tired, as if something is really going royally wrong, as if your consciousness is no longer really "in control."

The Doctor starts the checkup and says "how do you feel?" and you internally think, "lousy! I need you to remove it, get it out, now!" -- but that's not what you say. Your lips articulate instead, "Doc, it feels great, I'm almost ready to check out and get back to work."

You live the rest of your life a prisoner in your own brain, which has been co-opted and taken over by the artificially intelligent electronics.

I tend to find Searle's discussions on AI to be overly simplistic. I find that scenario highly unlikely. Regardless of how you choose to interpret the research on the neuroscience of where decisions to action originate, it is clear that the conscious mind is extremely good at taking full credit for events it had no part or only a partial role in.

Such an "AI parasite" has plenty of machinery inbuilt in the brain to take advantage of in order to have full control without causing dissonance in the host. Indeed, not only will it likely be a path of least resistance, continued dissonance may cause enough mental instability in the host as to disrupt some emergent balance in the brain. This would have an overall negative effect on the user AI as to motivate it to choose to not make the extra effort required to have the human suffer such a disconnect.

The question then would be in whether thinking of the AI as other is valid instead of expanding the notion of personal agency to accept such symbiotes.

http://en.wikipedia.org/wiki/Neuroscience_of_free_will#Manip...

http://en.wikipedia.org/wiki/Neuroscience_of_free_will#The_p...

Society already does a good job of this without the need for technology or artificial intelligence.

I'd genuinely rather spend my day chopping wood, picking fruit or fishing, but no, I'm chained to a desk in front of Visual Studio 2010 pumping out code to prop up the insurance industry.

I still don't know why I do it. Something has taken me over and it's not artificially intelligent electronics.

Change jobs, at least you don't have to prop up the insurance industry anymore.

Currently, we're all propping up the insurance industry - There's no escape.

We've been assimilated by a hive mind whose neural impulses are electronic banking transactions.

The short sf story Learning to be Me by Greg Egan explores this scenario. Well worth a read.

You're right. Thank you for the suggested reading.