But the brain exists in a certain state at any given time, and this state theoretically can be uploaded (from some individual person) to a computer simulating a brain so that we don't always have to "grow" the computer brain.
Your brain wouldn't be worth much without your body. You'd be surprised how much your body does. Think of typing for example. You couldn't do it without the exact nerve/muscle pathways in your hands. Hook up robot hands (even crudely modelled after your existing nervous/muscle/bone system in your current hands) and you'd basically have to relearn to do anything. You'd be a baby again.
I think you'd be surprised how much this applies to. Speech, even things like counting we rely on our bodies for.