I'm always amazed, on the practical level, how many people I know have worries or issues about public speaking. I understand it on the emotional level, mind you, but I love public reading. Being a showboat helps, I guess.

My big worry about reading aloud is whether I'm speeding up. I speak, and read, very quickly, and with a listening audience, it's just as you said: pacing and rhythm are needed.