Dangineer is right (and since he said speedfreak was right, that makes speedfreak right, too
). Hopefully an analogy will help, because it's very hard at first to think of the universe expanding and
not imagine it moving away from a central point.
When we talk about curved spaces in physics, it's very helpful to take away one of the spatial dimensions and consider a universe with two dimensions (a sheet), since we can much more easily visualize curvature on a surface like that. A good analogue in this case is a balloon - imagine putting a bunch of dots on a balloon. Call them galaxies
Now start blowing up the balloon. The "galaxies" all move away from each other at a certain speed - and if you pick a galaxy to be "stationary", it looks like everything is moving away from it at a speed proportional to its distance. But of course, good luck finding a center on the surface of the balloon. There is no such thing.
This analogy is imperfect so you shouldn't take it any farther than I have, otherwise it breaks down (and you'll take home some very funny conclusions about the universe!). But I always found that very conceptually helpful.