I think that I can help here. You are mixing up the number series with the physical universe. One is a part of the number line and can be treated any way you wish and the other is a physical reality that must follow the laws of physics.
If I have missed your point, let me know what your point is.