The Saturn upper stages did place the LOX at the back for this reason. However both the Shuttle and the Delta IV Heavy have widely spaced engines at the base. When the Shuttle SRBs drop off, the main engines must be able to gimble far enough the keep the line of thrust through the center of gravity. <br /><br />If you imagine the Shuttle with the LOX tank (which weighs eight times as much as the larger LH2 tank) at the base of the external tank, you can see this would place the CG just ahead of the main engines but several meters away from them laterally. There is no way they could be gimbled far enough to thrust through the CG. <br /><br />In the case of the Delta IV, in the heavy version the three engines are widely spaced at the base. If an outboard engine fails, the remaining two engines are very asymetrical and must gimble far enough to keep the thrust line through the CG. If the CG is just ahead of the engines, this can't be done.