Government interference
The problem is that all governments hate the idea of heavy lift vehicles in civilian/private hands because it's easy to either have an accident that causes mass destruction, or deliberate attacks doing the same.
The only reason why there are a few of space tourism companies like Space Adventures, Virgin Galactic, Starchaser, Blue Origin, Armadillo Aerospace, XCOR Aerospace, Rocketplane Limited operating is because their vehicles are mostly gloried rocket planes that aren't much more destructive than an airliner crash. They don't have the power to orbit a vehicle, much less fly to the moon, lagrange, or beyond.
