Dead on TAPhilo...
People are dumb enough to buy a house next to train tracks and then complain when a train runs on them.
Most of these rails would be laid on existing rail rights of way. The problem is some of them have been out of use since the 1940s and saw the tracks ripped up in the 1970s and 1980s. Other lines see just a few cargo trains a week during the day when people are at work.
Running trains at 150 mph at all hours of the morning and evening is what scares these people.