Building trades
Your main point is valid. House construction jobs exist, to a large degree, because so much is done on site rather than at factories. The reason so much work is on site is that local building ordinances require it. So many construction jobs would disappear if there were national or even, in some cases, statewide standards for factory built modules. The factories would themselves be highly automated.