Instantaneous Blindness
One challenge will be for the system to fail gracefully. Imagine cruising along the highway at night with the system eliminating half of the downpour. You will be slowed down from normal, non-raining speed, but you will still be going as fast as you can and still see. If anything causes the system to stop working (hail? a splash from another car? spotlights from road construction?) you will be going too fast for your new level of unassisted vision.
But don't hit your brakes! There are cars right behind you. And probably they will be following closely because they do not have the fancy vision system and are tailgating to take advantage of your "super vision".
I'm not saying "Don't do it!" Just think about what you are doing because there will be trade-offs.
