Where in Florida are you located? A long while back Connie and I spend the night in Palatka, and the water there was terrible. You smelled worse after a shower than you did before. And we brushed our teeth with just a tiny bit of toothpaste, no water.
So yeah, some places can have pretty bad ground water.
Fortunately there are a lot of springs up here in Wakulla County, and the water here is actually pretty good. There was an existing well on our property when we bought it, so we just tapped into that for our water needs. A guy dropped a plumb line down it and hit water at 20 feet. And then let out the remaining 80 ft. of line, and never hit bottom. So yeah, we're probably living right on top of some vast underground lake.