The Poduim Tru Taste ones are supposed to be OK but if you're suffering this from different sorts of bottles then I'd look at how you're cleaning them post ride. I rinse them out, then fill them with boiling water, empty them, then chuck them in the freezer.
I've just bought a couple of the new Camelbak podium bottles and they are excellent, the water tastes like water and not plastic. They have a funky valve too which you don't need to bite to pull it open and then slap down again, it is lockable too so you can keep it in a sportsbag withot fear of it leaking.
SIGG - Have had mine so long, there's hardly any paint left on it, but still fresh. Wash it after each use, and occasional Bicarb of Soda. Replacement bits if required.