You can always contract a waterborne parasite when swimming.

Lenses heighten the risk. Have you read the article? It's explained there.
It can happen even in correctly chlorinated pools.

Personally, I've gotten over my intense dislike of goggles and wouldn't swim without anymore.
Especially since I know what's going on in pools.
My health > looks.

You could try to wear corrective lenses beneath goggles, provided those are 100% watertight and you don't take them off.
I wouldn't risk it though.