City leaders in Cayce are telling water customers that the water is completely safe to drink, despite many reports of an "earthy" taste.