A former Conway pastor has pleaded guilty to federal charges stemming from a Ponzi scheme in which people were bilked out of $2.5 million.