A captain with Orangeburg's police department has been fired after being accused of taking weapons from the department's armory.