Daniel Vargas Paredes, 27, 1308 Knob Creek Road, No. 7, was charged with aggravated assault.
Police said Paredes got angry with his wife around 8:15 p.m., threatened her with the gun and forced her to leave the apartment without the two children. Police arrested him without further trouble and secured the gun.
The infants were returned to their mother unharmed.
Paredes was held in the Washington County Detention Center on a $25,000 bond awaiting a Sessions Court appearance set for Friday.