In mid-May, 1863, Grant, Sherman and McPherson treated themselves to a stay in the Bowman House after capturing Jackson during the Vicksburg. The Union troops left the city enroute to Vicksburg and the city returned to Confederate control. Shortly afterward Bowman House was destroyed by a fire. The Confederate House was burned during the brief Federal occupation of the city.