Once a mayor of Huntsville,Alabama, Captain John James Ward raised Ward's Battery in Madison County,Alabama, in 1862. Ward's Battery served in the Army of Mississippi at Mobile,Alabama,in 1863 and was later transferred to the Army of Tennessee where the battery served in George S. Storrs' battalion at Kennesaw Mountain and other battles during the Atlanta Campaign.
One website has Captain John James Ward killed near Nashville,Tennessee on July 27,1864. I like this website because it has some official records of Ward's Artillery.
Captain John James Ward is buried in the Oak Hill Cemetery in Spalding,Georgia.
The date of his death on the tombstone is July 20,1864. I checked a Civil War time line and found that the Battle of Peachtree Creek was fought on July 20,1864.
In the Confederate order of battle at Peachtree Creek, Ward's Battery is listed as having fought in that battle.