My ancestor Captain Charles Candler stayed with the 64th until nearly the bitter end. There is some confusion on his CSR in that he was listed as a deserter, but it seems like there was just confusion about his status, but he was finally captured in early 1865--his 2nd time as a POW.
He was paroled on the condition he stay north of the Ohio river for the remainder of the war, but there is a somewhat bitter note in his CSR that he was last seen en route to Knoxville. LOL
I don't know that he made it back to the unit before the end of the war or if he intended to. Charles seems to be one of the staunchest Confederates in my Madison Co. family tree--he enlisted early and as an infantry officer rather than a medical officer, though he was a doctor, and one of his little brothers accused Charles of forcing him to enlist in the 64th against his will--but I wonder if he realized the end was nigh and just wanted to go home by that point. He'd been in the army for nearly 4 years.