If i'm not mistaken (Mosby's) 43rd Virginia Cavalry Battalion was disbanded without surrender as well.
According to Wikipedia.com:
"On April 9, 1865, General
Robert E. Lee surrendered the 43rd Battalion's parent command, the
Army of Northern Virginia. Immediately Colonel Mosby attempted negotiations with the Union commander in
Winchester, Virginia, to arrange for the surrender of the 43rd Battalion, but could not come to agreeable terms. Therefore, on April 21, twelve days after Lee's surrender, Mosby gathered his battalion at Salem in
Fauquier County, Virginia, and read this farewell address to his men:
Soldiers: I have summoned you together for the last time. The vision we have cherished for a free and independent country has vanished and that country is now the spoil of a conqueror. I disband your organization in preference to surrendering it to our enemies. I am no longer your commander. After an association of more than two eventful years I part from you with a just pride in the fame of your achievements and grateful recollections of your generous kindness to myself. And now at this moment of bidding you a final adieu accept the assurance of my unchanging confidence and regard. Farewell.
— Col. John S. Mosby, CSA, Commander, 43rd Battalion Virginia Cavalry"