You're right, they are pretty slow, pretty quick back to DC after 1st Bull Run though!
You would actually think that having smaller corps would make the organization more flexible and hence easier to move.
Could it be as simple as the Union army has more stuff to bring along?