I slightly disagree - there would be times in situations like Fredericksburg when they could have all been together. For example, Lee accompanied by Longstreet might be inspecting his extended line right after the arrival of Jackson's men, and encountered Jackson talking with Stuart, who was protecting the right flank, in the vicinity of Early's Division of Jackson's Corps. Division commanders are high enough up the chain of command and there are only around a dozen of them, making them important elements in command.