It just so happens I'm in the midst of a blog post of a book review of Horace Porter's book, Campaigning With Grant. In it, Porter tells us what Grant's view of the command arrangement was:
"An animated discussion took place at headquarters that day regarding General Meade's somewhat anomalous position, and the embarrassments which were at times caused on the field by the necessity of issuing orders through him instead of direct to the corps commanders. The general-in-chief always invited the most frank and cordial interchange of views, and never failed to listen patiently to the more prominent members of his staff. He seldom joined in the discussions, and usually reserved what he had to say till the end of the argument, when he gave his views and rendered his decision. It was now urged upon him, with much force, that time was often lost in having field orders pass through an intermediary; that there was danger that, in transmitting orders to corps commanders, the instructions might be either so curtailed or elaborated as to change their spirit; that no matter how able General Meade might be, his position was in some measure a false one; that few responsibilities were given him; and yet he was charged with the duties of an army commander; that if he failed the responsibility could not be fixed upon him, and if he succeeded he could not reap the full reward of his merits; that, besides, he had an irascible temper, and often irritated officers who came in contact with him, while General Grant was even-tempered, and succeeded in securing a more hearty cooperation of his generals when he dealt with them direct. The discussion became heated at times. At the close of the arguments the general said: 'I am fully aware that some embarrassments arise from the present organization, but there is more weight on the other side of the question. I am commanding all the armies, and I cannot neglect others by giving my time exclusively to the Army of the Potomac, which would involve performing all the detailed duties of an army commander, directing its administration, enforcing discipline, reviewing its court-martial proceedings, etc. I have Burnside's, Butler's, and Siegel's armies to look after in Virginia, to say nothing of our Western armies, and I may make Sheridan's cavalry a separate command. Besides, Meade has served a long time with the Army of the Potomac, knows its subordinate officers thoroughly, and led it to a memorable victory at Gettysburg. I have just come from the West, and if I removed a deserving Eastern man from the position of army commander, my motives might be misunderstood, and the effect be bad upon the spirits of the troops. General Meade and I are in close contact on the field; he is capable and perfectly subordinate, and by attending to the details he relieves me of much unnecessary work, and gives me more time to think and to mature my general plans. I will always see that he gets full credit for what he does.' " [pp. 114-115]