I hope
@cash will share some other sources.
"In talking with Colonel Carter about the situation of farmers at that time in the South, and of their prospects for the future, he urged him to get rid of the negroes left on the farm—some ninety-odd in number, principally women and children, with a few old men—saying the government would provide for them, and advised him to secure white labour. The Colonel told him he had to use, for immediate needs, such force as he had, being unable at that time to get the whites. Wereupon General Lee remarked: 'I have always observed that wherever you find the negro, everything is going down around him, and wherever you find the white man, you see everything around him improving.' " [Robert E. Lee, Jr.,
Recollections and Letters of Robert E. Lee, p. 168]
"You will never prosper with the blacks, and it is abhorrent to a reflecting mind to be supporting and cherishing those who are plotting and working for your injury, and all of whose sympathies and associations are antagonistic to yours. I wish them no evil in the world on the contrary, will do them every good in my power, and know that they are misled by those to whom they have given their confidence; but our material, social, and political interests are naturally with the whites." [General Robert E. Lee quoted in Robert E. Lee, Jr.,
Recollections and Letters of Robert E. Lee, p. 306]
Robert E. Lee Testimony before Joint Congressional Committee on Reconstruction, February 17, 1866:
http://www.archive.org/stream/jointreconstruct00congrich/jointreconstruct00congrich_djvu.txt
Question. General, you are very competent to judge of the capacity of black men for acquiring knowledge : I want your opinion on that capacity, as compared with the capacity of white men?
Answer. I do not know that I am particularly qualified to speak on that subject, as you seem to intimate ; but I do not think that he is as capable of acquiring knowledge as the white man is. There are some more apt than others. I have known some to acquire knowledge and skill in" their trade or profession. I have had servants of my own who learned to
read and write very well.
Question. Do they show a capacity to obtain knowledge of mathematics and the exact sciences ?
Answer. I have no knowledge on that subject. I am merely acquainted with those who have learned the common rudiments of education.
Question. Has the colored race generally as great a love of money and property as the white race possesses?
Answer. I do not think it has. The blacks with whom I am acquainted look more to the present time than to the future.
Question. Does that absence of a lust of money and property arise more from the nature of the negro than from his former servile condition?
Answer. Well, it may be, in some measure;, attributable to his former condition. They are an amiable, social race. They like their ease and comfort, and, I think, look more to their present than to their future condition.
Question. Suppose an amendment should, nevertheless, be adopted, conferring on the blacks the right of suffrage, would that, in your opinion, lead to scenes of violence and breaches of the peace between the two races in Virginia?
Answer. I think it would excite unfriendly feelings between the two races. I cannot pretend to say to what extent it would go, but that would be the result.
Question. Do you not think that the question, as to whether any southern State would allow the colored people the right of suffrage in order to increase representation, would depend a good deal on the amount which the colored people might contribute to the wealth of the State in order to secure two things : first, the larger representation, and, second, the influence derived from these persons voting?
Answer. I think they would determine the question more in reference to their opinion as to the manner in which those votes would be exercised, whether they consider those people qualified to vote. My own opinion is, that, at this time, they cannot vote intelligently, and that giving them the right of suffrage would open the door to a great deal of demagoguism, and lead to embarrassments in various ways. What the future may prove, how intelligent they may become, with what eyes they may look upon the interests of the State in which they may reside, I cannot say more than you can.
Question. What is your opinion about it being an advantage to Virginia to keep them there at all. Do you not think that Virginia would be better off if the colored population were to go to Alabama, Louisiana, and the other southern States.
Answer. I think it would be better for Virginia if she could get rid of them. That is no new opinion with me. I have always thought so, and have always been in favor of emancipation gradual emancipation.
Question. As a question of labor alone, do you not think that the labor which would flow into Virginia, if the negroes left it for the cotton States, would be far more advantageous to the State and to its future prosperity ?
Answer. I think it would be for the benefit of Virginia, and I believe that everybody there would be willing to aid it.
Question. Do you not think that the State of Virginia is absolutely injured and its future impaired by the presence of the black population there ?
Answer. I think it is.
Question. And do you not think it is peculiarly adapted to the quality of labor which would flow, into it, from its great natural resources, in case it- was made more attractive by the absence of the colored race ?
Answer. I do.