I believe Lee was emotionally a broken man for two reasons. First was he made aware belatedly that his decision to engage in a southern slaveholder insurrection was a mistake. Secondly he was made more upset over those who were engaging in the subsequent post War insurrection violence and lynching of fellow southerners. Lee lawfully returned to his obligation to the Republic and stood as a noble example of how others should be behaving but he was ignore by most. I have high regards for Fredrick Douglass but here he only tooting his horn while missing the big picture while being partially correct. Stress hastens Death.
No disrespect intended to you Louisiana Jayhawker, but I'd say that Frederick Douglass had every right to toot his own horn considering he was born into slavery, escaped and became a leader in the abolition and suffrage movements. And that if former slaves had a negative picture of the leaders of the rebellion that wanted to keep them enslaved forever, that is big picture.I am not aware of Lee ever critizising any paramilitary terrorist groups or advocating racial equality. Are there any examples of Lee doing so post ACW.
Post ACW NBF did give a speech about the need for racial equality although he died soon afterwards if I recall correctly.
Former Confederate General Longstreet did briefly lead African American milita in Louisiana against the Red Shirts so not all former Confederates were against racial equality .