When I toured his headquarters in Winchester, VA, the guide said he actually loved peaches. She said his love for lemons is mostly a myth. Interestingly enough, his grave was strewn with lemons when I visited the site in Lexington, VA.
Thanks
@J. Horace for posting the link. It was a great read.