Nobody really knows. He's only been at that spot since 1971 so it's a relatively new thing. I've heard people say leaving coin just pays respect, that it symbolizes providing for Traveller's needs, and that it is thought to bring good luck on exams. It's just something somebody started and now lots of people do it (I did). It's also said that one should place the pennies with the Lincoln side down.