I tried riding one bareback once, it kept banging sideways into the barn. At first I thought it was just an accident. When he did it a bunch of times I realized he was trying to mash my leg and get me off. He won the argument.
As kids we rode all over bareback, fields and hills even across the river swimming our horses to the other side. falling off was something we knew could happen and on occasion, it did!