That is probably something that should be determined by the free blacks themselves, at that time. To me it seems that from the time of the Revolution onwards free blacks preferred freedom. Very few if any, returned south and reinslaved themselves.Well, they certainly had a better quality of life than the vast majority of the unemployed, homeless, half-starved, vagabond "free" blacks living in the squalid, filthy, ghettos of New York and Philadelphia.
People did not let the slave chasers find them and return them to slavery, if they could avoid it. Instead thousands moved to Canada, and others returned to Africa.