Certain people that were legally free by USA law were not legally free by CSA law. The CSA Army was following the CSA law. According to them what they did was legal. According to USA what they did was kidnapping. Two points of view and two legal systems. Thus the conflict.
But there are people arguing that no such thing happened... surely any person without an agenda cannot say that black people weren’t taken south by CSA forces against their will.