You seem to be appealing to an ultimate, absolute sense of knowing. The social kinds of freedom seem clear. For instance, slaves are unfree, whereas masters are free. No metaphysics is needed to understand that distinction.