If that's right it would certainly add to the confusion. There may also be no module for understanding consciousness itself, which would make our mental states counterintuitive. We'd understand the folk notions of personhood but not their ontology.

Some of these modules, though, may be just theoretical. They're part of an analysis of mental functions, but these functions talk to each other, so they're not entirely independent. The definition of a mental "module" is somewhat controversial.

https://en.wikipedia.org/wiki/Modularity_of_mind#Evolutionary_psychology_and_massive_modularity