I think the idea is that the brain uses some of that energy to regulate body temperature. We can offload some of that strain by wearing clothes in cold weather, whereas in hot weather it's all down to the brain since you'd be too hot even when naked in a tropical region.