Yeah, that’s how convection and radiation work. Do I notice it? No. Do I care? No. It’s hot as balls with or without the neighbors house next door, I’ll be running fans and the a/c regardless.

If you’re asking for the engineering of it all, you’re looking for study materials from Heat Transfer courses, keywords: convection, radiation, R-value.