Common sense volume

I would like to ask why some people believe that they need to listen to music to the highest volume to really be able to enjoy it. Does the volume really make such a difference? And what if the neighbors or flatmates do not want to listen to it?