It really is about information and coherence and is really hard to explain and I'm not qualified to do it. For me the polarization show that it is beyond touching anything. You can use the first pass of filter to aquire information and it break the interference. But then you can use a second pass to remove this information and get an interference back. The photon was "touched" by both filter, so how come interference get back ? A photon is not the same as light (many photons) so you can't really apply electromagnetic reasoning to the quantum world. Sorry to do an appeals to authority, but it's been literally 100 years since the discovery of this science and if it was simply like space time and electromagnetic waves it wouldn't be know as this really weird and unintuitive model that works on really small scale. You can create a pair of photon and observe their linked property even kilometers apart when they collapse. It weird, but having information about the system, change it. Of course it's not literally like this meme. But again, I'm not an expert or a scientist, so if you know more, please correct me.