Why do some alien encounters seem to affect time and others don't?

Good observation.

Apparently, it's not the humanoid aliens that can affect time.

It's the dogs you need to keep your distance from.

Mr. Gordon is still studying the phenomenon. There are notes in his journal on this topic.