It makes me wonder if there's something like split timelines involved. Like, when people go back, they're sent back to some... alternate version of their worlds.

[...Ugh, he sounds like a conspiracy theorist.]</small. But that's probably pushing it.