I wondered the same thing when we were taken to Romania and the denizens of the Game there didn't converge on us. I believe we're being taken to parallel worlds and different worlds entirely, where the Game doesn't exactly exist. Or, so the last two changes have shown, anyway.