Yeah. What if someone went into a black hole, broke newtonian physics (which apparently happens quite often around singularities), ended up going back in time (we're not sure it's completely impossible), and now there's a colony ship of 9 billion people on the other side of the universe? We couldn't possibly know for sure. And if in fact the universe is infinitely large and time goes on forever, then if it's possible it's almost likely. But now we're getting into the multiverse thing...