Sort of an edit to my last comment, I meant that the survivors all traveled through time again. I just realized that some were already in the past, other were in the present. Basically I'm thinking they all ended up in the same place. I'm not sure if that place/time is 2004 when the plane crashed, but where/when ever they are, they are all together.
I got you there and yes they need to end up together it only makes sense in the long run. Well to me at least because it has to be that way, now watch the writers mess that up