There are people who have seen each other in their memories. In some cases, there's even been a shared memory, that meshes. Seeing someone you've known in your past life here, I think, can cause an echo.

And I think even fragments of memories aren't something you just make up like that. It'd be something else entirely if we were only getting objects that could come from anywhere.