Yeah... I'm aware that it sounds incredibly weird, and it is, but like anything, you do get used to it.

[It's certainly looking like he's going to be more willing to talk after the revelation that they're in some way connected even closer than most Numbered.]

The... implication is that we're all remembering dead people, yes.