Ooh, there's the game being good at its details! Notice this man's armor. He's clearly from the Schwann Brigade
He immediately turns away so he's not to be seen, and leaves. Of course one of his knights would recognize him, even like this.
But the gamer, unless they've played before, would have no idea of Raven's identity.
On one hand, it's an excuse to leave. But on the other hand...
Yuri and this knight knew each other when Yuri was training to be one too. Raven lost his best friends and people he loved who were fellow knights, and that's stuck with him this whole time.
They're is probably a hint of truth to what the old man is saying...