Wo Fat isn't ex-CIA, but remember he did work with them conducting arms deal where we couldn't legally. He's ex Chinese military with his own empire. We know Doris was/is an agent so when she faked her death she still worked for the CIA or at least acted as a spy for them.

That's my theory.