If his extra marital affair had no bearing on his work at the CIA, and so far, there is nothing to indicate that it had, then if his job performance at the CIA was exceptional, then it is worthy of consideration.
I do not know how his work at the CIA was considered, and what effect on morale there would be.
"Remember to always be yourself. Unless you can be batman. Then always be batman." Unknown
Personally I think it would be a bad move since intelligence agents should avoid blackmail by staying out of sexual relationships, it would be like "Do as I say, not as I do."
Thomas Sowell: There are no solutions, just trade-offs.
