You cannot condemn a man for ...
You cannot condemn a man for what may only be a figment of your own imagination.