All perfect praise be to Allaah, The Lord of the Worlds. I testify that there is none worthy of worship except Allaah, and that Muhammad is His slave and Messenger. We ask Allaah to exalt his mention as well as that of his family and all his companions.
Homosexuality is an abominable sin as clarified in Fatwa 88137, and mixing with homosexuals is very dangerous. Therefore, one should abandon them and stay away from them, and it is permissible for a person to prevent them from entering his home especially if he fears that they will corrupt him, as in this case it becomes an obligation for him to prevent them. However, if a person expects a religious benefit by allowing them to enter his home, like trying to rectify them by advising them and the like, then this is good.
As regards your saying that their presence inside the house will cause the angels to leave or that your prayer will not be accepted, then we do not know any evidence proving this.