All perfect praise be to Allaah, The Lord of the Worlds. I testify that there is none worthy of worship except Allaah, and that Muhammad, sallallaahu ‘alayhi wa sallam, is His slave and messenger.
If your wife had given birth to this daughter after six months or more after your marriage, then she is to be attributed to you as per the Sharee'ah. ‘Aa’ishah reported that the Prophet, sallallaahu ‘alayhi wa sallam, said: “The child is to be attributed to the owner of the bed (the husband).” [Al-Bukhari and Muslim] For further information, please refer to Fataawa 82709, 122944 and 90098.
It should be noted that this maid’s accusations against your wife are considered Qathf (a false accusation of adultery or fornication). Verily, Qathf is a grave major sins in Islam.
On the other hand, it is prohibited to exhume your daughter’s grave by any means. It is prohibited to exhume graves unless there is a legitimate necessity. It is also disliked for the husband to ask his wife about her past (sins). Moreover, it is impermissible for the wife in such a case to inform her husband of her past sins and mistakes as per the Sharee'ah, because she is required to turn to Allaah and repent of those sins and conceal them. Abu Hurayrah reported that the Prophet, sallallaahu ‘alayhi wa sallam, said: “All the people of my Ummah are pardoned for their sins except the Mujaahiroon (i.e. a bold sinners who commit sinful acts publicly or announces them shamelessly). Example of this is when a slave (of Allaah) commits a sin at night and Allaah conceals it for him, but he says (to people) in the morning, ‘I committed such and such a sin last night,' removing the screen of Allaah from himself.” [Al-Bukhari and Muslim]
Dear brother, you should consider your wife’s present conduct only. If she is proven righteous and chaste, you are advised to keep her as a wife and live with her in kindness. However, if she is proven otherwise, you should advise her and revive the fear of Allaah within her heart. If she turns back to Allaah in repentance and keeps chaste, keep her as a wife. But if she does not, you are advised to divorce her. For more benefit, please refer to Fatwa 191839.
Allaah Knows best.