All perfect praise be to Allah, The Lord of the Worlds. I testify that there is none worthy of worship except Allah, and that Muhammad is His slave and Messenger.
You did the right thing by repenting of Zina (fornication); may Allah accept your repentance, forgive your sin, and bless you with steadfastness on the path of righteousness. It is incumbent on you to beware of whatever may lead you to Zina, such as looking at what is forbidden for you to look at, being alone and intermixing with the opposite sex, and so on. Allah, The Exalted, Says (what means): {And do not approach unlawful sexual intercourse. Indeed, it is ever an immorality and is evil as a way.} [Quran 17:32] Tafseer Ibn Katheer reads: “Allah, The Exalted, forbidding His servants from committing Zina or even approaching it and doing whatever may lead to it, Says, (what means): {And do not approach unlawful sexual intercourse. Indeed, it is ever an immorality…}” [End of quote]
If this woman embraced Islam and proved to be a good Muslim, then embracing Islam wipes out all past sins. If she adhered to the path of righteousness and displayed religious commitment, and you could marry her, then this is a good deed for which you will be rewarded if you hold the intention of guarding her chastity thereby. However, according to the opinion of the majority of jurists, it is impermissible for you to marry her before she gives birth, and this baby is not attributed to you and is rather attributed to her only. Some jurists held that the baby may be attributed to you if you claim paternity and wish to attribute it to yourself. There is nothing wrong if you do not wish to marry her; you are not obliged to do so.
If she does not embrace Islam and retains her religion, then it is prohibited for a Muslim to marry a disbelieving woman unless she is from the People of the Book (Christian or Jew) and provided that she is chaste, i.e. she is not a fornicator.
Allah Knows best.