Is it ok to get a loan from a bank or a credit card and pay them only the exact amount monthly without paying any interest - (even if they ask me I just want to pay the amount that I have taken)?

Praise be to Allah, the Lord of the World; and may His blessings and peace be upon our Prophet Muhammad and upon all his Family and Companions.

It is Haram to take a loan from usury-taking-banks even if there will be no amount of interest. It is Haram to deal with such banks unless there is no substitute, or there is dire need, since such dealing is a form of co-operation in sin and aggression.
Allah Says (interpretation of meaning): {… Help you one another in AlBirr and AtTaqwa (virtue, righteousness and piety); but do not help one another in sin and transgression. …} [5: 2].
Allah knows best.