Then it is rough, since you do have your vows and all that, the contract with your wife, so if she is not willing to let you find enjoyment from other people, then that means you have to break or bend the contract, and you will have to decide if that is alright with you, and also think about if she found out, what would she feel about that?
Anyway I am not going to judge you, I believe you have to make up your own mind on if that is okay for you, with you, or if you do believe in a god like it seems like you do, I don't, but I guess you are supposed to be able to pray and stuff, and some versions of religion give forgiveness for anything if you ask for it after, some even sell forgiveness for future sins, crazy stuff to me that. To me though the only persons that matter is myself and whomever I have promised something, nobody else matters, that is why I very rarely promise anyone anything.