That is first class that you are both becoming free now from sex desire. This is a
great victory. In the spiritual world there are husbands and wives who are unbelievably beautiful, but yet they are not attracted to each other. They are only attracted to Krishna. Married couples who are fixed in Krishna consciousness do not engage in sex at all unless they are trying to have a child. They are not interested even in hugging and kissing, what to speak of having sex.
So you should not
feel frustrated. Srila Prabhupada explains that if we tolerate the sex itch instead of indulging in sex, the itch will go away. Conversely if we give into the itch, it will keep bothering us for our entire life. It has been seen that even a dying man can be sexually inclined.
However, since sex is divine if it is used in producing Krishna conscious children, if you and your wife desire
more children, you may continue having sex while at the same you are cultivating your Krishna consciousness. The system for Krishna conscious householders who want to have children is to first take permission from the spiritual master to try for a child. If the permission is granted, then once a month five days after the wife's menstrual cycle the husband and wife both chant at least 50 rounds of Hare Krishna japa mala and then engage in sex. And if
the wife is pregnant, then there is no more sex life till the child is born and at least six months old. Children conceived in this way are very special sent by Krishna.
So the conclusion is that you should both feel happy that you are going beyond bodily consciousness by coming to the liberated platform of Krishna consciousness. And if you want to have more children to
raise them in Krishna consciousness so that they can be liberated from the cycle of birth and death, this an option that will also liberate your from sex desire.
