Infertility is Not Just Related to Women No, it’s not. Fertility is related to men and women. Fertility issues are basically one-third related to just the man, one-third related to just the woman, and one-third related to either both or some unknown reason for the infertility.