Am I over thinking things...?

My husband and I have been trying to conceive for six months now. And in the mean time of trying to conceive, I came down with severe pains in my lower abdomen area. I went to the Doctor to have it checked out, and the doctor ordered having an ultra sound done, just to be on the safe side. But I was not expecting the results that I got. My doctor was hoping that it was going to be ovulation that I would be feeling since I went off the pill, and that is when the pain started, but it was found out that I have fibroid tumors, on the outside of my uterus. I was utterly devastated. I was referred to a specialist, who looked at my results, and suggested that we try for six months, and then if nothing takes go and have surgery to remove the tumors. Talk about a lot to take in. I'm 33 years old, soon to be 34. I know I don't have much time left to try and conceive. I feel like I am in a constant worry about this, but am I just over thinking this? Getting pregnant, and have a child of my own has been something I have always wanted, and hope to achieve at some point. But I'm afraid to go through surgery, without further testing, not only for myself, but for my husband. He does have children from previous relationships, but again he is also getting older. I just feel at a loss, and unsure what direction I should take at this time.