OP, your feelings are very normal and understandable.
In most all cases, 'feelings' are valid!!!! (Not necessarily 'selfish' in and of themselves)
As somebody who experienced infertility, and thought I might never become a parent, I completely and totally understand.
The desire to become a parent, for most people, at some point, is a very natural and very strong thing!
It is like 'grieving'!!! A very real land serious thing.
I am sending you hugs....
I am also thinking about how it was just Mother's Day... with all of the idealistic and promo polished focus and images of the 'IDEAL' of mother's day... (not always a realistic image/vision of what a being a parent/mother really can be) That makes this kind of thing even harder.
Also, ALL of us have things that might not be possible for us.
ALL of us probably have some regrets. and, a lot of wishful thinking.
I know that I do....
It can be very difficult.
But, I think you know, in your heart, that most of us here are right. Your husband seems to continue to feel that he does not want to become a parent. And, with love and with all due respect, I think that, maybe, becoming a parent would not be the best thing for the two of you.
Perhaps, as mentioned, this is something that you can talk to somebody, specifically, about.
While your feelings are very real and understandable, you don't want to let something like this come between you and your husband.
Hope this helps!