I'd say what your'e feeling is totally normal!! I think we all worry about what we're doing to our unborn bub!! Just remember that its an emotional time too, and it's normal to have ups and downs. Look what your body is going through, BIG changes! It can't not effect you emotionally!!
As for DH, at least he's not alone, he could come on BB and meet ALOT of other partners who are having a dry spell!!!!!
Just take it easy.
I have two daughters with allergies, one slight, one severe and I wanted SO much to do everything different this pregnancy, but it's just not working out that way (I am avoiding allergens, but I wanted to be soooo omuch more healthy). I have moments when Im annoyed at myself, but like someone said to me recently, the worry and all that goes with it is worse for bubs than the diet I have (which like you is pretty good). So I have decided that when I have days and dont eat ANYTHIGN but bread, that is ok!!!
take care xo