Leash, TBH I really have been feeling the same. The Bear is very keen on more kids but right now I just want to give DD all my attention, and I am not in a hurry to have any more babies. Maybe when she is older I'll want a baby again, but right now I am just enjoying being with her. Also I agree with Mayaness on it being more about a good age gap than about numbers. And on the headspace thing.... I need to have a certain amount of headspace (not to mention sleep) otherwise I just become a completely horrible person so I don't want to overload myself IYKWIM? And I don't find it that easy to get the headspace even now so with more than one, I am not sure how I would do it.
Anyway, you're certainly not alone. Just roll with it. The way I see it, either you'll change your mind later and TTC then, or you won't and you'll be happy with Jazz.