Perhaps it is because your youngest is only 6 months old - I know when my youngest was 6 months neither myself or my DH could contemplate having any more, but now we have agreed that one more would be good. I think you should just give it some time.