I will be talking this afternoon and thank you mayaness for the help with my situation, I will explain to him exactly what you have said in your post and hopefully that goes down ok. I am pretty sure it will as he is a pretty easy going guy.
Sherie - Thank you so much, you are not out of line at all. I have thought about it the other way around which is why I was a lil confused on what to do I didn't want him thinking that he cant do it or he is useless kus I know he is not. I will talk with him this afternoon and I will let you all know how it goes and if we have things sorted.
Thanks so much everyone for your help and options.

Thanks cailin, You have not come across rude. Everyone is pretty much saying the same thing which is very very helpful, as now I know what I need to do. We need to talk but I also need to realise that he is daddy and he has rights too. I think now with everyones help I will be able to talk about things without it turning into an argument or DP feeling as though I don't trust him or he is useless.