litter box vs newspaper

We just got a kitten hes 10 weeks old and was apparently litter trained he could well have been at that house but he certainly isnt here! I was going to buy a litter box but DH is addament just newpaper will do as he will eventually once hes mastered the newspaper be going outside to do his business.
My question is do you think it makes a difference whether we use a litter tray or just newspaper DH is under the assumption that its easier to trian them to go outside using newspaper.

We have the newspaper near the laundry door as the kids dont bother with that room but my fluffy little guy is going in the corner of our walk in pantry and his poos are quite runny and its very disgusting to pick up id prefer him to go on the paper and just throw it out! How can i get him to go where i want him?
Its not as easy as picking him up every 15 mins and popping him on the paper hes quite timid so far and goes into hiding during the day either behind the oven or the fridge.

Now i could easily close the pantry door to stop him going in there the only thing is being very rural out here we get mice and we got the kitty to catch the mice so i dont want to block him off from them as hes already a good hunter.

Any suggestions?

Definitely a litter tray as cats naturally dig into the litter substrate to bury their waste and newspaper is unlikely to cut it. Instead you may promote bad habits developing when he looks for somewhere to go he actually likes.

If you want him to eventually go outside then I would suggest putting something more natural in the litter box. I don't have cats but next doors cats love my front garden (thankfully my neigbours come and clean it up). Krysalyss is right they like to bury their business and they can not do that on paper. The kitten would have been trained with some sort of litter but without you providing it he will continue going where he wants. If your DH really wants to keep using paper try shredding it up for the kitten.

Your kitten is litter trained not newspaper trained.
Please ring the people you got it from and ask what kind of litter they used and get that. Once it is back to using its litter you might be able to introduce paper by putting it under the litter and gradually reducing the amount of litter but cats like to dig when they do their dirty cat business and bury it so newspaper goes against that. Your kitten is probably pretty distressed about the paper because cat's are quite fastidious animals.
TBH I don't fancy the idea of getting your cat to do it outside - it is smelly and with children about they're likely to step in it (or worse if you have a toddler who likes to eat random stuff). I prefer it in a litter box where I can put it in a child proofed room and flush it away instead of leaving it hanging about in the garden.