Learning to count - when do you get concerned?

[Calluna]

He sounds like he is doing better than my DS Miss E, he sounds like he doesnt count as high but he understands it more.

Mr I recites up to 12 then skips a few to 20, recognises up to 10 and with a bit of help can read most numbers (ie 25) and letters.
But he doesnt really "get" what counting is about. He recognises at a glance 2 of something but if you ask him to count objects he just randomly recites numbers, often pointing to empty spaces on the page or counting the same object 2 or 3 times. Slight improvement if I ask him to slow down and think about it but he finds that difficult, I think.
He doesnt get less/more when talking about numbers, he still hasnt got a handle on you/me/I. Although that is partly my fault, trying to break the habit of speaking in third person
And he either cant or wont follow directions/instructions when doing activities despite wanting to play the game/whatever. In daily life he can but usually wont.

Is he deliberately being difficult or am I expecting too much?