Abbie, it only seems to be for me! he is fine around everyone else...
He might be still adjusting to the visits with his dad maybe, i wonder if he is sooky with them or if they give him what he wants and therefore he is expecting the same from you..
Not sure sorry i am not much help.