we started them in their own beds and they could come into our bed anytime in the night. they still do this at 7 and 5.

If your not ready to have him by himself then dont, but you can try things like laying with him to sleep then leaving until he needs you again.