Wow, I would of hit the roof too!
I had DS at 4am, we'd been at the hospital since 3pm the previous afternoon and DH didn't leave until around 2pm that day and was back at 5pm (the hospital had a strict rest time in the maternity ward from 2 til 4pm). He then didn't leave til 10pm and was back first thing the next morning!
Think your DH is being a bit of a twat, DH would of got a good kick up the backside if he'd of said that to me!