It's more about the first few days/weeks after birth.
One DD was identical to her dad at the start, but looks nothing like him now. She looks way more like MY dad! Same with the other DD and they have different dads.

DS - we all have no idea who he looks like, we often used to wonder who his mother was lol