People just tend to transfer their own feelings onto others. What you do with your family is between you and your family and you don't have to justify or explain yourself to anyone.