Maybe give them warning that you are doing a themed party. If they don't want to know the sex then they don't have to go. That way the ball is in their court, and you can still have the party that you want.
I agree. I would just warn them and let them decide what they want to do.
Good luck