I think I know what you mean by a head hugger - and yeah, I wouldn't have any problems taking it out.

If it is able to be easily removed, then there wouldn't be an offence for removing it. I do not believe it adds to the overall safety of the seat if a crash was to occur. It's more a comfort thing to keep bubs head from tilting too much (if it's what I'm thinking it is ).

If you're still unsure have a read of the manufacturer guidelines (if you have thrown them out you may be able to find them online) or otherwise call the company to triple check.