I would never, ever tell my child their father thought something else was more important than their needs EVER.

Can you get a formal financial agreement made, it sounds like you might need it. What a w@nker (to paraphrase Kitt3n!).