Sounds to me you alrady know what you want to do, you just need to work through your inner monologue (or justify yourself to someone else).

Here's a good decision making tool:
On a piece of paper, draw a line down the middle to make 2 columns. On either side, write down the Pros & Cons in a list. Each should have a weighting (of say 1-5). Add up all the results in each column. The highest points wins. You'll end up with the result you want, but when you start doubting yourself, this can back it up.

e.g. On Pros you may have: better to rest for baby and toddler and give that a rating. On a con, you may have loss of income or "may get bored" or "stress from evaluation"

GL