My hubby has said before that plaster isn't as expensive as people think - so maybe look into that option, yes its not as cheap as paint because you are doing the plaster and then still painting, and yes it'll be more work for the same reason, but if it saves you from making an undoable change to the wood, then it might be worth it!

Having said that - you sound as if you really don't like it, do you think that'll change in the future???