I reckon it would work.

I bought some bibs on the weekend, that are kinda like what you describe, but the other way around, IYKWIM? They have a wipeable front, and a fabric back... If you google Gaia & Ko bib, you should be able to see what I'm talking about...mine are very similar, but a different brand...