I took mine out around 20ish weeks I think it was. The hole didn't close over & all was fine.

Check out this thread and also this one where we have discussed it before.......