This may be a lame suggestion but maybe try mixing things up a bit so it doesn't always seem like you are after his swimmers. For instance get a quicky in before work or suprise him while he's cooking dinner.