Did you make sure it was cooled before you popped them out? I have read you need to do that, although having said that I've had little luck with the silicon trays.

And the chocolate mousse idea is a winner. Mail it to me if you need feedback