Match the celebrity to their baby's name, bingo using baby related items.
When I have done a baby shower recently I googled baby shower games and found tonnes of great websites so maybe try that.

Cupcakes are cute for food (especially the tiny ones) dips and vegie sticks, little sausage rolls, sandwiches etc.