Hi there,
We had the same problem in our bathroom - ours actually looked like dark sawdust or something. Each time I cleared it away it would return not long after. When we had our pest control done, the guy said exactly what you mentioned - it's like a graveyard! He just sprayed it with some chemical (nothing too harsh) and it's done the trick!
Hope you can get rid of them soon!