That's an awful situation it sounds like the centre isnt dealing with it properly. We have two males at our centre, they do all the regular stuff and they comfort and hug my girls if they need to. One of them is close to my eldest he helped calm her down last year when I was in hospital with Ds.

Your centre should be explaining that you are trained, have police checks etc and are no different to the female carers.