No! No! No! Don't back into it! Legally you aren't allowed to reverse out of your driveway, so you (or DH) would be responsible for all damage.

I would try approaching them first, but if that's not possible (or a dead end), then call the council and voice your concern of safety. Good luck.