Tums worked (still works!) best for me.

Milk also seems to help soothe it, and I sleep propped up a bit.

Hope you get some relief soon, it's so uncomfortable x