Not entirely sure if you do have to make a booking, but it can't hurt! It was pretty busy when we went there, and it really is a little room for the cafe, so I reckon it would be best to book, so we get a big enough table inside, not on the footpath...