I agree, it depends on what you're after. You said you love luxury - does that mean you'd want to stay at the resort all day? I'd go Port Douglas.
BUT, I looooove the tablelands... If it were me and DH and we only had a long weekend, I'd stay in a cabin at Lake Eacham or something. Lots of rainforest and walks and birds.