Beatrice, I would just say 'there'.
'down there' is more specific, but we are not yet sure specifically 'where' he is referring to.
Usually, the guest of the day sits there.