It only ever opened, so the way out of the settings panel was somewhere else. Pressing it again closes it, and it carries the pressed state the other dock toggles do.