When hanging up, the conference transitions to undefined, so we should skip all processing related to setting up listeners for a new conference.