Supervising for Safety