For large businesses.
Add subteams that would only get people in the same subteam on their contact lists.
A manager would be assignable to one or multiple subteams, with rights to add/remove people.