While Group Visibility will remove a group’s listing from all members cards, it’s been commonly requested that you can customize this per-member.

Inverse of Privacy option for members to be visible in group list but not system list & vice versa?