Hi,
Check if in the global address book parameters the option Secure by address book is enabled. If so, this can be the reason for not seeing the customers when the users are not linked to a team and this team is not assigned to one or more address books.