I have recently enabled the sharepoint server integration with a default site that automatically creates folders per contact.
My user test user 1 has access to the sharepoint default site.
When I open a contact record and then files, I can see the document location and update as necessary. Here's a screenshot of this:

However, if I add a new sharepoint document location that my user doesn't have access to, then I get a permission error and I can't open either document location. I get the following error whether I click on the "Enrollment", or the "Documents on Default Site 1" or the "All Locations" document locations.
If I choose a new document location, I see the spinning dots for quite a few seconds.

Is there a way to enable users to see the document locations that they are able to see, and to not see the ones they don't have access to or to simply hide the folders that they don't have access to? I've set the permissions in sharepoint for each of these sharepoint sites. I haven't updated any permissions within Dynamics 365 itself.
This looks like a bug to me, but I would appreciate any help.