Here's a complete list of Dynamics 365 App for Outlook privileges in case someone else is also struggling with them.

At least one of them (Model-driven App) was missing from the documentation.

Dynamics App for Outlook Privileges

Entity

Read

Write

Use Dynamics 365 App for Outlook

Organization

 

Model-driven App

Organization

 

Mailbox

User

User

Entity

Organization

Organization

Field

Organization

Organization

Relationship

Organization

Organization

System Application Metadata

Organization

Organization

System Form

Organization

Organization

User Application Metadata

User

User

View

Organization

Organization

This list will only be valid for a while because of the coming Dynamics 365 App for Outlook User security role.

Please comment if the list should be changed.