Hello.
Any thoughts/hints/suggestions would be helpful against my current situation. And thank you in Advanced!
My team is running Dynamics 365 On Prem, and performance has taken a hit after a recent update to 8.2 and upgrade of our ClickDimensions solution. I'm not sure if these are the guilty culprits, but I figure that it might be important to mention.
What might be alarming is that the SQL Server (16 GB of Ram, and sufficient HD space) is running with a Databaase I/O of ~59 MB/S (Can someone tell me if that is unusual from a 50 user implementation standpoint?)
After turning on the tracelogs, we are the following message every 5 seconds. I was wondering if anyone had any ideas. Here are some facts:
- OrganizationID e11e527a-697a-e811-8104-00155d004b19 does not exist.
- None of our plugins explicitly reference an OrganizationID e11e527a-697a-e811-8104-00155d004b19.
- We are running Server Side Sync and Outlook Client and the CRM App for Outlook.
- We were running a French Language pack, but turning it off did not help.
Please view the following.
Crm Exception: Message: The organizationid - e11e527a-697a-e811-8104-00155d004b19 is missing or invalid ; stack trace : at Microsoft.Crm.Caching.OrganizationBaseLanguageCacheLoader.GetBaseLanguage(Guid key, SqlExecutionContext context), ErrorCode: -2147220989
[2018-07-03 11:37:56.214] Process:CrmAsyncService |Organization:e11e527a-697a-e811-8104-00155d004b19 |Thread: 189 |Category: EmailConnector |User: 00000000-0000-0000-0000-000000000000 |Level: Error |ReqId: 00000000-0000-0000-0000-000000000000 |ActivityId: 0137144b-5ff6-4f3b-865c-2bc131d92180 | EmailConnectorTraceHandler.EmailConnectorTraceFormat ilOffset = 0x163
>Mailbox checking active status process encountered CRM exception. Exception: Unhandled Exception: Microsoft.Crm.CrmException: The organizationid - e11e527a-697a-e811-8104-00155d004b19 is missing or invalid ; stack trace : at Microsoft.Crm.Caching.OrganizationBaseLanguageCacheLoader.GetBaseLanguage(Guid key, SqlExecutionContext context)
> at Microsoft.Crm.Caching.OrganizationBaseLanguageCacheLoader.GetBaseLanguage(Guid key, SqlExecutionContext context)
> at Microsoft.Crm.Caching.OrganizationBaseLanguageCacheLoader.LoadCacheData(Guid key, ExecutionContext context)
> at Microsoft.Crm.Caching.ObjectModelCacheLoader`2.LoadCacheData(TKey key, IOrganizationContext context)
> at Microsoft.Crm.Caching.BasicCrmCache`2.LookupEntry(TKey key, IOrganizationContext context)
> at Microsoft.Crm.Metadata.OrganizationBaseLanguage.GetOrganizationBaseLanguage(IOrganizationContext context)
> at Microsoft.Crm.Metadata.LabelCacheLabelCollection.HasLabels(IOrganizationContext context)
> at Microsoft.Crm.Metadata.PreloadedOptionSetMetadataDataProvider.CreateEntityNameReferenceOptions(SortedList`2& optionsSorted, IOrganizationContext organizationContext)
> at Microsoft.Crm.Metadata.PreloadedOptionSetMetadataDataProvider.LoadEntityNameReferenceOptionsIfNecessary(IOrganizationContext context, LoadMasks masks)
> at Microsoft.Crm.Metadata.PreloadedMetadataCacheDataProvider.InitializeOptionSets(IPreloadedMetadataInitializationContext context, LoadMasks masks, IOrganizationContext organizationContext)
> at Microsoft.Crm.Metadata.PreloadedMetadataCacheDataProvider.Initialize(IOrganizationContext organizationContext, MetadataContainer container, LoadMasks masks)
> at Microsoft.Crm.Metadata.MultiOrgSharableMetadataCacheLoader.CreateMetadataCacheDataProvider(MetadataContainer container, LoadMasks masks, CounterList counter)
> at Microsoft.Crm.Metadata.DynamicMetadataCacheLoader.BuildMetadataCacheFromMetadataContainer(MetadataContainer container, LoadMasks masks, CounterList counter)
> at Microsoft.Crm.Metadata.DynamicMetadataCacheLoader.LoadCacheFromDatabaseInternal(LoadMasks masks, CrmDbConnection connection, CrmTransaction transaction, CounterList counter)
> at Microsoft.Crm.Metadata.DynamicMetadataCacheLoader.LoadCacheFromDatabase(LoadMasks masks, CounterList counter)
> at Microsoft.Crm.Metadata.DynamicMetadataCacheFactory.LoadMetadataCache(LoadMethod method, CacheType type, IOrganizationContext context)
> at Microsoft.Crm.Metadata.MetadataCache.LoadCache(IOrganizationContext context, Boolean fileOnlyIfExists)
> at Microsoft.Crm.Metadata.MetadataCache.GetInstance(IOrganizationContext context)
> at Microsoft.Crm.BusinessEntities.BusinessEntityMoniker..ctor(Guid id, String entityName, IOrganizationContext orgContext)
> at Microsoft.Crm.Caching.OrganizationSettingsCacheLoader.LoadCacheData(Guid key, ExecutionContext context)
> at Microsoft.Crm.Caching.ObjectModelCacheLoader`2.LoadCacheData(TKey key, IOrganizationContext context)
> at Microsoft.Crm.Caching.CrmMultiOrgCacheBase`2.CreateEntry(TKey key, IOrganizationContext context)
> at Microsoft.Crm.Caching.CrmMultiOrgCacheBase`2.LookupEntry(TKey key, IOrganizationContext context)
> at Microsoft.Crm.BusinessEntities.SecurityLibrary.GetOrganizationSystemUser(Guid org, IOrganizationContext context)
> at Microsoft.Crm.Caching.MailboxCacheLoader.LoadCacheData(Guid key, ExecutionContext context)
> at Microsoft.Crm.Caching.ObjectModelCacheLoader`2.LoadCacheData(TKey key, IOrganizationContext context)
> at Microsoft.Crm.Caching.CrmMultiOrgCacheBase`2.CreateEntry(TKey key, IOrganizationContext context)
> at Microsoft.Crm.Caching.CrmMultiOrgCacheBase`2.LookupEntry(TKey key, IOrganizationContext context)
> at Microsoft.Crm.Asynchronous.EmailConnector.Mailbox.GetMailboxData(Boolean flushItemBeforeLookup)
> at Microsoft.Crm.Asynchronous.EmailConnector.MailboxDataAccess.IsInactiveMailbox(Entity mailbox, Boolean isMaxPostponeTime, Boolean isOutgoingMailbox)
>.
[2018-07-03 11:37:58.260] Process:CrmAsyncService |Organization:e11e527a-697a-e811-8104-00155d004b19 |Thread: 154 |Category: Exception |User: 00000000-0000-0000-0000-000000000000 |Level: Error |ReqId: 00000000-0000-0000-0000-000000000000 |ActivityId: 7d37316e-b81d-4551-be77-ea8afd15058e | CrmException..ctor ilOffset = 0xB
at CrmException..ctor(String message, Int32 errorCode) ilOffset = 0xB
at OrganizationBaseLanguageCacheLoader.GetBaseLanguage(Guid key, SqlExecutionContext context) ilOffset = 0x0
at OrganizationBaseLanguageCacheLoader.LoadCacheData(Guid key, ExecutionContext context) ilOffset = 0x9
at ObjectModelCacheLoader`2.LoadCacheData(TKey key, IOrganizationContext context) ilOffset = 0x0
at BasicCrmCache`2.LookupEntry(TKey key, IOrganizationContext context) ilOffset = 0x1A
at OrganizationBaseLanguage.GetOrganizationBaseLanguage(IOrganizationContext context) ilOffset = 0x0
at LabelCacheLabelCollection.HasLabels(IOrganizationContext context) ilOffset = 0x0
at PreloadedOptionSetMetadataDataProvider.CreateEntityNameReferenceOptions(SortedList`2& optionsSorted, IOrganizationContext organizationContext) ilOffset = 0x50
at PreloadedOptionSetMetadataDataProvider.LoadEntityNameReferenceOptionsIfNecessary(IOrganizationContext context, LoadMasks masks) ilOffset = 0x1B
at PreloadedMetadataCacheDataProvider.InitializeOptionSets(IPreloadedMetadataInitializationContext context, LoadMasks masks, IOrganizationContext organizationContext) ilOffset = 0x23
at PreloadedMetadataCacheDataProvider.Initialize(IOrganizationContext organizationContext, MetadataContainer container, LoadMasks masks) ilOffset = 0x12C
at MultiOrgSharableMetadataCacheLoader.CreateMetadataCacheDataProvider(MetadataContainer container, LoadMasks masks, CounterList counter) ilOffset = 0x23
at DynamicMetadataCacheLoader.BuildMetadataCacheFromMetadataContainer(MetadataContainer container, LoadMasks masks, CounterList counter) ilOffset = 0x19
at DynamicMetadataCacheLoader.LoadCacheFromDatabaseInternal(LoadMasks masks, CrmDbConnection connection, CrmTransaction transaction, CounterList counter) ilOffset = 0x30
at DynamicMetadataCacheLoader.LoadCacheFromDatabase(LoadMasks masks, CounterList counter) ilOffset = 0x24
at DynamicMetadataCacheFactory.LoadMetadataCache(LoadMethod method, CacheType type, IOrganizationContext context) ilOffset = 0x131
at MetadataCache.LoadCache(IOrganizationContext context, Boolean fileOnlyIfExists) ilOffset = 0xF3
at MetadataCache.GetInstance(IOrganizationContext context) ilOffset = 0x9A
at BusinessEntityMoniker..ctor(Guid id, String entityName, IOrganizationContext orgContext) ilOffset = 0x19
at OrganizationSettingsCacheLoader.LoadCacheData(Guid key, ExecutionContext context) ilOffset = 0x4F
at ObjectModelCacheLoader`2.LoadCacheData(TKey key, IOrganizationContext context) ilOffset = 0x0
at CrmMultiOrgCacheBase`2.CreateEntry(TKey key, IOrganizationContext context) ilOffset = 0x1A
at CrmMultiOrgCacheBase`2.LookupEntry(TKey key, IOrganizationContext context) ilOffset = 0x0
at ServerOrganizationConfiguration.get_OrganizationSettings() ilOffset = 0x16
at MailboxOperationCommand.InitializeOperations(MailboxAsyncEvent asyncEvent, AsyncThrottleSubscriber throttlerSubscriber) ilOffset = 0x0
at MailboxOperationCommand.InternalExecute(MailboxAsyncEvent asyncEvent) ilOffset = 0x61
at AsyncEventHandlerCommand`1.Execute(IAsyncEvent asyncEvent) ilOffset = 0xD7
at AsyncEventExecutionManager`2.ExecuteCommand(IAsyncEventHandlerFactory handlerFactory) ilOffset = 0x95
at AsyncEventExecutionManager`2.ExecuteHandler(IAsyncEventHandlerFactory handlerFactory) ilOffset = 0x63
at PoolHandler.ProcessAsyncEvent(IAsyncEventExecutionManager asyncEventExecutionManager) ilOffset = 0x22A
at AsyncEventOperation.<.ctor>b__2(IServiceOperation operation) ilOffset = 0x0
at FaultToleranceBehavior.Execute(ServiceOperationAction operation, IServiceOperation operationParameter) ilOffset = 0x18
at IsolatedOperation.Execute() ilOffset = 0x27
at MonitoredOperation.Execute() ilOffset = 0xD
at ThreadPoolQueueExecutionEngine.InvokeNextOperationInThreadPool(Object state) ilOffset = 0x16
at ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) ilOffset = 0x79
at ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) ilOffset = 0x9
at QueueUserWorkItemCallback.System.Threading.IThreadPoolWorkItem.ExecuteWorkItem() ilOffset = 0x33
at ThreadPoolWorkQueue.Dispatch() ilOffset = 0xA4
*This post is locked for comments