web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

No record found.

Community site session details

Community site session details

Session Id :
Microsoft Dynamics AX (Archived)

DMF Data migration from Extract to staging table Error | Records Import Limit

(0) ShareShare
ReportReport
Posted on by

Hi there,

I have to import around 1.6 million record from extract table to the staging one DIXF. 

When I use DIXF service 3million record get transfered but it doesn't works as soon as it reaches above 3 million it fails with error: 

System.ServiceModel.CommunicationException: An error occurred while receiving the HTTP response to localhost/.../DMFServiceHelper.svc. This could be due to the service endpoint binding not using the HTTP protocol. This could also be due to an HTTP request context being aborted by the server (possibly due to the service shutting down). See server logs for more details. ---> System.Net.WebException: The underlying connection was closed: An unexpected error occurred on a receive. ---> System.IO.IOException: Unable to read data from the transport connection: An existing connection was forcibly closed by the remote host. ---> System.Net.Sockets.SocketException: An existing connection was forcibly closed by the remote host
   at System.Net.Sockets.Socket.Receive(Byte[] buffer, Int32 offset, Int32 size, SocketFlags socketFlags)
   at System.Net.Sockets.NetworkStream.Read(Byte[] buffer, Int32 offset, Int32 size)
   --- End of inner exception stack trace ---
   at System.Net.Sockets.NetworkStream.Read(Byte[] buffer, Int32 offset, Int32 size)
   at System.Net.PooledStream.Read(Byte[] buffer, Int32 offset, Int32 size)
   at System.Net.Connection.SyncRead(HttpWebRequest request, Boolean userRetrievedStream, Boolean probeRead)
   --- End of inner exception stack trace ---
   at System.Net.HttpWebRequest.GetResponse()
   at System.ServiceModel.Channels.HttpChannelFactory`1.HttpRequestChannel.HttpChannelRequest.WaitForReply(TimeSpan timeout)
   --- End of inner exception stack trace ---
Server stack trace:
   at System.ServiceModel.Channels.HttpChannelUtilities.ProcessGetResponseWebException(WebException webException, HttpWebRequest request, HttpAbortReason abortReason)
   at System.ServiceModel.Channels.HttpChannelFactory`1.HttpRequestChannel.HttpChannelRequest.WaitForReply(TimeSpan timeout)
   at System.ServiceModel.Channels.RequestChannel.Request(Message message, TimeSpan timeout)
   at System.ServiceModel.Channels.ClientReliableChannelBinder`1.RequestClientReliableChannelBinder`1.OnRequest(TRequestChannel channel, Message message, TimeSpan timeout, MaskingMode maskingMode)
   at System.ServiceModel.Channels.ClientReliableChannelBinder`1.Request(Message message, TimeSpan timeout, MaskingMode maskingMode)
   at System.ServiceModel.Channels.ClientReliableChannelBinder`1.Request(Message message, TimeSpan timeout)
   at System.ServiceModel.Security.SecuritySessionClientSettings`1.SecurityRequestSessionChannel.Request(Message message, TimeSpan timeout)
   at System.ServiceModel.Dispatcher.RequestChannelBinder.Request(Message message, TimeSpan timeout)
   at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
   at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
   at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)
Exception rethrown at [0]:
   at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
   at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
   at Microsoft.Dynamics.AX.DMF.ServiceProxy.DMFServiceReference.ServiceContract.MigrateEntity(DMFEntity entity)
   at Microsoft.Dynamics.AX.DMF.ServiceProxy.DmfEntityProxy.<>c__DisplayClass1.<MigrateEntity>b__0()
   at Microsoft.Dynamics.AX.DMF.ServiceProxy.DmfEntityProxy.DoWork[T](Func`1 work)
'0' 'Site settings' record(s) inserted in staging

Ive placed a new variable named LoadBalance and this will be updated upon recCount above or less than 3million
here the code:

if (recCount < 300000)
        {
            extract.LoadBalance = loadBal;
            recCount++;
        }
        else
        {
            loadBal++;
            extract.LoadBalance = loadBal;
            recCount = 1;
        }

and set this in my query in processing group i.e. 

select * from ssi_extract_sitesettings where loadbalance = 1

Im therefore, thinking if its a record transfer limit or a timeout. Any Idea?

*This post is locked for comments

I have the same question (0)
  • Verified answer
    Vilmos Kintera Profile Picture
    46,149 on at

    DIXF is using AIF services that you could check in AX at the Inbound ports form, starting with DMF* prefix.

    You are probably hitting a record size or transfer timeout set within the WCF configuration. It is possible to edit these limits if you deactivate the ports (please only do that during a maintenance window if you are doing this in Production).

    [View:https://blogs.msdn.microsoft.com/axsupport/2015/04/07/requesting-large-packages-across-ax-aif-can-result-in-timeout-errors-after-30-seconds-regardless-of-your-timeout-values/:750:50]

    [View:https://stackoverflow.com/questions/1520283/wcf-service-how-to-increase-the-timeout:750:50]

    You could also search for "size" on the second link and see what values can you try to increase.

    Once you have re-activated the inbound ports, try again and let us know which combination has worked for you.

  • Community Member Profile Picture
    on at

    Thanks Vilmos Kintera

    It answered my query.

  • Suggested answer
    Umair Qaisar Profile Picture
    on at

    Just to confirm that there shouldn't be any record limit, I have loaded 10M records to Staging in one go.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Responsible AI policies

As AI tools become more common, we’re introducing a Responsible AI Use…

Neeraj Kumar – Community Spotlight

We are honored to recognize Neeraj Kumar as our Community Spotlight honoree for…

Leaderboard > 🔒一 Microsoft Dynamics AX (Archived)

#1
Martin Dráb Profile Picture

Martin Dráb 4 Most Valuable Professional

#1
Priya_K Profile Picture

Priya_K 4

#3
MyDynamicsNAV Profile Picture

MyDynamicsNAV 2

Last 30 days Overall leaderboard

Featured topics

Product updates

Dynamics 365 release plans