Skip to main content

Notifications

Finance | Project Operations, Human Resources, ...
Unanswered

Need to extract data in Batches using eConnectOut.

(0) ShareShare
ReportReport
Posted on by 265

Hi,

We are trying to extract data from GreatPlains using eConnect. We are getting the following error when we try to extract large volume of data.

"Failed to allocate a managed memory buffer of 536870912 bytes. The amount of available memory may be low.". So we assume that this issue due to volume of records. So we are trying to implement batching in our extraction. That is getting the  records in batches. It will be helpful if we can get answers for the following.

1) How to resove this "Failed to allocate a managed memory buffer of 536870912 bytes. The amount of available memory may be low." error.

2) How to get the record in batches (100 by 100 or 1000 by 1000).

Any help highly appreciated.

Thanks and Regards

Venkatesan

Categories:
  • Richard Wheeler Profile Picture
    Richard Wheeler 75,730 on at
    RE: Need to extract data in Batches using eConnectOut.

    I have never used eConnect to extract data but my buddy Mariano Gomez has.

    Perhaps this will help.

    community.dynamics.com/.../extracting-data-from-microsoft-dynamics-gp-company-databases-using-sql-server-for-xml-and-xmlnamespaces

  • venkateshmpr Profile Picture
    venkateshmpr 265 on at
    RE: Need to extract data in Batches using eConnectOut.

    Thanks for you replay Richard, Using eConnect we can extract data too. We are trying to extract Sales Transactions. Below is the sample code we used to extract the data.

               eConnectType myEConnectType = new eConnectType();

               RQeConnectOutType myReqType = new RQeConnectOutType();

               eConnectOut myeConnectOut = new eConnectOut();

               myeConnectOut.ACTION = 1;

               myeConnectOut.DOCTYPE = "Sales_Transaction";

               myeConnectOut.OUTPUTTYPE = 2;

               myeConnectOut.FORLIST = 1;

               if (!string.IsNullOrEmpty(filter))

                   myeConnectOut.WhereClause = filter;

               myReqType.eConnectOut = myeConnectOut;

               RQeConnectOutType[] myReqOutType = { myReqType };

               myEConnectType.RQeConnectOutType = myReqOutType;

               MemoryStream myMemStream = new MemoryStream();

               XmlSerializer mySerializer = new XmlSerializer(myEConnectType.GetType());

               mySerializer.Serialize(myMemStream, myEConnectType);

               myMemStream.Position = 0;

               XmlTextReader xmlreader = new XmlTextReader(myMemStream);

               string xmldoc = string.Empty;

               while (xmlreader.Read())

               {

                   xmldoc = xmldoc + xmlreader.ReadOuterXml();

               }

               myMemStream.Close();

               eConnectMethods requester = new eConnectMethods();

               string reqDoc = requester.eConnect_Requester(connString, EnumTypes.ConnectionStringType.SqlClient, xmldoc);

    Thanks and Regards

    Venkatesan

  • Richard Wheeler Profile Picture
    Richard Wheeler 75,730 on at
    RE: Need to extract data in Batches using eConnectOut.

    eConnect is used to write data into GP not extract data. Exactly what data are you trying to extract?

  • venkateshmpr Profile Picture
    venkateshmpr 265 on at
    RE: Need to extract data in Batches using eConnectOut.

    Can anyone help here? Need to resolve the issue asap.

    Thanks and Regards

    Venkat

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

News and Announcements

Announcing Category Subscriptions!

Quick Links

December Spotlight Star - Muhammad Affan

Congratulations to a top community star!

Top 10 leaders for November!

Congratulations to our November super stars!

Tips for Writing Effective Verified Answers

Best practices for providing successful forum answers ✍️

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,359 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 230,370 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Product updates

Dynamics 365 release plans