Skip to main content

Notifications

Announcements

No record found.

Finance | Project Operations, Human Resources, ...
Suggested answer

eConnect_Out Table - Company Level - Data retention and cleanup?

(0) ShareShare
ReportReport
Posted on by 10

So, I started at a new company and am reviewing the configuration here. Lot's of old data and we are using the Profad tool to start archiving older data

One question that came up concerns the eConnect_Out Table. This is in the Company level database (Not DYNAMICS) and has a huge number of old records.

  1. Do the records need to be kept?
  2. Retention policy for eConnect_Out records?
    1. Trim it or
    2. Truncate it?

2b or not 2b ? (Yes I went there)

Year   RowCount

2014    6,998,711
2015    3,957,746
2016    2,624,884
2017    2,700,585
2018    5,361,000
2019    3,618,308
2020    4,024,757
2021   20,879,942
2022   10,234,094

Categories:
  • Beat Bucher  GP Geek  GPUG All Star Profile Picture
    Beat Bucher GP Gee... 28,021 Super User 2024 Season 1 on at
    RE: eConnect_Out Table - Company Level - Data retention and cleanup?

    Thank you David,

    Scribe ? oh boy... it's been at least 15 years I used Scribe to do an Integration with GP 8.5 and it was for EDI transactions to feed into GP SOP module... but boy did I never looked back when I started working with SmartConnect a few years later.. Scribe was finicky and cumbersome to use and code.. SC's UI is so much more intuitive.

    Anyhow, if you couldn't find any eConnect setup, nor from where the Requester was configured, I'd try to disable the various triggers in the GP tables that are producing the data in the Out table.. it should be fairly easy to do I guess based on the data in the table... If anybody complains that something stopped working or is missing in the coming days, you may find out quickly this way.

    If nobody has reported back or complained within the next weeks, then you can safely assume that this data is no longer needed and turn everything off.

    Thanks Isaac Olson   for the thorough explanation about the eConnect Requester process.. I had seen it setup many years back by some partner that needed integration from and to GP for a project, which never completed, but the whole setup remained in place for several years, leaving the various tables sitting there, but never removed or cleaned up the mess. I finally stumbled across that in the light of a GP upgrade and managed to remove everything. Like for David, the triggers were never disabled, so they kept filling tables for nothing.

  • Suggested answer
    Isaac Olson Profile Picture
    Isaac Olson on at
    RE: eConnect_Out Table - Company Level - Data retention and cleanup?

    Hi David,

    There is a pretty decent section in the eConnectProgammersGuide.PDF that should be in the HELP folders of every eConnect install that describes how this table is used.

    Here is a diagram but there is more details in the guide.  I pulled out what I felt was relevant below. 

    pastedimage1643900190535v1.png 

    "eConnect_Out This table stores data from selected create, update, or delete operations that occur within Microsoft Dynamics GP. The data identifies the individual transactions that occurred. The Outgoing Service uses the data in this table to create an XML document that is placed in a queue."

    "For example, assume you want your application to be updated when a new customer is added to Microsoft Dynamics GP. To begin, you use the eConnect Requester Setup utility to specify the customer object and the SQL insert operation. The eConnect Requester Setup adds a SQL trigger to the database. When a new customer record is inserted, the SQL trigger creates a record of the event in the eConnect_Out table.

    The eConnect Outgoing Service periodically queries the eConnect_Out table. The service uses the record in the table to create an XML document that describes the new customer document.

    The Outgoing Service then places the XML document in a message queue where it can be retrieved and used by your application.

    To configure the eConnect Transaction Requester, use the eConnect Requester Setup utility. The eConnect Requester Setup utility allows you to specify Dynamics GP objects and operations you want to export to another application. The utility then adds SQL triggers to Dynamics GP that populate the eConnect_Out table for the specified objects and operations. For a detailed explanation of how to use the eConnect Requester Setup utility, see the eConnect Installation and Administration Guide.

    Refer to Chapter 17, “Customizing the Transaction Requester,” for information about using and customizing the Transaction Requester Service."

    Based on this my guess would be that when this was originally set up for the client, they marked more options than they really needed for tracking changes in GP, and all of these records are captured changes that have been waiting to be picked up by their outside application but never were because they were not needed by the outside application.  Now I obviously don't know their whole structure and what they require to tracking changes and what they do not, but based on this, to me these are all just stray records of changes that occurred to documents over the years that they had no need for so they are sitting around waiting to be picked up.  

    You may want to review chapter 17 in the Programmers Guide next to see what changes they are actually pushing to their outside application, 'if any', and also see if their outside application ever reads this table for any sort of history or reporting on transactions. 

    To me it would be logical that after passing the changes from GP into the eConnect_Out table, then from the eConnect_Out table to the outside application, that you would want to delete the record, which is why I think these have been piling up for years waiting to be called and never were because the outside applicaiton doesn't need them. 

    Anyways, I cannot tell you 'Yes' delete them or 'No' keep them because I do feel that answer would be dependent on your environment business processes outside of GP and whether they still need those records, but I hope this information helps you in making your decision easier or at least gives you direction to identify if your outside applications rely on them or not.  

    Thanks!

    Isaac Olson

    Microsoft Support

  • David Morinello Profile Picture
    David Morinello 10 on at
    RE: eConnect_Out Table - Company Level - Data retention and cleanup?

    It looks like this is coming from Scribe, as the data paused when we paused Scribe the other day.

    But eConnect is not installed on the Scribe Server. Running the Requester from another server shows nothing checked.

    SELECT * FROM dbo.eConnect_Out_Setup WITH (NOLOCK)

    No QUEUEPATH values and QUEUE_ENABLED are all set to 0. Several of the Trigger, Join, and most Data fields do have values.

  • Beat Bucher  GP Geek  GPUG All Star Profile Picture
    Beat Bucher GP Gee... 28,021 Super User 2024 Season 1 on at
    RE: eConnect_Out Table - Company Level - Data retention and cleanup?

    David,

    if you want to know where the data is coming from, just open eConnect Requester and look at which form/module of GP is checked off to produce data.. once you have identified it, it might be easier to understand what business process sits behind the eConnect_Out table and if it is still used. The same process should also take care of the clean-up, if ever there was an intent to clean-out the data from that table...

  • David Morinello Profile Picture
    David Morinello 10 on at
    RE: eConnect_Out Table - Company Level - Data retention and cleanup?

    Thanks guys!

    I wish I understood why it is not getting cleared out as that was my understanding of it's behavior also.

    I sent samples of the newest 100 records to our Partner since they designed most of the current external feed processes and might be able to tell where they come from.

  • Suggested answer
    Beat Bucher  GP Geek  GPUG All Star Profile Picture
    Beat Bucher GP Gee... 28,021 Super User 2024 Season 1 on at
    RE: eConnect_Out Table - Company Level - Data retention and cleanup?

    Hi David,

    That's indeed a very interesting question (2B or not 2B) :-)

    I've not met many customers so far that still uses the eConnect_Out  tables and I always thought that those tables were serving for the data to transition into GP, not really to be kept and that the process that puts data into those tables should also take care of cleaning up once the data is in GP..

    Any other thoughts on that ?

    This older thread might help to answer some of the qestions:

    community.dynamics.com/.../what-is-the-purpose-of-the-econnect-tables

    And maybe Isaac Olson  can jump in and help?

    PS: after I hit Post, I found this : https://carldesouza.com/get-data-from-dynamics-gp-using-econnect-requester/

    This is very interesting, as it explains the purpose of the eConnect_Out table and how records get populated.. This bears the question of post-processes that might be hooked up to your GP and use that data. If not, I would simply check for the Requester Tool Setup settings and disable those triggers... 

    PPS: And this answers my own question... LoL, didn' t even remember about that old post.. 8 years ago. https://dynamicsgpland.blogspot.com/2010/09/econnect-requester-and-econnectout.html

  • Suggested answer
    RE: eConnect_Out Table - Company Level - Data retention and cleanup?

    I was thinking that once the outgoing service picks the records up to output an XML to MSMQ, it should be done with the records and remove them.

    That being said, I'd think you'd be ok with removing records for 2014, 2015, etc.

    I'd make a backup of the database, just to be completely  safe, but I think you're fine.

    Thanks

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

December Spotlight Star - Muhammad Affan

Congratulations to a top community star!

Top 10 leaders for November!

Congratulations to our November super stars!

Tips for Writing Effective Verified Answers

Best practices for providing successful forum answers ✍️

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,391 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 230,445 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Product updates

Dynamics 365 release plans