And then there is the rest of the story.
At 5:30 last night I was pretty sure the 8 integrations of the data running back to back was going to last for a while - it did - in fact run until about 9:00 pm. When I looked at it at that time "ALL of the INTEGRATIONS FAILED"
There were errors in a number of the lines of data which needed to be fixed.
I did that and then ran a single currency integration to ensure I was again good to go.
This ran took about 1/2 hour before it failed - at about 1,300 records - the system pops a SQL message that there are too many windows open and the process has aborted.
Now I have seen this before with large data sets. So, I simply hacked down the data set into 1,000 line chunks. No big deal, but now that means I need 3 x 8 currencies worth of Integrations in order to not crash the system.
So, 4 hours later, I now have 24 Integrations built, 1000 lines per, and I have put them all into an Integration Group and pushed the RUN button.
I wake up in the morning figuring all is good, since I have a GP menu in front of me and not a blue screen of death - there are no errors that I can see.
I start testing the data. It is exactly the same data in the TEST as in the LIVE. What happened?? Where did it fail
Interesting note about using Integration Groups, when the integration finishes, good or bad - it is done and the screen closes. So you have to open the Integration Manager to find out the status of the import.
All integrations failed and the all failed on line 315 to 325 - since I am using the same data source I know that I have a problem with those 10 lines of data.
Start the search for what is wrong.
1. Using CSV converts data that is badly formated in to junk
2. Using CSV drops any and all leading ZEROS
3. Importing JUNK into the ITEM NUMBER causes the system to realize you are dumber than you think.
So now it is middle of the morning Friday and I find all errors, recreate the integrations, start the integration group - ha, I tested once currency and it got no errors run through all 1,000 records - so, I push the run Integration Group. Now go off for a couple of hours and come back.
All the Integrations work - reviewed the log - there are no errors - yes, I have now taken 32 plus computer hours to complete the import into TEST - I still have to do it in LIVE.
Prior to the integration into LIVE database, I start to review the data as it appears when looking at the GP interface, specifically the Item Maintenance and the Item Currency Master windows.
All the inventory items appear to be there - the one field on the main screen that I was updating appears good - however, when I go the Item Currency Master, all the records are still at the same status as they were in the LIVE database 2 days ago.
What the heck is going on? There are no errors, the field on the Item Maintenance main screen is updated, but none (not one) 18,800 records in the Item Currency was updated.
Back to the drawing board. Well then something tickles that back of my brain while have a late well needed lunch that maybe something is interfering with the writing of the data to the Item Currency Master. Before you ask, yes I have Insert and Update selected.
Way back in the recess of my crusty old mind I seem to recall something about data in a table can interfere with the import of new data. Even with the Update flag chosen this can still cause a problem.
So, backup the IV00105 table - go to SQL Maintenance and DROP / RECREATE the Item Currency Master - clears and rebuilds - good thing.
Run a single Currency integration and NO ERRORS. Moment of truth - looking at Item Currency in the GP system and the dollar value is now correct. Run 2 more single currencies - just as a test - and all is good.
Long story - really too long - before you import into the Item Currency Master - IV00105 delete the junk that is in there first - the integration runs faster and it works.
Now I go to DRINK and get some sleep.
Share
Report
All responses (
Answers (
292,516
