How to limit SOP batch size or break the batch into smaller batches

(0) Share

Report

Posted on by David.Ahalt

470

Is there a way to limit the number of transaction in a batch or a way to break them into smaller batches? I have several batches which grow very large during the day. The problem we are seeing is the batches are so large that when they post at night we encounter deadlocks and network interrupts before the batches finish posting thus hanging the posting process requiring batch recovery. Does anyone have a script or automated process to break a batch into smaller batches to minimize the chances of encountering interrupts?

Thanks, Dave

*This post is locked for comments

I have the same question (0)

All responses (10)

Answers (1)

Sort by

Suggested answer

Richard Whaley 25,195 on at

Like
a
(0)

Report
Copy link

Link copied!

Sorry, there is no way to limit the number of transactions in a batch.

Are you using (or could you switch to using) Fulfillment Orders? There is a sales multiple order to invoice transfer that allows you to select a range of orders that are fulfilled and transfer them to a new batch for posting.

However, you mentioned nightly posting. Do you post multiple batches at the same time? Having more batches posting at the same time can make the deadlock problem worse.

You may want to get a SQL expert to review the setup of your SQL. It is possible to increase the number of threads, lengthen the time out, and several other changes that they would know best that could help.

Was this reply helpful? Yes No
Ian Grieve 22,784 on at

Like
a
(0)

Report
Copy link

Link copied!

David, there is no way to do this out of the box.

How are your batches being created?

Was this reply helpful? Yes No
Suggested answer

sandipdjadhav 18,335 on at

Like
a
(0)

Report
Copy link

Link copied!

David,

Why don't you force user to use another batch after certain no of transactions. Through vba or Visual Studio Tools you can check on each batches no of transaction and force user to create new batch ID.

Thanks

Sandip

Was this reply helpful? Yes No
Suggested answer

Mahmoud Saadi 32,738 on at

Like
a
(0)

Report
Copy link

Link copied!

Nothing more valuable to add, just to ensure what's your main target of this post. Is it to get this solved permanently so that you solve this problem once and forever, or just to handle the current huge batches in your system now.

To handle this permanently, nothing out of the box in GP to handle this as Mr. Ian says, although simple customization either to prevent or pop up a warning message on the entry window is doable.

In case you want to split your current batches for now, you may consider a simple macro to run through all the transaction and update the "Batch ID" field accordingly so that you could limit down the size of the batches.

I will absolutely echo Mr. Richard suggestion in not considering a mass posting with no previous consideration as deadlock might result with undesirable results.

Was this reply helpful? Yes No
David.Ahalt 470 on at

Like
a
(0)

Report
Copy link

Link copied!

These are being sent in from an online store on a continous basis as orders are submitted. The volume of daily transactions has increased to a level much greater than projected when this was implemented a few years back. I would normally recommend keeping batches to around 200 transactions but we are seeing much more. I had seen a batch parsing tool/sql job a couple years back that would doing something like this but cannot find it.

Was this reply helpful? Yes No
Frank Hamelly | MVP... 46,633 Moderator on at

Like
a
(0)

Report
Copy link

Link copied!

David, what tool is being used to integrate the orders into GP?

Was this reply helpful? Yes No
Community Member on at

Like
a
(0)

Report
Copy link

Link copied!

Hi Dave,

It's been a minute since we've worked together. Hope all is well in Kansas. If you're using the web-service hit up Chad Larson on LinkedIn. We capped SOP's at 200 per batch for a recent Xennsoft>GP integration. He coded it and can point you in the right direction.

Donnette

Was this reply helpful? Yes No
L Vail 65,271 on at

Like
a
(0)

Report
Copy link

Link copied!

Hi,

I agree with the others. We've had to do this to manage the number of transactions coming in from the RMS systems. While not very elegant, we run a stored procedure before executing the post that scrolls through the batches and changes the batch ID after a set number of transactions. We first pull all of the 'postable' transactions out of the existing batches so that we have on huge batch containing everything we want to post. Next, we traverse through that batch and change the batch ID after X number of batches.

So far, it has been working.

Kind regards,

Leslie

Was this reply helpful? Yes No
Verified answer

David.Ahalt 470 on at

Like
a
(0)

Report
Copy link

Link copied!

Thanks all appreciate the feedback. Looks like a little stored proc is in order.

Was this reply helpful? Yes No
Richard Wheeler 75,852 Moderator on at

Like
a
(0)

Report
Copy link

Link copied!

Just to add my two cents here, I have a Visual Studio integration that imports hundreds of eExpense entries and it is set to create one batch for each 50 invoices. This elimated all batches errors that occurred with large batch postings.

Was this reply helpful? Yes No