Skip to main content

Notifications

Microsoft Dynamics RMS (Archived)

all stores hq clients connecting at same time causing high load

Posted on by Microsoft Employee

how do you solve having 100 stores all connecting at same time to hq server ?

 

it seems the sql server spikes to 99% Memory at that time, and lags the whole process...

 

Cant we have stores upload at theyre own interval ?

10 minutes after hour, is 10 minutes after hour for all.. UNLESS clocks are skewed in which case all goes bad...

 

*This post is locked for comments

  • Suggested answer
    Community Member Profile Picture
    Community Member Microsoft Employee on at
    RE: all stores hq clients connecting at same time causing high load

    We split the polling up over three Com servers. we use about 99 HQ Server ports split over the three servers. Polling is set to run at 15 minute intervals twice a night between

    5:00Pm and 8:00 am. Each store gets to poll twice a day. This has solved most of our polling issues.

  • Community Member Profile Picture
    Community Member Microsoft Employee on at
    RE: all stores hq clients connecting at same time causing high load

    I had this same issue and I only have 16 stores...can't imagine having 100.  I have my stores staggered by going into Headquarters Manager\Admin\Stores then selecting a store and properties and selecting the connection schedule tab(each store will have it's own entry and thus will have it's own connection schedule.)  Another thing that helped was only allowing worksheet 401 to run during the course of the business day.  We run all other worksheets after closing generally.

    You definitely do not want to skew your system clocks especially if you do inter-store transfers as doing so will send your transfers in 'limbo' as they will get lost due to the time difference between the server and the various stores which is a whole other nightmare to deal with.

    Hope this is of some help to you.

  • Community Member Profile Picture
    Community Member Microsoft Employee on at
    RE: all stores hq clients connecting at same time causing high load

    In my case we have 200 stores, 10 HQ Server Activated, each store syncs every 2 hours, with minute differences, the idea is that each time they are connecting the minimum possible number of stores in each HQ Server.

    As is every 2 hours, some stores even synchronize time and other odd hour.

    Similarly this is not enough, work on database is both constant monitoring and maintenance.

    Must also analyze the capacity of your network and your server where your HQ database.

    We've changed several times, to root growth.

  • Suggested answer
    archelle16 Profile Picture
    archelle16 1,735 on at
    RE: all stores hq clients connecting at same time causing high load

    Wow that is one big challenge for maintaining 100 stores. We only got 30 and it really drives me crazy haha.

    Anyways, what we do is that, we give schedules for a store when they are allowed to sync. Sync started after working hours, so we started at 5pm. store a should finish its sync before 6 pm. store b should start its sync in 6 and should finished before 7. In this way, we can accommodate our store to sync daily or alternately. Sync uses sql transaction which yields locking to some tables. You need to wait for one transaction to complete before you can make another transaction. Database and Time management are keys to avoid this issues.

  • Suggested answer
    Community Member Profile Picture
    Community Member Microsoft Employee on at
    RE: all stores hq clients connecting at same time causing high load

    We have customers with around 100 stores, but there are users with over 1000.

  • Community Member Profile Picture
    Community Member Microsoft Employee on at
    RE: all stores hq clients connecting at same time causing high load

    25 locations? is there any company that has more than 25 and more? I would like to know how their setup is... we are about to reach 25 locations and it is driving me nut.,.. is anybody done using multiple database?

  • Suggested answer
    Community Member Profile Picture
    Community Member Microsoft Employee on at
    RE: all stores hq clients connecting at same time causing high load

    There are 3rd-party solutions for this, from nChannel, Davidson-Richards, etc. I know most people would want to find a solution within the base software, but I have seen this come up many times and it seems like RMS/HQ is really only efficient for up to about 25 locations.

    Regards

    Mike Haugen

    Senior Retail Technology Consultant

    Retail Technology Experts (RTE)

    3601 SW 160th Ave. Suite 110|Miramar, FL 33027

    Phone: 800-513-5917 x123  |  Fax: 954-266-4781

    Mobile: 786-219-7864  |  Skype: rte_sales

  • Community Member Profile Picture
    Community Member Microsoft Employee on at
    RE: all stores hq clients connecting at same time causing high load

    If there's 100 stores connecting to HQ server, you probably will have deadlock error from HQ client more often. We have 24 stores and running 6 different HQ Server Apps. and each HQ Server apps holding 5 different stores. Each store connection times are 10 mins apart. I figured, even stores are connecting to HQ Server Apps same time with different port number HQ Server Apps, you will end up getting deadlock errors.

    If you separate 100 store connection 1min apart, you can only connect 60 stores.

    MS does not have any solution for this yet but you can run multiple database and consolidate to one database.

    I am not a DBA... but if you have 100 stores, I think you should find detail info how to run multiple database.

  • Community Member Profile Picture
    Community Member Microsoft Employee on at
    Re: all stores hq clients connecting at same time causing high load

    yes, of course, and therefore to have all fresh data every 15 minutes, one needs to select

    CONNECT EVERY 15 MINUTES WITHIN THE HOUR

    therefore i would assume that for every computer (X) it is set to SAME TIME on this planet as they all sync to same time server...

    unless they are faster then speed of light wich is another story.

    basically they will ALL connect 15 minutes after the hour to be able to have fresh data 4 times per hour...

    MS should of put an option like...

    Connect EVERY 15 minutes STARTING at 12:00 PM

    then i could change the 12:00PM to 12:03PM on store 2, 12:05PM on store 3 , and so on...

    Get it ? or im missing something too obvious...

    because if i change the every amount... then i would get every 17 minutes, which in my book wont be 4 times an hour, but 88% of my requested schedule.. and less after that.

  • Zakeer Hussain Profile Picture
    Zakeer Hussain 345 on at
    Re: all stores hq clients connecting at same time causing high load

    You can schedule the sync for every store from HQ Manager. Go to Admin->Store-->properties

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

December Spotlight Star - Muhammad Affan

Congratulations to a top community star!

Top 10 leaders for November!

Congratulations to our November super stars!

Community AMA December 12th

Join us as we continue to demystify the Dynamics 365 Contact Center

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,253 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 230,188 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans