Finance | Project Operations, Human Resources, ...

RSAT Testing of multiple combinations

(0) Share

Report

Posted on by Marvin Hehlert

Hello,

I am working with the Regression Suite Automation Tool right now and I've read the documentations, but I still haven't found an answer to my question.

Is there a way to use one test case in a loop, and in every loop it uses another variable from a list and iterates all entries?

Example: I want to test the creation of a sales order with different payment methods, payment terms, accounts and products. The steps are the same every time, but I want to test every possible comibination of all these parameters, so there will be hundreds of possibilities.
Of course I don't want to create all cases one by one or copy it and change the parameters manually. I want RSAT to iterate through those combinations and fill them into the parameter file, then loop through the test again.

Sample list like this:

2021_2D00_05_2D00_20-19_5F00_38_5F00_11_2D00_Mappe1-_2D00_-Excel.jpg

Thanks in advance!

Is there a way to add a list of parameters to the RSAT runs?

I have the same question (0)

All responses (16)

Answers (0)

Anton Tjiptadi 2,013 on at

Like (2)

Report

Hi,

You can use the parameter file, open from your RSAT tools with your Excel. Over there is a sheet for the steps with values on one column.

You can manipulate this parameter file's cell to retrieve data from another cell. And in that "another cell" you can put your logic so the value keep changing every time this parameter file is refresh (called).

Something like this :

The column F is actually my addition (for the value option) and in my cell F19, here is the formula : =TODAY()+INDEX($F$3:$F$5,RANDBETWEEN(1,ROWS($F$3:$F$5)),1)

In above sample, my RSAT parameter will change the session date every time the RSAT is running. It's just for example only, the list of probability you can make as per your own needs.

For references, may take a look at this : Run test cases by using the Regression suite automation tool (RSAT) - Finance & Operations | Dynamics 365 | Microsoft Docs

Hope this is what you looking for.

Was this reply helpful? Yes No
Marvin Hehlert 10 on at

Like (0)

Report

Thanks for your answer, unfortunately it doesn't fit my requirement for the tests as it is random, so I can't be sure that every combination that I need to check is tested. Also I would have to start the RSAT again for every run random parameters and it's not doing this by itself for every combination.

But your post was still helpful for other uses, thanks!

Was this reply helpful? Yes No
AJJAIS on at

Like (0)

Report

This scenario is not supported.

Was this reply helpful? Yes No
markmj 584 on at

Like (0)

Report

Are you running the tests from Azure Devops. If so, I believe you can setup multiple parameter sets. This is something I need to test/verify. Have you made any progress?

Was this reply helpful? Yes No
SonalY 45 on at

Like (0)

Report

Is there any way to set up a multiple parameter in DevOps? Even I am looking for a solution to parametrize my test, the solution I got is to derive the test cases and change the value in each test case manually ? is there any other way to feed the data ?

Was this reply helpful? Yes No
markmj 584 on at

Like (1)

Report

[quote user="SonalY"]
Is there any way to set up a multiple parameter in DevOps? Even I am looking for a solution to parametrize my test, the solution I got is to derive the test cases and change the value in each test case manually ? is there any other way to feed the data ?
[/quote]
I did this using PowerShell. I have 51 different PO's I need to create, submit for approval and then verify that the approver is correct. The test runs from powershell 51 times (using a for loop) and between each run, updates the parameter file with new values. The one downside is that I can only seem to do this with a test case and not a suite, as every time it starts the suite, it seems to revert the parameter file (I presume it downloads from Devops again), so I had to build a single test case that creates the PO, submits for approval, validates the approver. (Previously, this was a test suite with 3 tests cases)

Happy to share more details of required

Was this reply helpful? Yes No
YY Lim 960 on at

Like (0)

Report

You can use the derived test case, the recording is the same (means all the steps are the same) but with different parameter file.

test case 1: credit card, 30 daysm US-001, ABC1

test case 2: credit card, 30 daysm US-001, ABC2

and so on.

I don't have RSAT with me to provide screen shot, but this should help if I understand your requirement correctly.

docs.microsoft.com/.../rsat-derived-test-cases

Was this reply helpful? Yes No
markmj 584 on at

Like (2)

Report
You can, but it's maintenance nightmare. If I change the test (record a new step) and I have 50 derived test cases, I need to update 50 parameter files with my test data again. It works, but it's not practical beyond a handful of derived test cases IMO

I'd say there are 2 practical solutions:

Execute test via powershell n-times and update parameter file between each test

Write something to update all parameter files for derived tests

Would be interested in other options

Was this reply helpful? Yes No
Marvin Hehlert 10 on at

Like (1)

Report

Thanks for responding, I didn't give any feedback in this post for some time now because we accepted the manual change of all varaibles. But as I said in my original answer, this is a lot of manual work and also a maintenance nightmare like you said.

The powershell option is possible but also not very viable for the customer. You can't track your results in DevOps without looking into details for every run as they all have the same name, they are all the same test case for DevOps and just edited by the script.

I stopped looking for another solution, it looks like there is no better way to do this but if anybody else has a suggestion it could help someone else. Thanks all!

Was this reply helpful? Yes No
Mateusz Lukowiec 5 on at

Like (1)

Report

Hi Marvin Hehlert, have you looked at any RSAT alternatives?

RSAT is a fine tool to use if your project is small and the number of test scripts is <100. The bigger the project and the more test scripts you have, the more of a maintenance and management nightmare it is.

Here is a 2,5-year-old video showing such an excel loop inside a test script in a tool that we and many of our clients use for test automation projects, Executive Automats -

Was this reply helpful? Yes No

Join the conversation

Community site session details

RSAT Testing of multiple combinations

Helpful resources

Quick Links

Responsible AI policies

Neeraj Kumar – Community Spotlight

Congratulations to the November Top 10 Community Leaders!

Leaderboard > Finance | Project Operations, Human Resources, AX, GP, SL

Featured topics

Product updates

Community site session details

RSAT Testing of multiple combinations

Helpful resources

Quick Links

Responsible AI policies

Neeraj Kumar – Community Spotlight

Congratulations to the November Top 10 Community Leaders!

Subscribe to this forum!

Select categories

Leaderboard > Finance | Project Operations, Human Resources, AX, GP, SL

Featured topics

Product updates