Parallelism just not happening

[agray]

https://github.com/Sauceforge/Saucery/actions/runs/18253542864/job/51971811832

I sit and watch DataDrivenTest and ClickLinkTest run one at a time despite limit set to 4 and 15 platforms to run each test on:

https://github.com/Sauceforge/Saucery/tree/master/Merlin.TUnit

Am I setting my tests up incorrectly?

[thomhurst]

Looks correct. There's tests in TUnit verifying parallelism is working.

Could it be SauceLabs or something limiting you instead?

[agray]

Don't think it is SauceLabs.

See this branch (Tests are running one at a time):
https://github.com/Sauceforge/Saucery/tree/tunitparalleltest/Merlin.TUnit

Combined tests:
https://github.com/Sauceforge/Saucery/blob/tunitparalleltest/Merlin.TUnit/GuineaPigTests.cs

Parallel set at 40 - way bigger than my OpenSauce account limit of 5 for virtual devices:
https://github.com/Sauceforge/Saucery/blob/tunitparalleltest/Merlin.TUnit/MyParallelLimit.cs

15 platforms x 3 tests:
https://github.com/Sauceforge/Saucery/blob/tunitparalleltest/Merlin.TUnit/RequestedPlatformData.cs

Expectation:
45 tests executed all at once in parallel. (5 at a time)
Currently it appears MethodDataSource is feeding items in sequentially rather than parallel, which I understood was TUnit default behaviour.

[thomhurst]

Sauceforge/Saucery#343

[agray]

Thank you for the PR. I cherry picked your commits to run my full pipeline (need to check my triggers).
https://github.com/Sauceforge/Saucery/actions/runs/18301953547

Previous run to compare run durations:
https://github.com/Sauceforge/Saucery/actions/runs/18114203190

nunit and xunit improved. Watched the tests run in parallel.
but tunit (0.67.0) still definitely one test at a time.

[thomhurst]

Can you upgrade to v0.67.9 and run with --log-level Debug - It should log some information about the parallelism decisions it's making

[agray]

Should I be running Merlin.TUnit with dotnet run or dotnet test?

Currently I am running the unit tests with dotnet run... but Merlin.TUnit with dotnet test...

[thomhurst]

dotnet run gives a better experience

[thomhurst]

You might possibly need to specify the --diagnostic flag too and it'll spit out a log file

[agray]

dotnet run -c Release --project Merlin.TUnit/Merlin.TUnit.csproj -- \
  --report-trx \
  --report-trx-filename "merlin.tunit.trx" \
  --coverage \
  --coverage-output "/home/runner/work/Saucery/Saucery/./TestResults/cobertura.tunit.integration.xml" \
  --coverage-output-format "cobertura" \
  --results-directory "TestResults" \
  --log-level Debug \
  --diagnostic

https://github.com/Sauceforge/Saucery/actions/runs/18337703941/job/52225460902

Merlin.TUnit is being executed in Run TUnit Integration Tests (with coverage + TRX)

Doesn't look like it produced a .diag file,