Share more specifications on benchmarks.md #113
Description
Description
The benchmarks.md article leaves some open questions about the testing conditions.
Expected result
As much detail as possible about the testing conditions are specified....
- Which payment method was used to place orders?
- Which shipping methods was used?
- How was tax calculation handled?
- Was reCAPTCHA enabled during order placement?
- Were any extensions installed on the storefront (I assume no, but it would be good to explicitly specify this)
These lab conditions, while they sound good on paper, are likely not reality for any merchants -- it would be interesting if there were a few permutations of benchmarks showing how the system performed under different condition. FYI we did publish some real world benchmarks about a year ago: https://www.rightpoint.com/thought/article/high-scale-adobe-commerce-in-the-wild
Benefits
Ensures clarity and understanding of the data presented.
Possible solutions
As much detail as possible about the test conditions is provided.