Skip to content

Update the Windows test agent to latest #7275

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jul 30, 2025
Merged

Update the Windows test agent to latest #7275

merged 1 commit into from
Jul 30, 2025

Conversation

andrewlock
Copy link
Member

Summary of changes

Update the test agent to use the latest version

Reason for change

#7244 requires endpoints that are not in the existing version

Implementation details

Try just bumping the version

Test coverage

This is the test

@andrewlock andrewlock added the area:builds project files, build scripts, pipelines, versioning, releases, packages label Jul 24, 2025
@andrewlock andrewlock requested a review from a team as a code owner July 24, 2025 11:44
@datadog-datadog-prod-us1
Copy link

✅ Tests

🎉 All green!

❄️ No new flaky tests detected
🧪 All tests passed

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 6df77ca | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Jul 24, 2025

Benchmarks

Benchmarks Report for benchmark platform 🐌

Benchmarks for #7275 compared to master:

  • 7 benchmarks are slower, with geometric mean 1.426
  • 41 benchmarks have fewer allocations
  • 5 benchmarks have more allocations

The following thresholds were used for comparing the benchmark speeds:

  • Mann–Whitney U test with statistical test for significance of 5%
  • Only results indicating a difference greater than 10% and 0.3 ns are considered.

Allocation changes below 0.5% are ignored.

Benchmark details

Benchmarks.Trace.ActivityBenchmark - Same speed ✔️ Fewer allocations 🎉

Fewer allocations 🎉 in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.ActivityBenchmark.StartStopWithChild‑netcoreapp3.1 5.75 KB 5.71 KB -40 B -0.70%
Benchmarks.Trace.ActivityBenchmark.StartStopWithChild‑net6.0 5.58 KB 5.5 KB -78 B -1.40%
Benchmarks.Trace.ActivityBenchmark.StartStopWithChild‑net472 6.09 KB 6 KB -90 B -1.48%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StartStopWithChild net6.0 11.2μs 59.7ns 322ns 0 0 0 5.58 KB
master StartStopWithChild netcoreapp3.1 14.1μs 67.5ns 286ns 0 0 0 5.75 KB
master StartStopWithChild net472 22.1μs 119ns 651ns 1.03 0.411 0.103 6.09 KB
#7275 StartStopWithChild net6.0 10.8μs 58.3ns 345ns 0 0 0 5.5 KB
#7275 StartStopWithChild netcoreapp3.1 14.2μs 65.9ns 272ns 0 0 0 5.71 KB
#7275 StartStopWithChild net472 22μs 119ns 650ns 1.02 0.338 0.113 6 KB
Benchmarks.Trace.AgentWriterBenchmark - Same speed ✔️ More allocations ⚠️

More allocations ⚠️ in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces‑net472 3.33 KB 3.38 KB 51 B 1.53%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master WriteAndFlushEnrichedTraces net6.0 927μs 26.6ns 103ns 0 0 0 2.71 KB
master WriteAndFlushEnrichedTraces netcoreapp3.1 1.04ms 404ns 1.56μs 0 0 0 2.7 KB
master WriteAndFlushEnrichedTraces net472 1.25ms 357ns 1.38μs 0 0 0 3.33 KB
#7275 WriteAndFlushEnrichedTraces net6.0 931μs 293ns 1.14μs 0 0 0 2.7 KB
#7275 WriteAndFlushEnrichedTraces netcoreapp3.1 1.01ms 364ns 1.41μs 0 0 0 2.7 KB
#7275 WriteAndFlushEnrichedTraces net472 1.28ms 75.5ns 283ns 0 0 0 3.38 KB
Benchmarks.Trace.Asm.AppSecBodyBenchmark - Same speed ✔️ More allocations ⚠️

More allocations ⚠️ in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody‑net472 236.35 KB 239.66 KB 3.3 KB 1.40%
Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleMoreComplexBody‑net472 239.87 KB 243.17 KB 3.3 KB 1.38%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master AllCycleSimpleBody net6.0 331μs 1.76μs 8.42μs 0 0 0 197.06 KB
master AllCycleSimpleBody netcoreapp3.1 510μs 1.45μs 5.61μs 0 0 0 204.77 KB
master AllCycleSimpleBody net472 436μs 119ns 460ns 36.6 2.16 0 236.35 KB
master AllCycleMoreComplexBody net6.0 338μs 1.76μs 8.8μs 0 0 0 200.56 KB
master AllCycleMoreComplexBody netcoreapp3.1 495μs 987ns 3.56μs 0 0 0 208.18 KB
master AllCycleMoreComplexBody net472 446μs 106ns 412ns 36.6 2.16 0 239.87 KB
master ObjectExtractorSimpleBody net6.0 311ns 1.77ns 12.3ns 0 0 0 280 B
master ObjectExtractorSimpleBody netcoreapp3.1 409ns 1.93ns 8.2ns 0 0 0 272 B
master ObjectExtractorSimpleBody net472 303ns 0.175ns 0.676ns 0.0442 0 0 281 B
master ObjectExtractorMoreComplexBody net6.0 6.52μs 29.5ns 110ns 0 0 0 3.78 KB
master ObjectExtractorMoreComplexBody netcoreapp3.1 7.76μs 36.2ns 140ns 0 0 0 3.69 KB
master ObjectExtractorMoreComplexBody net472 6.66μs 0.89ns 3.33ns 0.599 0 0 3.8 KB
#7275 AllCycleSimpleBody net6.0 333μs 1.62μs 6.67μs 0 0 0 197.61 KB
#7275 AllCycleSimpleBody netcoreapp3.1 489μs 1.3μs 5.03μs 0 0 0 205.37 KB
#7275 AllCycleSimpleBody net472 443μs 90.6ns 351ns 36.6 2.16 0 239.66 KB
#7275 AllCycleMoreComplexBody net6.0 339μs 1.65μs 6.58μs 0 0 0 201.11 KB
#7275 AllCycleMoreComplexBody netcoreapp3.1 504μs 2μs 7.74μs 0 0 0 208.78 KB
#7275 AllCycleMoreComplexBody net472 453μs 84ns 314ns 37.9 2.23 0 243.17 KB
#7275 ObjectExtractorSimpleBody net6.0 333ns 1.33ns 5.16ns 0 0 0 280 B
#7275 ObjectExtractorSimpleBody netcoreapp3.1 402ns 2.19ns 12.4ns 0 0 0 272 B
#7275 ObjectExtractorSimpleBody net472 300ns 0.0608ns 0.227ns 0.044 0 0 281 B
#7275 ObjectExtractorMoreComplexBody net6.0 6.36μs 8.7ns 33.7ns 0 0 0 3.78 KB
#7275 ObjectExtractorMoreComplexBody netcoreapp3.1 7.79μs 30.5ns 114ns 0 0 0 3.69 KB
#7275 ObjectExtractorMoreComplexBody net472 6.73μs 1.42ns 5.32ns 0.572 0 0 3.8 KB
Benchmarks.Trace.Asm.AppSecEncoderBenchmark - Same speed ✔️ Fewer allocations 🎉

Fewer allocations 🎉 in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs‑net6.0 2.16 KB 2.15 KB -11 B -0.51%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EncodeArgs net6.0 73.3μs 263ns 984ns 0 0 0 32.41 KB
master EncodeArgs netcoreapp3.1 95.7μs 36.2ns 130ns 0 0 0 32.4 KB
master EncodeArgs net472 107μs 17.6ns 65.8ns 4.82 0 0 32.51 KB
master EncodeLegacyArgs net6.0 143μs 122ns 472ns 0 0 0 2.16 KB
master EncodeLegacyArgs netcoreapp3.1 197μs 42.5ns 147ns 0 0 0 2.14 KB
master EncodeLegacyArgs net472 261μs 66.8ns 250ns 0 0 0 2.16 KB
#7275 EncodeArgs net6.0 77μs 50.8ns 197ns 0 0 0 32.4 KB
#7275 EncodeArgs netcoreapp3.1 96.7μs 274ns 1.06μs 0 0 0 32.4 KB
#7275 EncodeArgs net472 109μs 79.2ns 307ns 4.92 0 0 32.51 KB
#7275 EncodeLegacyArgs net6.0 144μs 39.5ns 142ns 0 0 0 2.15 KB
#7275 EncodeLegacyArgs netcoreapp3.1 200μs 699ns 2.71μs 0 0 0 2.14 KB
#7275 EncodeLegacyArgs net472 262μs 46ns 178ns 0 0 0 2.16 KB
Benchmarks.Trace.Asm.AppSecWafBenchmark - Slower ⚠️ Same allocations ✔️

Slower ⚠️ in #7275

Benchmark diff/base Base Median (ns) Diff Median (ns) Modality
Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmarkWithAttack‑net6.0 1.577 181,119.78 285,697.02
Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmarkWithAttack‑net472 1.508 206,733.04 311,680.16
Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmarkWithAttack‑netcoreapp3.1 1.505 198,578.46 298,901.93
Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmark‑net6.0 1.441 271,505.69 391,146.37
Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmark‑netcoreapp3.1 1.403 293,157.49 411,219.38
Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmark‑net472 1.396 306,857.62 428,322.08

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master RunWafRealisticBenchmark net6.0 271μs 133ns 499ns 0 0 0 4.55 KB
master RunWafRealisticBenchmark netcoreapp3.1 294μs 264ns 989ns 0 0 0 4.48 KB
master RunWafRealisticBenchmark net472 307μs 38.1ns 147ns 0 0 0 4.66 KB
master RunWafRealisticBenchmarkWithAttack net6.0 181μs 80.1ns 300ns 0 0 0 2.24 KB
master RunWafRealisticBenchmarkWithAttack netcoreapp3.1 198μs 104ns 404ns 0 0 0 2.22 KB
master RunWafRealisticBenchmarkWithAttack net472 207μs 45.3ns 169ns 0 0 0 2.28 KB
#7275 RunWafRealisticBenchmark net6.0 391μs 51.9ns 201ns 0 0 0 4.56 KB
#7275 RunWafRealisticBenchmark netcoreapp3.1 411μs 39.9ns 144ns 0 0 0 4.48 KB
#7275 RunWafRealisticBenchmark net472 428μs 63.2ns 245ns 0 0 0 4.66 KB
#7275 RunWafRealisticBenchmarkWithAttack net6.0 286μs 17.5ns 67.9ns 0 0 0 2.24 KB
#7275 RunWafRealisticBenchmarkWithAttack netcoreapp3.1 299μs 58.6ns 203ns 0 0 0 2.22 KB
#7275 RunWafRealisticBenchmarkWithAttack net472 312μs 23ns 86.2ns 0 0 0 2.29 KB
Benchmarks.Trace.AspNetCoreBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendRequest net6.0 61.1μs 29ns 104ns 0 0 0 14.53 KB
master SendRequest netcoreapp3.1 69.9μs 118ns 440ns 0 0 0 17.42 KB
master SendRequest net472 0.0171ns 0.00147ns 0.00551ns 0 0 0 0 b
#7275 SendRequest net6.0 60.7μs 144ns 521ns 0 0 0 14.52 KB
#7275 SendRequest netcoreapp3.1 71.2μs 242ns 1.11μs 0 0 0 17.42 KB
#7275 SendRequest net472 0.0344ns 0.00203ns 0.00785ns 0 0 0 0 b
Benchmarks.Trace.CharSliceBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
#7275 OriginalCharSlice net6.0 1.92ms 2.99μs 11.6μs 0 0 0 640.01 KB
#7275 OriginalCharSlice netcoreapp3.1 2.14ms 8.36μs 31.3μs 0 0 0 640 KB
#7275 OriginalCharSlice net472 2.74ms 2.76μs 10.3μs 100 0 0 641.95 KB
#7275 OptimizedCharSlice net6.0 1.37ms 107ns 413ns 0 0 0 2 B
#7275 OptimizedCharSlice netcoreapp3.1 1.66ms 156ns 606ns 0 0 0 1 B
#7275 OptimizedCharSlice net472 2.03ms 679ns 2.63μs 0 0 0 0 b
#7275 OptimizedCharSliceWithPool net6.0 881μs 27.7ns 104ns 0 0 0 4 B
#7275 OptimizedCharSliceWithPool netcoreapp3.1 810μs 50.5ns 196ns 0 0 0 1 B
#7275 OptimizedCharSliceWithPool net472 1.18ms 75.2ns 281ns 0 0 0 0 b
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark - Same speed ✔️ More allocations ⚠️

More allocations ⚠️ in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces‑net472 55.75 KB 56.18 KB 431 B 0.77%
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces‑netcoreapp3.1 41.89 KB 42.12 KB 236 B 0.56%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master WriteAndFlushEnrichedTraces net6.0 645μs 512ns 1.98μs 0 0 0 41.73 KB
master WriteAndFlushEnrichedTraces netcoreapp3.1 631μs 1.67μs 6.67μs 0 0 0 41.89 KB
master WriteAndFlushEnrichedTraces net472 923μs 1.93μs 7.2μs 4.46 0 0 55.75 KB
#7275 WriteAndFlushEnrichedTraces net6.0 699μs 3.19μs 12.3μs 0 0 0 41.72 KB
#7275 WriteAndFlushEnrichedTraces netcoreapp3.1 659μs 2.32μs 9μs 0 0 0 42.12 KB
#7275 WriteAndFlushEnrichedTraces net472 855μs 2.34μs 9.06μs 8.33 0 0 56.18 KB
Benchmarks.Trace.DbCommandBenchmark - Same speed ✔️ Fewer allocations 🎉

Fewer allocations 🎉 in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.DbCommandBenchmark.ExecuteNonQuery‑net6.0 1.03 KB 1.02 KB -8 B -0.78%
Benchmarks.Trace.DbCommandBenchmark.ExecuteNonQuery‑netcoreapp3.1 1.02 KB 1.02 KB -8 B -0.78%
Benchmarks.Trace.DbCommandBenchmark.ExecuteNonQuery‑net472 995 B 987 B -8 B -0.80%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master ExecuteNonQuery net6.0 1.99μs 10.2ns 46.8ns 0 0 0 1.03 KB
master ExecuteNonQuery netcoreapp3.1 2.53μs 3.43ns 13.3ns 0 0 0 1.02 KB
master ExecuteNonQuery net472 2.7μs 2.41ns 9.34ns 0.147 0.0134 0 995 B
#7275 ExecuteNonQuery net6.0 1.86μs 8.06ns 30.1ns 0 0 0 1.02 KB
#7275 ExecuteNonQuery netcoreapp3.1 2.48μs 10.4ns 36.1ns 0 0 0 1.02 KB
#7275 ExecuteNonQuery net472 2.77μs 3.03ns 11.7ns 0.154 0.014 0 987 B
Benchmarks.Trace.ElasticsearchBenchmark - Same speed ✔️ Fewer allocations 🎉

Fewer allocations 🎉 in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync‑net472 1.11 KB 1.1 KB -8 B -0.72%
Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync‑netcoreapp3.1 1.09 KB 1.08 KB -8 B -0.74%
Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch‑net472 1.05 KB 1.04 KB -8 B -0.76%
Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch‑net6.0 1.04 KB 1.03 KB -8 B -0.77%
Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch‑netcoreapp3.1 1.04 KB 1.03 KB -8 B -0.77%
Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync‑net6.0 1.02 KB 1.01 KB -8 B -0.79%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master CallElasticsearch net6.0 1.83μs 5.85ns 22.7ns 0 0 0 1.04 KB
master CallElasticsearch netcoreapp3.1 2.3μs 11.8ns 56.6ns 0 0 0 1.04 KB
master CallElasticsearch net472 3.55μs 3.05ns 11.8ns 0.159 0 0 1.05 KB
master CallElasticsearchAsync net6.0 1.81μs 3.89ns 14.5ns 0 0 0 1.02 KB
master CallElasticsearchAsync netcoreapp3.1 2.35μs 7.26ns 28.1ns 0 0 0 1.09 KB
master CallElasticsearchAsync net472 3.84μs 3.19ns 12.4ns 0.169 0 0 1.11 KB
#7275 CallElasticsearch net6.0 1.76μs 7.89ns 30.5ns 0 0 0 1.03 KB
#7275 CallElasticsearch netcoreapp3.1 2.31μs 9.12ns 35.3ns 0 0 0 1.03 KB
#7275 CallElasticsearch net472 3.54μs 1.6ns 6ns 0.16 0 0 1.04 KB
#7275 CallElasticsearchAsync net6.0 1.87μs 9.53ns 46.7ns 0 0 0 1.01 KB
#7275 CallElasticsearchAsync netcoreapp3.1 2.44μs 11.1ns 44.6ns 0 0 0 1.08 KB
#7275 CallElasticsearchAsync net472 3.85μs 2.8ns 10.5ns 0.172 0 0 1.1 KB
Benchmarks.Trace.GraphQLBenchmark - Same speed ✔️ Fewer allocations 🎉

Fewer allocations 🎉 in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync‑net6.0 960 B 952 B -8 B -0.83%
Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync‑netcoreapp3.1 960 B 952 B -8 B -0.83%
Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync‑net472 923 B 915 B -8 B -0.87%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master ExecuteAsync net6.0 1.78μs 9.27ns 43.5ns 0 0 0 960 B
master ExecuteAsync netcoreapp3.1 2.29μs 7.45ns 25.8ns 0 0 0 960 B
master ExecuteAsync net472 2.58μs 1.78ns 6.88ns 0.143 0 0 923 B
#7275 ExecuteAsync net6.0 1.84μs 8.04ns 31.1ns 0 0 0 952 B
#7275 ExecuteAsync netcoreapp3.1 2.27μs 8.57ns 33.2ns 0 0 0 952 B
#7275 ExecuteAsync net472 2.49μs 1.14ns 4.4ns 0.137 0 0 915 B
Benchmarks.Trace.HttpClientBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendAsync net6.0 7.1μs 10.4ns 39ns 0 0 0 2.37 KB
master SendAsync netcoreapp3.1 8.69μs 14.1ns 54.6ns 0 0 0 2.9 KB
master SendAsync net472 12.5μs 10.3ns 38.5ns 0.498 0 0 3.19 KB
#7275 SendAsync net6.0 7μs 20.9ns 80.8ns 0 0 0 2.36 KB
#7275 SendAsync netcoreapp3.1 8.61μs 11.5ns 43.1ns 0 0 0 2.9 KB
#7275 SendAsync net472 11.9μs 12.4ns 48.2ns 0.478 0 0 3.18 KB
Benchmarks.Trace.Iast.StringAspectsBenchmark - Slower ⚠️ Fewer allocations 🎉

Slower ⚠️ in #7275

Benchmark diff/base Base Median (ns) Diff Median (ns) Modality
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑netcoreapp3.1 1.189 413,700.00 492,050.00

Fewer allocations 🎉 in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑netcoreapp3.1 274.93 KB 257.66 KB -17.27 KB -6.28%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StringConcatBenchmark net6.0 44.6μs 212ns 1.6μs 0 0 0 43.83 KB
master StringConcatBenchmark netcoreapp3.1 47.2μs 224ns 838ns 0 0 0 42.64 KB
master StringConcatBenchmark net472 56.8μs 259ns 968ns 0 0 0 57.34 KB
master StringConcatAspectBenchmark net6.0 458μs 1.08μs 3.89μs 0 0 0 259.96 KB
master StringConcatAspectBenchmark netcoreapp3.1 447μs 6.44μs 63.7μs 0 0 0 274.93 KB
master StringConcatAspectBenchmark net472 410μs 2.07μs 9.27μs 0 0 0 286.72 KB
#7275 StringConcatBenchmark net6.0 44.1μs 243ns 1.46μs 0 0 0 44 KB
#7275 StringConcatBenchmark netcoreapp3.1 48.4μs 254ns 1.27μs 0 0 0 42.68 KB
#7275 StringConcatBenchmark net472 57.1μs 98.3ns 354ns 0 0 0 57.34 KB
#7275 StringConcatAspectBenchmark net6.0 460μs 2.19μs 8.49μs 0 0 0 260.54 KB
#7275 StringConcatAspectBenchmark netcoreapp3.1 496μs 2.17μs 8.1μs 0 0 0 257.66 KB
#7275 StringConcatAspectBenchmark net472 405μs 1.89μs 7.56μs 0 0 0 286.72 KB
Benchmarks.Trace.ILoggerBenchmark - Same speed ✔️ Fewer allocations 🎉

Fewer allocations 🎉 in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.ILoggerBenchmark.EnrichedLog‑net6.0 1.76 KB 1.7 KB -56 B -3.18%
Benchmarks.Trace.ILoggerBenchmark.EnrichedLog‑netcoreapp3.1 1.76 KB 1.7 KB -56 B -3.18%
Benchmarks.Trace.ILoggerBenchmark.EnrichedLog‑net472 1.69 KB 1.64 KB -56 B -3.31%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 2.63μs 2.6ns 10.1ns 0 0 0 1.76 KB
master EnrichedLog netcoreapp3.1 3.44μs 4.38ns 17ns 0 0 0 1.76 KB
master EnrichedLog net472 4.05μs 4.83ns 18.7ns 0.265 0 0 1.69 KB
#7275 EnrichedLog net6.0 2.55μs 12.5ns 49.9ns 0 0 0 1.7 KB
#7275 EnrichedLog netcoreapp3.1 3.42μs 15.4ns 55.5ns 0 0 0 1.7 KB
#7275 EnrichedLog net472 3.92μs 4.15ns 16.1ns 0.255 0 0 1.64 KB
Benchmarks.Trace.Log4netBenchmark - Same speed ✔️ Fewer allocations 🎉

Fewer allocations 🎉 in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.Log4netBenchmark.EnrichedLog‑net472 4.57 KB 4.52 KB -55 B -1.20%
Benchmarks.Trace.Log4netBenchmark.EnrichedLog‑net6.0 4.37 KB 4.31 KB -56 B -1.28%
Benchmarks.Trace.Log4netBenchmark.EnrichedLog‑netcoreapp3.1 4.37 KB 4.31 KB -56 B -1.28%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 123μs 145ns 563ns 0 0 0 4.37 KB
master EnrichedLog netcoreapp3.1 126μs 330ns 1.24μs 0 0 0 4.37 KB
master EnrichedLog net472 167μs 161ns 603ns 0 0 0 4.57 KB
#7275 EnrichedLog net6.0 124μs 29.2ns 105ns 0 0 0 4.31 KB
#7275 EnrichedLog netcoreapp3.1 127μs 132ns 496ns 0 0 0 4.31 KB
#7275 EnrichedLog net472 166μs 101ns 363ns 0 0 0 4.52 KB
Benchmarks.Trace.NLogBenchmark - Same speed ✔️ Fewer allocations 🎉

Fewer allocations 🎉 in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.NLogBenchmark.EnrichedLog‑net6.0 2.32 KB 2.26 KB -56 B -2.41%
Benchmarks.Trace.NLogBenchmark.EnrichedLog‑netcoreapp3.1 2.32 KB 2.26 KB -56 B -2.41%
Benchmarks.Trace.NLogBenchmark.EnrichedLog‑net472 2.14 KB 2.08 KB -56 B -2.62%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 4.94μs 19.3ns 74.6ns 0 0 0 2.32 KB
master EnrichedLog netcoreapp3.1 6.77μs 22.2ns 79.9ns 0 0 0 2.32 KB
master EnrichedLog net472 7.45μs 8.04ns 31.1ns 0.335 0 0 2.14 KB
#7275 EnrichedLog net6.0 4.97μs 6.53ns 25.3ns 0 0 0 2.26 KB
#7275 EnrichedLog netcoreapp3.1 6.77μs 10.5ns 39.2ns 0 0 0 2.26 KB
#7275 EnrichedLog net472 7.34μs 4.54ns 17.6ns 0.294 0 0 2.08 KB
Benchmarks.Trace.RedisBenchmark - Same speed ✔️ Fewer allocations 🎉

Fewer allocations 🎉 in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.RedisBenchmark.SendReceive‑net472 1.21 KB 1.2 KB -8 B -0.66%
Benchmarks.Trace.RedisBenchmark.SendReceive‑net6.0 1.21 KB 1.2 KB -8 B -0.66%
Benchmarks.Trace.RedisBenchmark.SendReceive‑netcoreapp3.1 1.21 KB 1.2 KB -8 B -0.66%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendReceive net6.0 2.04μs 10.5ns 49.4ns 0 0 0 1.21 KB
master SendReceive netcoreapp3.1 2.53μs 11.8ns 47.4ns 0 0 0 1.21 KB
master SendReceive net472 3.28μs 2.71ns 10.5ns 0.178 0 0 1.21 KB
#7275 SendReceive net6.0 1.99μs 9.67ns 38.7ns 0 0 0 1.2 KB
#7275 SendReceive netcoreapp3.1 2.59μs 12.4ns 50.9ns 0 0 0 1.2 KB
#7275 SendReceive net472 3.19μs 2.75ns 10.6ns 0.19 0 0 1.2 KB
Benchmarks.Trace.SerilogBenchmark - Same speed ✔️ Fewer allocations 🎉

Fewer allocations 🎉 in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.SerilogBenchmark.EnrichedLog‑net472 2.08 KB 2.03 KB -56 B -2.69%
Benchmarks.Trace.SerilogBenchmark.EnrichedLog‑netcoreapp3.1 1.69 KB 1.63 KB -56 B -3.32%
Benchmarks.Trace.SerilogBenchmark.EnrichedLog‑net6.0 1.64 KB 1.58 KB -56 B -3.41%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 4.18μs 0.92ns 3.44ns 0 0 0 1.64 KB
master EnrichedLog netcoreapp3.1 5.64μs 23ns 89.3ns 0 0 0 1.69 KB
master EnrichedLog net472 6.67μs 7.28ns 27.3ns 0.298 0 0 2.08 KB
#7275 EnrichedLog net6.0 4.16μs 7.98ns 30.9ns 0 0 0 1.58 KB
#7275 EnrichedLog netcoreapp3.1 5.53μs 13.9ns 53.7ns 0 0 0 1.63 KB
#7275 EnrichedLog net472 6.61μs 8.04ns 31.1ns 0.297 0 0 2.03 KB
Benchmarks.Trace.SpanBenchmark - Same speed ✔️ Fewer allocations 🎉

Fewer allocations 🎉 in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.SpanBenchmark.StartFinishScope‑net6.0 704 B 696 B -8 B -1.14%
Benchmarks.Trace.SpanBenchmark.StartFinishScope‑netcoreapp3.1 704 B 696 B -8 B -1.14%
Benchmarks.Trace.SpanBenchmark.StartFinishScope‑net472 666 B 658 B -8 B -1.20%
Benchmarks.Trace.SpanBenchmark.StartFinishSpan‑net472 586 B 578 B -8 B -1.37%
Benchmarks.Trace.SpanBenchmark.StartFinishSpan‑net6.0 584 B 576 B -8 B -1.37%
Benchmarks.Trace.SpanBenchmark.StartFinishSpan‑netcoreapp3.1 584 B 576 B -8 B -1.37%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StartFinishSpan net6.0 751ns 3.97ns 22.4ns 0 0 0 584 B
master StartFinishSpan netcoreapp3.1 953ns 4.42ns 17.7ns 0 0 0 584 B
master StartFinishSpan net472 914ns 0.809ns 3.13ns 0.0912 0 0 586 B
master StartFinishScope net6.0 918ns 0.479ns 1.73ns 0 0 0 704 B
master StartFinishScope netcoreapp3.1 1.15μs 6.24ns 34.2ns 0 0 0 704 B
master StartFinishScope net472 1.09μs 0.174ns 0.652ns 0.104 0 0 666 B
#7275 StartFinishSpan net6.0 759ns 0.533ns 2ns 0 0 0 576 B
#7275 StartFinishSpan netcoreapp3.1 953ns 4.57ns 17.7ns 0 0 0 576 B
#7275 StartFinishSpan net472 900ns 0.36ns 1.39ns 0.0901 0 0 578 B
#7275 StartFinishScope net6.0 886ns 4.82ns 24.6ns 0 0 0 696 B
#7275 StartFinishScope netcoreapp3.1 1.17μs 5.7ns 24.8ns 0 0 0 696 B
#7275 StartFinishScope net472 1.12μs 0.185ns 0.691ns 0.101 0 0 658 B
Benchmarks.Trace.TraceAnnotationsBenchmark - Same speed ✔️ Fewer allocations 🎉

Fewer allocations 🎉 in #7275

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin‑net6.0 704 B 696 B -8 B -1.14%
Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin‑netcoreapp3.1 704 B 696 B -8 B -1.14%
Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin‑net472 666 B 658 B -8 B -1.20%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master RunOnMethodBegin net6.0 1.02μs 5.36ns 26.8ns 0 0 0 704 B
master RunOnMethodBegin netcoreapp3.1 1.38μs 2.28ns 8.82ns 0 0 0 704 B
master RunOnMethodBegin net472 1.36μs 0.141ns 0.544ns 0.102 0 0 666 B
#7275 RunOnMethodBegin net6.0 1.04μs 1.39ns 5.38ns 0 0 0 696 B
#7275 RunOnMethodBegin netcoreapp3.1 1.41μs 6.68ns 25.9ns 0 0 0 696 B
#7275 RunOnMethodBegin net472 1.38μs 1.21ns 4.69ns 0.105 0 0 658 B

@dd-trace-dotnet-ci-bot
Copy link

Execution-Time Benchmarks Report ⏱️

Execution-time results for samples comparing the following branches/commits:

Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:

  • Welch test with statistical test for significance of 5%
  • Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

gantt
    title Execution time (ms) FakeDbCommand (.NET Framework 4.8) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7275) - mean (71ms)  : 70, 73
     .   : milestone, 71,
    master - mean (72ms)  : 71, 73
     .   : milestone, 72,

    section Baseline
    This PR (7275) - mean (68ms)  : 66, 70
     .   : milestone, 68,
    master - mean (69ms)  : 65, 73
     .   : milestone, 69,

    section CallTarget+Inlining+NGEN
    This PR (7275) - mean (1,036ms)  : 1011, 1061
     .   : milestone, 1036,
    master - mean (1,044ms)  : 1015, 1072
     .   : milestone, 1044,
Loading 
gantt
    title Execution time (ms) FakeDbCommand (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7275) - mean (107ms)  : 106, 108
     .   : milestone, 107,
    master - mean (108ms)  : 106, 109
     .   : milestone, 108,

    section Baseline
    This PR (7275) - mean (106ms)  : 103, 109
     .   : milestone, 106,
    master - mean (107ms)  : 104, 109
     .   : milestone, 107,

    section CallTarget+Inlining+NGEN
    This PR (7275) - mean (722ms)  : 702, 742
     .   : milestone, 722,
    master - mean (727ms)  : 709, 744
     .   : milestone, 727,
Loading 
gantt
    title Execution time (ms) FakeDbCommand (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7275) - mean (95ms)  : 93, 96
     .   : milestone, 95,
    master - mean (95ms)  : 94, 96
     .   : milestone, 95,

    section Baseline
    This PR (7275) - mean (94ms)  : 93, 96
     .   : milestone, 94,
    master - mean (95ms)  : 93, 97
     .   : milestone, 95,

    section CallTarget+Inlining+NGEN
    This PR (7275) - mean (681ms)  : 662, 701
     .   : milestone, 681,
    master - mean (688ms)  : 670, 706
     .   : milestone, 688,
Loading 
gantt
    title Execution time (ms) FakeDbCommand (.NET 8) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7275) - mean (94ms)  : 92, 95
     .   : milestone, 94,
    master - mean (94ms)  : 92, 95
     .   : milestone, 94,

    section Baseline
    This PR (7275) - mean (93ms)  : 90, 96
     .   : milestone, 93,
    master - mean (93ms)  : 91, 95
     .   : milestone, 93,

    section CallTarget+Inlining+NGEN
    This PR (7275) - mean (630ms)  : 596, 663
     .   : milestone, 630,
    master - mean (632ms)  : 600, 665
     .   : milestone, 632,
Loading 
gantt
    title Execution time (ms) HttpMessageHandler (.NET Framework 4.8) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7275) - mean (197ms)  : 191, 202
     .   : milestone, 197,
    master - mean (197ms)  : 193, 202
     .   : milestone, 197,

    section Baseline
    This PR (7275) - mean (193ms)  : 187, 200
     .   : milestone, 193,
    master - mean (195ms)  : 189, 201
     .   : milestone, 195,

    section CallTarget+Inlining+NGEN
    This PR (7275) - mean (1,157ms)  : 1127, 1187
     .   : milestone, 1157,
    master - mean (1,158ms)  : 1124, 1192
     .   : milestone, 1158,
Loading 
gantt
    title Execution time (ms) HttpMessageHandler (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7275) - mean (279ms)  : 272, 285
     .   : milestone, 279,
    master - mean (280ms)  : 275, 285
     .   : milestone, 280,

    section Baseline
    This PR (7275) - mean (278ms)  : 270, 286
     .   : milestone, 278,
    master - mean (280ms)  : 272, 288
     .   : milestone, 280,

    section CallTarget+Inlining+NGEN
    This PR (7275) - mean (924ms)  : 902, 945
     .   : milestone, 924,
    master - mean (929ms)  : 900, 958
     .   : milestone, 929,
Loading 
gantt
    title Execution time (ms) HttpMessageHandler (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7275) - mean (271ms)  : 263, 278
     .   : milestone, 271,
    master - mean (270ms)  : 262, 278
     .   : milestone, 270,

    section Baseline
    This PR (7275) - mean (272ms)  : 264, 279
     .   : milestone, 272,
    master - mean (268ms)  : 259, 277
     .   : milestone, 268,

    section CallTarget+Inlining+NGEN
    This PR (7275) - mean (920ms)  : 894, 945
     .   : milestone, 920,
    master - mean (905ms)  : 871, 939
     .   : milestone, 905,
Loading 
gantt
    title Execution time (ms) HttpMessageHandler (.NET 8) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7275) - mean (271ms)  : 262, 280
     .   : milestone, 271,
    master - mean (270ms)  : 260, 280
     .   : milestone, 270,

    section Baseline
    This PR (7275) - mean (270ms)  : 262, 279
     .   : milestone, 270,
    master - mean (268ms)  : 258, 279
     .   : milestone, 268,

    section CallTarget+Inlining+NGEN
    This PR (7275) - mean (821ms)  : 790, 852
     .   : milestone, 821,
    master - mean (823ms)  : 788, 857
     .   : milestone, 823,
Loading

@andrewlock andrewlock merged commit 314ded4 into master Jul 30, 2025
67 of 69 checks passed
@andrewlock andrewlock deleted the andrew/ci/update-test-agent branch July 30, 2025 07:14
@github-actions github-actions bot added this to the vNext-v3 milestone Jul 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bouwkast bouwkast bouwkast approved these changes

@NachoEchevarria NachoEchevarria NachoEchevarria approved these changes

Assignees
No one assigned
Labels
area:builds project files, build scripts, pipelines, versioning, releases, packages
Projects
None yet
Milestone
3.23.0
Development

Successfully merging this pull request may close these issues.
3 participants
@andrewlock @bouwkast @NachoEchevarria