Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cache entry span code origin information to avoid unnecessary repeated stack walks. #8029

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

evanchooly
Copy link
Contributor

@evanchooly evanchooly commented Nov 27, 2024

What Does This Do

This PR uses the class parsing during instrumentation to extract out more accurate entry span information
caches that information to reuse it on commit()

Motivation

Additional Notes

Contributor Checklist

Jira ticket: DEBUG-3159

…rate entry span information

cache that information and reuse it on commit()
@evanchooly evanchooly requested a review from a team as a code owner November 27, 2024 21:43
@evanchooly evanchooly requested review from jpbempel and removed request for a team November 27, 2024 21:43
Copy link
Contributor

github-actions bot commented Nov 27, 2024

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@evanchooly evanchooly enabled auto-merge (squash) November 27, 2024 21:43
@evanchooly evanchooly added the comp: debugger Dynamic Instrumentation label Nov 27, 2024
@pr-commenter
Copy link

pr-commenter bot commented Nov 27, 2024

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1732744226 1732744603
end_time 2024-11-27T21:51:44 2024-11-27T21:58:00
git_branch master evanchooly/DEBUG-3159
git_commit_sha 207f770 dce86b3
start_time 2024-11-27T21:50:27 2024-11-27T21:56:44
See matching parameters
Baseline Candidate
ci_job_id 722470367 722470367
ci_pipeline_id 50085513 50085513
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1732743640 1732743640

Summary

Found 1 performance improvements and 5 performance regressions! Performance is the same for 2 metrics, 7 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:basic better
[-17.091µs; -4.914µs] or [-6.053%; -1.741%]
same same unstable
[-34.567µs; +57.109µs] or [-6.452%; +10.659%]
unstable
[-98.748op/s; +226.953op/s] or [-3.950%; +9.078%]
scenario:loop worse
[+627.206µs; +641.736µs] or [+6.148%; +6.290%]
worse
[+622.948µs; +690.611µs] or [+6.008%; +6.661%]
worse
[+573.584µs; +692.469µs] or [+5.479%; +6.614%]
worse
[+391.218µs; +786.416µs] or [+3.596%; +7.229%]
worse
[-6.592op/s; -4.503op/s] or [-6.922%; -4.728%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-42.845µs; +27.886µs] or [-15.395%; +10.020%]
unstable
[-62.035µs; +40.935µs] or [-19.216%; +12.680%]
unstable
[-71.895µs; +53.347µs] or [-21.267%; +15.780%]
unstable
[-165.418µs; +112.459µs] or [-26.284%; +17.869%]
unstable
[-102.633op/s; +169.233op/s] or [-4.003%; +6.600%]
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (322.835 µs) : 268, 377
.   : milestone, 323,
basic (312.133 µs) : 302, 322
.   : milestone, 312,
loop (10.368 ms) : 10340, 10396
.   : milestone, 10368,
section candidate
noprobe (312.286 µs) : 269, 355
.   : milestone, 312,
basic (305.49 µs) : 294, 317
.   : milestone, 305,
loop (11.025 ms) : 10991, 11059
.   : milestone, 11025,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 322.835 µs [268.226 µs, 377.444 µs]
basic 312.133 µs [301.976 µs, 322.291 µs]
loop 10.368 ms [10.34 ms, 10.396 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 312.286 µs [269.476 µs, 355.095 µs]
basic 305.49 µs [293.997 µs, 316.982 µs]
loop 11.025 ms [10.991 ms, 11.059 ms]

@pr-commenter
Copy link

pr-commenter bot commented Nov 27, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master evanchooly/DEBUG-3159
git_commit_date 1732735962 1732743640
git_commit_sha 207f770 dce86b3
release_version 1.44.0-SNAPSHOT~207f770623 1.44.0-SNAPSHOT~dce86b32b8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1732746083 1732746083
ci_job_id 722470361 722470361
ci_pipeline_id 50085513 50085513
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 6 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.44.0-SNAPSHOT~dce86b32b8, baseline=1.44.0-SNAPSHOT~207f770623

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.097 s) : 0, 1097071
Total [baseline] (8.691 s) : 0, 8690875
Agent [candidate] (1.1 s) : 0, 1099926
Total [candidate] (8.704 s) : 0, 8703569
section iast
Agent [baseline] (1.227 s) : 0, 1227082
Total [baseline] (9.251 s) : 0, 9250958
Agent [candidate] (1.217 s) : 0, 1216617
Total [candidate] (9.217 s) : 0, 9217445
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.223 s) : 0, 1222772
Total [baseline] (9.168 s) : 0, 9168157
Agent [candidate] (1.224 s) : 0, 1223997
Total [candidate] (9.211 s) : 0, 9210552
section iast_TELEMETRY_OFF
Agent [baseline] (1.217 s) : 0, 1217330
Total [baseline] (9.186 s) : 0, 9185655
Agent [candidate] (1.214 s) : 0, 1213965
Total [candidate] (9.183 s) : 0, 9183074
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.097 s -
Agent iast 1.227 s 130.01 ms (11.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.223 s 125.701 ms (11.5%)
Agent iast_TELEMETRY_OFF 1.217 s 120.259 ms (11.0%)
Total tracing 8.691 s -
Total iast 9.251 s 560.083 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.168 s 477.283 ms (5.5%)
Total iast_TELEMETRY_OFF 9.186 s 494.78 ms (5.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.1 s -
Agent iast 1.217 s 116.691 ms (10.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.224 s 124.07 ms (11.3%)
Agent iast_TELEMETRY_OFF 1.214 s 114.038 ms (10.4%)
Total tracing 8.704 s -
Total iast 9.217 s 513.876 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.211 s 506.983 ms (5.8%)
Total iast_TELEMETRY_OFF 9.183 s 479.506 ms (5.5%)
gantt
    title insecure-bank - break down per module: candidate=1.44.0-SNAPSHOT~dce86b32b8, baseline=1.44.0-SNAPSHOT~207f770623

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (699.327 ms) : 0, 699327
BytebuddyAgent [candidate] (700.289 ms) : 0, 700289
GlobalTracer [baseline] (319.529 ms) : 0, 319529
GlobalTracer [candidate] (319.724 ms) : 0, 319724
AppSec [baseline] (55.126 ms) : 0, 55126
AppSec [candidate] (54.8 ms) : 0, 54800
Remote Config [baseline] (681.889 µs) : 0, 682
Remote Config [candidate] (685.664 µs) : 0, 686
Telemetry [baseline] (8.606 ms) : 0, 8606
Telemetry [candidate] (10.621 ms) : 0, 10621
section iast
BytebuddyAgent [baseline] (818.16 ms) : 0, 818160
BytebuddyAgent [candidate] (811.233 ms) : 0, 811233
GlobalTracer [baseline] (307.891 ms) : 0, 307891
GlobalTracer [candidate] (305.35 ms) : 0, 305350
AppSec [baseline] (58.288 ms) : 0, 58288
AppSec [candidate] (56.629 ms) : 0, 56629
Remote Config [baseline] (636.639 µs) : 0, 637
Remote Config [candidate] (642.922 µs) : 0, 643
Telemetry [baseline] (7.485 ms) : 0, 7485
Telemetry [candidate] (7.489 ms) : 0, 7489
IAST [baseline] (20.784 ms) : 0, 20784
IAST [candidate] (21.592 ms) : 0, 21592
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (814.16 ms) : 0, 814160
BytebuddyAgent [candidate] (816.807 ms) : 0, 816807
GlobalTracer [baseline] (308.339 ms) : 0, 308339
GlobalTracer [candidate] (306.272 ms) : 0, 306272
AppSec [baseline] (57.632 ms) : 0, 57632
AppSec [candidate] (56.185 ms) : 0, 56185
Remote Config [baseline] (634.566 µs) : 0, 635
Remote Config [candidate] (653.252 µs) : 0, 653
Telemetry [baseline] (7.466 ms) : 0, 7466
Telemetry [candidate] (7.588 ms) : 0, 7588
IAST [baseline] (20.817 ms) : 0, 20817
IAST [candidate] (22.671 ms) : 0, 22671
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (810.265 ms) : 0, 810265
BytebuddyAgent [candidate] (807.921 ms) : 0, 807921
GlobalTracer [baseline] (306.64 ms) : 0, 306640
GlobalTracer [candidate] (305.846 ms) : 0, 305846
AppSec [baseline] (57.556 ms) : 0, 57556
AppSec [candidate] (57.893 ms) : 0, 57893
Remote Config [baseline] (617.124 µs) : 0, 617
Remote Config [candidate] (615.241 µs) : 0, 615
Telemetry [baseline] (7.409 ms) : 0, 7409
Telemetry [candidate] (7.475 ms) : 0, 7475
IAST [baseline] (21.129 ms) : 0, 21129
IAST [candidate] (20.513 ms) : 0, 20513
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.44.0-SNAPSHOT~dce86b32b8, baseline=1.44.0-SNAPSHOT~207f770623

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.094 s) : 0, 1093953
Total [baseline] (10.411 s) : 0, 10410644
Agent [candidate] (1.092 s) : 0, 1091508
Total [candidate] (10.414 s) : 0, 10414047
section appsec
Agent [baseline] (1.224 s) : 0, 1223956
Total [baseline] (10.779 s) : 0, 10778861
Agent [candidate] (1.232 s) : 0, 1232071
Total [candidate] (10.745 s) : 0, 10744832
section iast
Agent [baseline] (1.215 s) : 0, 1215474
Total [baseline] (10.916 s) : 0, 10916046
Agent [candidate] (1.22 s) : 0, 1220366
Total [candidate] (10.955 s) : 0, 10955188
section profiling
Agent [baseline] (1.312 s) : 0, 1312223
Total [baseline] (10.793 s) : 0, 10793257
Agent [candidate] (1.314 s) : 0, 1314323
Total [candidate] (10.776 s) : 0, 10776388
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.094 s -
Agent appsec 1.224 s 130.004 ms (11.9%)
Agent iast 1.215 s 121.521 ms (11.1%)
Agent profiling 1.312 s 218.27 ms (20.0%)
Total tracing 10.411 s -
Total appsec 10.779 s 368.217 ms (3.5%)
Total iast 10.916 s 505.402 ms (4.9%)
Total profiling 10.793 s 382.613 ms (3.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.092 s -
Agent appsec 1.232 s 140.563 ms (12.9%)
Agent iast 1.22 s 128.858 ms (11.8%)
Agent profiling 1.314 s 222.815 ms (20.4%)
Total tracing 10.414 s -
Total appsec 10.745 s 330.784 ms (3.2%)
Total iast 10.955 s 541.141 ms (5.2%)
Total profiling 10.776 s 362.341 ms (3.5%)
gantt
    title petclinic - break down per module: candidate=1.44.0-SNAPSHOT~dce86b32b8, baseline=1.44.0-SNAPSHOT~207f770623

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (696.798 ms) : 0, 696798
BytebuddyAgent [candidate] (694.083 ms) : 0, 694083
GlobalTracer [baseline] (317.132 ms) : 0, 317132
GlobalTracer [candidate] (317.287 ms) : 0, 317287
AppSec [baseline] (54.993 ms) : 0, 54993
AppSec [candidate] (55.064 ms) : 0, 55064
Remote Config [baseline] (679.777 µs) : 0, 680
Remote Config [candidate] (670.093 µs) : 0, 670
Telemetry [baseline] (10.61 ms) : 0, 10610
Telemetry [candidate] (10.694 ms) : 0, 10694
section appsec
BytebuddyAgent [baseline] (710.583 ms) : 0, 710583
BytebuddyAgent [candidate] (714.393 ms) : 0, 714393
GlobalTracer [baseline] (314.347 ms) : 0, 314347
GlobalTracer [candidate] (316.76 ms) : 0, 316760
AppSec [baseline] (167.863 ms) : 0, 167863
AppSec [candidate] (168.264 ms) : 0, 168264
Remote Config [baseline] (643.182 µs) : 0, 643
Remote Config [candidate] (656.49 µs) : 0, 656
Telemetry [baseline] (7.412 ms) : 0, 7412
Telemetry [candidate] (8.525 ms) : 0, 8525
IAST [baseline] (18.901 ms) : 0, 18901
IAST [candidate] (19.398 ms) : 0, 19398
section iast
BytebuddyAgent [baseline] (810.037 ms) : 0, 810037
BytebuddyAgent [candidate] (812.721 ms) : 0, 812721
GlobalTracer [baseline] (305.177 ms) : 0, 305177
GlobalTracer [candidate] (306.875 ms) : 0, 306875
AppSec [baseline] (57.838 ms) : 0, 57838
AppSec [candidate] (57.919 ms) : 0, 57919
Remote Config [baseline] (625.504 µs) : 0, 626
Remote Config [candidate] (645.767 µs) : 0, 646
Telemetry [baseline] (7.468 ms) : 0, 7468
Telemetry [candidate] (7.573 ms) : 0, 7573
IAST [baseline] (20.697 ms) : 0, 20697
IAST [candidate] (20.906 ms) : 0, 20906
section profiling
BytebuddyAgent [baseline] (687.066 ms) : 0, 687066
BytebuddyAgent [candidate] (687.329 ms) : 0, 687329
GlobalTracer [baseline] (430.883 ms) : 0, 430883
GlobalTracer [candidate] (433.246 ms) : 0, 433246
AppSec [baseline] (53.683 ms) : 0, 53683
AppSec [candidate] (53.581 ms) : 0, 53581
Remote Config [baseline] (653.8 µs) : 0, 654
Remote Config [candidate] (658.552 µs) : 0, 659
Telemetry [baseline] (7.692 ms) : 0, 7692
Telemetry [candidate] (7.707 ms) : 0, 7707
ProfilingAgent [baseline] (93.263 ms) : 0, 93263
ProfilingAgent [candidate] (92.723 ms) : 0, 92723
Profiling [baseline] (93.288 ms) : 0, 93288
Profiling [candidate] (92.746 ms) : 0, 92746
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-11-27T21:51:27 2024-11-27T21:58:24
git_branch master evanchooly/DEBUG-3159
git_commit_date 1732735962 1732743640
git_commit_sha 207f770 dce86b3
release_version 1.44.0-SNAPSHOT~207f770623 1.44.0-SNAPSHOT~dce86b32b8
start_time 2024-11-27T21:51:14 2024-11-27T21:58:11
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1732745055 1732745055
ci_job_id 722470362 722470362
ci_pipeline_id 50085513 50085513
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~dce86b32b8, baseline=1.44.0-SNAPSHOT~207f770623
    dateFormat X
    axisFormat %s
section baseline
no_agent (377.53 µs) : 357, 398
.   : milestone, 378,
iast (486.174 µs) : 465, 508
.   : milestone, 486,
iast_FULL (646.51 µs) : 625, 668
.   : milestone, 647,
iast_GLOBAL (512.728 µs) : 491, 534
.   : milestone, 513,
iast_HARDCODED_SECRET_DISABLED (485.354 µs) : 464, 507
.   : milestone, 485,
iast_INACTIVE (446.102 µs) : 425, 467
.   : milestone, 446,
iast_TELEMETRY_OFF (484.939 µs) : 463, 507
.   : milestone, 485,
tracing (448.009 µs) : 427, 469
.   : milestone, 448,
section candidate
no_agent (372.601 µs) : 353, 392
.   : milestone, 373,
iast (486.934 µs) : 465, 509
.   : milestone, 487,
iast_FULL (644.839 µs) : 623, 666
.   : milestone, 645,
iast_GLOBAL (515.228 µs) : 493, 537
.   : milestone, 515,
iast_HARDCODED_SECRET_DISABLED (487.385 µs) : 466, 509
.   : milestone, 487,
iast_INACTIVE (446.23 µs) : 425, 467
.   : milestone, 446,
iast_TELEMETRY_OFF (477.899 µs) : 457, 499
.   : milestone, 478,
tracing (448.353 µs) : 426, 470
.   : milestone, 448,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 377.53 µs [357.087 µs, 397.972 µs] -
iast 486.174 µs [464.79 µs, 507.558 µs] 108.644 µs (28.8%)
iast_FULL 646.51 µs [625.067 µs, 667.954 µs] 268.98 µs (71.2%)
iast_GLOBAL 512.728 µs [491.375 µs, 534.08 µs] 135.198 µs (35.8%)
iast_HARDCODED_SECRET_DISABLED 485.354 µs [464.036 µs, 506.671 µs] 107.824 µs (28.6%)
iast_INACTIVE 446.102 µs [425.106 µs, 467.098 µs] 68.572 µs (18.2%)
iast_TELEMETRY_OFF 484.939 µs [463.239 µs, 506.638 µs] 107.409 µs (28.5%)
tracing 448.009 µs [427.133 µs, 468.884 µs] 70.479 µs (18.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 372.601 µs [352.992 µs, 392.21 µs] -
iast 486.934 µs [465.31 µs, 508.558 µs] 114.333 µs (30.7%)
iast_FULL 644.839 µs [623.284 µs, 666.393 µs] 272.238 µs (73.1%)
iast_GLOBAL 515.228 µs [493.138 µs, 537.318 µs] 142.628 µs (38.3%)
iast_HARDCODED_SECRET_DISABLED 487.385 µs [466.182 µs, 508.588 µs] 114.784 µs (30.8%)
iast_INACTIVE 446.23 µs [425.069 µs, 467.392 µs] 73.63 µs (19.8%)
iast_TELEMETRY_OFF 477.899 µs [456.591 µs, 499.208 µs] 105.298 µs (28.3%)
tracing 448.353 µs [426.368 µs, 470.338 µs] 75.752 µs (20.3%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~dce86b32b8, baseline=1.44.0-SNAPSHOT~207f770623
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.365 ms) : 1345, 1384
.   : milestone, 1365,
appsec (1.748 ms) : 1723, 1773
.   : milestone, 1748,
appsec_no_iast (1.739 ms) : 1714, 1763
.   : milestone, 1739,
iast (1.485 ms) : 1462, 1507
.   : milestone, 1485,
profiling (1.515 ms) : 1492, 1539
.   : milestone, 1515,
tracing (1.483 ms) : 1459, 1508
.   : milestone, 1483,
section candidate
no_agent (1.349 ms) : 1330, 1369
.   : milestone, 1349,
appsec (1.739 ms) : 1715, 1763
.   : milestone, 1739,
appsec_no_iast (1.717 ms) : 1691, 1743
.   : milestone, 1717,
iast (1.487 ms) : 1464, 1510
.   : milestone, 1487,
profiling (1.518 ms) : 1492, 1543
.   : milestone, 1518,
tracing (1.476 ms) : 1452, 1500
.   : milestone, 1476,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.365 ms [1.345 ms, 1.384 ms] -
appsec 1.748 ms [1.723 ms, 1.773 ms] 383.444 µs (28.1%)
appsec_no_iast 1.739 ms [1.714 ms, 1.763 ms] 374.381 µs (27.4%)
iast 1.485 ms [1.462 ms, 1.507 ms] 120.275 µs (8.8%)
profiling 1.515 ms [1.492 ms, 1.539 ms] 150.876 µs (11.1%)
tracing 1.483 ms [1.459 ms, 1.508 ms] 118.719 µs (8.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.349 ms [1.33 ms, 1.369 ms] -
appsec 1.739 ms [1.715 ms, 1.763 ms] 389.623 µs (28.9%)
appsec_no_iast 1.717 ms [1.691 ms, 1.743 ms] 367.659 µs (27.2%)
iast 1.487 ms [1.464 ms, 1.51 ms] 137.355 µs (10.2%)
profiling 1.518 ms [1.492 ms, 1.543 ms] 168.052 µs (12.5%)
tracing 1.476 ms [1.452 ms, 1.5 ms] 126.749 µs (9.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master evanchooly/DEBUG-3159
git_commit_date 1732735962 1732743640
git_commit_sha 207f770 dce86b3
release_version 1.44.0-SNAPSHOT~207f770623 1.44.0-SNAPSHOT~dce86b32b8
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1732745626 1732745626
ci_job_id 722470363 722470363
ci_pipeline_id 50085513 50085513
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~dce86b32b8, baseline=1.44.0-SNAPSHOT~207f770623
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.464 ms) : 1453, 1476
.   : milestone, 1464,
appsec (2.327 ms) : 2286, 2369
.   : milestone, 2327,
iast (2.081 ms) : 2029, 2134
.   : milestone, 2081,
iast_GLOBAL (2.117 ms) : 2064, 2170
.   : milestone, 2117,
profiling (1.935 ms) : 1894, 1977
.   : milestone, 1935,
tracing (1.921 ms) : 1881, 1962
.   : milestone, 1921,
section candidate
no_agent (1.464 ms) : 1453, 1476
.   : milestone, 1464,
appsec (2.335 ms) : 2293, 2376
.   : milestone, 2335,
iast (2.08 ms) : 2027, 2133
.   : milestone, 2080,
iast_GLOBAL (2.12 ms) : 2067, 2173
.   : milestone, 2120,
profiling (1.944 ms) : 1902, 1986
.   : milestone, 1944,
tracing (1.92 ms) : 1880, 1960
.   : milestone, 1920,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.464 ms [1.453 ms, 1.476 ms] -
appsec 2.327 ms [2.286 ms, 2.369 ms] 863.201 µs (59.0%)
iast 2.081 ms [2.029 ms, 2.134 ms] 616.927 µs (42.1%)
iast_GLOBAL 2.117 ms [2.064 ms, 2.17 ms] 652.866 µs (44.6%)
profiling 1.935 ms [1.894 ms, 1.977 ms] 471.085 µs (32.2%)
tracing 1.921 ms [1.881 ms, 1.962 ms] 457.137 µs (31.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.464 ms [1.453 ms, 1.476 ms] -
appsec 2.335 ms [2.293 ms, 2.376 ms] 870.738 µs (59.5%)
iast 2.08 ms [2.027 ms, 2.133 ms] 615.886 µs (42.1%)
iast_GLOBAL 2.12 ms [2.067 ms, 2.173 ms] 655.824 µs (44.8%)
profiling 1.944 ms [1.902 ms, 1.986 ms] 479.702 µs (32.8%)
tracing 1.92 ms [1.88 ms, 1.96 ms] 455.994 µs (31.1%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~dce86b32b8, baseline=1.44.0-SNAPSHOT~207f770623
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.523 s) : 15523000, 15523000
.   : milestone, 15523000,
appsec (15.152 s) : 15152000, 15152000
.   : milestone, 15152000,
iast (18.672 s) : 18672000, 18672000
.   : milestone, 18672000,
iast_GLOBAL (17.681 s) : 17681000, 17681000
.   : milestone, 17681000,
profiling (14.738 s) : 14738000, 14738000
.   : milestone, 14738000,
tracing (15.097 s) : 15097000, 15097000
.   : milestone, 15097000,
section candidate
no_agent (15.474 s) : 15474000, 15474000
.   : milestone, 15474000,
appsec (15.159 s) : 15159000, 15159000
.   : milestone, 15159000,
iast (18.571 s) : 18571000, 18571000
.   : milestone, 18571000,
iast_GLOBAL (17.818 s) : 17818000, 17818000
.   : milestone, 17818000,
profiling (15.582 s) : 15582000, 15582000
.   : milestone, 15582000,
tracing (14.855 s) : 14855000, 14855000
.   : milestone, 14855000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.523 s [15.523 s, 15.523 s] -
appsec 15.152 s [15.152 s, 15.152 s] -371.0 ms (-2.4%)
iast 18.672 s [18.672 s, 18.672 s] 3.149 s (20.3%)
iast_GLOBAL 17.681 s [17.681 s, 17.681 s] 2.158 s (13.9%)
profiling 14.738 s [14.738 s, 14.738 s] -785.0 ms (-5.1%)
tracing 15.097 s [15.097 s, 15.097 s] -426.0 ms (-2.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.474 s [15.474 s, 15.474 s] -
appsec 15.159 s [15.159 s, 15.159 s] -315.0 ms (-2.0%)
iast 18.571 s [18.571 s, 18.571 s] 3.097 s (20.0%)
iast_GLOBAL 17.818 s [17.818 s, 17.818 s] 2.344 s (15.1%)
profiling 15.582 s [15.582 s, 15.582 s] 108.0 ms (0.7%)
tracing 14.855 s [14.855 s, 14.855 s] -619.0 ms (-4.0%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: debugger Dynamic Instrumentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant