Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bump profiler to 1.15.0 #7671

Merged
merged 2 commits into from
Sep 24, 2024
Merged

Bump profiler to 1.15.0 #7671

merged 2 commits into from
Sep 24, 2024

Conversation

MattAlp
Copy link
Contributor

@MattAlp MattAlp commented Sep 23, 2024

What Does This Do

Addresses JDK 23 crashes caused by (<= v1.13.0 of) the profiler.

Motivation

To be used for patch v1.39.1, see #7665

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@MattAlp
Bump profiler to 1.15.0
e72240d 
To be used for patch v1.39.1
@MattAlp MattAlp added this to the 1.39.1 milestone Sep 23, 2024
@MattAlp MattAlp requested a review from a team as a code owner September 23, 2024 14:05
@MattAlp MattAlp changed the base branch from master to release/v1.39.x September 23, 2024 14:05
@pr-commenter
Copy link

pr-commenter bot commented Sep 23, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/patch-profiler-to-1.15.0
git_commit_date 1727166392 1727177965
git_commit_sha 0dcde79 5a97b55
release_version 1.40.0-SNAPSHOT~0dcde7931e 1.40.0-SNAPSHOT~5a97b55256
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1727180399 1727180399
ci_job_id 649549125 649549125
ci_pipeline_id 45001932 45001932
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 43 metrics, 16 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:tracing:AppSec better
[-2.861ms; -1.316ms] or [-5.303%; -2.439%]		 51.858ms 53.946ms
scenario:startup:petclinic:profiling:AppSec better
[-2.658ms; -1.260ms] or [-4.853%; -2.301%]		 52.809ms 54.768ms
scenario:startup:petclinic:profiling:Remote Config worse
[+31.768µs; +82.591µs] or [+4.798%; +12.475%]		 719.240µs 662.061µs
scenario:startup:petclinic:tracing:AppSec better
[-3.241ms; -1.469ms] or [-6.000%; -2.720%]		 51.656ms 54.011ms
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~5a97b55256, baseline=1.40.0-SNAPSHOT~0dcde7931e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.076 s) : 0, 1075907
Total [baseline] (10.466 s) : 0, 10465599
Agent [candidate] (1.063 s) : 0, 1062541
Total [candidate] (10.355 s) : 0, 10355340
section appsec
Agent [baseline] (1.206 s) : 0, 1205746
Total [baseline] (10.642 s) : 0, 10642389
Agent [candidate] (1.205 s) : 0, 1205054
Total [candidate] (10.612 s) : 0, 10611717
section iast
Agent [baseline] (1.209 s) : 0, 1209036
Total [baseline] (10.915 s) : 0, 10914694
Agent [candidate] (1.186 s) : 0, 1186037
Total [candidate] (10.84 s) : 0, 10839710
section profiling
Agent [baseline] (1.266 s) : 0, 1266466
Total [baseline] (10.643 s) : 0, 10642765
Agent [candidate] (1.267 s) : 0, 1267346
Total [candidate] (10.595 s) : 0, 10595373
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.076 s -
Agent appsec 1.206 s 129.838 ms (12.1%)
Agent iast 1.209 s 133.129 ms (12.4%)
Agent profiling 1.266 s 190.559 ms (17.7%)
Total tracing 10.466 s -
Total appsec 10.642 s 176.79 ms (1.7%)
Total iast 10.915 s 449.095 ms (4.3%)
Total profiling 10.643 s 177.166 ms (1.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent appsec 1.205 s 142.513 ms (13.4%)
Agent iast 1.186 s 123.496 ms (11.6%)
Agent profiling 1.267 s 204.805 ms (19.3%)
Total tracing 10.355 s -
Total appsec 10.612 s 256.376 ms (2.5%)
Total iast 10.84 s 484.369 ms (4.7%)
Total profiling 10.595 s 240.033 ms (2.3%) 
gantt
    title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~5a97b55256, baseline=1.40.0-SNAPSHOT~0dcde7931e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.987 ms) : 0, 686987
BytebuddyAgent [candidate] (678.362 ms) : 0, 678362
GlobalTracer [baseline] (312.879 ms) : 0, 312879
GlobalTracer [candidate] (310.684 ms) : 0, 310684
AppSec [baseline] (54.011 ms) : 0, 54011
AppSec [candidate] (51.656 ms) : 0, 51656
Remote Config [baseline] (663.967 µs) : 0, 664
Remote Config [candidate] (686.623 µs) : 0, 687
Telemetry [baseline] (7.623 ms) : 0, 7623
Telemetry [candidate] (7.498 ms) : 0, 7498
section appsec
BytebuddyAgent [baseline] (703.873 ms) : 0, 703873
BytebuddyAgent [candidate] (703.481 ms) : 0, 703481
GlobalTracer [baseline] (304.694 ms) : 0, 304694
GlobalTracer [candidate] (306.094 ms) : 0, 306094
AppSec [baseline] (163.308 ms) : 0, 163308
AppSec [candidate] (159.943 ms) : 0, 159943
Remote Config [baseline] (658.325 µs) : 0, 658
Remote Config [candidate] (640.976 µs) : 0, 641
Telemetry [baseline] (8.839 ms) : 0, 8839
Telemetry [candidate] (10.419 ms) : 0, 10419
IAST [baseline] (21.404 ms) : 0, 21404
IAST [candidate] (21.438 ms) : 0, 21438
section iast
BytebuddyAgent [baseline] (807.361 ms) : 0, 807361
BytebuddyAgent [candidate] (788.801 ms) : 0, 788801
GlobalTracer [baseline] (301.304 ms) : 0, 301304
GlobalTracer [candidate] (299.264 ms) : 0, 299264
AppSec [baseline] (56.328 ms) : 0, 56328
AppSec [candidate] (52.305 ms) : 0, 52305
Remote Config [baseline] (621.79 µs) : 0, 622
Remote Config [candidate] (602.34 µs) : 0, 602
Telemetry [baseline] (7.968 ms) : 0, 7968
Telemetry [candidate] (7.314 ms) : 0, 7314
IAST [baseline] (21.493 ms) : 0, 21493
IAST [candidate] (24.106 ms) : 0, 24106
section profiling
BytebuddyAgent [baseline] (673.94 ms) : 0, 673940
BytebuddyAgent [candidate] (675.923 ms) : 0, 675923
GlobalTracer [baseline] (394.567 ms) : 0, 394567
GlobalTracer [candidate] (395.049 ms) : 0, 395049
AppSec [baseline] (54.768 ms) : 0, 54768
AppSec [candidate] (52.809 ms) : 0, 52809
Remote Config [baseline] (662.061 µs) : 0, 662
Remote Config [candidate] (719.24 µs) : 0, 719
Telemetry [baseline] (7.493 ms) : 0, 7493
Telemetry [candidate] (7.503 ms) : 0, 7503
ProfilingAgent [baseline] (96.443 ms) : 0, 96443
ProfilingAgent [candidate] (97.117 ms) : 0, 97117
Profiling [baseline] (96.466 ms) : 0, 96466
Profiling [candidate] (97.141 ms) : 0, 97141
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~5a97b55256, baseline=1.40.0-SNAPSHOT~0dcde7931e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1068265
Total [baseline] (8.587 s) : 0, 8587329
Agent [candidate] (1.081 s) : 0, 1080629
Total [candidate] (8.556 s) : 0, 8555675
section iast
Agent [baseline] (1.19 s) : 0, 1189964
Total [baseline] (9.007 s) : 0, 9007391
Agent [candidate] (1.195 s) : 0, 1194954
Total [candidate] (9.033 s) : 0, 9033044
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.192 s) : 0, 1191836
Total [baseline] (9.002 s) : 0, 9002051
Agent [candidate] (1.187 s) : 0, 1187323
Total [candidate] (9.028 s) : 0, 9028223
section iast_TELEMETRY_OFF
Agent [baseline] (1.186 s) : 0, 1186488
Total [baseline] (9.039 s) : 0, 9038667
Agent [candidate] (1.183 s) : 0, 1182592
Total [candidate] (9.015 s) : 0, 9015217
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent iast 1.19 s 121.698 ms (11.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.192 s 123.571 ms (11.6%)
Agent iast_TELEMETRY_OFF 1.186 s 118.223 ms (11.1%)
Total tracing 8.587 s -
Total iast 9.007 s 420.062 ms (4.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.002 s 414.722 ms (4.8%)
Total iast_TELEMETRY_OFF 9.039 s 451.338 ms (5.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent iast 1.195 s 114.325 ms (10.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.187 s 106.694 ms (9.9%)
Agent iast_TELEMETRY_OFF 1.183 s 101.963 ms (9.4%)
Total tracing 8.556 s -
Total iast 9.033 s 477.369 ms (5.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.028 s 472.548 ms (5.5%)
Total iast_TELEMETRY_OFF 9.015 s 459.543 ms (5.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~5a97b55256, baseline=1.40.0-SNAPSHOT~0dcde7931e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (681.031 ms) : 0, 681031
BytebuddyAgent [candidate] (692.375 ms) : 0, 692375
GlobalTracer [baseline] (311.365 ms) : 0, 311365
GlobalTracer [candidate] (314.271 ms) : 0, 314271
AppSec [baseline] (53.946 ms) : 0, 53946
AppSec [candidate] (51.858 ms) : 0, 51858
Remote Config [baseline] (668.072 µs) : 0, 668
Remote Config [candidate] (695.2 µs) : 0, 695
Telemetry [baseline] (7.641 ms) : 0, 7641
Telemetry [candidate] (7.51 ms) : 0, 7510
section iast
BytebuddyAgent [baseline] (791.557 ms) : 0, 791557
BytebuddyAgent [candidate] (794.742 ms) : 0, 794742
GlobalTracer [baseline] (298.993 ms) : 0, 298993
GlobalTracer [candidate] (301.262 ms) : 0, 301262
AppSec [baseline] (53.121 ms) : 0, 53121
AppSec [candidate] (55.062 ms) : 0, 55062
Remote Config [baseline] (584.475 µs) : 0, 584
Remote Config [candidate] (615.805 µs) : 0, 616
Telemetry [baseline] (6.907 ms) : 0, 6907
Telemetry [candidate] (8.263 ms) : 0, 8263
IAST [baseline] (25.145 ms) : 0, 25145
IAST [candidate] (21.272 ms) : 0, 21272
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (792.784 ms) : 0, 792784
BytebuddyAgent [candidate] (788.698 ms) : 0, 788698
GlobalTracer [baseline] (299.713 ms) : 0, 299713
GlobalTracer [candidate] (299.888 ms) : 0, 299888
AppSec [baseline] (55.292 ms) : 0, 55292
AppSec [candidate] (53.156 ms) : 0, 53156
Remote Config [baseline] (603.298 µs) : 0, 603
Remote Config [candidate] (617.17 µs) : 0, 617
Telemetry [baseline] (7.067 ms) : 0, 7067
Telemetry [candidate] (8.258 ms) : 0, 8258
IAST [baseline] (22.732 ms) : 0, 22732
IAST [candidate] (22.997 ms) : 0, 22997
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (787.798 ms) : 0, 787798
BytebuddyAgent [candidate] (785.248 ms) : 0, 785248
GlobalTracer [baseline] (299.336 ms) : 0, 299336
GlobalTracer [candidate] (299.595 ms) : 0, 299595
AppSec [baseline] (55.78 ms) : 0, 55780
AppSec [candidate] (52.219 ms) : 0, 52219
Remote Config [baseline] (596.578 µs) : 0, 597
Remote Config [candidate] (598.334 µs) : 0, 598
Telemetry [baseline] (6.933 ms) : 0, 6933
Telemetry [candidate] (9.507 ms) : 0, 9507
IAST [baseline] (22.394 ms) : 0, 22394
IAST [candidate] (21.738 ms) : 0, 21738
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-24T11:50:32 2024-09-24T11:57:20
git_branch master mattalp/patch-profiler-to-1.15.0
git_commit_date 1727166392 1727177965
git_commit_sha 0dcde79 5a97b55
release_version 1.40.0-SNAPSHOT~0dcde7931e 1.40.0-SNAPSHOT~5a97b55256
start_time 2024-09-24T11:50:18 2024-09-24T11:57:06
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1727179386 1727179386
ci_job_id 649549126 649549126
ci_pipeline_id 45001932 45001932
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 9 metrics, 18 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+34.681µs; +89.463µs] or [+2.348%; +6.056%]		 unstable
[-833.814op/s; +359.740op/s] or [-26.057%; +11.242%]		 1.539ms 2962.963op/s 1.477ms 3200.000op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~5a97b55256, baseline=1.40.0-SNAPSHOT~0dcde7931e
    dateFormat X
    axisFormat %s
section baseline
no_agent (371.898 µs) : 352, 392
.   : milestone, 372,
iast (489.498 µs) : 467, 512
.   : milestone, 489,
iast_FULL (547.398 µs) : 526, 569
.   : milestone, 547,
iast_GLOBAL (507.486 µs) : 485, 529
.   : milestone, 507,
iast_HARDCODED_SECRET_DISABLED (480.253 µs) : 459, 502
.   : milestone, 480,
iast_INACTIVE (441.7 µs) : 421, 462
.   : milestone, 442,
iast_TELEMETRY_OFF (471.982 µs) : 449, 495
.   : milestone, 472,
tracing (440.659 µs) : 420, 462
.   : milestone, 441,
section candidate
no_agent (364.6 µs) : 345, 384
.   : milestone, 365,
iast (488.025 µs) : 465, 511
.   : milestone, 488,
iast_FULL (550.663 µs) : 529, 572
.   : milestone, 551,
iast_GLOBAL (502.683 µs) : 482, 524
.   : milestone, 503,
iast_HARDCODED_SECRET_DISABLED (480.461 µs) : 458, 503
.   : milestone, 480,
iast_INACTIVE (447.565 µs) : 427, 469
.   : milestone, 448,
iast_TELEMETRY_OFF (468.489 µs) : 446, 491
.   : milestone, 468,
tracing (438.389 µs) : 418, 459
.   : milestone, 438,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 371.898 µs [352.19 µs, 391.606 µs] -
iast 489.498 µs [467.489 µs, 511.507 µs] 117.6 µs (31.6%)
iast_FULL 547.398 µs [526.004 µs, 568.791 µs] 175.499 µs (47.2%)
iast_GLOBAL 507.486 µs [485.479 µs, 529.493 µs] 135.588 µs (36.5%)
iast_HARDCODED_SECRET_DISABLED 480.253 µs [458.947 µs, 501.559 µs] 108.355 µs (29.1%)
iast_INACTIVE 441.7 µs [421.119 µs, 462.282 µs] 69.802 µs (18.8%)
iast_TELEMETRY_OFF 471.982 µs [449.269 µs, 494.695 µs] 100.084 µs (26.9%)
tracing 440.659 µs [419.731 µs, 461.587 µs] 68.761 µs (18.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 364.6 µs [345.301 µs, 383.9 µs] -
iast 488.025 µs [465.336 µs, 510.714 µs] 123.425 µs (33.9%)
iast_FULL 550.663 µs [529.39 µs, 571.936 µs] 186.063 µs (51.0%)
iast_GLOBAL 502.683 µs [481.781 µs, 523.585 µs] 138.083 µs (37.9%)
iast_HARDCODED_SECRET_DISABLED 480.461 µs [458.037 µs, 502.886 µs] 115.861 µs (31.8%)
iast_INACTIVE 447.565 µs [426.545 µs, 468.585 µs] 82.965 µs (22.8%)
iast_TELEMETRY_OFF 468.489 µs [445.79 µs, 491.187 µs] 103.888 µs (28.5%)
tracing 438.389 µs [417.762 µs, 459.017 µs] 73.789 µs (20.2%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~5a97b55256, baseline=1.40.0-SNAPSHOT~0dcde7931e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.33 ms) : 1309, 1350
.   : milestone, 1330,
appsec (1.713 ms) : 1689, 1738
.   : milestone, 1713,
appsec_no_iast (1.681 ms) : 1656, 1706
.   : milestone, 1681,
iast (1.465 ms) : 1443, 1487
.   : milestone, 1465,
profiling (1.477 ms) : 1452, 1502
.   : milestone, 1477,
tracing (1.464 ms) : 1439, 1488
.   : milestone, 1464,
section candidate
no_agent (1.326 ms) : 1307, 1345
.   : milestone, 1326,
appsec (1.718 ms) : 1695, 1742
.   : milestone, 1718,
appsec_no_iast (1.727 ms) : 1703, 1750
.   : milestone, 1727,
iast (1.466 ms) : 1444, 1489
.   : milestone, 1466,
profiling (1.539 ms) : 1514, 1565
.   : milestone, 1539,
tracing (1.457 ms) : 1433, 1482
.   : milestone, 1457,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.33 ms [1.309 ms, 1.35 ms] -
appsec 1.713 ms [1.689 ms, 1.738 ms] 383.942 µs (28.9%)
appsec_no_iast 1.681 ms [1.656 ms, 1.706 ms] 351.822 µs (26.5%)
iast 1.465 ms [1.443 ms, 1.487 ms] 135.122 µs (10.2%)
profiling 1.477 ms [1.452 ms, 1.502 ms] 147.787 µs (11.1%)
tracing 1.464 ms [1.439 ms, 1.488 ms] 134.254 µs (10.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.326 ms [1.307 ms, 1.345 ms] -
appsec 1.718 ms [1.695 ms, 1.742 ms] 392.449 µs (29.6%)
appsec_no_iast 1.727 ms [1.703 ms, 1.75 ms] 400.675 µs (30.2%)
iast 1.466 ms [1.444 ms, 1.489 ms] 140.353 µs (10.6%)
profiling 1.539 ms [1.514 ms, 1.565 ms] 213.527 µs (16.1%)
tracing 1.457 ms [1.433 ms, 1.482 ms] 131.467 µs (9.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/patch-profiler-to-1.15.0
git_commit_date 1727166392 1727177965
git_commit_sha 0dcde79 5a97b55
release_version 1.40.0-SNAPSHOT~0dcde7931e 1.40.0-SNAPSHOT~5a97b55256
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1727179933 1727179933
ci_job_id 649549127 649549127
ci_pipeline_id 45001932 45001932
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~5a97b55256, baseline=1.40.0-SNAPSHOT~0dcde7931e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.309 ms) : 2269, 2349
.   : milestone, 2309,
iast (2.061 ms) : 2010, 2112
.   : milestone, 2061,
iast_GLOBAL (2.096 ms) : 2046, 2147
.   : milestone, 2096,
profiling (1.935 ms) : 1893, 1976
.   : milestone, 1935,
tracing (1.911 ms) : 1873, 1950
.   : milestone, 1911,
section candidate
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (2.295 ms) : 2255, 2336
.   : milestone, 2295,
iast (2.052 ms) : 2002, 2102
.   : milestone, 2052,
iast_GLOBAL (2.095 ms) : 2045, 2146
.   : milestone, 2095,
profiling (1.933 ms) : 1892, 1974
.   : milestone, 1933,
tracing (1.9 ms) : 1862, 1938
.   : milestone, 1900,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 2.309 ms [2.269 ms, 2.349 ms] 837.04 µs (56.9%)
iast 2.061 ms [2.01 ms, 2.112 ms] 588.418 µs (40.0%)
iast_GLOBAL 2.096 ms [2.046 ms, 2.147 ms] 624.27 µs (42.4%)
profiling 1.935 ms [1.893 ms, 1.976 ms] 462.623 µs (31.4%)
tracing 1.911 ms [1.873 ms, 1.95 ms] 439.158 µs (29.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 2.295 ms [2.255 ms, 2.336 ms] 822.837 µs (55.9%)
iast 2.052 ms [2.002 ms, 2.102 ms] 579.296 µs (39.3%)
iast_GLOBAL 2.095 ms [2.045 ms, 2.146 ms] 622.569 µs (42.3%)
profiling 1.933 ms [1.892 ms, 1.974 ms] 460.485 µs (31.3%)
tracing 1.9 ms [1.862 ms, 1.938 ms] 427.142 µs (29.0%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~5a97b55256, baseline=1.40.0-SNAPSHOT~0dcde7931e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.149 s) : 15149000, 15149000
.   : milestone, 15149000,
appsec (15.39 s) : 15390000, 15390000
.   : milestone, 15390000,
iast (18.753 s) : 18753000, 18753000
.   : milestone, 18753000,
iast_GLOBAL (18.103 s) : 18103000, 18103000
.   : milestone, 18103000,
profiling (15.842 s) : 15842000, 15842000
.   : milestone, 15842000,
tracing (15.143 s) : 15143000, 15143000
.   : milestone, 15143000,
section candidate
no_agent (15.038 s) : 15038000, 15038000
.   : milestone, 15038000,
appsec (15.248 s) : 15248000, 15248000
.   : milestone, 15248000,
iast (18.707 s) : 18707000, 18707000
.   : milestone, 18707000,
iast_GLOBAL (18.034 s) : 18034000, 18034000
.   : milestone, 18034000,
profiling (15.068 s) : 15068000, 15068000
.   : milestone, 15068000,
tracing (15.361 s) : 15361000, 15361000
.   : milestone, 15361000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.149 s [15.149 s, 15.149 s] -
appsec 15.39 s [15.39 s, 15.39 s] 241.0 ms (1.6%)
iast 18.753 s [18.753 s, 18.753 s] 3.604 s (23.8%)
iast_GLOBAL 18.103 s [18.103 s, 18.103 s] 2.954 s (19.5%)
profiling 15.842 s [15.842 s, 15.842 s] 693.0 ms (4.6%)
tracing 15.143 s [15.143 s, 15.143 s] -6.0 ms (-0.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.038 s [15.038 s, 15.038 s] -
appsec 15.248 s [15.248 s, 15.248 s] 210.0 ms (1.4%)
iast 18.707 s [18.707 s, 18.707 s] 3.669 s (24.4%)
iast_GLOBAL 18.034 s [18.034 s, 18.034 s] 2.996 s (19.9%)
profiling 15.068 s [15.068 s, 15.068 s] 30.0 ms (0.2%)
tracing 15.361 s [15.361 s, 15.361 s] 323.0 ms (2.1%)

@PerfectSlayer PerfectSlayer added the tag: dependencies Dependencies related changes label Sep 23, 2024
@MattAlp MattAlp merged commit 010e6f7 into release/v1.39.x Sep 24, 2024
94 checks passed
@MattAlp MattAlp deleted the mattalp/patch-profiler-to-1.15.0 branch September 24, 2024 12:49
@MattAlp MattAlp restored the mattalp/patch-profiler-to-1.15.0 branch September 24, 2024 23:54
@MattAlp MattAlp deleted the mattalp/patch-profiler-to-1.15.0 branch September 24, 2024 23:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jbachorik jbachorik jbachorik approved these changes

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

Assignees
No one assigned
Labels
comp: profiling Profiling tag: dependencies Dependencies related changes type: enhancement
Projects
None yet
Milestone
1.39.1
Development

Successfully merging this pull request may close these issues.
3 participants
@MattAlp @jbachorik @PerfectSlayer