Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix freemarker test with newer versions #7616

Merged
merged 1 commit into from
Sep 13, 2024
Merged

Fix freemarker test with newer versions #7616

merged 1 commit into from
Sep 13, 2024

Conversation

Mariovido
Copy link
Contributor

What Does This Do

Fix the test with newer versions of freemarker

Motivation

This is motivated by an upgrade of the freemarker latest version that was showing error in the specific test

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@Mariovido Mariovido added type: bug tag: no release notes Changes to exclude from release notes comp: asm iast Application Security Management (IAST) labels Sep 13, 2024
PerfectSlayer
PerfectSlayer approved these changes Sep 13, 2024
View reviewed changes
Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the fix 👍

@Mariovido Mariovido marked this pull request as ready for review September 13, 2024 08:13
@Mariovido Mariovido requested a review from a team as a code owner September 13, 2024 08:13
@smola smola added comp: testing Testing and removed type: bug labels Sep 13, 2024
@pr-commenter
Copy link

pr-commenter bot commented Sep 13, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mario.vidal/fix_freemarker_test
git_commit_date 1726211196 1726214243
git_commit_sha fcd206e 19239bf
release_version 1.40.0-SNAPSHOT~fcd206e7d7 1.40.0-SNAPSHOT~19239bf814
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1726217000 1726217000
ci_job_id 638265958 638265958
ci_pipeline_id 44260578 44260578
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 14 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~19239bf814, baseline=1.40.0-SNAPSHOT~fcd206e7d7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063789
Total [baseline] (8.503 s) : 0, 8503124
Agent [candidate] (1.075 s) : 0, 1075385
Total [candidate] (8.511 s) : 0, 8511453
section iast
Agent [baseline] (1.19 s) : 0, 1189708
Total [baseline] (8.975 s) : 0, 8975257
Agent [candidate] (1.187 s) : 0, 1186906
Total [candidate] (8.972 s) : 0, 8971594
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.186 s) : 0, 1186453
Total [baseline] (8.939 s) : 0, 8938524
Agent [candidate] (1.185 s) : 0, 1185199
Total [candidate] (8.934 s) : 0, 8934203
section iast_TELEMETRY_OFF
Agent [baseline] (1.184 s) : 0, 1183942
Total [baseline] (8.978 s) : 0, 8977534
Agent [candidate] (1.186 s) : 0, 1185535
Total [candidate] (8.975 s) : 0, 8974542
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.19 s 125.919 ms (11.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.186 s 122.664 ms (11.5%)
Agent iast_TELEMETRY_OFF 1.184 s 120.153 ms (11.3%)
Total tracing 8.503 s -
Total iast 8.975 s 472.133 ms (5.6%)
Total iast_HARDCODED_SECRET_DISABLED 8.939 s 435.399 ms (5.1%)
Total iast_TELEMETRY_OFF 8.978 s 474.41 ms (5.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.075 s -
Agent iast 1.187 s 111.522 ms (10.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.185 s 109.814 ms (10.2%)
Agent iast_TELEMETRY_OFF 1.186 s 110.151 ms (10.2%)
Total tracing 8.511 s -
Total iast 8.972 s 460.141 ms (5.4%)
Total iast_HARDCODED_SECRET_DISABLED 8.934 s 422.75 ms (5.0%)
Total iast_TELEMETRY_OFF 8.975 s 463.089 ms (5.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~19239bf814, baseline=1.40.0-SNAPSHOT~fcd206e7d7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (679.89 ms) : 0, 679890
BytebuddyAgent [candidate] (687.513 ms) : 0, 687513
GlobalTracer [baseline] (310.228 ms) : 0, 310228
GlobalTracer [candidate] (313.585 ms) : 0, 313585
AppSec [baseline] (51.796 ms) : 0, 51796
AppSec [candidate] (52.221 ms) : 0, 52221
Remote Config [baseline] (724.52 µs) : 0, 725
Remote Config [candidate] (720.034 µs) : 0, 720
Telemetry [baseline] (7.561 ms) : 0, 7561
Telemetry [candidate] (7.603 ms) : 0, 7603
section iast
BytebuddyAgent [baseline] (792.37 ms) : 0, 792370
BytebuddyAgent [candidate] (790.512 ms) : 0, 790512
GlobalTracer [baseline] (299.327 ms) : 0, 299327
GlobalTracer [candidate] (298.536 ms) : 0, 298536
AppSec [baseline] (53.791 ms) : 0, 53791
AppSec [candidate] (53.513 ms) : 0, 53513
IAST [baseline] (22.541 ms) : 0, 22541
IAST [candidate] (22.663 ms) : 0, 22663
Remote Config [baseline] (638.264 µs) : 0, 638
Remote Config [candidate] (638.541 µs) : 0, 639
Telemetry [baseline] (7.346 ms) : 0, 7346
Telemetry [candidate] (7.428 ms) : 0, 7428
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (789.484 ms) : 0, 789484
BytebuddyAgent [candidate] (788.736 ms) : 0, 788736
GlobalTracer [baseline] (298.578 ms) : 0, 298578
GlobalTracer [candidate] (298.642 ms) : 0, 298642
AppSec [baseline] (53.134 ms) : 0, 53134
AppSec [candidate] (51.812 ms) : 0, 51812
IAST [baseline] (23.667 ms) : 0, 23667
IAST [candidate] (23.635 ms) : 0, 23635
Remote Config [baseline] (619.666 µs) : 0, 620
Remote Config [candidate] (606.423 µs) : 0, 606
Telemetry [baseline] (7.388 ms) : 0, 7388
Telemetry [candidate] (8.137 ms) : 0, 8137
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (788.042 ms) : 0, 788042
BytebuddyAgent [candidate] (788.111 ms) : 0, 788111
GlobalTracer [baseline] (298.746 ms) : 0, 298746
GlobalTracer [candidate] (298.956 ms) : 0, 298956
AppSec [baseline] (52.359 ms) : 0, 52359
AppSec [candidate] (51.041 ms) : 0, 51041
IAST [baseline] (23.247 ms) : 0, 23247
IAST [candidate] (25.125 ms) : 0, 25125
Remote Config [baseline] (610.957 µs) : 0, 611
Remote Config [candidate] (604.907 µs) : 0, 605
Telemetry [baseline] (7.304 ms) : 0, 7304
Telemetry [candidate] (8.032 ms) : 0, 8032
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~19239bf814, baseline=1.40.0-SNAPSHOT~fcd206e7d7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1063119
Total [baseline] (10.34 s) : 0, 10339577
Agent [candidate] (1.077 s) : 0, 1077053
Total [candidate] (10.382 s) : 0, 10382493
section appsec
Agent [baseline] (1.196 s) : 0, 1196130
Total [baseline] (10.566 s) : 0, 10566354
Agent [candidate] (1.197 s) : 0, 1197155
Total [candidate] (10.544 s) : 0, 10544343
section iast
Agent [baseline] (1.191 s) : 0, 1190900
Total [baseline] (10.828 s) : 0, 10827838
Agent [candidate] (1.196 s) : 0, 1196214
Total [candidate] (10.837 s) : 0, 10837063
section profiling
Agent [baseline] (1.261 s) : 0, 1261349
Total [baseline] (10.604 s) : 0, 10603750
Agent [candidate] (1.259 s) : 0, 1258941
Total [candidate] (10.586 s) : 0, 10586324
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent appsec 1.196 s 133.011 ms (12.5%)
Agent iast 1.191 s 127.781 ms (12.0%)
Agent profiling 1.261 s 198.229 ms (18.6%)
Total tracing 10.34 s -
Total appsec 10.566 s 226.777 ms (2.2%)
Total iast 10.828 s 488.262 ms (4.7%)
Total profiling 10.604 s 264.173 ms (2.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.077 s -
Agent appsec 1.197 s 120.102 ms (11.2%)
Agent iast 1.196 s 119.161 ms (11.1%)
Agent profiling 1.259 s 181.888 ms (16.9%)
Total tracing 10.382 s -
Total appsec 10.544 s 161.85 ms (1.6%)
Total iast 10.837 s 454.57 ms (4.4%)
Total profiling 10.586 s 203.831 ms (2.0%) 
gantt
    title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~19239bf814, baseline=1.40.0-SNAPSHOT~fcd206e7d7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (679.189 ms) : 0, 679189
BytebuddyAgent [candidate] (688.82 ms) : 0, 688820
GlobalTracer [baseline] (310.448 ms) : 0, 310448
GlobalTracer [candidate] (313.863 ms) : 0, 313863
AppSec [baseline] (51.654 ms) : 0, 51654
AppSec [candidate] (52.168 ms) : 0, 52168
Remote Config [baseline] (723.604 µs) : 0, 724
Remote Config [candidate] (727.752 µs) : 0, 728
Telemetry [baseline] (7.495 ms) : 0, 7495
Telemetry [candidate] (7.648 ms) : 0, 7648
section appsec
BytebuddyAgent [baseline] (699.874 ms) : 0, 699874
BytebuddyAgent [candidate] (700.186 ms) : 0, 700186
GlobalTracer [baseline] (303.37 ms) : 0, 303370
GlobalTracer [candidate] (303.481 ms) : 0, 303481
AppSec [baseline] (161.069 ms) : 0, 161069
AppSec [candidate] (161.304 ms) : 0, 161304
Remote Config [baseline] (645.714 µs) : 0, 646
Remote Config [candidate] (648.621 µs) : 0, 649
Telemetry [baseline] (7.985 ms) : 0, 7985
Telemetry [candidate] (8.315 ms) : 0, 8315
IAST [baseline] (19.168 ms) : 0, 19168
IAST [candidate] (19.139 ms) : 0, 19139
section iast
BytebuddyAgent [baseline] (793.53 ms) : 0, 793530
BytebuddyAgent [candidate] (797.388 ms) : 0, 797388
GlobalTracer [baseline] (299.185 ms) : 0, 299185
GlobalTracer [candidate] (300.589 ms) : 0, 300589
AppSec [baseline] (54.885 ms) : 0, 54885
AppSec [candidate] (52.696 ms) : 0, 52696
Remote Config [baseline] (630.831 µs) : 0, 631
Remote Config [candidate] (671.766 µs) : 0, 672
Telemetry [baseline] (7.303 ms) : 0, 7303
Telemetry [candidate] (7.379 ms) : 0, 7379
IAST [baseline] (21.749 ms) : 0, 21749
IAST [candidate] (23.77 ms) : 0, 23770
section profiling
ProfilingAgent [baseline] (95.985 ms) : 0, 95985
ProfilingAgent [candidate] (95.305 ms) : 0, 95305
BytebuddyAgent [baseline] (673.593 ms) : 0, 673593
BytebuddyAgent [candidate] (672.359 ms) : 0, 672359
GlobalTracer [baseline] (393.44 ms) : 0, 393440
GlobalTracer [candidate] (392.989 ms) : 0, 392989
AppSec [baseline] (52.192 ms) : 0, 52192
AppSec [candidate] (52.228 ms) : 0, 52228
Remote Config [baseline] (717.943 µs) : 0, 718
Remote Config [candidate] (704.231 µs) : 0, 704
Telemetry [baseline] (7.431 ms) : 0, 7431
Telemetry [candidate] (7.398 ms) : 0, 7398
Profiling [baseline] (96.009 ms) : 0, 96009
Profiling [candidate] (95.329 ms) : 0, 95329
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-13T10:05:44 2024-09-13T10:12:33
git_branch master mario.vidal/fix_freemarker_test
git_commit_date 1726217221 1726214243
git_commit_sha e11c39e 19239bf
release_version 1.40.0-SNAPSHOT~e11c39e1b4 1.40.0-SNAPSHOT~19239bf814
start_time 2024-09-13T10:05:30 2024-09-13T10:12:20
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1726222698 1726222698
ci_job_id 638444159 638444159
ci_pipeline_id 44260578 44260578
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~19239bf814, baseline=1.40.0-SNAPSHOT~e11c39e1b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (374.386 µs) : 355, 394
.   : milestone, 374,
iast (488.148 µs) : 466, 510
.   : milestone, 488,
iast_FULL (555.98 µs) : 535, 577
.   : milestone, 556,
iast_GLOBAL (505.842 µs) : 485, 527
.   : milestone, 506,
iast_HARDCODED_SECRET_DISABLED (482.385 µs) : 461, 504
.   : milestone, 482,
iast_INACTIVE (447.811 µs) : 427, 468
.   : milestone, 448,
iast_TELEMETRY_OFF (479.808 µs) : 457, 502
.   : milestone, 480,
tracing (440.257 µs) : 420, 461
.   : milestone, 440,
section candidate
no_agent (377.843 µs) : 358, 398
.   : milestone, 378,
iast (493.494 µs) : 471, 516
.   : milestone, 493,
iast_FULL (555.218 µs) : 534, 576
.   : milestone, 555,
iast_GLOBAL (500.901 µs) : 480, 522
.   : milestone, 501,
iast_HARDCODED_SECRET_DISABLED (491.123 µs) : 468, 514
.   : milestone, 491,
iast_INACTIVE (448.621 µs) : 428, 469
.   : milestone, 449,
iast_TELEMETRY_OFF (473.773 µs) : 452, 496
.   : milestone, 474,
tracing (443.298 µs) : 423, 463
.   : milestone, 443,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 374.386 µs [354.89 µs, 393.882 µs] -
iast 488.148 µs [466.244 µs, 510.051 µs] 113.762 µs (30.4%)
iast_FULL 555.98 µs [534.909 µs, 577.052 µs] 181.595 µs (48.5%)
iast_GLOBAL 505.842 µs [484.828 µs, 526.857 µs] 131.457 µs (35.1%)
iast_HARDCODED_SECRET_DISABLED 482.385 µs [460.789 µs, 503.981 µs] 107.999 µs (28.8%)
iast_INACTIVE 447.811 µs [427.266 µs, 468.355 µs] 73.425 µs (19.6%)
iast_TELEMETRY_OFF 479.808 µs [457.252 µs, 502.365 µs] 105.423 µs (28.2%)
tracing 440.257 µs [420.013 µs, 460.502 µs] 65.871 µs (17.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 377.843 µs [357.961 µs, 397.724 µs] -
iast 493.494 µs [470.8 µs, 516.189 µs] 115.652 µs (30.6%)
iast_FULL 555.218 µs [534.119 µs, 576.318 µs] 177.376 µs (46.9%)
iast_GLOBAL 500.901 µs [479.756 µs, 522.045 µs] 123.058 µs (32.6%)
iast_HARDCODED_SECRET_DISABLED 491.123 µs [468.192 µs, 514.054 µs] 113.28 µs (30.0%)
iast_INACTIVE 448.621 µs [427.99 µs, 469.251 µs] 70.778 µs (18.7%)
iast_TELEMETRY_OFF 473.773 µs [451.591 µs, 495.955 µs] 95.93 µs (25.4%)
tracing 443.298 µs [423.309 µs, 463.287 µs] 65.455 µs (17.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~19239bf814, baseline=1.40.0-SNAPSHOT~e11c39e1b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.349 ms) : 1330, 1368
.   : milestone, 1349,
appsec (1.716 ms) : 1692, 1741
.   : milestone, 1716,
appsec_no_iast (1.718 ms) : 1694, 1742
.   : milestone, 1718,
iast (1.472 ms) : 1450, 1495
.   : milestone, 1472,
profiling (1.474 ms) : 1451, 1498
.   : milestone, 1474,
tracing (1.457 ms) : 1433, 1482
.   : milestone, 1457,
section candidate
no_agent (1.322 ms) : 1303, 1341
.   : milestone, 1322,
appsec (1.733 ms) : 1710, 1757
.   : milestone, 1733,
appsec_no_iast (1.702 ms) : 1679, 1726
.   : milestone, 1702,
iast (1.477 ms) : 1454, 1500
.   : milestone, 1477,
profiling (1.488 ms) : 1463, 1513
.   : milestone, 1488,
tracing (1.473 ms) : 1449, 1497
.   : milestone, 1473,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.349 ms [1.33 ms, 1.368 ms] -
appsec 1.716 ms [1.692 ms, 1.741 ms] 367.404 µs (27.2%)
appsec_no_iast 1.718 ms [1.694 ms, 1.742 ms] 368.921 µs (27.3%)
iast 1.472 ms [1.45 ms, 1.495 ms] 123.398 µs (9.1%)
profiling 1.474 ms [1.451 ms, 1.498 ms] 125.309 µs (9.3%)
tracing 1.457 ms [1.433 ms, 1.482 ms] 108.406 µs (8.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.322 ms [1.303 ms, 1.341 ms] -
appsec 1.733 ms [1.71 ms, 1.757 ms] 411.235 µs (31.1%)
appsec_no_iast 1.702 ms [1.679 ms, 1.726 ms] 380.166 µs (28.8%)
iast 1.477 ms [1.454 ms, 1.5 ms] 154.773 µs (11.7%)
profiling 1.488 ms [1.463 ms, 1.513 ms] 165.81 µs (12.5%)
tracing 1.473 ms [1.449 ms, 1.497 ms] 150.733 µs (11.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mario.vidal/fix_freemarker_test
git_commit_date 1726217221 1726214243
git_commit_sha e11c39e 19239bf
release_version 1.40.0-SNAPSHOT~e11c39e1b4 1.40.0-SNAPSHOT~19239bf814
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1726223220 1726223220
ci_job_id 638444158 638444158
ci_pipeline_id 44260578 44260578
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~19239bf814, baseline=1.40.0-SNAPSHOT~e11c39e1b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.38 s) : 15380000, 15380000
.   : milestone, 15380000,
appsec (15.249 s) : 15249000, 15249000
.   : milestone, 15249000,
iast (18.832 s) : 18832000, 18832000
.   : milestone, 18832000,
iast_GLOBAL (18.246 s) : 18246000, 18246000
.   : milestone, 18246000,
profiling (15.463 s) : 15463000, 15463000
.   : milestone, 15463000,
tracing (15.243 s) : 15243000, 15243000
.   : milestone, 15243000,
section candidate
no_agent (15.086 s) : 15086000, 15086000
.   : milestone, 15086000,
appsec (15.141 s) : 15141000, 15141000
.   : milestone, 15141000,
iast (18.998 s) : 18998000, 18998000
.   : milestone, 18998000,
iast_GLOBAL (18.146 s) : 18146000, 18146000
.   : milestone, 18146000,
profiling (15.107 s) : 15107000, 15107000
.   : milestone, 15107000,
tracing (15.16 s) : 15160000, 15160000
.   : milestone, 15160000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.38 s [15.38 s, 15.38 s] -
appsec 15.249 s [15.249 s, 15.249 s] -131.0 ms (-0.9%)
iast 18.832 s [18.832 s, 18.832 s] 3.452 s (22.4%)
iast_GLOBAL 18.246 s [18.246 s, 18.246 s] 2.866 s (18.6%)
profiling 15.463 s [15.463 s, 15.463 s] 83.0 ms (0.5%)
tracing 15.243 s [15.243 s, 15.243 s] -137.0 ms (-0.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.086 s [15.086 s, 15.086 s] -
appsec 15.141 s [15.141 s, 15.141 s] 55.0 ms (0.4%)
iast 18.998 s [18.998 s, 18.998 s] 3.912 s (25.9%)
iast_GLOBAL 18.146 s [18.146 s, 18.146 s] 3.06 s (20.3%)
profiling 15.107 s [15.107 s, 15.107 s] 21.0 ms (0.1%)
tracing 15.16 s [15.16 s, 15.16 s] 74.0 ms (0.5%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~19239bf814, baseline=1.40.0-SNAPSHOT~e11c39e1b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.465 ms) : 1454, 1477
.   : milestone, 1465,
appsec (2.292 ms) : 2251, 2332
.   : milestone, 2292,
iast (2.056 ms) : 2007, 2104
.   : milestone, 2056,
iast_GLOBAL (2.091 ms) : 2041, 2140
.   : milestone, 2091,
profiling (1.925 ms) : 1885, 1966
.   : milestone, 1925,
tracing (1.902 ms) : 1865, 1940
.   : milestone, 1902,
section candidate
no_agent (1.466 ms) : 1455, 1478
.   : milestone, 1466,
appsec (2.303 ms) : 2262, 2344
.   : milestone, 2303,
iast (2.043 ms) : 1995, 2091
.   : milestone, 2043,
iast_GLOBAL (2.096 ms) : 2046, 2147
.   : milestone, 2096,
profiling (1.921 ms) : 1881, 1960
.   : milestone, 1921,
tracing (1.914 ms) : 1876, 1953
.   : milestone, 1914,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.465 ms [1.454 ms, 1.477 ms] -
appsec 2.292 ms [2.251 ms, 2.332 ms] 826.178 µs (56.4%)
iast 2.056 ms [2.007 ms, 2.104 ms] 590.278 µs (40.3%)
iast_GLOBAL 2.091 ms [2.041 ms, 2.14 ms] 625.2 µs (42.7%)
profiling 1.925 ms [1.885 ms, 1.966 ms] 459.971 µs (31.4%)
tracing 1.902 ms [1.865 ms, 1.94 ms] 437.01 µs (29.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.466 ms [1.455 ms, 1.478 ms] -
appsec 2.303 ms [2.262 ms, 2.344 ms] 836.674 µs (57.1%)
iast 2.043 ms [1.995 ms, 2.091 ms] 576.385 µs (39.3%)
iast_GLOBAL 2.096 ms [2.046 ms, 2.147 ms] 629.921 µs (43.0%)
profiling 1.921 ms [1.881 ms, 1.96 ms] 454.141 µs (31.0%)
tracing 1.914 ms [1.876 ms, 1.953 ms] 447.807 µs (30.5%)

@Mariovido Mariovido merged commit d2ff624 into master Sep 13, 2024
98 checks passed
@Mariovido Mariovido deleted the mario.vidal/fix_freemarker_test branch September 13, 2024 10:30
@github-actions github-actions bot added this to the 1.40.0 milestone Sep 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@smola smola smola approved these changes

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@ValentinZakharov ValentinZakharov ValentinZakharov approved these changes

Assignees
No one assigned
Labels
comp: asm iast Application Security Management (IAST) comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.40.0
Development

Successfully merging this pull request may close these issues.
4 participants
@Mariovido @smola @PerfectSlayer @ValentinZakharov