Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add test case names to CI spec tests #7693

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Add test case names to CI spec tests #7693

wants to merge 1 commit into from

Conversation

nikita-tkachenko-datadog
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented Sep 30, 2024 •
edited by jira bot
Loading

What Does This Do

Updates CI spec tests to have human-readable test names.

Motivation

CI spec tests are based on test fixtures that are generated automatically.
When a test case fails, it is not always easy to determine which exact test fixture failed.
Adding human readable names makes debugging test failures easier.

Contributor Checklist

Jira ticket: SDTEST-958

@nikita-tkachenko-datadog nikita-tkachenko-datadog added comp: testing Testing tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility labels Sep 30, 2024
@pr-commenter
Copy link

pr-commenter bot commented Sep 30, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/ci-spec-tests-update
git_commit_date 1727691229 1727703592
git_commit_sha 70ac474 d0c45a8
release_version 1.40.0-SNAPSHOT~70ac474684 1.41.0-SNAPSHOT~d0c45a80cd
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1727706360 1727706360
ci_job_id 655559126 655559126
ci_pipeline_id 45417420 45417420
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 12 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064641
Total [baseline] (10.361 s) : 0, 10361149
Agent [candidate] (1.068 s) : 0, 1067756
Total [candidate] (10.335 s) : 0, 10334985
section appsec
Agent [baseline] (1.198 s) : 0, 1198013
Total [baseline] (10.572 s) : 0, 10572421
Agent [candidate] (1.212 s) : 0, 1212301
Total [candidate] (10.554 s) : 0, 10554076
section iast
Agent [baseline] (1.195 s) : 0, 1195012
Total [baseline] (10.829 s) : 0, 10828713
Agent [candidate] (1.193 s) : 0, 1193007
Total [candidate] (10.808 s) : 0, 10807855
section profiling
Agent [baseline] (1.275 s) : 0, 1274553
Total [baseline] (10.731 s) : 0, 10731117
Agent [candidate] (1.265 s) : 0, 1265277
Total [candidate] (10.577 s) : 0, 10576932
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.198 s 133.372 ms (12.5%)
Agent iast 1.195 s 130.371 ms (12.2%)
Agent profiling 1.275 s 209.912 ms (19.7%)
Total tracing 10.361 s -
Total appsec 10.572 s 211.272 ms (2.0%)
Total iast 10.829 s 467.564 ms (4.5%)
Total profiling 10.731 s 369.968 ms (3.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent appsec 1.212 s 144.545 ms (13.5%)
Agent iast 1.193 s 125.251 ms (11.7%)
Agent profiling 1.265 s 197.52 ms (18.5%)
Total tracing 10.335 s -
Total appsec 10.554 s 219.091 ms (2.1%)
Total iast 10.808 s 472.87 ms (4.6%)
Total profiling 10.577 s 241.947 ms (2.3%) 
gantt
    title petclinic - break down per module: candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (679.853 ms) : 0, 679853
BytebuddyAgent [candidate] (681.929 ms) : 0, 681929
GlobalTracer [baseline] (309.209 ms) : 0, 309209
GlobalTracer [candidate] (310.167 ms) : 0, 310167
AppSec [baseline] (53.799 ms) : 0, 53799
AppSec [candidate] (53.712 ms) : 0, 53712
Remote Config [baseline] (655.011 µs) : 0, 655
Remote Config [candidate] (662.291 µs) : 0, 662
Telemetry [baseline] (7.544 ms) : 0, 7544
Telemetry [candidate] (7.64 ms) : 0, 7640
section appsec
BytebuddyAgent [baseline] (696.927 ms) : 0, 696927
BytebuddyAgent [candidate] (704.483 ms) : 0, 704483
GlobalTracer [baseline] (306.116 ms) : 0, 306116
GlobalTracer [candidate] (309.439 ms) : 0, 309439
AppSec [baseline] (161.809 ms) : 0, 161809
AppSec [candidate] (163.684 ms) : 0, 163684
Remote Config [baseline] (634.184 µs) : 0, 634
Remote Config [candidate] (645.53 µs) : 0, 646
Telemetry [baseline] (8.173 ms) : 0, 8173
Telemetry [candidate] (9.312 ms) : 0, 9312
IAST [baseline] (21.511 ms) : 0, 21511
IAST [candidate] (21.981 ms) : 0, 21981
section iast
BytebuddyAgent [baseline] (796.456 ms) : 0, 796456
BytebuddyAgent [candidate] (794.873 ms) : 0, 794873
GlobalTracer [baseline] (299.247 ms) : 0, 299247
GlobalTracer [candidate] (299.034 ms) : 0, 299034
AppSec [baseline] (55.283 ms) : 0, 55283
AppSec [candidate] (54.228 ms) : 0, 54228
Remote Config [baseline] (608.872 µs) : 0, 609
Remote Config [candidate] (609.99 µs) : 0, 610
Telemetry [baseline] (7.024 ms) : 0, 7024
Telemetry [candidate] (7.009 ms) : 0, 7009
IAST [baseline] (22.729 ms) : 0, 22729
IAST [candidate] (23.6 ms) : 0, 23600
section profiling
BytebuddyAgent [baseline] (679.961 ms) : 0, 679961
BytebuddyAgent [candidate] (674.906 ms) : 0, 674906
GlobalTracer [baseline] (395.163 ms) : 0, 395163
GlobalTracer [candidate] (392.756 ms) : 0, 392756
AppSec [baseline] (54.899 ms) : 0, 54899
AppSec [candidate] (54.301 ms) : 0, 54301
Remote Config [baseline] (664.291 µs) : 0, 664
Remote Config [candidate] (660.08 µs) : 0, 660
Telemetry [baseline] (7.537 ms) : 0, 7537
Telemetry [candidate] (7.37 ms) : 0, 7370
ProfilingAgent [baseline] (97.501 ms) : 0, 97501
ProfilingAgent [candidate] (96.743 ms) : 0, 96743
Profiling [baseline] (97.525 ms) : 0, 97525
Profiling [candidate] (96.766 ms) : 0, 96766
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1065535
Total [baseline] (8.526 s) : 0, 8525955
Agent [candidate] (1.067 s) : 0, 1066726
Total [candidate] (8.541 s) : 0, 8541378
section iast
Agent [baseline] (1.193 s) : 0, 1193442
Total [baseline] (9.057 s) : 0, 9056804
Agent [candidate] (1.21 s) : 0, 1210221
Total [candidate] (9.109 s) : 0, 9108520
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.202 s) : 0, 1201778
Total [baseline] (9.078 s) : 0, 9077764
Agent [candidate] (1.192 s) : 0, 1192394
Total [candidate] (9.04 s) : 0, 9039915
section iast_TELEMETRY_OFF
Agent [baseline] (1.189 s) : 0, 1188507
Total [baseline] (9.039 s) : 0, 9039316
Agent [candidate] (1.193 s) : 0, 1192572
Total [candidate] (9.09 s) : 0, 9090049
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.193 s 127.907 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.202 s 136.243 ms (12.8%)
Agent iast_TELEMETRY_OFF 1.189 s 122.971 ms (11.5%)
Total tracing 8.526 s -
Total iast 9.057 s 530.849 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.078 s 551.809 ms (6.5%)
Total iast_TELEMETRY_OFF 9.039 s 513.361 ms (6.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent iast 1.21 s 143.495 ms (13.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.192 s 125.668 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.193 s 125.846 ms (11.8%)
Total tracing 8.541 s -
Total iast 9.109 s 567.142 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.04 s 498.537 ms (5.8%)
Total iast_TELEMETRY_OFF 9.09 s 548.671 ms (6.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (680.998 ms) : 0, 680998
BytebuddyAgent [candidate] (681.429 ms) : 0, 681429
GlobalTracer [baseline] (308.946 ms) : 0, 308946
GlobalTracer [candidate] (309.76 ms) : 0, 309760
AppSec [baseline] (53.7 ms) : 0, 53700
AppSec [candidate] (53.668 ms) : 0, 53668
Remote Config [baseline] (659.025 µs) : 0, 659
Remote Config [candidate] (658.68 µs) : 0, 659
Telemetry [baseline] (7.595 ms) : 0, 7595
Telemetry [candidate] (7.589 ms) : 0, 7589
section iast
BytebuddyAgent [baseline] (795.245 ms) : 0, 795245
BytebuddyAgent [candidate] (807.513 ms) : 0, 807513
GlobalTracer [baseline] (299.132 ms) : 0, 299132
GlobalTracer [candidate] (302.652 ms) : 0, 302652
AppSec [baseline] (53.724 ms) : 0, 53724
AppSec [candidate] (55.572 ms) : 0, 55572
Remote Config [baseline] (611.81 µs) : 0, 612
Remote Config [candidate] (628.947 µs) : 0, 629
Telemetry [baseline] (6.972 ms) : 0, 6972
Telemetry [candidate] (7.08 ms) : 0, 7080
IAST [baseline] (24.073 ms) : 0, 24073
IAST [candidate] (22.885 ms) : 0, 22885
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (801.899 ms) : 0, 801899
BytebuddyAgent [candidate] (794.077 ms) : 0, 794077
GlobalTracer [baseline] (300.509 ms) : 0, 300509
GlobalTracer [candidate] (298.766 ms) : 0, 298766
AppSec [baseline] (56.073 ms) : 0, 56073
AppSec [candidate] (54.713 ms) : 0, 54713
Remote Config [baseline] (615.713 µs) : 0, 616
Remote Config [candidate] (614.778 µs) : 0, 615
Telemetry [baseline] (7.048 ms) : 0, 7048
Telemetry [candidate] (7.001 ms) : 0, 7001
IAST [baseline] (21.797 ms) : 0, 21797
IAST [candidate] (23.533 ms) : 0, 23533
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (790.716 ms) : 0, 790716
BytebuddyAgent [candidate] (792.751 ms) : 0, 792751
GlobalTracer [baseline] (298.919 ms) : 0, 298919
GlobalTracer [candidate] (300.054 ms) : 0, 300054
AppSec [baseline] (56.11 ms) : 0, 56110
AppSec [candidate] (56.563 ms) : 0, 56563
Remote Config [baseline] (614.612 µs) : 0, 615
Remote Config [candidate] (633.98 µs) : 0, 634
Telemetry [baseline] (6.914 ms) : 0, 6914
Telemetry [candidate] (7.006 ms) : 0, 7006
IAST [baseline] (21.542 ms) : 0, 21542
IAST [candidate] (21.866 ms) : 0, 21866
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-30T13:54:31 2024-09-30T14:01:24
git_branch master nikita-tkachenko/ci-spec-tests-update
git_commit_date 1727691229 1727703592
git_commit_sha 70ac474 d0c45a8
release_version 1.40.0-SNAPSHOT~70ac474684 1.41.0-SNAPSHOT~d0c45a80cd
start_time 2024-09-30T13:54:18 2024-09-30T14:01:10
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1727705231 1727705231
ci_job_id 655559127 655559127
ci_pipeline_id 45417420 45417420
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.359 ms) : 1340, 1378
.   : milestone, 1359,
appsec (1.728 ms) : 1704, 1753
.   : milestone, 1728,
appsec_no_iast (1.701 ms) : 1677, 1726
.   : milestone, 1701,
iast (1.472 ms) : 1449, 1494
.   : milestone, 1472,
profiling (1.505 ms) : 1479, 1530
.   : milestone, 1505,
tracing (1.45 ms) : 1426, 1474
.   : milestone, 1450,
section candidate
no_agent (1.335 ms) : 1315, 1354
.   : milestone, 1335,
appsec (1.735 ms) : 1709, 1760
.   : milestone, 1735,
appsec_no_iast (1.713 ms) : 1689, 1738
.   : milestone, 1713,
iast (1.472 ms) : 1449, 1495
.   : milestone, 1472,
profiling (1.55 ms) : 1525, 1574
.   : milestone, 1550,
tracing (1.453 ms) : 1428, 1478
.   : milestone, 1453,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.359 ms [1.34 ms, 1.378 ms] -
appsec 1.728 ms [1.704 ms, 1.753 ms] 369.656 µs (27.2%)
appsec_no_iast 1.701 ms [1.677 ms, 1.726 ms] 342.573 µs (25.2%)
iast 1.472 ms [1.449 ms, 1.494 ms] 113.173 µs (8.3%)
profiling 1.505 ms [1.479 ms, 1.53 ms] 146.11 µs (10.8%)
tracing 1.45 ms [1.426 ms, 1.474 ms] 91.334 µs (6.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.335 ms [1.315 ms, 1.354 ms] -
appsec 1.735 ms [1.709 ms, 1.76 ms] 399.803 µs (30.0%)
appsec_no_iast 1.713 ms [1.689 ms, 1.738 ms] 378.486 µs (28.4%)
iast 1.472 ms [1.449 ms, 1.495 ms] 137.502 µs (10.3%)
profiling 1.55 ms [1.525 ms, 1.574 ms] 214.845 µs (16.1%)
tracing 1.453 ms [1.428 ms, 1.478 ms] 118.15 µs (8.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684
    dateFormat X
    axisFormat %s
section baseline
no_agent (372.483 µs) : 352, 393
.   : milestone, 372,
iast (483.201 µs) : 462, 504
.   : milestone, 483,
iast_FULL (550.924 µs) : 530, 572
.   : milestone, 551,
iast_GLOBAL (508.6 µs) : 486, 531
.   : milestone, 509,
iast_HARDCODED_SECRET_DISABLED (486.208 µs) : 465, 507
.   : milestone, 486,
iast_INACTIVE (449.304 µs) : 428, 471
.   : milestone, 449,
iast_TELEMETRY_OFF (472.987 µs) : 452, 494
.   : milestone, 473,
tracing (444.776 µs) : 424, 466
.   : milestone, 445,
section candidate
no_agent (371.692 µs) : 352, 391
.   : milestone, 372,
iast (477.808 µs) : 457, 499
.   : milestone, 478,
iast_FULL (553.874 µs) : 533, 575
.   : milestone, 554,
iast_GLOBAL (497.694 µs) : 477, 519
.   : milestone, 498,
iast_HARDCODED_SECRET_DISABLED (481.58 µs) : 460, 503
.   : milestone, 482,
iast_INACTIVE (450.527 µs) : 429, 472
.   : milestone, 451,
iast_TELEMETRY_OFF (469.003 µs) : 448, 490
.   : milestone, 469,
tracing (436.462 µs) : 416, 457
.   : milestone, 436,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 372.483 µs [351.944 µs, 393.023 µs] -
iast 483.201 µs [461.965 µs, 504.437 µs] 110.717 µs (29.7%)
iast_FULL 550.924 µs [529.864 µs, 571.984 µs] 178.441 µs (47.9%)
iast_GLOBAL 508.6 µs [486.184 µs, 531.016 µs] 136.116 µs (36.5%)
iast_HARDCODED_SECRET_DISABLED 486.208 µs [465.201 µs, 507.215 µs] 113.725 µs (30.5%)
iast_INACTIVE 449.304 µs [427.95 µs, 470.657 µs] 76.82 µs (20.6%)
iast_TELEMETRY_OFF 472.987 µs [451.589 µs, 494.386 µs] 100.504 µs (27.0%)
tracing 444.776 µs [423.655 µs, 465.898 µs] 72.293 µs (19.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 371.692 µs [352.156 µs, 391.229 µs] -
iast 477.808 µs [456.792 µs, 498.823 µs] 106.116 µs (28.5%)
iast_FULL 553.874 µs [532.711 µs, 575.038 µs] 182.182 µs (49.0%)
iast_GLOBAL 497.694 µs [476.582 µs, 518.807 µs] 126.002 µs (33.9%)
iast_HARDCODED_SECRET_DISABLED 481.58 µs [460.354 µs, 502.806 µs] 109.888 µs (29.6%)
iast_INACTIVE 450.527 µs [428.827 µs, 472.227 µs] 78.835 µs (21.2%)
iast_TELEMETRY_OFF 469.003 µs [448.043 µs, 489.964 µs] 97.311 µs (26.2%)
tracing 436.462 µs [416.308 µs, 456.616 µs] 64.77 µs (17.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/ci-spec-tests-update
git_commit_date 1727691229 1727703592
git_commit_sha 70ac474 d0c45a8
release_version 1.40.0-SNAPSHOT~70ac474684 1.41.0-SNAPSHOT~d0c45a80cd
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1727705786 1727705786
ci_job_id 655559128 655559128
ci_pipeline_id 45417420 45417420
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.03 s) : 15030000, 15030000
.   : milestone, 15030000,
appsec (15.455 s) : 15455000, 15455000
.   : milestone, 15455000,
iast (18.772 s) : 18772000, 18772000
.   : milestone, 18772000,
iast_GLOBAL (18.198 s) : 18198000, 18198000
.   : milestone, 18198000,
profiling (15.224 s) : 15224000, 15224000
.   : milestone, 15224000,
tracing (15.316 s) : 15316000, 15316000
.   : milestone, 15316000,
section candidate
no_agent (15.18 s) : 15180000, 15180000
.   : milestone, 15180000,
appsec (15.291 s) : 15291000, 15291000
.   : milestone, 15291000,
iast (18.846 s) : 18846000, 18846000
.   : milestone, 18846000,
iast_GLOBAL (17.934 s) : 17934000, 17934000
.   : milestone, 17934000,
profiling (14.791 s) : 14791000, 14791000
.   : milestone, 14791000,
tracing (15.01 s) : 15010000, 15010000
.   : milestone, 15010000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.03 s [15.03 s, 15.03 s] -
appsec 15.455 s [15.455 s, 15.455 s] 425.0 ms (2.8%)
iast 18.772 s [18.772 s, 18.772 s] 3.742 s (24.9%)
iast_GLOBAL 18.198 s [18.198 s, 18.198 s] 3.168 s (21.1%)
profiling 15.224 s [15.224 s, 15.224 s] 194.0 ms (1.3%)
tracing 15.316 s [15.316 s, 15.316 s] 286.0 ms (1.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.18 s [15.18 s, 15.18 s] -
appsec 15.291 s [15.291 s, 15.291 s] 111.0 ms (0.7%)
iast 18.846 s [18.846 s, 18.846 s] 3.666 s (24.2%)
iast_GLOBAL 17.934 s [17.934 s, 17.934 s] 2.754 s (18.1%)
profiling 14.791 s [14.791 s, 14.791 s] -389.0 ms (-2.6%)
tracing 15.01 s [15.01 s, 15.01 s] -170.0 ms (-1.1%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.468 ms) : 1456, 1479
.   : milestone, 1468,
appsec (2.323 ms) : 2283, 2363
.   : milestone, 2323,
iast (2.067 ms) : 2016, 2119
.   : milestone, 2067,
iast_GLOBAL (2.108 ms) : 2056, 2160
.   : milestone, 2108,
profiling (1.942 ms) : 1900, 1985
.   : milestone, 1942,
tracing (1.912 ms) : 1873, 1951
.   : milestone, 1912,
section candidate
no_agent (1.462 ms) : 1451, 1474
.   : milestone, 1462,
appsec (2.325 ms) : 2285, 2366
.   : milestone, 2325,
iast (2.077 ms) : 2026, 2129
.   : milestone, 2077,
iast_GLOBAL (2.113 ms) : 2062, 2165
.   : milestone, 2113,
profiling (1.922 ms) : 1881, 1962
.   : milestone, 1922,
tracing (1.909 ms) : 1870, 1948
.   : milestone, 1909,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.456 ms, 1.479 ms] -
appsec 2.323 ms [2.283 ms, 2.363 ms] 854.986 µs (58.2%)
iast 2.067 ms [2.016 ms, 2.119 ms] 599.263 µs (40.8%)
iast_GLOBAL 2.108 ms [2.056 ms, 2.16 ms] 639.945 µs (43.6%)
profiling 1.942 ms [1.9 ms, 1.985 ms] 474.581 µs (32.3%)
tracing 1.912 ms [1.873 ms, 1.951 ms] 443.703 µs (30.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.451 ms, 1.474 ms] -
appsec 2.325 ms [2.285 ms, 2.366 ms] 863.177 µs (59.0%)
iast 2.077 ms [2.026 ms, 2.129 ms] 614.896 µs (42.1%)
iast_GLOBAL 2.113 ms [2.062 ms, 2.165 ms] 651.189 µs (44.5%)
profiling 1.922 ms [1.881 ms, 1.962 ms] 459.251 µs (31.4%)
tracing 1.909 ms [1.87 ms, 1.948 ms] 446.462 µs (30.5%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog marked this pull request as ready for review September 30, 2024 15:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@juan-fernandez juan-fernandez Awaiting requested review from juan-fernandez juan-fernandez is a code owner automatically assigned from DataDog/ci-app-libraries-java

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
comp: ci visibility Continuous Integration Visibility comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@nikita-tkachenko-datadog