Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add a test throwing CPU count #7679

Closed
wants to merge 2 commits into from
Closed

Add a test throwing CPU count #7679

wants to merge 2 commits into from

Conversation

nikita-tkachenko-datadog
Copy link
Contributor

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@pr-commenter
Copy link

pr-commenter bot commented Sep 24, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/circle-ci-cpu-limits-test
git_commit_date 1727166392 1727186946
git_commit_sha 0dcde79 dc4f16c
release_version 1.40.0-SNAPSHOT~0dcde7931e 1.40.0-SNAPSHOT~dc4f16c857
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1727189466 1727189466
ci_job_id 649777504 649777504
ci_pipeline_id 45015690 45015690
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~dc4f16c857, baseline=1.40.0-SNAPSHOT~0dcde7931e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063999
Total [baseline] (10.382 s) : 0, 10381632
Agent [candidate] (1.067 s) : 0, 1066609
Total [candidate] (10.393 s) : 0, 10393458
section appsec
Agent [baseline] (1.207 s) : 0, 1206863
Total [baseline] (10.67 s) : 0, 10669840
Agent [candidate] (1.209 s) : 0, 1208967
Total [candidate] (10.6 s) : 0, 10600307
section iast
Agent [baseline] (1.198 s) : 0, 1198349
Total [baseline] (10.846 s) : 0, 10845934
Agent [candidate] (1.201 s) : 0, 1200966
Total [candidate] (10.847 s) : 0, 10847216
section profiling
Agent [baseline] (1.265 s) : 0, 1264776
Total [baseline] (10.558 s) : 0, 10557961
Agent [candidate] (1.264 s) : 0, 1264167
Total [candidate] (10.603 s) : 0, 10603433
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent appsec 1.207 s 142.864 ms (13.4%)
Agent iast 1.198 s 134.35 ms (12.6%)
Agent profiling 1.265 s 200.777 ms (18.9%)
Total tracing 10.382 s -
Total appsec 10.67 s 288.207 ms (2.8%)
Total iast 10.846 s 464.302 ms (4.5%)
Total profiling 10.558 s 176.328 ms (1.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent appsec 1.209 s 142.358 ms (13.3%)
Agent iast 1.201 s 134.358 ms (12.6%)
Agent profiling 1.264 s 197.559 ms (18.5%)
Total tracing 10.393 s -
Total appsec 10.6 s 206.849 ms (2.0%)
Total iast 10.847 s 453.757 ms (4.4%)
Total profiling 10.603 s 209.974 ms (2.0%) 
gantt
    title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~dc4f16c857, baseline=1.40.0-SNAPSHOT~0dcde7931e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (679.194 ms) : 0, 679194
BytebuddyAgent [candidate] (680.958 ms) : 0, 680958
GlobalTracer [baseline] (309.168 ms) : 0, 309168
GlobalTracer [candidate] (309.884 ms) : 0, 309884
AppSec [baseline] (53.778 ms) : 0, 53778
AppSec [candidate] (53.931 ms) : 0, 53931
Remote Config [baseline] (671.227 µs) : 0, 671
Remote Config [candidate] (660.765 µs) : 0, 661
Telemetry [baseline] (7.585 ms) : 0, 7585
Telemetry [candidate] (7.568 ms) : 0, 7568
section appsec
BytebuddyAgent [baseline] (705.606 ms) : 0, 705606
BytebuddyAgent [candidate] (707.267 ms) : 0, 707267
GlobalTracer [baseline] (304.411 ms) : 0, 304411
GlobalTracer [candidate] (305.013 ms) : 0, 305013
AppSec [baseline] (163.666 ms) : 0, 163666
AppSec [candidate] (162.703 ms) : 0, 162703
IAST [baseline] (20.708 ms) : 0, 20708
IAST [candidate] (21.361 ms) : 0, 21361
Remote Config [baseline] (653.12 µs) : 0, 653
Remote Config [candidate] (661.831 µs) : 0, 662
Telemetry [baseline] (8.541 ms) : 0, 8541
Telemetry [candidate] (8.932 ms) : 0, 8932
section iast
BytebuddyAgent [baseline] (797.511 ms) : 0, 797511
BytebuddyAgent [candidate] (798.96 ms) : 0, 798960
GlobalTracer [baseline] (300.482 ms) : 0, 300482
GlobalTracer [candidate] (300.988 ms) : 0, 300988
AppSec [baseline] (56.143 ms) : 0, 56143
AppSec [candidate] (52.922 ms) : 0, 52922
IAST [baseline] (22.888 ms) : 0, 22888
IAST [candidate] (26.457 ms) : 0, 26457
Remote Config [baseline] (644.919 µs) : 0, 645
Remote Config [candidate] (674.002 µs) : 0, 674
Telemetry [baseline] (7.043 ms) : 0, 7043
Telemetry [candidate] (7.197 ms) : 0, 7197
section profiling
BytebuddyAgent [baseline] (673.643 ms) : 0, 673643
BytebuddyAgent [candidate] (673.081 ms) : 0, 673081
GlobalTracer [baseline] (394.158 ms) : 0, 394158
GlobalTracer [candidate] (393.612 ms) : 0, 393612
AppSec [baseline] (54.371 ms) : 0, 54371
AppSec [candidate] (54.589 ms) : 0, 54589
Remote Config [baseline] (650.843 µs) : 0, 651
Remote Config [candidate] (655.356 µs) : 0, 655
Telemetry [baseline] (7.394 ms) : 0, 7394
Telemetry [candidate] (7.469 ms) : 0, 7469
ProfilingAgent [baseline] (95.997 ms) : 0, 95997
ProfilingAgent [candidate] (96.347 ms) : 0, 96347
Profiling [baseline] (96.022 ms) : 0, 96022
Profiling [candidate] (96.371 ms) : 0, 96371
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~dc4f16c857, baseline=1.40.0-SNAPSHOT~0dcde7931e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1068430
Total [baseline] (8.538 s) : 0, 8537964
Agent [candidate] (1.064 s) : 0, 1064428
Total [candidate] (8.524 s) : 0, 8523505
section iast
Agent [baseline] (1.199 s) : 0, 1198884
Total [baseline] (9.066 s) : 0, 9065639
Agent [candidate] (1.204 s) : 0, 1204406
Total [candidate] (9.015 s) : 0, 9015098
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.192 s) : 0, 1192052
Total [baseline] (8.972 s) : 0, 8972130
Agent [candidate] (1.19 s) : 0, 1190154
Total [candidate] (8.956 s) : 0, 8955597
section iast_TELEMETRY_OFF
Agent [baseline] (1.187 s) : 0, 1186569
Total [baseline] (8.998 s) : 0, 8998197
Agent [candidate] (1.192 s) : 0, 1191501
Total [candidate] (9.052 s) : 0, 9051871
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent iast 1.199 s 130.454 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.192 s 123.622 ms (11.6%)
Agent iast_TELEMETRY_OFF 1.187 s 118.139 ms (11.1%)
Total tracing 8.538 s -
Total iast 9.066 s 527.675 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 8.972 s 434.166 ms (5.1%)
Total iast_TELEMETRY_OFF 8.998 s 460.233 ms (5.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.204 s 139.978 ms (13.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.19 s 125.726 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.192 s 127.073 ms (11.9%)
Total tracing 8.524 s -
Total iast 9.015 s 491.593 ms (5.8%)
Total iast_HARDCODED_SECRET_DISABLED 8.956 s 432.092 ms (5.1%)
Total iast_TELEMETRY_OFF 9.052 s 528.366 ms (6.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~dc4f16c857, baseline=1.40.0-SNAPSHOT~0dcde7931e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.29 ms) : 0, 682290
BytebuddyAgent [candidate] (679.431 ms) : 0, 679431
GlobalTracer [baseline] (310.599 ms) : 0, 310599
GlobalTracer [candidate] (309.448 ms) : 0, 309448
AppSec [baseline] (53.649 ms) : 0, 53649
AppSec [candidate] (53.675 ms) : 0, 53675
Remote Config [baseline] (674.453 µs) : 0, 674
Remote Config [candidate] (664.289 µs) : 0, 664
Telemetry [baseline] (7.61 ms) : 0, 7610
Telemetry [candidate] (7.577 ms) : 0, 7577
section iast
BytebuddyAgent [baseline] (798.15 ms) : 0, 798150
BytebuddyAgent [candidate] (802.069 ms) : 0, 802069
GlobalTracer [baseline] (300.282 ms) : 0, 300282
GlobalTracer [candidate] (301.96 ms) : 0, 301960
AppSec [baseline] (56.696 ms) : 0, 56696
AppSec [candidate] (55.376 ms) : 0, 55376
IAST [baseline] (22.245 ms) : 0, 22245
IAST [candidate] (23.582 ms) : 0, 23582
Remote Config [baseline] (621.616 µs) : 0, 622
Remote Config [candidate] (607.739 µs) : 0, 608
Telemetry [baseline] (7.148 ms) : 0, 7148
Telemetry [candidate] (6.99 ms) : 0, 6990
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (792.993 ms) : 0, 792993
BytebuddyAgent [candidate] (791.702 ms) : 0, 791702
GlobalTracer [baseline] (299.254 ms) : 0, 299254
GlobalTracer [candidate] (298.85 ms) : 0, 298850
AppSec [baseline] (54.573 ms) : 0, 54573
AppSec [candidate] (54.67 ms) : 0, 54670
IAST [baseline] (23.833 ms) : 0, 23833
IAST [candidate] (23.648 ms) : 0, 23648
Remote Config [baseline] (632.195 µs) : 0, 632
Remote Config [candidate] (614.083 µs) : 0, 614
Telemetry [baseline] (7.093 ms) : 0, 7093
Telemetry [candidate] (7.015 ms) : 0, 7015
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (788.26 ms) : 0, 788260
BytebuddyAgent [candidate] (792.588 ms) : 0, 792588
GlobalTracer [baseline] (298.616 ms) : 0, 298616
GlobalTracer [candidate] (299.136 ms) : 0, 299136
AppSec [baseline] (53.612 ms) : 0, 53612
AppSec [candidate] (55.167 ms) : 0, 55167
IAST [baseline] (24.054 ms) : 0, 24054
IAST [candidate] (22.545 ms) : 0, 22545
Remote Config [baseline] (1.52 ms) : 0, 1520
Remote Config [candidate] (1.351 ms) : 0, 1351
Telemetry [baseline] (6.902 ms) : 0, 6902
Telemetry [candidate] (6.933 ms) : 0, 6933
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-24T14:21:44 2024-09-24T14:28:35
git_branch master nikita-tkachenko/circle-ci-cpu-limits-test
git_commit_date 1727166392 1727186946
git_commit_sha 0dcde79 dc4f16c
release_version 1.40.0-SNAPSHOT~0dcde7931e 1.40.0-SNAPSHOT~dc4f16c857
start_time 2024-09-24T14:21:30 2024-09-24T14:28:21
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1727188462 1727188462
ci_job_id 649777508 649777508
ci_pipeline_id 45015690 45015690
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~dc4f16c857, baseline=1.40.0-SNAPSHOT~0dcde7931e
    dateFormat X
    axisFormat %s
section baseline
no_agent (371.223 µs) : 352, 391
.   : milestone, 371,
iast (491.64 µs) : 471, 513
.   : milestone, 492,
iast_FULL (553.999 µs) : 533, 575
.   : milestone, 554,
iast_GLOBAL (513.26 µs) : 492, 535
.   : milestone, 513,
iast_HARDCODED_SECRET_DISABLED (490.052 µs) : 468, 512
.   : milestone, 490,
iast_INACTIVE (448.102 µs) : 427, 469
.   : milestone, 448,
iast_TELEMETRY_OFF (485.837 µs) : 463, 509
.   : milestone, 486,
tracing (447.081 µs) : 426, 468
.   : milestone, 447,
section candidate
no_agent (370.36 µs) : 350, 390
.   : milestone, 370,
iast (485.951 µs) : 465, 507
.   : milestone, 486,
iast_FULL (559.993 µs) : 539, 581
.   : milestone, 560,
iast_GLOBAL (510.187 µs) : 488, 532
.   : milestone, 510,
iast_HARDCODED_SECRET_DISABLED (489.131 µs) : 468, 511
.   : milestone, 489,
iast_INACTIVE (448.759 µs) : 428, 470
.   : milestone, 449,
iast_TELEMETRY_OFF (479.291 µs) : 457, 502
.   : milestone, 479,
tracing (449.271 µs) : 428, 471
.   : milestone, 449,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 371.223 µs [351.656 µs, 390.79 µs] -
iast 491.64 µs [470.56 µs, 512.72 µs] 120.416 µs (32.4%)
iast_FULL 553.999 µs [532.792 µs, 575.206 µs] 182.776 µs (49.2%)
iast_GLOBAL 513.26 µs [491.955 µs, 534.565 µs] 142.037 µs (38.3%)
iast_HARDCODED_SECRET_DISABLED 490.052 µs [468.168 µs, 511.937 µs] 118.829 µs (32.0%)
iast_INACTIVE 448.102 µs [426.709 µs, 469.494 µs] 76.879 µs (20.7%)
iast_TELEMETRY_OFF 485.837 µs [462.602 µs, 509.072 µs] 114.614 µs (30.9%)
tracing 447.081 µs [426.465 µs, 467.698 µs] 75.858 µs (20.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 370.36 µs [350.407 µs, 390.313 µs] -
iast 485.951 µs [464.709 µs, 507.192 µs] 115.59 µs (31.2%)
iast_FULL 559.993 µs [538.64 µs, 581.346 µs] 189.633 µs (51.2%)
iast_GLOBAL 510.187 µs [488.393 µs, 531.982 µs] 139.827 µs (37.8%)
iast_HARDCODED_SECRET_DISABLED 489.131 µs [467.632 µs, 510.631 µs] 118.771 µs (32.1%)
iast_INACTIVE 448.759 µs [427.675 µs, 469.843 µs] 78.399 µs (21.2%)
iast_TELEMETRY_OFF 479.291 µs [456.625 µs, 501.956 µs] 108.931 µs (29.4%)
tracing 449.271 µs [427.619 µs, 470.923 µs] 78.911 µs (21.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~dc4f16c857, baseline=1.40.0-SNAPSHOT~0dcde7931e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.333 ms) : 1313, 1353
.   : milestone, 1333,
appsec (1.743 ms) : 1720, 1767
.   : milestone, 1743,
appsec_no_iast (1.688 ms) : 1663, 1713
.   : milestone, 1688,
iast (1.485 ms) : 1463, 1508
.   : milestone, 1485,
profiling (1.495 ms) : 1470, 1520
.   : milestone, 1495,
tracing (1.469 ms) : 1446, 1493
.   : milestone, 1469,
section candidate
no_agent (1.345 ms) : 1326, 1365
.   : milestone, 1345,
appsec (1.739 ms) : 1715, 1763
.   : milestone, 1739,
appsec_no_iast (1.71 ms) : 1686, 1735
.   : milestone, 1710,
iast (1.491 ms) : 1468, 1514
.   : milestone, 1491,
profiling (1.508 ms) : 1483, 1532
.   : milestone, 1508,
tracing (1.464 ms) : 1439, 1489
.   : milestone, 1464,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.333 ms [1.313 ms, 1.353 ms] -
appsec 1.743 ms [1.72 ms, 1.767 ms] 410.067 µs (30.8%)
appsec_no_iast 1.688 ms [1.663 ms, 1.713 ms] 354.688 µs (26.6%)
iast 1.485 ms [1.463 ms, 1.508 ms] 152.156 µs (11.4%)
profiling 1.495 ms [1.47 ms, 1.52 ms] 161.638 µs (12.1%)
tracing 1.469 ms [1.446 ms, 1.493 ms] 135.785 µs (10.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.345 ms [1.326 ms, 1.365 ms] -
appsec 1.739 ms [1.715 ms, 1.763 ms] 393.351 µs (29.2%)
appsec_no_iast 1.71 ms [1.686 ms, 1.735 ms] 364.885 µs (27.1%)
iast 1.491 ms [1.468 ms, 1.514 ms] 145.742 µs (10.8%)
profiling 1.508 ms [1.483 ms, 1.532 ms] 162.255 µs (12.1%)
tracing 1.464 ms [1.439 ms, 1.489 ms] 118.657 µs (8.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/circle-ci-cpu-limits-test
git_commit_date 1727166392 1727186946
git_commit_sha 0dcde79 dc4f16c
release_version 1.40.0-SNAPSHOT~0dcde7931e 1.40.0-SNAPSHOT~dc4f16c857
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1727188855 1727188855
ci_job_id 649777510 649777510
ci_pipeline_id 45015690 45015690
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~dc4f16c857, baseline=1.40.0-SNAPSHOT~0dcde7931e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.461 ms) : 1449, 1472
.   : milestone, 1461,
appsec (2.311 ms) : 2271, 2351
.   : milestone, 2311,
iast (2.058 ms) : 2008, 2109
.   : milestone, 2058,
iast_GLOBAL (2.102 ms) : 2052, 2153
.   : milestone, 2102,
profiling (1.921 ms) : 1881, 1961
.   : milestone, 1921,
tracing (1.903 ms) : 1864, 1942
.   : milestone, 1903,
section candidate
no_agent (1.468 ms) : 1456, 1479
.   : milestone, 1468,
appsec (2.3 ms) : 2260, 2340
.   : milestone, 2300,
iast (2.039 ms) : 1990, 2088
.   : milestone, 2039,
iast_GLOBAL (2.106 ms) : 2055, 2157
.   : milestone, 2106,
profiling (1.922 ms) : 1882, 1961
.   : milestone, 1922,
tracing (1.899 ms) : 1860, 1937
.   : milestone, 1899,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.461 ms [1.449 ms, 1.472 ms] -
appsec 2.311 ms [2.271 ms, 2.351 ms] 850.515 µs (58.2%)
iast 2.058 ms [2.008 ms, 2.109 ms] 597.636 µs (40.9%)
iast_GLOBAL 2.102 ms [2.052 ms, 2.153 ms] 641.799 µs (43.9%)
profiling 1.921 ms [1.881 ms, 1.961 ms] 460.339 µs (31.5%)
tracing 1.903 ms [1.864 ms, 1.942 ms] 442.625 µs (30.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.456 ms, 1.479 ms] -
appsec 2.3 ms [2.26 ms, 2.34 ms] 832.344 µs (56.7%)
iast 2.039 ms [1.99 ms, 2.088 ms] 571.476 µs (38.9%)
iast_GLOBAL 2.106 ms [2.055 ms, 2.157 ms] 638.557 µs (43.5%)
profiling 1.922 ms [1.882 ms, 1.961 ms] 454.156 µs (30.9%)
tracing 1.899 ms [1.86 ms, 1.937 ms] 431.286 µs (29.4%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~dc4f16c857, baseline=1.40.0-SNAPSHOT~0dcde7931e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.087 s) : 15087000, 15087000
.   : milestone, 15087000,
appsec (15.018 s) : 15018000, 15018000
.   : milestone, 15018000,
iast (18.718 s) : 18718000, 18718000
.   : milestone, 18718000,
iast_GLOBAL (18.05 s) : 18050000, 18050000
.   : milestone, 18050000,
profiling (15.8 s) : 15800000, 15800000
.   : milestone, 15800000,
tracing (14.86 s) : 14860000, 14860000
.   : milestone, 14860000,
section candidate
no_agent (15.038 s) : 15038000, 15038000
.   : milestone, 15038000,
appsec (15.099 s) : 15099000, 15099000
.   : milestone, 15099000,
iast (19.052 s) : 19052000, 19052000
.   : milestone, 19052000,
iast_GLOBAL (18.195 s) : 18195000, 18195000
.   : milestone, 18195000,
profiling (15.217 s) : 15217000, 15217000
.   : milestone, 15217000,
tracing (15.222 s) : 15222000, 15222000
.   : milestone, 15222000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.087 s [15.087 s, 15.087 s] -
appsec 15.018 s [15.018 s, 15.018 s] -69.0 ms (-0.5%)
iast 18.718 s [18.718 s, 18.718 s] 3.631 s (24.1%)
iast_GLOBAL 18.05 s [18.05 s, 18.05 s] 2.963 s (19.6%)
profiling 15.8 s [15.8 s, 15.8 s] 713.0 ms (4.7%)
tracing 14.86 s [14.86 s, 14.86 s] -227.0 ms (-1.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.038 s [15.038 s, 15.038 s] -
appsec 15.099 s [15.099 s, 15.099 s] 61.0 ms (0.4%)
iast 19.052 s [19.052 s, 19.052 s] 4.014 s (26.7%)
iast_GLOBAL 18.195 s [18.195 s, 18.195 s] 3.157 s (21.0%)
profiling 15.217 s [15.217 s, 15.217 s] 179.0 ms (1.2%)
tracing 15.222 s [15.222 s, 15.222 s] 184.0 ms (1.2%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/circle-ci-cpu-limits-test branch September 24, 2024 14:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@nikita-tkachenko-datadog