Enable Single Step Instrumentation Guardrails #7568

PerfectSlayer · 2024-09-05T12:02:26Z

What Does This Do

This PR enables SSI guardrails.

Motivation

When SSI will be enabled by default, guardrails will make sure injection does not apply every time, skipping known incompatible configurations.

Additional Notes

Additional blocking mechanism is added on injector repository: https://github.com/DataDog/auto_inject/pull/436

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Squash your commits prior merging or merge using GitHub's Squash and merge
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: APMLP-100

pr-commenter · 2024-09-05T12:31:04Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/ssi-guardrails
git_commit_date	1727682967	1727685911
git_commit_sha	`efa3824`	`8d9ff59`
release_version	1.40.0-SNAPSHOT~efa3824d5d	1.40.0-SNAPSHOT~8d9ff5908d

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1727688504	1727688504
ci_job_id	655167245	655167245
ci_pipeline_id	45394547	45394547
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 4 performance regressions! Performance is the same for 45 metrics, 14 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:iast:Telemetry	worse [+184.230µs; +420.329µs] or [+2.649%; +6.044%]	7.256ms	6.954ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Telemetry	worse [+236.729µs; +489.367µs] or [+3.368%; +6.962%]	7.392ms	7.029ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Telemetry	worse [+224.003µs; +564.204µs] or [+3.240%; +8.161%]	7.307ms	6.913ms
scenario:startup:petclinic:iast:Telemetry	worse [+229.341µs; +535.683µs] or [+3.299%; +7.705%]	7.335ms	6.953ms

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~8d9ff5908d, baseline=1.40.0-SNAPSHOT~efa3824d5d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1065987
Total [baseline] (10.438 s) : 0, 10437867
Agent [candidate] (1.064 s) : 0, 1063954
Total [candidate] (10.391 s) : 0, 10390892
section appsec
Agent [baseline] (1.208 s) : 0, 1207642
Total [baseline] (10.587 s) : 0, 10586741
Agent [candidate] (1.203 s) : 0, 1203204
Total [candidate] (10.66 s) : 0, 10660211
section iast
Agent [baseline] (1.19 s) : 0, 1189982
Total [baseline] (10.789 s) : 0, 10788729
Agent [candidate] (1.198 s) : 0, 1197784
Total [candidate] (10.933 s) : 0, 10933493
section profiling
Agent [baseline] (1.268 s) : 0, 1268008
Total [baseline] (10.58 s) : 0, 10579735
Agent [candidate] (1.262 s) : 0, 1261600
Total [candidate] (10.576 s) : 0, 10575681

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.066 s	-
Agent	appsec	1.208 s	141.655 ms (13.3%)
Agent	iast	1.19 s	123.995 ms (11.6%)
Agent	profiling	1.268 s	202.021 ms (19.0%)
Total	tracing	10.438 s	-
Total	appsec	10.587 s	148.874 ms (1.4%)
Total	iast	10.789 s	350.862 ms (3.4%)
Total	profiling	10.58 s	141.868 ms (1.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.064 s	-
Agent	appsec	1.203 s	139.25 ms (13.1%)
Agent	iast	1.198 s	133.83 ms (12.6%)
Agent	profiling	1.262 s	197.646 ms (18.6%)
Total	tracing	10.391 s	-
Total	appsec	10.66 s	269.319 ms (2.6%)
Total	iast	10.933 s	542.6 ms (5.2%)
Total	profiling	10.576 s	184.789 ms (1.8%)

gantt
    title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~8d9ff5908d, baseline=1.40.0-SNAPSHOT~efa3824d5d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (679.205 ms) : 0, 679205
BytebuddyAgent [candidate] (678.716 ms) : 0, 678716
GlobalTracer [baseline] (311.181 ms) : 0, 311181
GlobalTracer [candidate] (311.026 ms) : 0, 311026
AppSec [baseline] (53.766 ms) : 0, 53766
AppSec [candidate] (52.407 ms) : 0, 52407
Remote Config [baseline] (658.354 µs) : 0, 658
Remote Config [candidate] (667.746 µs) : 0, 668
Telemetry [baseline] (7.576 ms) : 0, 7576
Telemetry [candidate] (7.504 ms) : 0, 7504
section appsec
BytebuddyAgent [baseline] (701.543 ms) : 0, 701543
BytebuddyAgent [candidate] (703.501 ms) : 0, 703501
GlobalTracer [baseline] (309.295 ms) : 0, 309295
GlobalTracer [candidate] (304.536 ms) : 0, 304536
AppSec [baseline] (164.44 ms) : 0, 164440
AppSec [candidate] (163.346 ms) : 0, 163346
Remote Config [baseline] (638.912 µs) : 0, 639
Remote Config [candidate] (629.925 µs) : 0, 630
Telemetry [baseline] (7.833 ms) : 0, 7833
Telemetry [candidate] (7.982 ms) : 0, 7982
IAST [baseline] (20.379 ms) : 0, 20379
IAST [candidate] (19.063 ms) : 0, 19063
section iast
BytebuddyAgent [baseline] (791.734 ms) : 0, 791734
BytebuddyAgent [candidate] (797.421 ms) : 0, 797421
GlobalTracer [baseline] (299.034 ms) : 0, 299034
GlobalTracer [candidate] (300.989 ms) : 0, 300989
AppSec [baseline] (52.895 ms) : 0, 52895
AppSec [candidate] (54.721 ms) : 0, 54721
Remote Config [baseline] (593.974 µs) : 0, 594
Remote Config [candidate] (626.429 µs) : 0, 626
Telemetry [baseline] (6.953 ms) : 0, 6953
Telemetry [candidate] (7.335 ms) : 0, 7335
IAST [baseline] (25.133 ms) : 0, 25133
IAST [candidate] (22.941 ms) : 0, 22941
section profiling
BytebuddyAgent [baseline] (676.608 ms) : 0, 676608
BytebuddyAgent [candidate] (672.586 ms) : 0, 672586
GlobalTracer [baseline] (394.604 ms) : 0, 394604
GlobalTracer [candidate] (394.028 ms) : 0, 394028
AppSec [baseline] (54.288 ms) : 0, 54288
AppSec [candidate] (53.0 ms) : 0, 53000
Remote Config [baseline] (658.475 µs) : 0, 658
Remote Config [candidate] (661.093 µs) : 0, 661
Telemetry [baseline] (7.537 ms) : 0, 7537
Telemetry [candidate] (7.364 ms) : 0, 7364
ProfilingAgent [baseline] (95.499 ms) : 0, 95499
ProfilingAgent [candidate] (95.998 ms) : 0, 95998
Profiling [baseline] (95.524 ms) : 0, 95524
Profiling [candidate] (96.022 ms) : 0, 96022

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~8d9ff5908d, baseline=1.40.0-SNAPSHOT~efa3824d5d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.07 s) : 0, 1069751
Total [baseline] (8.556 s) : 0, 8555587
Agent [candidate] (1.064 s) : 0, 1064205
Total [candidate] (8.517 s) : 0, 8517158
section iast
Agent [baseline] (1.19 s) : 0, 1190494
Total [baseline] (9.017 s) : 0, 9017291
Agent [candidate] (1.191 s) : 0, 1191127
Total [candidate] (8.997 s) : 0, 8997351
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.19 s) : 0, 1190075
Total [baseline] (8.997 s) : 0, 8996991
Agent [candidate] (1.189 s) : 0, 1188824
Total [candidate] (8.966 s) : 0, 8966115
section iast_TELEMETRY_OFF
Agent [baseline] (1.189 s) : 0, 1189489
Total [baseline] (9.044 s) : 0, 9044418
Agent [candidate] (1.204 s) : 0, 1204424
Total [candidate] (9.073 s) : 0, 9073484

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.07 s	-
Agent	iast	1.19 s	120.743 ms (11.3%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.19 s	120.323 ms (11.2%)
Agent	iast_TELEMETRY_OFF	1.189 s	119.737 ms (11.2%)
Total	tracing	8.556 s	-
Total	iast	9.017 s	461.704 ms (5.4%)
Total	iast_HARDCODED_SECRET_DISABLED	8.997 s	441.403 ms (5.2%)
Total	iast_TELEMETRY_OFF	9.044 s	488.83 ms (5.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.064 s	-
Agent	iast	1.191 s	126.921 ms (11.9%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.189 s	124.618 ms (11.7%)
Agent	iast_TELEMETRY_OFF	1.204 s	140.218 ms (13.2%)
Total	tracing	8.517 s	-
Total	iast	8.997 s	480.193 ms (5.6%)
Total	iast_HARDCODED_SECRET_DISABLED	8.966 s	448.957 ms (5.3%)
Total	iast_TELEMETRY_OFF	9.073 s	556.326 ms (6.5%)

gantt
    title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~8d9ff5908d, baseline=1.40.0-SNAPSHOT~efa3824d5d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.58 ms) : 0, 682580
BytebuddyAgent [candidate] (679.038 ms) : 0, 679038
GlobalTracer [baseline] (311.621 ms) : 0, 311621
GlobalTracer [candidate] (311.052 ms) : 0, 311052
AppSec [baseline] (53.585 ms) : 0, 53585
AppSec [candidate] (52.424 ms) : 0, 52424
Remote Config [baseline] (667.797 µs) : 0, 668
Remote Config [candidate] (653.453 µs) : 0, 653
Telemetry [baseline] (7.589 ms) : 0, 7589
Telemetry [candidate] (7.421 ms) : 0, 7421
section iast
BytebuddyAgent [baseline] (792.25 ms) : 0, 792250
BytebuddyAgent [candidate] (792.649 ms) : 0, 792649
GlobalTracer [baseline] (299.353 ms) : 0, 299353
GlobalTracer [candidate] (299.65 ms) : 0, 299650
AppSec [baseline] (52.546 ms) : 0, 52546
AppSec [candidate] (52.915 ms) : 0, 52915
Remote Config [baseline] (624.238 µs) : 0, 624
Remote Config [candidate] (593.055 µs) : 0, 593
Telemetry [baseline] (6.954 ms) : 0, 6954
Telemetry [candidate] (7.256 ms) : 0, 7256
IAST [baseline] (25.14 ms) : 0, 25140
IAST [candidate] (24.367 ms) : 0, 24367
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (791.845 ms) : 0, 791845
BytebuddyAgent [candidate] (791.112 ms) : 0, 791112
GlobalTracer [baseline] (299.976 ms) : 0, 299976
GlobalTracer [candidate] (299.296 ms) : 0, 299296
AppSec [baseline] (52.401 ms) : 0, 52401
AppSec [candidate] (53.945 ms) : 0, 53945
Remote Config [baseline] (636.07 µs) : 0, 636
Remote Config [candidate] (632.435 µs) : 0, 632
Telemetry [baseline] (7.029 ms) : 0, 7029
Telemetry [candidate] (7.392 ms) : 0, 7392
IAST [baseline] (24.515 ms) : 0, 24515
IAST [candidate] (22.783 ms) : 0, 22783
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (789.672 ms) : 0, 789672
BytebuddyAgent [candidate] (800.966 ms) : 0, 800966
GlobalTracer [baseline] (300.152 ms) : 0, 300152
GlobalTracer [candidate] (303.705 ms) : 0, 303705
AppSec [baseline] (54.263 ms) : 0, 54263
AppSec [candidate] (55.381 ms) : 0, 55381
Remote Config [baseline] (653.696 µs) : 0, 654
Remote Config [candidate] (602.388 µs) : 0, 602
Telemetry [baseline] (6.913 ms) : 0, 6913
Telemetry [candidate] (7.307 ms) : 0, 7307
IAST [baseline] (24.165 ms) : 0, 24165
IAST [candidate] (22.592 ms) : 0, 22592

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2024-09-30T08:59:19	2024-09-30T09:06:10
git_branch	master	bbujon/ssi-guardrails
git_commit_date	1727682967	1727685911
git_commit_sha	`efa3824`	`8d9ff59`
release_version	1.40.0-SNAPSHOT~efa3824d5d	1.40.0-SNAPSHOT~8d9ff5908d
start_time	2024-09-30T08:59:06	2024-09-30T09:05:56

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1727687516	1727687516
ci_job_id	655167246	655167246
ci_pipeline_id	45394547	45394547
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~8d9ff5908d, baseline=1.40.0-SNAPSHOT~efa3824d5d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.343 ms) : 1324, 1362
.   : milestone, 1343,
appsec (1.712 ms) : 1687, 1737
.   : milestone, 1712,
appsec_no_iast (1.726 ms) : 1702, 1750
.   : milestone, 1726,
iast (1.484 ms) : 1461, 1506
.   : milestone, 1484,
profiling (1.466 ms) : 1443, 1489
.   : milestone, 1466,
tracing (1.458 ms) : 1433, 1483
.   : milestone, 1458,
section candidate
no_agent (1.335 ms) : 1316, 1354
.   : milestone, 1335,
appsec (1.731 ms) : 1707, 1755
.   : milestone, 1731,
appsec_no_iast (1.741 ms) : 1716, 1765
.   : milestone, 1741,
iast (1.492 ms) : 1469, 1515
.   : milestone, 1492,
profiling (1.476 ms) : 1452, 1499
.   : milestone, 1476,
tracing (1.465 ms) : 1440, 1490
.   : milestone, 1465,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.343 ms [1.324 ms, 1.362 ms]	-
appsec	1.712 ms [1.687 ms, 1.737 ms]	369.279 µs (27.5%)
appsec_no_iast	1.726 ms [1.702 ms, 1.75 ms]	383.2 µs (28.5%)
iast	1.484 ms [1.461 ms, 1.506 ms]	140.526 µs (10.5%)
profiling	1.466 ms [1.443 ms, 1.489 ms]	123.036 µs (9.2%)
tracing	1.458 ms [1.433 ms, 1.483 ms]	115.133 µs (8.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.335 ms [1.316 ms, 1.354 ms]	-
appsec	1.731 ms [1.707 ms, 1.755 ms]	395.887 µs (29.7%)
appsec_no_iast	1.741 ms [1.716 ms, 1.765 ms]	405.943 µs (30.4%)
iast	1.492 ms [1.469 ms, 1.515 ms]	157.478 µs (11.8%)
profiling	1.476 ms [1.452 ms, 1.499 ms]	140.786 µs (10.5%)
tracing	1.465 ms [1.44 ms, 1.49 ms]	130.183 µs (9.8%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~8d9ff5908d, baseline=1.40.0-SNAPSHOT~efa3824d5d
    dateFormat X
    axisFormat %s
section baseline
no_agent (375.132 µs) : 355, 395
.   : milestone, 375,
iast (482.401 µs) : 461, 504
.   : milestone, 482,
iast_FULL (552.84 µs) : 532, 574
.   : milestone, 553,
iast_GLOBAL (514.14 µs) : 492, 536
.   : milestone, 514,
iast_HARDCODED_SECRET_DISABLED (488.937 µs) : 467, 511
.   : milestone, 489,
iast_INACTIVE (451.209 µs) : 430, 472
.   : milestone, 451,
iast_TELEMETRY_OFF (480.228 µs) : 458, 502
.   : milestone, 480,
tracing (455.046 µs) : 433, 477
.   : milestone, 455,
section candidate
no_agent (375.089 µs) : 355, 396
.   : milestone, 375,
iast (481.389 µs) : 460, 503
.   : milestone, 481,
iast_FULL (554.027 µs) : 533, 575
.   : milestone, 554,
iast_GLOBAL (511.507 µs) : 490, 533
.   : milestone, 512,
iast_HARDCODED_SECRET_DISABLED (488.81 µs) : 467, 510
.   : milestone, 489,
iast_INACTIVE (455.953 µs) : 434, 477
.   : milestone, 456,
iast_TELEMETRY_OFF (477.051 µs) : 455, 500
.   : milestone, 477,
tracing (447.21 µs) : 426, 469
.   : milestone, 447,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	375.132 µs [355.158 µs, 395.106 µs]	-
iast	482.401 µs [461.181 µs, 503.62 µs]	107.268 µs (28.6%)
iast_FULL	552.84 µs [531.729 µs, 573.95 µs]	177.708 µs (47.4%)
iast_GLOBAL	514.14 µs [492.048 µs, 536.232 µs]	139.007 µs (37.1%)
iast_HARDCODED_SECRET_DISABLED	488.937 µs [467.184 µs, 510.691 µs]	113.805 µs (30.3%)
iast_INACTIVE	451.209 µs [430.095 µs, 472.322 µs]	76.076 µs (20.3%)
iast_TELEMETRY_OFF	480.228 µs [458.449 µs, 502.006 µs]	105.096 µs (28.0%)
tracing	455.046 µs [433.47 µs, 476.621 µs]	79.913 µs (21.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	375.089 µs [354.57 µs, 395.609 µs]	-
iast	481.389 µs [460.166 µs, 502.611 µs]	106.299 µs (28.3%)
iast_FULL	554.027 µs [532.816 µs, 575.238 µs]	178.938 µs (47.7%)
iast_GLOBAL	511.507 µs [489.6 µs, 533.414 µs]	136.418 µs (36.4%)
iast_HARDCODED_SECRET_DISABLED	488.81 µs [467.165 µs, 510.456 µs]	113.721 µs (30.3%)
iast_INACTIVE	455.953 µs [434.434 µs, 477.471 µs]	80.863 µs (21.6%)
iast_TELEMETRY_OFF	477.051 µs [454.515 µs, 499.586 µs]	101.961 µs (27.2%)
tracing	447.21 µs [425.743 µs, 468.677 µs]	72.12 µs (19.2%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/ssi-guardrails
git_commit_date	1727682967	1727685911
git_commit_sha	`efa3824`	`8d9ff59`
release_version	1.40.0-SNAPSHOT~efa3824d5d	1.40.0-SNAPSHOT~8d9ff5908d

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1727688088	1727688088
ci_job_id	655167247	655167247
ci_pipeline_id	45394547	45394547
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~8d9ff5908d, baseline=1.40.0-SNAPSHOT~efa3824d5d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (2.313 ms) : 2273, 2353
.   : milestone, 2313,
iast (2.067 ms) : 2016, 2118
.   : milestone, 2067,
iast_GLOBAL (2.109 ms) : 2057, 2160
.   : milestone, 2109,
profiling (1.949 ms) : 1907, 1990
.   : milestone, 1949,
tracing (1.909 ms) : 1871, 1947
.   : milestone, 1909,
section candidate
no_agent (1.481 ms) : 1469, 1493
.   : milestone, 1481,
appsec (2.3 ms) : 2260, 2341
.   : milestone, 2300,
iast (2.066 ms) : 2015, 2116
.   : milestone, 2066,
iast_GLOBAL (2.104 ms) : 2053, 2154
.   : milestone, 2104,
profiling (1.93 ms) : 1889, 1970
.   : milestone, 1930,
tracing (1.907 ms) : 1869, 1945
.   : milestone, 1907,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.463 ms, 1.486 ms]	-
appsec	2.313 ms [2.273 ms, 2.353 ms]	839.103 µs (56.9%)
iast	2.067 ms [2.016 ms, 2.118 ms]	593.17 µs (40.2%)
iast_GLOBAL	2.109 ms [2.057 ms, 2.16 ms]	634.386 µs (43.0%)
profiling	1.949 ms [1.907 ms, 1.99 ms]	474.434 µs (32.2%)
tracing	1.909 ms [1.871 ms, 1.947 ms]	434.794 µs (29.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.481 ms [1.469 ms, 1.493 ms]	-
appsec	2.3 ms [2.26 ms, 2.341 ms]	819.462 µs (55.3%)
iast	2.066 ms [2.015 ms, 2.116 ms]	584.513 µs (39.5%)
iast_GLOBAL	2.104 ms [2.053 ms, 2.154 ms]	622.922 µs (42.1%)
profiling	1.93 ms [1.889 ms, 1.97 ms]	448.826 µs (30.3%)
tracing	1.907 ms [1.869 ms, 1.945 ms]	426.111 µs (28.8%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~8d9ff5908d, baseline=1.40.0-SNAPSHOT~efa3824d5d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.413 s) : 15413000, 15413000
.   : milestone, 15413000,
appsec (15.09 s) : 15090000, 15090000
.   : milestone, 15090000,
iast (18.681 s) : 18681000, 18681000
.   : milestone, 18681000,
iast_GLOBAL (17.816 s) : 17816000, 17816000
.   : milestone, 17816000,
profiling (15.065 s) : 15065000, 15065000
.   : milestone, 15065000,
tracing (15.187 s) : 15187000, 15187000
.   : milestone, 15187000,
section candidate
no_agent (15.088 s) : 15088000, 15088000
.   : milestone, 15088000,
appsec (15.212 s) : 15212000, 15212000
.   : milestone, 15212000,
iast (18.849 s) : 18849000, 18849000
.   : milestone, 18849000,
iast_GLOBAL (18.015 s) : 18015000, 18015000
.   : milestone, 18015000,
profiling (15.274 s) : 15274000, 15274000
.   : milestone, 15274000,
tracing (15.223 s) : 15223000, 15223000
.   : milestone, 15223000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.413 s [15.413 s, 15.413 s]	-
appsec	15.09 s [15.09 s, 15.09 s]	-323.0 ms (-2.1%)
iast	18.681 s [18.681 s, 18.681 s]	3.268 s (21.2%)
iast_GLOBAL	17.816 s [17.816 s, 17.816 s]	2.403 s (15.6%)
profiling	15.065 s [15.065 s, 15.065 s]	-348.0 ms (-2.3%)
tracing	15.187 s [15.187 s, 15.187 s]	-226.0 ms (-1.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.088 s [15.088 s, 15.088 s]	-
appsec	15.212 s [15.212 s, 15.212 s]	124.0 ms (0.8%)
iast	18.849 s [18.849 s, 18.849 s]	3.761 s (24.9%)
iast_GLOBAL	18.015 s [18.015 s, 18.015 s]	2.927 s (19.4%)
profiling	15.274 s [15.274 s, 15.274 s]	186.0 ms (1.2%)
tracing	15.223 s [15.223 s, 15.223 s]	135.0 ms (0.9%)

PerfectSlayer added type: enhancement comp: tooling Build & Tooling labels Sep 5, 2024

PerfectSlayer changed the title ~~Bbujon/ssi guardrails~~ Enable Single Step Instrumentation Guardrails Sep 5, 2024

PerfectSlayer force-pushed the bbujon/ssi-guardrails branch from f38928c to 99cb49a Compare September 5, 2024 14:45

PerfectSlayer force-pushed the bbujon/ssi-guardrails branch 3 times, most recently from 1303caa to 017a398 Compare September 18, 2024 09:18

PerfectSlayer force-pushed the bbujon/ssi-guardrails branch 2 times, most recently from bc26afd to 655eb7a Compare September 30, 2024 08:34

feat: Add initial deny list

8d9ff59

PerfectSlayer force-pushed the bbujon/ssi-guardrails branch from 655eb7a to 8d9ff59 Compare September 30, 2024 08:45

PerfectSlayer marked this pull request as ready for review September 30, 2024 08:45

PerfectSlayer requested a review from a team as a code owner September 30, 2024 08:45

PerfectSlayer requested a review from mcculls September 30, 2024 08:45

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Enable Single Step Instrumentation Guardrails #7568

Enable Single Step Instrumentation Guardrails #7568

PerfectSlayer commented Sep 5, 2024 •

edited

Loading

pr-commenter bot commented Sep 5, 2024 •

edited

Loading

Enable Single Step Instrumentation Guardrails #7568

Are you sure you want to change the base?

Enable Single Step Instrumentation Guardrails #7568

Conversation

PerfectSlayer commented Sep 5, 2024 • edited Loading

What Does This Do

Motivation

Additional Notes

Contributor Checklist

pr-commenter bot commented Sep 5, 2024 • edited Loading

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

PerfectSlayer commented Sep 5, 2024 •

edited

Loading

pr-commenter bot commented Sep 5, 2024 •

edited

Loading