Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use remote service to get CI provider info when configured to do so #7689

Merged
merged 4 commits into from
Sep 27, 2024
Merged

Use remote service to get CI provider info when configured to do so #7689

merged 4 commits into from
Sep 27, 2024

Conversation

nikita-tkachenko-datadog
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented Sep 27, 2024 •
edited by jira bot
Loading

What Does This Do

Adds logic that retrieves CI provider info (CI job name and URL, workspace path, commit and branch info, etc) from a remote service.

Normally this info is retrieved using environment variables, the remote service retrieval is only active when configured (i.e. when remote service URL is specified).

The data retrieved from the remote service has higher priority than the data retrieved from environment variables.

Motivation

When tracing tests that are executed with Bazel, all environment variables required by the tracer have to be defined as the inputs to the Bazel's test task.
Since these environment variables are different with every CI job run, this prevents Bazel from using its cache (since whether a task is cacheable or not depends on if its inputs have changed or not).
The solution is to not provide the env variables as inputs, and instead make them available via the remote service, thus "hiding" them from Bazel.

Additional Notes

This task also refactors some common logic: different components that use OkhttpClient are forced to use the same instance that is available in SharedCommunicationObjects.

This only affects CI Visibility agentless mode.

The motivation behind this is that there is supposed to be a single HTTP client instance per JVM, whereas with CI Visibility agentless mode enabled the tracer was creating up to 3 different clients.

Contributor Checklist

Jira ticket: LANGTOOLS-1771

@nikita-tkachenko-datadog nikita-tkachenko-datadog added the comp: ci visibility Continuous Integration Visibility label Sep 27, 2024
@pr-commenter
Copy link

pr-commenter bot commented Sep 27, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/remote-ci-provider-environment
git_commit_date 1727445368 1727451436
git_commit_sha aa1e54c fca948a
release_version 1.40.0-SNAPSHOT~aa1e54c87a 1.40.0-SNAPSHOT~fca948a4bf
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1727453957 1727453957
ci_job_id 654215093 654215093
ci_pipeline_id 45317889 45317889
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~fca948a4bf, baseline=1.40.0-SNAPSHOT~aa1e54c87a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.07 s) : 0, 1070192
Total [baseline] (10.448 s) : 0, 10448322
Agent [candidate] (1.078 s) : 0, 1078106
Total [candidate] (10.474 s) : 0, 10473776
section appsec
Agent [baseline] (1.201 s) : 0, 1201345
Total [baseline] (10.617 s) : 0, 10616993
Agent [candidate] (1.211 s) : 0, 1210564
Total [candidate] (10.653 s) : 0, 10653429
section iast
Agent [baseline] (1.201 s) : 0, 1200510
Total [baseline] (10.866 s) : 0, 10865567
Agent [candidate] (1.202 s) : 0, 1202085
Total [candidate] (10.88 s) : 0, 10880407
section profiling
Agent [baseline] (1.269 s) : 0, 1269021
Total [baseline] (10.596 s) : 0, 10596218
Agent [candidate] (1.267 s) : 0, 1267370
Total [candidate] (10.666 s) : 0, 10665806
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent appsec 1.201 s 131.153 ms (12.3%)
Agent iast 1.201 s 130.317 ms (12.2%)
Agent profiling 1.269 s 198.829 ms (18.6%)
Total tracing 10.448 s -
Total appsec 10.617 s 168.671 ms (1.6%)
Total iast 10.866 s 417.244 ms (4.0%)
Total profiling 10.596 s 147.896 ms (1.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.078 s -
Agent appsec 1.211 s 132.458 ms (12.3%)
Agent iast 1.202 s 123.979 ms (11.5%)
Agent profiling 1.267 s 189.264 ms (17.6%)
Total tracing 10.474 s -
Total appsec 10.653 s 179.653 ms (1.7%)
Total iast 10.88 s 406.63 ms (3.9%)
Total profiling 10.666 s 192.03 ms (1.8%) 
gantt
    title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~fca948a4bf, baseline=1.40.0-SNAPSHOT~aa1e54c87a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.843 ms) : 0, 682843
BytebuddyAgent [candidate] (687.814 ms) : 0, 687814
GlobalTracer [baseline] (311.19 ms) : 0, 311190
GlobalTracer [candidate] (313.827 ms) : 0, 313827
AppSec [baseline] (54.092 ms) : 0, 54092
AppSec [candidate] (54.23 ms) : 0, 54230
Remote Config [baseline] (671.071 µs) : 0, 671
Remote Config [candidate] (669.487 µs) : 0, 669
Telemetry [baseline] (7.679 ms) : 0, 7679
Telemetry [candidate] (7.702 ms) : 0, 7702
section appsec
BytebuddyAgent [baseline] (702.199 ms) : 0, 702199
BytebuddyAgent [candidate] (706.541 ms) : 0, 706541
GlobalTracer [baseline] (303.701 ms) : 0, 303701
GlobalTracer [candidate] (306.36 ms) : 0, 306360
AppSec [baseline] (162.824 ms) : 0, 162824
AppSec [candidate] (163.405 ms) : 0, 163405
Remote Config [baseline] (646.559 µs) : 0, 647
Remote Config [candidate] (650.79 µs) : 0, 651
Telemetry [baseline] (7.866 ms) : 0, 7866
Telemetry [candidate] (9.282 ms) : 0, 9282
IAST [baseline] (20.808 ms) : 0, 20808
IAST [candidate] (21.055 ms) : 0, 21055
section iast
BytebuddyAgent [baseline] (798.858 ms) : 0, 798858
BytebuddyAgent [candidate] (800.828 ms) : 0, 800828
GlobalTracer [baseline] (301.357 ms) : 0, 301357
GlobalTracer [candidate] (301.913 ms) : 0, 301913
AppSec [baseline] (54.151 ms) : 0, 54151
AppSec [candidate] (53.883 ms) : 0, 53883
Remote Config [baseline] (635.04 µs) : 0, 635
Remote Config [candidate] (615.333 µs) : 0, 615
Telemetry [baseline] (7.055 ms) : 0, 7055
Telemetry [candidate] (7.086 ms) : 0, 7086
IAST [baseline] (24.593 ms) : 0, 24593
IAST [candidate] (23.863 ms) : 0, 23863
section profiling
BytebuddyAgent [baseline] (674.834 ms) : 0, 674834
BytebuddyAgent [candidate] (674.786 ms) : 0, 674786
GlobalTracer [baseline] (395.492 ms) : 0, 395492
GlobalTracer [candidate] (395.058 ms) : 0, 395058
AppSec [baseline] (54.89 ms) : 0, 54890
AppSec [candidate] (54.633 ms) : 0, 54633
Remote Config [baseline] (656.639 µs) : 0, 657
Remote Config [candidate] (671.188 µs) : 0, 671
Telemetry [baseline] (7.448 ms) : 0, 7448
Telemetry [candidate] (7.461 ms) : 0, 7461
ProfilingAgent [baseline] (96.912 ms) : 0, 96912
ProfilingAgent [candidate] (95.929 ms) : 0, 95929
Profiling [baseline] (96.936 ms) : 0, 96936
Profiling [candidate] (95.953 ms) : 0, 95953
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~fca948a4bf, baseline=1.40.0-SNAPSHOT~aa1e54c87a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.077 s) : 0, 1076899
Total [baseline] (8.565 s) : 0, 8564584
Agent [candidate] (1.075 s) : 0, 1075356
Total [candidate] (8.586 s) : 0, 8585700
section iast
Agent [baseline] (1.192 s) : 0, 1191970
Total [baseline] (9.024 s) : 0, 9023770
Agent [candidate] (1.193 s) : 0, 1192884
Total [candidate] (9.042 s) : 0, 9042340
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.193 s) : 0, 1193135
Total [baseline] (8.985 s) : 0, 8985400
Agent [candidate] (1.195 s) : 0, 1195317
Total [candidate] (8.987 s) : 0, 8987352
section iast_TELEMETRY_OFF
Agent [baseline] (1.207 s) : 0, 1207330
Total [baseline] (9.052 s) : 0, 9052106
Agent [candidate] (1.198 s) : 0, 1198277
Total [candidate] (9.077 s) : 0, 9076828
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.077 s -
Agent iast 1.192 s 115.07 ms (10.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.193 s 116.236 ms (10.8%)
Agent iast_TELEMETRY_OFF 1.207 s 130.431 ms (12.1%)
Total tracing 8.565 s -
Total iast 9.024 s 459.186 ms (5.4%)
Total iast_HARDCODED_SECRET_DISABLED 8.985 s 420.816 ms (4.9%)
Total iast_TELEMETRY_OFF 9.052 s 487.522 ms (5.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.075 s -
Agent iast 1.193 s 117.527 ms (10.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.195 s 119.961 ms (11.2%)
Agent iast_TELEMETRY_OFF 1.198 s 122.921 ms (11.4%)
Total tracing 8.586 s -
Total iast 9.042 s 456.64 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 8.987 s 401.651 ms (4.7%)
Total iast_TELEMETRY_OFF 9.077 s 491.127 ms (5.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~fca948a4bf, baseline=1.40.0-SNAPSHOT~aa1e54c87a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.599 ms) : 0, 687599
BytebuddyAgent [candidate] (686.035 ms) : 0, 686035
GlobalTracer [baseline] (312.752 ms) : 0, 312752
GlobalTracer [candidate] (312.92 ms) : 0, 312920
AppSec [baseline] (54.295 ms) : 0, 54295
AppSec [candidate] (54.188 ms) : 0, 54188
Remote Config [baseline] (691.747 µs) : 0, 692
Remote Config [candidate] (671.989 µs) : 0, 672
Telemetry [baseline] (7.718 ms) : 0, 7718
Telemetry [candidate] (7.699 ms) : 0, 7699
section iast
BytebuddyAgent [baseline] (792.985 ms) : 0, 792985
BytebuddyAgent [candidate] (793.685 ms) : 0, 793685
GlobalTracer [baseline] (299.377 ms) : 0, 299377
GlobalTracer [candidate] (299.438 ms) : 0, 299438
AppSec [baseline] (54.779 ms) : 0, 54779
AppSec [candidate] (53.765 ms) : 0, 53765
IAST [baseline] (23.489 ms) : 0, 23489
IAST [candidate] (24.485 ms) : 0, 24485
Remote Config [baseline] (597.102 µs) : 0, 597
Remote Config [candidate] (657.588 µs) : 0, 658
Telemetry [baseline] (6.974 ms) : 0, 6974
Telemetry [candidate] (7.041 ms) : 0, 7041
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (793.45 ms) : 0, 793450
BytebuddyAgent [candidate] (795.37 ms) : 0, 795370
GlobalTracer [baseline] (299.967 ms) : 0, 299967
GlobalTracer [candidate] (300.435 ms) : 0, 300435
AppSec [baseline] (56.345 ms) : 0, 56345
AppSec [candidate] (55.316 ms) : 0, 55316
IAST [baseline] (21.981 ms) : 0, 21981
IAST [candidate] (22.7 ms) : 0, 22700
Remote Config [baseline] (612.919 µs) : 0, 613
Remote Config [candidate] (637.256 µs) : 0, 637
Telemetry [baseline] (7.05 ms) : 0, 7050
Telemetry [candidate] (7.055 ms) : 0, 7055
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (802.457 ms) : 0, 802457
BytebuddyAgent [candidate] (795.885 ms) : 0, 795885
GlobalTracer [baseline] (304.019 ms) : 0, 304019
GlobalTracer [candidate] (302.051 ms) : 0, 302051
AppSec [baseline] (57.239 ms) : 0, 57239
AppSec [candidate] (56.149 ms) : 0, 56149
IAST [baseline] (21.999 ms) : 0, 21999
IAST [candidate] (22.692 ms) : 0, 22692
Remote Config [baseline] (611.521 µs) : 0, 612
Remote Config [candidate] (611.767 µs) : 0, 612
Telemetry [baseline] (7.014 ms) : 0, 7014
Telemetry [candidate] (6.994 ms) : 0, 6994
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-27T15:51:20 2024-09-27T15:58:11
git_branch master nikita-tkachenko/remote-ci-provider-environment
git_commit_date 1727445368 1727451436
git_commit_sha aa1e54c fca948a
release_version 1.40.0-SNAPSHOT~aa1e54c87a 1.40.0-SNAPSHOT~fca948a4bf
start_time 2024-09-27T15:51:07 2024-09-27T15:57:58
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1727453037 1727453037
ci_job_id 654215094 654215094
ci_pipeline_id 45317889 45317889
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~fca948a4bf, baseline=1.40.0-SNAPSHOT~aa1e54c87a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.331 ms) : 1312, 1350
.   : milestone, 1331,
appsec (1.722 ms) : 1697, 1747
.   : milestone, 1722,
appsec_no_iast (1.719 ms) : 1695, 1744
.   : milestone, 1719,
iast (1.466 ms) : 1444, 1488
.   : milestone, 1466,
profiling (1.519 ms) : 1493, 1544
.   : milestone, 1519,
tracing (1.463 ms) : 1439, 1486
.   : milestone, 1463,
section candidate
no_agent (1.335 ms) : 1316, 1355
.   : milestone, 1335,
appsec (1.732 ms) : 1708, 1755
.   : milestone, 1732,
appsec_no_iast (1.717 ms) : 1693, 1741
.   : milestone, 1717,
iast (1.486 ms) : 1463, 1508
.   : milestone, 1486,
profiling (1.485 ms) : 1460, 1510
.   : milestone, 1485,
tracing (1.489 ms) : 1465, 1513
.   : milestone, 1489,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.331 ms [1.312 ms, 1.35 ms] -
appsec 1.722 ms [1.697 ms, 1.747 ms] 391.469 µs (29.4%)
appsec_no_iast 1.719 ms [1.695 ms, 1.744 ms] 388.539 µs (29.2%)
iast 1.466 ms [1.444 ms, 1.488 ms] 134.83 µs (10.1%)
profiling 1.519 ms [1.493 ms, 1.544 ms] 187.699 µs (14.1%)
tracing 1.463 ms [1.439 ms, 1.486 ms] 131.633 µs (9.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.335 ms [1.316 ms, 1.355 ms] -
appsec 1.732 ms [1.708 ms, 1.755 ms] 396.509 µs (29.7%)
appsec_no_iast 1.717 ms [1.693 ms, 1.741 ms] 381.853 µs (28.6%)
iast 1.486 ms [1.463 ms, 1.508 ms] 150.245 µs (11.3%)
profiling 1.485 ms [1.46 ms, 1.51 ms] 149.84 µs (11.2%)
tracing 1.489 ms [1.465 ms, 1.513 ms] 153.494 µs (11.5%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~fca948a4bf, baseline=1.40.0-SNAPSHOT~aa1e54c87a
    dateFormat X
    axisFormat %s
section baseline
no_agent (369.985 µs) : 350, 390
.   : milestone, 370,
iast (479.752 µs) : 459, 501
.   : milestone, 480,
iast_FULL (553.609 µs) : 532, 575
.   : milestone, 554,
iast_GLOBAL (504.349 µs) : 483, 525
.   : milestone, 504,
iast_HARDCODED_SECRET_DISABLED (481.78 µs) : 460, 503
.   : milestone, 482,
iast_INACTIVE (442.318 µs) : 422, 463
.   : milestone, 442,
iast_TELEMETRY_OFF (473.877 µs) : 451, 496
.   : milestone, 474,
tracing (441.921 µs) : 422, 462
.   : milestone, 442,
section candidate
no_agent (368.168 µs) : 348, 388
.   : milestone, 368,
iast (483.275 µs) : 462, 505
.   : milestone, 483,
iast_FULL (549.044 µs) : 528, 570
.   : milestone, 549,
iast_GLOBAL (507.265 µs) : 486, 529
.   : milestone, 507,
iast_HARDCODED_SECRET_DISABLED (492.538 µs) : 471, 515
.   : milestone, 493,
iast_INACTIVE (451.422 µs) : 430, 473
.   : milestone, 451,
iast_TELEMETRY_OFF (477.253 µs) : 454, 500
.   : milestone, 477,
tracing (448.542 µs) : 428, 470
.   : milestone, 449,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 369.985 µs [350.006 µs, 389.965 µs] -
iast 479.752 µs [458.589 µs, 500.915 µs] 109.766 µs (29.7%)
iast_FULL 553.609 µs [532.452 µs, 574.767 µs] 183.624 µs (49.6%)
iast_GLOBAL 504.349 µs [483.378 µs, 525.319 µs] 134.363 µs (36.3%)
iast_HARDCODED_SECRET_DISABLED 481.78 µs [460.5 µs, 503.06 µs] 111.794 µs (30.2%)
iast_INACTIVE 442.318 µs [421.847 µs, 462.788 µs] 72.332 µs (19.5%)
iast_TELEMETRY_OFF 473.877 µs [451.366 µs, 496.388 µs] 103.892 µs (28.1%)
tracing 441.921 µs [421.852 µs, 461.99 µs] 71.935 µs (19.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 368.168 µs [348.444 µs, 387.892 µs] -
iast 483.275 µs [461.901 µs, 504.65 µs] 115.107 µs (31.3%)
iast_FULL 549.044 µs [527.906 µs, 570.181 µs] 180.875 µs (49.1%)
iast_GLOBAL 507.265 µs [485.628 µs, 528.903 µs] 139.097 µs (37.8%)
iast_HARDCODED_SECRET_DISABLED 492.538 µs [470.562 µs, 514.513 µs] 124.369 µs (33.8%)
iast_INACTIVE 451.422 µs [429.892 µs, 472.951 µs] 83.253 µs (22.6%)
iast_TELEMETRY_OFF 477.253 µs [454.323 µs, 500.182 µs] 109.085 µs (29.6%)
tracing 448.542 µs [427.517 µs, 469.567 µs] 80.374 µs (21.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/remote-ci-provider-environment
git_commit_date 1727445368 1727451436
git_commit_sha aa1e54c fca948a
release_version 1.40.0-SNAPSHOT~aa1e54c87a 1.40.0-SNAPSHOT~fca948a4bf
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1727453484 1727453484
ci_job_id 654215095 654215095
ci_pipeline_id 45317889 45317889
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~fca948a4bf, baseline=1.40.0-SNAPSHOT~aa1e54c87a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (2.327 ms) : 2286, 2367
.   : milestone, 2327,
iast (2.072 ms) : 2021, 2124
.   : milestone, 2072,
iast_GLOBAL (2.111 ms) : 2060, 2162
.   : milestone, 2111,
profiling (1.93 ms) : 1890, 1970
.   : milestone, 1930,
tracing (1.907 ms) : 1869, 1945
.   : milestone, 1907,
section candidate
no_agent (1.477 ms) : 1465, 1489
.   : milestone, 1477,
appsec (2.321 ms) : 2281, 2362
.   : milestone, 2321,
iast (2.057 ms) : 2007, 2107
.   : milestone, 2057,
iast_GLOBAL (2.11 ms) : 2060, 2161
.   : milestone, 2110,
profiling (1.925 ms) : 1885, 1964
.   : milestone, 1925,
tracing (1.904 ms) : 1866, 1942
.   : milestone, 1904,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.458 ms, 1.481 ms] -
appsec 2.327 ms [2.286 ms, 2.367 ms] 857.455 µs (58.4%)
iast 2.072 ms [2.021 ms, 2.124 ms] 603.237 µs (41.1%)
iast_GLOBAL 2.111 ms [2.06 ms, 2.162 ms] 641.678 µs (43.7%)
profiling 1.93 ms [1.89 ms, 1.97 ms] 460.433 µs (31.3%)
tracing 1.907 ms [1.869 ms, 1.945 ms] 438.242 µs (29.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.489 ms] -
appsec 2.321 ms [2.281 ms, 2.362 ms] 844.173 µs (57.2%)
iast 2.057 ms [2.007 ms, 2.107 ms] 579.902 µs (39.3%)
iast_GLOBAL 2.11 ms [2.06 ms, 2.161 ms] 633.399 µs (42.9%)
profiling 1.925 ms [1.885 ms, 1.964 ms] 447.557 µs (30.3%)
tracing 1.904 ms [1.866 ms, 1.942 ms] 426.869 µs (28.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~fca948a4bf, baseline=1.40.0-SNAPSHOT~aa1e54c87a
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.084 s) : 15084000, 15084000
.   : milestone, 15084000,
appsec (15.314 s) : 15314000, 15314000
.   : milestone, 15314000,
iast (18.941 s) : 18941000, 18941000
.   : milestone, 18941000,
iast_GLOBAL (18.042 s) : 18042000, 18042000
.   : milestone, 18042000,
profiling (15.32 s) : 15320000, 15320000
.   : milestone, 15320000,
tracing (15.134 s) : 15134000, 15134000
.   : milestone, 15134000,
section candidate
no_agent (15.121 s) : 15121000, 15121000
.   : milestone, 15121000,
appsec (15.132 s) : 15132000, 15132000
.   : milestone, 15132000,
iast (18.944 s) : 18944000, 18944000
.   : milestone, 18944000,
iast_GLOBAL (18.122 s) : 18122000, 18122000
.   : milestone, 18122000,
profiling (15.183 s) : 15183000, 15183000
.   : milestone, 15183000,
tracing (15.129 s) : 15129000, 15129000
.   : milestone, 15129000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.084 s [15.084 s, 15.084 s] -
appsec 15.314 s [15.314 s, 15.314 s] 230.0 ms (1.5%)
iast 18.941 s [18.941 s, 18.941 s] 3.857 s (25.6%)
iast_GLOBAL 18.042 s [18.042 s, 18.042 s] 2.958 s (19.6%)
profiling 15.32 s [15.32 s, 15.32 s] 236.0 ms (1.6%)
tracing 15.134 s [15.134 s, 15.134 s] 50.0 ms (0.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.121 s [15.121 s, 15.121 s] -
appsec 15.132 s [15.132 s, 15.132 s] 11.0 ms (0.1%)
iast 18.944 s [18.944 s, 18.944 s] 3.823 s (25.3%)
iast_GLOBAL 18.122 s [18.122 s, 18.122 s] 3.001 s (19.8%)
profiling 15.183 s [15.183 s, 15.183 s] 62.0 ms (0.4%)
tracing 15.129 s [15.129 s, 15.129 s] 8.0 ms (0.1%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog marked this pull request as ready for review September 27, 2024 12:45
@nikita-tkachenko-datadog nikita-tkachenko-datadog merged commit 201bcbe into master Sep 27, 2024
103 checks passed
@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/remote-ci-provider-environment branch September 27, 2024 19:48
@github-actions github-actions bot added this to the 1.40.0 milestone Sep 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@anmarchenko anmarchenko anmarchenko approved these changes

@nayeem-kamal nayeem-kamal Awaiting requested review from nayeem-kamal nayeem-kamal is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: ci visibility Continuous Integration Visibility
Projects
None yet
Milestone
1.40.0
Development

Successfully merging this pull request may close these issues.
2 participants
@nikita-tkachenko-datadog @anmarchenko