-
Notifications
You must be signed in to change notification settings - Fork 285
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
AWS Payload Tagging #7312
Open
ygree
wants to merge
22
commits into
master
Choose a base branch
from
ygree/aws-payload-tagging
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
AWS Payload Tagging #7312
+1,845
−9
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
ygree
added
tag: do not merge
Do not merge changes
inst: aws sdk
AWS SDK instrumentation
labels
Jul 12, 2024
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 14 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~8f5912837c, baseline=1.40.0-SNAPSHOT~201bcbe8ed
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.072 s) : 0, 1071641
Total [baseline] (8.612 s) : 0, 8612453
Agent [candidate] (1.065 s) : 0, 1065032
Total [candidate] (8.511 s) : 0, 8511058
section iast
Agent [baseline] (1.197 s) : 0, 1197348
Total [baseline] (9.004 s) : 0, 9004118
Agent [candidate] (1.187 s) : 0, 1186505
Total [candidate] (8.992 s) : 0, 8991856
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.189 s) : 0, 1188748
Total [baseline] (9.07 s) : 0, 9069529
Agent [candidate] (1.192 s) : 0, 1192386
Total [candidate] (9.048 s) : 0, 9048188
section iast_TELEMETRY_OFF
Agent [baseline] (1.191 s) : 0, 1190888
Total [baseline] (8.98 s) : 0, 8979540
Agent [candidate] (1.196 s) : 0, 1196454
Total [candidate] (9.014 s) : 0, 9013886
gantt
title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~8f5912837c, baseline=1.40.0-SNAPSHOT~201bcbe8ed
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (685.374 ms) : 0, 685374
BytebuddyAgent [candidate] (679.389 ms) : 0, 679389
GlobalTracer [baseline] (310.466 ms) : 0, 310466
GlobalTracer [candidate] (310.127 ms) : 0, 310127
AppSec [baseline] (53.812 ms) : 0, 53812
AppSec [candidate] (53.721 ms) : 0, 53721
Remote Config [baseline] (663.654 µs) : 0, 664
Remote Config [candidate] (655.379 µs) : 0, 655
Telemetry [baseline] (7.583 ms) : 0, 7583
Telemetry [candidate] (7.541 ms) : 0, 7541
section iast
BytebuddyAgent [baseline] (797.303 ms) : 0, 797303
BytebuddyAgent [candidate] (789.978 ms) : 0, 789978
GlobalTracer [baseline] (300.048 ms) : 0, 300048
GlobalTracer [candidate] (298.006 ms) : 0, 298006
AppSec [baseline] (54.276 ms) : 0, 54276
AppSec [candidate] (52.83 ms) : 0, 52830
IAST [baseline] (24.343 ms) : 0, 24343
IAST [candidate] (24.389 ms) : 0, 24389
Remote Config [baseline] (610.22 µs) : 0, 610
Remote Config [candidate] (626.92 µs) : 0, 627
Telemetry [baseline] (7.013 ms) : 0, 7013
Telemetry [candidate] (7.018 ms) : 0, 7018
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (791.033 ms) : 0, 791033
BytebuddyAgent [candidate] (792.959 ms) : 0, 792959
GlobalTracer [baseline] (297.7 ms) : 0, 297700
GlobalTracer [candidate] (299.831 ms) : 0, 299831
AppSec [baseline] (53.845 ms) : 0, 53845
AppSec [candidate] (52.535 ms) : 0, 52535
IAST [baseline] (24.691 ms) : 0, 24691
IAST [candidate] (25.596 ms) : 0, 25596
Remote Config [baseline] (643.052 µs) : 0, 643
Remote Config [candidate] (628.967 µs) : 0, 629
Telemetry [baseline] (7.184 ms) : 0, 7184
Telemetry [candidate] (7.132 ms) : 0, 7132
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (791.692 ms) : 0, 791692
BytebuddyAgent [candidate] (795.277 ms) : 0, 795277
GlobalTracer [baseline] (299.754 ms) : 0, 299754
GlobalTracer [candidate] (301.614 ms) : 0, 301614
AppSec [baseline] (54.204 ms) : 0, 54204
AppSec [candidate] (56.905 ms) : 0, 56905
IAST [baseline] (24.038 ms) : 0, 24038
IAST [candidate] (21.379 ms) : 0, 21379
Remote Config [baseline] (604.599 µs) : 0, 605
Remote Config [candidate] (637.363 µs) : 0, 637
Telemetry [baseline] (6.896 ms) : 0, 6896
Telemetry [candidate] (6.876 ms) : 0, 6876
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~8f5912837c, baseline=1.40.0-SNAPSHOT~201bcbe8ed
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1071236
Total [baseline] (10.343 s) : 0, 10342811
Agent [candidate] (1.071 s) : 0, 1071413
Total [candidate] (10.357 s) : 0, 10356564
section appsec
Agent [baseline] (1.203 s) : 0, 1202848
Total [baseline] (10.588 s) : 0, 10588180
Agent [candidate] (1.203 s) : 0, 1203084
Total [candidate] (10.597 s) : 0, 10596765
section iast
Agent [baseline] (1.212 s) : 0, 1211924
Total [baseline] (10.874 s) : 0, 10873687
Agent [candidate] (1.2 s) : 0, 1199665
Total [candidate] (10.876 s) : 0, 10876381
section profiling
Agent [baseline] (1.273 s) : 0, 1273110
Total [baseline] (10.655 s) : 0, 10655341
Agent [candidate] (1.277 s) : 0, 1277325
Total [candidate] (10.568 s) : 0, 10567721
gantt
title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~8f5912837c, baseline=1.40.0-SNAPSHOT~201bcbe8ed
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (684.064 ms) : 0, 684064
BytebuddyAgent [candidate] (683.915 ms) : 0, 683915
GlobalTracer [baseline] (311.224 ms) : 0, 311224
GlobalTracer [candidate] (311.504 ms) : 0, 311504
AppSec [baseline] (53.886 ms) : 0, 53886
AppSec [candidate] (53.99 ms) : 0, 53990
Remote Config [baseline] (663.167 µs) : 0, 663
Remote Config [candidate] (668.784 µs) : 0, 669
Telemetry [baseline] (7.756 ms) : 0, 7756
Telemetry [candidate] (7.672 ms) : 0, 7672
section appsec
BytebuddyAgent [baseline] (703.56 ms) : 0, 703560
BytebuddyAgent [candidate] (702.926 ms) : 0, 702926
GlobalTracer [baseline] (303.836 ms) : 0, 303836
GlobalTracer [candidate] (304.45 ms) : 0, 304450
AppSec [baseline] (162.739 ms) : 0, 162739
AppSec [candidate] (162.544 ms) : 0, 162544
Remote Config [baseline] (641.979 µs) : 0, 642
Remote Config [candidate] (636.241 µs) : 0, 636
Telemetry [baseline] (8.543 ms) : 0, 8543
Telemetry [candidate] (8.539 ms) : 0, 8539
IAST [baseline] (19.777 ms) : 0, 19777
IAST [candidate] (20.686 ms) : 0, 20686
section iast
BytebuddyAgent [baseline] (808.321 ms) : 0, 808321
BytebuddyAgent [candidate] (798.586 ms) : 0, 798586
GlobalTracer [baseline] (303.308 ms) : 0, 303308
GlobalTracer [candidate] (301.179 ms) : 0, 301179
AppSec [baseline] (54.878 ms) : 0, 54878
AppSec [candidate] (53.82 ms) : 0, 53820
Remote Config [baseline] (640.036 µs) : 0, 640
Remote Config [candidate] (628.69 µs) : 0, 629
Telemetry [baseline] (7.12 ms) : 0, 7120
Telemetry [candidate] (7.09 ms) : 0, 7090
IAST [baseline] (23.742 ms) : 0, 23742
IAST [candidate] (24.635 ms) : 0, 24635
section profiling
BytebuddyAgent [baseline] (676.961 ms) : 0, 676961
BytebuddyAgent [candidate] (681.86 ms) : 0, 681860
GlobalTracer [baseline] (395.662 ms) : 0, 395662
GlobalTracer [candidate] (396.388 ms) : 0, 396388
AppSec [baseline] (55.084 ms) : 0, 55084
AppSec [candidate] (55.024 ms) : 0, 55024
Remote Config [baseline] (660.396 µs) : 0, 660
Remote Config [candidate] (656.402 µs) : 0, 656
Telemetry [baseline] (7.529 ms) : 0, 7529
Telemetry [candidate] (7.483 ms) : 0, 7483
ProfilingAgent [baseline] (98.402 ms) : 0, 98402
ProfilingAgent [candidate] (96.844 ms) : 0, 96844
Profiling [baseline] (98.426 ms) : 0, 98426
Profiling [candidate] (96.868 ms) : 0, 96868
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~8f5912837c, baseline=1.40.0-SNAPSHOT~201bcbe8ed
dateFormat X
axisFormat %s
section baseline
no_agent (1.34 ms) : 1320, 1359
. : milestone, 1340,
appsec (1.705 ms) : 1681, 1728
. : milestone, 1705,
appsec_no_iast (1.714 ms) : 1691, 1737
. : milestone, 1714,
iast (1.467 ms) : 1445, 1489
. : milestone, 1467,
profiling (1.503 ms) : 1477, 1528
. : milestone, 1503,
tracing (1.445 ms) : 1420, 1470
. : milestone, 1445,
section candidate
no_agent (1.33 ms) : 1310, 1349
. : milestone, 1330,
appsec (1.706 ms) : 1681, 1730
. : milestone, 1706,
appsec_no_iast (1.716 ms) : 1692, 1740
. : milestone, 1716,
iast (1.456 ms) : 1433, 1479
. : milestone, 1456,
profiling (1.52 ms) : 1496, 1545
. : milestone, 1520,
tracing (1.463 ms) : 1438, 1488
. : milestone, 1463,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~8f5912837c, baseline=1.40.0-SNAPSHOT~201bcbe8ed
dateFormat X
axisFormat %s
section baseline
no_agent (370.143 µs) : 349, 391
. : milestone, 370,
iast (487.194 µs) : 465, 509
. : milestone, 487,
iast_FULL (548.65 µs) : 527, 570
. : milestone, 549,
iast_GLOBAL (506.032 µs) : 485, 528
. : milestone, 506,
iast_HARDCODED_SECRET_DISABLED (476.175 µs) : 455, 497
. : milestone, 476,
iast_INACTIVE (442.694 µs) : 422, 463
. : milestone, 443,
iast_TELEMETRY_OFF (466.314 µs) : 444, 489
. : milestone, 466,
tracing (443.217 µs) : 422, 464
. : milestone, 443,
section candidate
no_agent (369.912 µs) : 351, 389
. : milestone, 370,
iast (489.063 µs) : 467, 511
. : milestone, 489,
iast_FULL (548.591 µs) : 527, 570
. : milestone, 549,
iast_GLOBAL (500.121 µs) : 479, 521
. : milestone, 500,
iast_HARDCODED_SECRET_DISABLED (477.863 µs) : 457, 499
. : milestone, 478,
iast_INACTIVE (452.764 µs) : 431, 474
. : milestone, 453,
iast_TELEMETRY_OFF (472.713 µs) : 451, 494
. : milestone, 473,
tracing (455.752 µs) : 435, 477
. : milestone, 456,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~8f5912837c, baseline=1.40.0-SNAPSHOT~201bcbe8ed
dateFormat X
axisFormat %s
section baseline
no_agent (15.737 s) : 15737000, 15737000
. : milestone, 15737000,
appsec (15.151 s) : 15151000, 15151000
. : milestone, 15151000,
iast (18.713 s) : 18713000, 18713000
. : milestone, 18713000,
iast_GLOBAL (18.058 s) : 18058000, 18058000
. : milestone, 18058000,
profiling (15.152 s) : 15152000, 15152000
. : milestone, 15152000,
tracing (15.096 s) : 15096000, 15096000
. : milestone, 15096000,
section candidate
no_agent (15.105 s) : 15105000, 15105000
. : milestone, 15105000,
appsec (15.095 s) : 15095000, 15095000
. : milestone, 15095000,
iast (19.213 s) : 19213000, 19213000
. : milestone, 19213000,
iast_GLOBAL (18.356 s) : 18356000, 18356000
. : milestone, 18356000,
profiling (15.773 s) : 15773000, 15773000
. : milestone, 15773000,
tracing (15.283 s) : 15283000, 15283000
. : milestone, 15283000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~8f5912837c, baseline=1.40.0-SNAPSHOT~201bcbe8ed
dateFormat X
axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
. : milestone, 1474,
appsec (2.325 ms) : 2284, 2366
. : milestone, 2325,
iast (2.065 ms) : 2015, 2115
. : milestone, 2065,
iast_GLOBAL (2.109 ms) : 2059, 2160
. : milestone, 2109,
profiling (1.924 ms) : 1883, 1964
. : milestone, 1924,
tracing (1.902 ms) : 1863, 1940
. : milestone, 1902,
section candidate
no_agent (1.467 ms) : 1455, 1478
. : milestone, 1467,
appsec (2.33 ms) : 2289, 2370
. : milestone, 2330,
iast (2.083 ms) : 2032, 2134
. : milestone, 2083,
iast_GLOBAL (2.111 ms) : 2060, 2162
. : milestone, 2111,
profiling (1.933 ms) : 1892, 1974
. : milestone, 1933,
tracing (1.908 ms) : 1870, 1946
. : milestone, 1908,
|
ygree
force-pushed
the
ygree/aws-payload-tagging
branch
from
July 12, 2024 19:09
c9a799d
to
1e180f3
Compare
vandonr
reviewed
Aug 21, 2024
vandonr
reviewed
Aug 22, 2024
...va-sdk-2.2/src/main/java/datadog/trace/instrumentation/aws/v2/ResponseBodyStreamWrapper.java
Outdated
Show resolved
Hide resolved
...va-sdk-2.2/src/main/java/datadog/trace/instrumentation/aws/v2/ResponseBodyStreamWrapper.java
Outdated
Show resolved
Hide resolved
ygree
force-pushed
the
ygree/aws-payload-tagging
branch
6 times, most recently
from
September 11, 2024 04:50
83f1bef
to
7252b43
Compare
dd-trace-core/src/main/java/datadog/trace/payloadtags/JsonToTags.java
Outdated
Show resolved
Hide resolved
ygree
force-pushed
the
ygree/aws-payload-tagging
branch
2 times, most recently
from
September 12, 2024 00:36
37eed2b
to
bdb7eaf
Compare
dd-trace-core/src/main/java/datadog/trace/payloadtags/json/JsonPath.java
Outdated
Show resolved
Hide resolved
dd-trace-core/src/main/java/datadog/trace/payloadtags/json/JsonPathParser.java
Outdated
Show resolved
Hide resolved
dd-trace-core/src/main/java/datadog/trace/payloadtags/json/JsonPath.java
Outdated
Show resolved
Hide resolved
dd-trace-core/src/main/java/datadog/trace/payloadtags/json/JsonPath.java
Outdated
Show resolved
Hide resolved
dd-trace-core/src/main/java/datadog/trace/payloadtags/JsonTagsCollector.java
Outdated
Show resolved
Hide resolved
…slf4j-api dependency in the agent
…PAYLOAD_TAGGING config settings
…ath to jsurfer-core
Remove all extra dependencies for JsonPath logic. Avoid Json materialization, traverse using event-based Moshi JsonReader.
ygree
force-pushed
the
ygree/aws-payload-tagging
branch
from
September 27, 2024 06:49
2b68631
to
84b04e2
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Adds functionality to capture AWS Json response/request payload and convert it to span tags while applying expansion and redaction defined rules.
Motivation
Having the ability to see data that was passed into an HTTPS payload from one service to the other.
Help customers (especially those who are using serverless architecture) reproduce and resolve bugs in their serverless compute code or configuration.
Additional Notes
Jira ticket: AIDM-174
NodeJS: DataDog/dd-trace-js#4309