-
Notifications
You must be signed in to change notification settings - Fork 285
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add support for new telemetry crash data format #7675
Merged
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
jbachorik
added
tag: no release notes
Changes to exclude from release notes
comp: crash tracking
Crash tracking
labels
Sep 24, 2024
...ent-crashtracking/src/main/java/com/datadog/crashtracking/parsers/HotspotCrashLogParser.java
Outdated
Show resolved
Hide resolved
...ent-crashtracking/src/main/java/com/datadog/crashtracking/parsers/HotspotCrashLogParser.java
Show resolved
Hide resolved
...ent-crashtracking/src/main/java/com/datadog/crashtracking/parsers/HotspotCrashLogParser.java
Outdated
Show resolved
Hide resolved
...ent-crashtracking/src/main/java/com/datadog/crashtracking/parsers/HotspotCrashLogParser.java
Show resolved
Hide resolved
jbachorik
force-pushed
the
jb/crash_tracking_dto
branch
2 times, most recently
from
September 24, 2024 13:11
8dd0cb5
to
9a279e7
Compare
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 2 performance regressions! Performance is the same for 49 metrics, 12 unstable metrics.
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~4933b3c399, baseline=1.40.0-SNAPSHOT~043adb202c
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1068825
Total [baseline] (8.518 s) : 0, 8517735
Agent [candidate] (1.065 s) : 0, 1064673
Total [candidate] (8.561 s) : 0, 8560573
section iast
Agent [baseline] (1.198 s) : 0, 1197611
Total [baseline] (9.069 s) : 0, 9068888
Agent [candidate] (1.196 s) : 0, 1195712
Total [candidate] (9.007 s) : 0, 9007013
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.192 s) : 0, 1192373
Total [baseline] (8.953 s) : 0, 8952645
Agent [candidate] (1.189 s) : 0, 1189480
Total [candidate] (8.973 s) : 0, 8973447
section iast_TELEMETRY_OFF
Agent [baseline] (1.184 s) : 0, 1184464
Total [baseline] (8.986 s) : 0, 8986050
Agent [candidate] (1.185 s) : 0, 1185321
Total [candidate] (9.011 s) : 0, 9010653
gantt
title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~4933b3c399, baseline=1.40.0-SNAPSHOT~043adb202c
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.514 ms) : 0, 682514
BytebuddyAgent [candidate] (679.215 ms) : 0, 679215
GlobalTracer [baseline] (310.651 ms) : 0, 310651
GlobalTracer [candidate] (310.117 ms) : 0, 310117
AppSec [baseline] (53.788 ms) : 0, 53788
AppSec [candidate] (53.559 ms) : 0, 53559
Remote Config [baseline] (665.029 µs) : 0, 665
Remote Config [candidate] (659.456 µs) : 0, 659
Telemetry [baseline] (7.586 ms) : 0, 7586
Telemetry [candidate] (7.512 ms) : 0, 7512
section iast
BytebuddyAgent [baseline] (797.604 ms) : 0, 797604
BytebuddyAgent [candidate] (796.444 ms) : 0, 796444
GlobalTracer [baseline] (299.762 ms) : 0, 299762
GlobalTracer [candidate] (299.74 ms) : 0, 299740
AppSec [baseline] (55.714 ms) : 0, 55714
AppSec [candidate] (55.326 ms) : 0, 55326
Remote Config [baseline] (629.292 µs) : 0, 629
Remote Config [candidate] (612.554 µs) : 0, 613
Telemetry [baseline] (7.116 ms) : 0, 7116
Telemetry [candidate] (7.286 ms) : 0, 7286
IAST [baseline] (23.097 ms) : 0, 23097
IAST [candidate] (22.614 ms) : 0, 22614
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (794.96 ms) : 0, 794960
BytebuddyAgent [candidate] (791.164 ms) : 0, 791164
GlobalTracer [baseline] (298.347 ms) : 0, 298347
GlobalTracer [candidate] (298.751 ms) : 0, 298751
AppSec [baseline] (54.421 ms) : 0, 54421
AppSec [candidate] (56.055 ms) : 0, 56055
Remote Config [baseline] (603.988 µs) : 0, 604
Remote Config [candidate] (602.49 µs) : 0, 602
Telemetry [baseline] (7.817 ms) : 0, 7817
Telemetry [candidate] (7.402 ms) : 0, 7402
IAST [baseline] (22.554 ms) : 0, 22554
IAST [candidate] (21.899 ms) : 0, 21899
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (787.001 ms) : 0, 787001
BytebuddyAgent [candidate] (787.735 ms) : 0, 787735
GlobalTracer [baseline] (298.497 ms) : 0, 298497
GlobalTracer [candidate] (298.674 ms) : 0, 298674
AppSec [baseline] (57.41 ms) : 0, 57410
AppSec [candidate] (55.408 ms) : 0, 55408
Remote Config [baseline] (601.161 µs) : 0, 601
Remote Config [candidate] (594.92 µs) : 0, 595
Telemetry [baseline] (6.862 ms) : 0, 6862
Telemetry [candidate] (7.149 ms) : 0, 7149
IAST [baseline] (20.489 ms) : 0, 20489
IAST [candidate] (22.123 ms) : 0, 22123
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~4933b3c399, baseline=1.40.0-SNAPSHOT~043adb202c
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1063073
Total [baseline] (10.325 s) : 0, 10325467
Agent [candidate] (1.062 s) : 0, 1061733
Total [candidate] (10.409 s) : 0, 10408989
section appsec
Agent [baseline] (1.202 s) : 0, 1201909
Total [baseline] (10.582 s) : 0, 10581557
Agent [candidate] (1.197 s) : 0, 1196891
Total [candidate] (10.679 s) : 0, 10679148
section iast
Agent [baseline] (1.189 s) : 0, 1189176
Total [baseline] (10.845 s) : 0, 10845282
Agent [candidate] (1.199 s) : 0, 1198807
Total [candidate] (10.855 s) : 0, 10855030
section profiling
Agent [baseline] (1.273 s) : 0, 1273467
Total [baseline] (10.607 s) : 0, 10607361
Agent [candidate] (1.271 s) : 0, 1271331
Total [candidate] (10.591 s) : 0, 10590999
gantt
title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~4933b3c399, baseline=1.40.0-SNAPSHOT~043adb202c
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (678.748 ms) : 0, 678748
BytebuddyAgent [candidate] (677.24 ms) : 0, 677240
GlobalTracer [baseline] (309.191 ms) : 0, 309191
GlobalTracer [candidate] (309.319 ms) : 0, 309319
AppSec [baseline] (53.362 ms) : 0, 53362
AppSec [candidate] (53.446 ms) : 0, 53446
Remote Config [baseline] (657.643 µs) : 0, 658
Remote Config [candidate] (658.024 µs) : 0, 658
Telemetry [baseline] (7.542 ms) : 0, 7542
Telemetry [candidate] (7.512 ms) : 0, 7512
section appsec
BytebuddyAgent [baseline] (702.155 ms) : 0, 702155
BytebuddyAgent [candidate] (700.304 ms) : 0, 700304
GlobalTracer [baseline] (303.641 ms) : 0, 303641
GlobalTracer [candidate] (302.237 ms) : 0, 302237
AppSec [baseline] (162.741 ms) : 0, 162741
AppSec [candidate] (161.361 ms) : 0, 161361
Remote Config [baseline] (644.632 µs) : 0, 645
Remote Config [candidate] (640.34 µs) : 0, 640
Telemetry [baseline] (8.428 ms) : 0, 8428
Telemetry [candidate] (9.538 ms) : 0, 9538
IAST [baseline] (21.362 ms) : 0, 21362
IAST [candidate] (18.531 ms) : 0, 18531
section iast
BytebuddyAgent [baseline] (791.903 ms) : 0, 791903
BytebuddyAgent [candidate] (798.416 ms) : 0, 798416
GlobalTracer [baseline] (298.394 ms) : 0, 298394
GlobalTracer [candidate] (300.323 ms) : 0, 300323
AppSec [baseline] (54.257 ms) : 0, 54257
AppSec [candidate] (55.169 ms) : 0, 55169
Remote Config [baseline] (583.498 µs) : 0, 583
Remote Config [candidate] (634.013 µs) : 0, 634
Telemetry [baseline] (6.963 ms) : 0, 6963
Telemetry [candidate] (7.453 ms) : 0, 7453
IAST [baseline] (23.436 ms) : 0, 23436
IAST [candidate] (23.127 ms) : 0, 23127
section profiling
BytebuddyAgent [baseline] (678.117 ms) : 0, 678117
BytebuddyAgent [candidate] (677.689 ms) : 0, 677689
GlobalTracer [baseline] (396.007 ms) : 0, 396007
GlobalTracer [candidate] (395.875 ms) : 0, 395875
AppSec [baseline] (55.075 ms) : 0, 55075
AppSec [candidate] (54.641 ms) : 0, 54641
Remote Config [baseline] (656.828 µs) : 0, 657
Remote Config [candidate] (674.221 µs) : 0, 674
Telemetry [baseline] (7.509 ms) : 0, 7509
Telemetry [candidate] (7.495 ms) : 0, 7495
ProfilingAgent [baseline] (97.326 ms) : 0, 97326
ProfilingAgent [candidate] (96.694 ms) : 0, 96694
Profiling [baseline] (97.351 ms) : 0, 97351
Profiling [candidate] (96.718 ms) : 0, 96718
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics. Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~4933b3c399, baseline=1.40.0-SNAPSHOT~043adb202c
dateFormat X
axisFormat %s
section baseline
no_agent (369.295 µs) : 350, 389
. : milestone, 369,
iast (487.421 µs) : 466, 509
. : milestone, 487,
iast_FULL (550.685 µs) : 530, 572
. : milestone, 551,
iast_GLOBAL (505.036 µs) : 483, 527
. : milestone, 505,
iast_HARDCODED_SECRET_DISABLED (482.293 µs) : 461, 503
. : milestone, 482,
iast_INACTIVE (448.768 µs) : 427, 470
. : milestone, 449,
iast_TELEMETRY_OFF (472.7 µs) : 450, 495
. : milestone, 473,
tracing (443.705 µs) : 423, 464
. : milestone, 444,
section candidate
no_agent (368.636 µs) : 349, 389
. : milestone, 369,
iast (482.904 µs) : 461, 505
. : milestone, 483,
iast_FULL (549.585 µs) : 528, 571
. : milestone, 550,
iast_GLOBAL (509.639 µs) : 487, 532
. : milestone, 510,
iast_HARDCODED_SECRET_DISABLED (482.947 µs) : 461, 504
. : milestone, 483,
iast_INACTIVE (454.369 µs) : 432, 476
. : milestone, 454,
iast_TELEMETRY_OFF (475.796 µs) : 453, 499
. : milestone, 476,
tracing (447.269 µs) : 425, 469
. : milestone, 447,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~4933b3c399, baseline=1.40.0-SNAPSHOT~043adb202c
dateFormat X
axisFormat %s
section baseline
no_agent (1.34 ms) : 1321, 1359
. : milestone, 1340,
appsec (1.727 ms) : 1702, 1751
. : milestone, 1727,
appsec_no_iast (1.736 ms) : 1712, 1759
. : milestone, 1736,
iast (1.461 ms) : 1439, 1484
. : milestone, 1461,
profiling (1.5 ms) : 1474, 1525
. : milestone, 1500,
tracing (1.468 ms) : 1444, 1492
. : milestone, 1468,
section candidate
no_agent (1.34 ms) : 1320, 1360
. : milestone, 1340,
appsec (1.716 ms) : 1692, 1739
. : milestone, 1716,
appsec_no_iast (1.722 ms) : 1697, 1747
. : milestone, 1722,
iast (1.471 ms) : 1449, 1494
. : milestone, 1471,
profiling (1.472 ms) : 1450, 1495
. : milestone, 1472,
tracing (1.467 ms) : 1443, 1491
. : milestone, 1467,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~4933b3c399, baseline=1.40.0-SNAPSHOT~043adb202c
dateFormat X
axisFormat %s
section baseline
no_agent (14.983 s) : 14983000, 14983000
. : milestone, 14983000,
appsec (15.135 s) : 15135000, 15135000
. : milestone, 15135000,
iast (18.618 s) : 18618000, 18618000
. : milestone, 18618000,
iast_GLOBAL (18.053 s) : 18053000, 18053000
. : milestone, 18053000,
profiling (15.38 s) : 15380000, 15380000
. : milestone, 15380000,
tracing (15.022 s) : 15022000, 15022000
. : milestone, 15022000,
section candidate
no_agent (15.8 s) : 15800000, 15800000
. : milestone, 15800000,
appsec (15.274 s) : 15274000, 15274000
. : milestone, 15274000,
iast (18.877 s) : 18877000, 18877000
. : milestone, 18877000,
iast_GLOBAL (17.797 s) : 17797000, 17797000
. : milestone, 17797000,
profiling (15.814 s) : 15814000, 15814000
. : milestone, 15814000,
tracing (14.946 s) : 14946000, 14946000
. : milestone, 14946000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~4933b3c399, baseline=1.40.0-SNAPSHOT~043adb202c
dateFormat X
axisFormat %s
section baseline
no_agent (1.468 ms) : 1457, 1480
. : milestone, 1468,
appsec (2.334 ms) : 2292, 2375
. : milestone, 2334,
iast (2.077 ms) : 2026, 2129
. : milestone, 2077,
iast_GLOBAL (2.11 ms) : 2059, 2162
. : milestone, 2110,
profiling (1.943 ms) : 1903, 1984
. : milestone, 1943,
tracing (1.91 ms) : 1872, 1948
. : milestone, 1910,
section candidate
no_agent (1.475 ms) : 1463, 1487
. : milestone, 1475,
appsec (2.323 ms) : 2283, 2364
. : milestone, 2323,
iast (2.071 ms) : 2021, 2122
. : milestone, 2071,
iast_GLOBAL (2.117 ms) : 2065, 2168
. : milestone, 2117,
profiling (1.936 ms) : 1896, 1976
. : milestone, 1936,
tracing (1.909 ms) : 1870, 1947
. : milestone, 1909,
|
jbachorik
force-pushed
the
jb/crash_tracking_dto
branch
from
September 24, 2024 14:13
9a279e7
to
d7d161f
Compare
dd-java-agent/agent-crashtracking/src/main/java/com/datadog/crashtracking/dto/Metadata.java
Outdated
Show resolved
Hide resolved
dd-java-agent/agent-crashtracking/src/main/java/com/datadog/crashtracking/dto/ProcInfo.java
Outdated
Show resolved
Hide resolved
dd-java-agent/agent-crashtracking/src/main/java/com/datadog/crashtracking/dto/StackFrame.java
Outdated
Show resolved
Hide resolved
dd-java-agent/agent-crashtracking/src/main/java/com/datadog/crashtracking/dto/Metadata.java
Outdated
Show resolved
Hide resolved
dd-java-agent/agent-crashtracking/src/main/java/com/datadog/crashtracking/dto/StackTrace.java
Outdated
Show resolved
Hide resolved
...a-agent/agent-crashtracking/src/main/java/com/datadog/crashtracking/dto/SemanticVersion.java
Outdated
Show resolved
Hide resolved
dd-java-agent/agent-crashtracking/src/main/java/com/datadog/crashtracking/dto/ProcInfo.java
Outdated
Show resolved
Hide resolved
dd-java-agent/agent-crashtracking/src/main/java/com/datadog/crashtracking/dto/OSInfo.java
Outdated
Show resolved
Hide resolved
dd-java-agent/agent-crashtracking/src/main/java/com/datadog/crashtracking/dto/OSInfo.java
Outdated
Show resolved
Hide resolved
dd-java-agent/agent-crashtracking/src/main/java/com/datadog/crashtracking/dto/StackFrame.java
Outdated
Show resolved
Hide resolved
jbachorik
force-pushed
the
jb/crash_tracking_dto
branch
3 times, most recently
from
September 25, 2024 08:38
bd9008c
to
f7c0c06
Compare
MattAlp
approved these changes
Sep 25, 2024
...crashtracking/src/test/java/com/datadog/crashtracking/parsers/HotspotCrashLogParserTest.java
Outdated
Show resolved
Hide resolved
dd-java-agent/agent-crashtracking/src/main/java/com/datadog/crashtracking/dto/StackFrame.java
Show resolved
Hide resolved
jbachorik
force-pushed
the
jb/crash_tracking_dto
branch
3 times, most recently
from
September 25, 2024 13:46
00acca5
to
af565a2
Compare
jbachorik
force-pushed
the
jb/crash_tracking_dto
branch
from
September 25, 2024 14:02
af565a2
to
4933b3c
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
This adds support for the new telemetry crash upload format.
Motivation
Without the new telemetry format the data is not properly linked with the crash-tracking product.
Additional Notes
Currently we support only Hotspot crash file format.
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: PROF-10562