Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Backport 2.9] Backport #1302, #1355, #1432, #1435, #1445, #1403, #1430, #1441 to 2.9 #1469

Merged
merged 12 commits into from
Mar 14, 2024

Commits on Mar 14, 2024

  1. optimize doc-level monitor execution workflow for datastreams (opense…

    …arch-project#1302)
    
    * optimize doc-level monitor execution for datastreams
    
    Signed-off-by: Subhobrata Dey <[email protected]>
    
    * add more tests to address comments
    
    Signed-off-by: Subhobrata Dey <[email protected]>
    
    * add integTest for multiple datastreams inside a single index pattern
    
    * add integTest for multiple datastreams inside a single index pattern
    
    Signed-off-by: Subhobrata Dey <[email protected]>
    
    ---------
    
    Signed-off-by: Subhobrata Dey <[email protected]>
    sbcd90 authored and eirsep committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    6a41aed View commit details
    Browse the repository at this point in the history
  2. Bulk index findings and sequentially invoke auto-correlations (opense…

    …arch-project#1355)
    
    * Bulk index findings and sequentially invoke auto-correlations
    
    Signed-off-by: Megha Goyal <[email protected]>
    
    * Bulk index findings in batches of 10000 and make it configurable
    
    Signed-off-by: Megha Goyal <[email protected]>
    
    * Addressing review comments
    
    Signed-off-by: Megha Goyal <[email protected]>
    
    * Add integ tests to test bulk index findings
    
    Signed-off-by: Megha Goyal <[email protected]>
    
    * Fix ktlint formatting
    
    Signed-off-by: Megha Goyal <[email protected]>
    
    ---------
    
    Signed-off-by: Megha Goyal <[email protected]>
    goyamegh authored and eirsep committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    b69bb56 View commit details
    Browse the repository at this point in the history
  3. fix for MapperException[the [enabled] parameter can't be updated for …

    …the object mapping [metadata.source_to_query_index_mapping] (opensearch-project#1432) (opensearch-project#1434)
    
    Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
    opensearch-trigger-bot[bot] authored and eirsep committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    c1e2316 View commit details
    Browse the repository at this point in the history
  4. Add jvm aware setting and max num docs settings for batching docs for…

    … percolate queries (opensearch-project#1435)
    
    * add jvm aware and max docs settings for batching docs for percolate queries
    
    Signed-off-by: Surya Sashank Nistala <[email protected]>
    
    * fix stats logging
    
    Signed-off-by: Surya Sashank Nistala <[email protected]>
    
    * add queryfieldnames field in findings mapping
    
    Signed-off-by: Surya Sashank Nistala <[email protected]>
    
    ---------
    
    Signed-off-by: Surya Sashank Nistala <[email protected]>
    eirsep committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    9ece656 View commit details
    Browse the repository at this point in the history
  5. clean up doc level queries on dry run (opensearch-project#1430)

    Signed-off-by: Joanne Wang <[email protected]>
    jowg-amazon authored and eirsep committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    e23dd95 View commit details
    Browse the repository at this point in the history
  6. optimize to fetch only fields relevant to doc level queries in doc le…

    …vel monitor instead of entire _source for each doc (opensearch-project#1441)
    
    * optimize to fetch only fields relevant to doc level queries in doc level monitor
    
    Signed-off-by: Surya Sashank Nistala <[email protected]>
    
    * fix test for settings check
    
    Signed-off-by: Surya Sashank Nistala <[email protected]>
    
    * fix ktlint
    
    Signed-off-by: Surya Sashank Nistala <[email protected]>
    
    ---------
    
    Signed-off-by: Surya Sashank Nistala <[email protected]>
    eirsep committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    2e16049 View commit details
    Browse the repository at this point in the history
  7. optimize sequence number calculation and reduce search requests in do…

    …c level monitor execution (opensearch-project#1445)
    
    * optimize sequence number calculation and reduce search requests by n where n is number of shards being queried in the executino
    
    Signed-off-by: Surya Sashank Nistala <[email protected]>
    
    * fix tests
    
    Signed-off-by: Surya Sashank Nistala <[email protected]>
    
    * optimize check indices and execute to query only write index of aliases and datastreams during monitor creation
    
    Signed-off-by: Surya Sashank Nistala <[email protected]>
    
    * fix test
    
    Signed-off-by: Surya Sashank Nistala <[email protected]>
    
    * add javadoc
    
    Signed-off-by: Surya Sashank Nistala <[email protected]>
    
    * add tests to verify seq_no calculation
    
    Signed-off-by: Surya Sashank Nistala <[email protected]>
    
    ---------
    
    Signed-off-by: Surya Sashank Nistala <[email protected]>
    eirsep committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    48eb050 View commit details
    Browse the repository at this point in the history
  8. add distributed locking to jobs in alerting (opensearch-project#1403)

    Signed-off-by: Subhobrata Dey <[email protected]>
    sbcd90 authored and eirsep committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    78955a6 View commit details
    Browse the repository at this point in the history
  9. 2.9.1 version bump

    Signed-off-by: Surya Sashank Nistala <[email protected]>
    eirsep committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    7d1096e View commit details
    Browse the repository at this point in the history
  10. fix compilation issues

    Signed-off-by: Surya Sashank Nistala <[email protected]>
    eirsep committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    e535ade View commit details
    Browse the repository at this point in the history
  11. dummy commit

    Signed-off-by: Surya Sashank Nistala <[email protected]>
    eirsep committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    b5b9e34 View commit details
    Browse the repository at this point in the history
  12. fix findings index schema version tsts

    Signed-off-by: Surya Sashank Nistala <[email protected]>
    eirsep committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    e74b166 View commit details
    Browse the repository at this point in the history