do not review #32476

tvalentyn · 2024-09-16T20:10:17Z

Please add a meaningful description for your change here

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
Update CHANGES.md with noteworthy changes.
If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

…As a result an input has multiple windows. So we need to consider that the accumulator can have multiple windows

… with sliding windows

…tions, set testMode to true. Some renaming

…neWithSlidingWindows

…tors, because this method modifies its first input accumulator. Decrease memory usage by storing only accumulator and timestamp in the combine.merge map

…merged to a window before combining

…oduction mode

…ected results

… using LOOPBACK execution mode

…lidatesRunner" task

… the window and not merge all the timestamps before combine

…ersion-plugin (#10154) * [BEAM-8729] Gracefully skip irrelevant lines from gradle-version-plugin * Fixed typo

…10146) * Add timestamp proto conversion for Python revert changes revert changes * add tests * lint * copy work for durations * lint

…rference with dependency check

…status in beam_Dependency_Check

…nfirm

…10102)

… release branch

The Maven artifact org.apache.beam:beam-sdks-java-core, which contains org.apache.beam.sdk.schemas.FieldValueTypeInformation, should declare the dependency to com.google.code.findbugs:jsr305. The class needs Nullable class at runtime.

…ncy declaration for Nullable class (#10324)

…signed certificates by default in ElasticsearchIO

…nsions/sql to declare used-but-undeclared dependencies

…nk job server container images

…ector command result type issue (#10282)

… rows to batching/sorting stages.

… beam-sdks-java-core does not have JSR305 specified as "compile"

…t logger as before.

…ort (#10387) * [BEAM-8944] Change to single thread executor in python sdk bundle progress report (cherry picked from commit 794e58d)

… py sdk bundle progress rep…

…ersion

…g equals

…functions

…emaCoder equals should not rely on from/toRowFunction equality

…n on process continuations. This is a forward fix for #10258 to fix Dataflow VR postcommit suite.

…Id returns wrong directoryName bugfix

…rectoryName bugfix"

…ResourceId returns wrong directoryName bugfix"

echauchot and others added 30 commits November 19, 2019 09:39

[BEAM-8470] Fix combiner. Do not reuse instance of accumulator

803bb0b

[BEAM-8470] input windows can arrive exploded (for sliding windows). …

a4c4ee7

…As a result an input has multiple windows. So we need to consider that the accumulator can have multiple windows

[BEAM-8470] Add a combine test with sliding windows

ea47c71

[BEAM-8470] Add a test to test combine translation on binaryCombineFn…

89eb1f0

… with sliding windows

[BEAM-8470] Fix tests: use correct SparkStructuredStreamingPipelineOp…

4416a2e

…tions, set testMode to true. Some renaming

[BEAM-8470] Fix wrong expected results in CombineTest.testBinaryCombi…

b980cf9

…neWithSlidingWindows

[BEAM-8470] Add disclaimers about this runner being experimental

22d98df

[BEAM-8470] Fix: create an empty accumulator in combine.mergeAccumula…

d680252

…tors, because this method modifies its first input accumulator. Decrease memory usage by storing only accumulator and timestamp in the combine.merge map

[BEAM-8470] Apply spotless

9922bcb

[BEAM-8470] Add a countPerElement test with sliding windows

a0872bc

[BEAM-8470] Fix the output timestamps of combine: timestamps must be …

c9ce072

…merged to a window before combining

[BEAM-8470] set log level to info to avoid resource consumption in pr…

f516554

…oduction mode

[BEAM-8470] Fix CombineTest.testCountPerElementWithSlidingWindows exp…

27dcc48

…ected results

Merge pull request #10128: [BEAM-8672] Keep Python process alive when…

860e46f

… using LOOPBACK execution mode

[BEAM-8470] Remove "validatesStructuredStreamingRunnerBatch" from "va…

f5cfbc1

…lidatesRunner" task

[BEAM-8470] Fix timestamps in combine output: assign the timestamp to…

ac3132c

… the window and not merge all the timestamps before combine

Fix inverted timeout check in TestPubsub

7a2e1d7

[BEAM-8737] Incorporate TRIAGE NEEDED status

53653d8

Handle None object returned from jira_manager.run

5d924e7

Add empty check before acknowledge

2d3311b

[BEAM-8729] Gracefully skip irrelevant http/https lines from gradle-v…

7da5071

…ersion-plugin (#10154) * [BEAM-8729] Gracefully skip irrelevant lines from gradle-version-plugin * Fixed typo

[BEAM-8335] Add timestamp and duration to/from protos to Python SDK (#…

0a9410e

…10146) * Add timestamp proto conversion for Python revert changes revert changes * add tests * lint * copy work for durations * lint

Merge pull request #10127 [BEAM-8654] Fixes resolutionStrategy's inte…

acf62a3

…rference with dependency check

Merge pull request #10155 from [BEAM-8737] Incorporate TRIAGE NEEDED …

018172c

…status in beam_Dependency_Check

empty commit

9aced3a

[BEAM-7473] Pack RangeTracker into restriction (#10118)

c240f06

Revert empty line

2a8570b

Merge remote-tracking branch 'origin/master' into dependency_check_co…

29b352f

…nfirm

Fixed typo

7e83e38

[BEAM-8575] Test flatten a single PC and test flatten a flattened PC (#…

eb81905

…10102)

suztomo and others added 30 commits December 11, 2019 14:50

Commons_lang3 and jackson_databind dependency

96b3ee0

BEAM-8861 - Disallow self-signed certs by default

dbd4265

Merge pull request #10320: [BEAM-8835] Cherry-pick #10308 onto 2.18.0…

ddca000

… release branch

Merge pull request #10371: [release-2.18.0][BEAM-8917] jsr305 depende…

4b1bfc5

…ncy declaration for Nullable class (#10324)

Merge pull request #10353: [release-2.18.0][BEAM-8861] Disallow self-…

e657f18

…signed certificates by default in ElasticsearchIO

Merge pull request #10352: [release-2.18.0][BEAM-8858] sdks/java/exte…

43fe9d7

…nsions/sql to declare used-but-undeclared dependencies

Merge pull request #10335: Cherry-pick #10272 [BEAM-8337] publish Fli…

5f94672

…nk job server container images

Merge pull request #10298: Cherry-pick [BEAM-8884] Fix mongodb splitV…

f44f334

…ector command result type issue (#10282)

Merge pull request #10330: [BEAM-8882] Cherry pick #10283 and #10292

759c078

Declare JSR305 dependency as 'shadow'

2a2d291

Merge pull request #10380: [BEAM-8825] Add limit on number of mutated…

712ccb0

… rows to batching/sorting stages.

Merge pull request #10385: [release-2.18.0][BEAM-8967] Maven artifact…

df46eb2

… beam-sdks-java-core does not have JSR305 specified as "compile"

Setting all logging on the root logger as before.

b870d97

Making logger in filesystems.py root logger.

647bf40

Merge pull request #10416: [BEAM-8976] Setting all logging on the roo…

0658bc6

…t logger as before.

[BEAM-8944] Change to use single thread in py sdk bundle progress rep…

1edcc10

…ort (#10387) * [BEAM-8944] Change to single thread executor in python sdk bundle progress report (cherry picked from commit 794e58d)

Merge pull request #10430: [BEAM-8944] Change to use single thread in…

feacdaf

… py sdk bundle progress rep…

[BEAM-9041] Add missing equals methods for GenericRecord <-> Row conv…

36862f7

…ersion

[BEAM-9042] Fix RowToGenericRecordFn Avro schema serialization

6db2b7f

[BEAM-9042] Update SchemaCoder doc with info about functions requirin…

3381d89

…g equals

[BEAM-9042] Test serializability and equality of Row<->GenericRecord …

43ce943

…functions

Merge pull request #10526: [release-2.18.0][BEAM-9041, BEAM-9042] Sch…

18e80b3

…emaCoder equals should not rely on from/toRowFunction equality

[BEAM-4287] Fix to use the residual instead of the current restrictio…

9e58be1

…n on process continuations. This is a forward fix for #10258 to fix Dataflow VR postcommit suite.

[Gradle Release Plugin] - pre tag commit: 'v2.18.0-RC1'.

6887a3f

[Gradle Release Plugin] - new version commit: 'v2.18.0-SNAPSHOT'.

dba0c68

[BEAM-9123] HadoopResourceId returns wrong directoryName bugfix

a61dfbf

Merge pull request #10625: [release-2.18.0][BEAM-9123] HadoopResource…

b813ed9

…Id returns wrong directoryName bugfix

Revert "[release-2.18.0][BEAM-9123] HadoopResourceId returns wrong di…

79ed0b6

…rectoryName bugfix"

Merge pull request #10658: Revert "[release-2.18.0][BEAM-9123] Hadoop…

40d2e7c

…ResourceId returns wrong directoryName bugfix"

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

do not review #32476

do not review #32476

tvalentyn commented Sep 16, 2024

do not review #32476

Are you sure you want to change the base?

do not review #32476

Conversation

tvalentyn commented Sep 16, 2024

GitHub Actions Tests Status (on master branch)