{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":463727703,"defaultBranch":"main","name":"flink-bigquery-connector","ownerLogin":"GoogleCloudDataproc","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2022-02-26T01:57:36.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/59933973?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1723028586.0","currentOid":""},"activityList":{"items":[{"before":"c23ec8b254157e1004d8676a1a78b36ecb38c6ac","after":"6a40c09a8f811f93cbc5362513fc0519468b89f8","ref":"refs/heads/main","pushedAt":"2024-09-20T09:02:38.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jayehwhyehentee","name":"Jayant Jain","path":"/jayehwhyehentee","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/141257304?s=80&v=4"},"commit":{"message":"Buffered writer for exactly once sink (#156)\n\nCreate writer used by exactly once sink, following the two-phase commit\r\nprotocol. This writer uses BQ's buffered stream for appending data to\r\nthe table.","shortMessageHtmlLink":"Buffered writer for exactly once sink (#156)"}},{"before":"83226c55015497bf2ad48971659c27d60f146c69","after":"c23ec8b254157e1004d8676a1a78b36ecb38c6ac","ref":"refs/heads/main","pushedAt":"2024-09-17T20:06:38.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jayehwhyehentee","name":"Jayant Jain","path":"/jayehwhyehentee","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/141257304?s=80&v=4"},"commit":{"message":"BQ write client for exactly once (#152)\n\nClient definition for the BigQuery storage write APIs for connector's\r\nexactly once sink.","shortMessageHtmlLink":"BQ write client for exactly once (#152)"}},{"before":"730acd9b1fb9c4f17dfeb85ce17ec0bf44f27890","after":"83226c55015497bf2ad48971659c27d60f146c69","ref":"refs/heads/main","pushedAt":"2024-09-13T17:22:42.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jayehwhyehentee","name":"Jayant Jain","path":"/jayehwhyehentee","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/141257304?s=80&v=4"},"commit":{"message":"Add signatures for exactly once sink (#151)\n\nInterfaces and classes that define the structure of exactly-once sink\r\nfeature.","shortMessageHtmlLink":"Add signatures for exactly once sink (#151)"}},{"before":"197560969f8dd4a7e37c80a1ff4b2b5998cd854e","after":"730acd9b1fb9c4f17dfeb85ce17ec0bf44f27890","ref":"refs/heads/main","pushedAt":"2024-08-14T10:31:02.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jayehwhyehentee","name":"Jayant Jain","path":"/jayehwhyehentee","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/141257304?s=80&v=4"},"commit":{"message":"fix: BQ partition utils intervals (#146)\n\nAn issue with the query restriction generated by the connector when running in unbounded mode.\r\n\r\nThe BETWEEN operator is inclusive: begin and end values are included.\r\nthis causes the source connector to read some of the data twice.","shortMessageHtmlLink":"fix: BQ partition utils intervals (#146)"}},{"before":"197560969f8dd4a7e37c80a1ff4b2b5998cd854e","after":null,"ref":"refs/heads/release-0.3.0","pushedAt":"2024-08-07T11:03:06.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dataproc-robot","name":null,"path":"/dataproc-robot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/97008022?s=80&v=4"}},{"before":"1d5527999bb659ee2e18edea6eaf646156206b6e","after":"197560969f8dd4a7e37c80a1ff4b2b5998cd854e","ref":"refs/heads/main","pushedAt":"2024-08-07T11:03:03.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"jayehwhyehentee","name":"Jayant Jain","path":"/jayehwhyehentee","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/141257304?s=80&v=4"},"commit":{"message":"Development commit after release 0.3.0.","shortMessageHtmlLink":"Development commit after release 0.3.0."}},{"before":null,"after":"197560969f8dd4a7e37c80a1ff4b2b5998cd854e","ref":"refs/heads/release-0.3.0","pushedAt":"2024-08-07T08:19:15.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dataproc-robot","name":null,"path":"/dataproc-robot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/97008022?s=80&v=4"},"commit":{"message":"Development commit after release 0.3.0.","shortMessageHtmlLink":"Development commit after release 0.3.0."}},{"before":null,"after":"1d5527999bb659ee2e18edea6eaf646156206b6e","ref":"refs/heads/e2e-test","pushedAt":"2024-08-07T07:05:38.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"jayehwhyehentee","name":"Jayant Jain","path":"/jayehwhyehentee","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/141257304?s=80&v=4"},"commit":{"message":"Update changes md for next release (#145)\n\nChanges.md for release notes","shortMessageHtmlLink":"Update changes md for next release (#145)"}},{"before":"ef5cb0ea7bec41fdc93bca8a4f47e298c5823aea","after":"1d5527999bb659ee2e18edea6eaf646156206b6e","ref":"refs/heads/main","pushedAt":"2024-08-07T06:57:18.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jayehwhyehentee","name":"Jayant Jain","path":"/jayehwhyehentee","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/141257304?s=80&v=4"},"commit":{"message":"Update changes md for next release (#145)\n\nChanges.md for release notes","shortMessageHtmlLink":"Update changes md for next release (#145)"}},{"before":"46a8ae055ed0f942cd7819eb39cfe07d48fe9c69","after":"ef5cb0ea7bec41fdc93bca8a4f47e298c5823aea","ref":"refs/heads/main","pushedAt":"2024-08-02T05:22:37.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"prashastia","name":"Prashasti Agarwal","path":"/prashastia","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/144427971?s=80&v=4"},"commit":{"message":"Adds Integration tests for Table API Implementation. (#141)\n\nNote: Merge only after parameters of the cloudbuild trigger have been\r\nmodified according to [this\r\ntrigger](https://pantheon.corp.google.com/cloud-build/triggers;region=global/edit/ab3088bb-8e6d-4204-a5ba-78b0019a4740?inv=1&invt=AbWwOw&project=testproject-398714).\r\n* Modifies `BigQueryIntegegrationTest.java` - add additional parameter\r\n`is-sql` which when set to `True` would execute Flink's Table API\r\nmethods such as `.select($(*))` to read the BigQuery Table and\r\n`.insertInto().execute()` to sink records to bigquery table.\r\n* Corresponding changes in `cloudbuild.yaml`, `nightly.sh` file to add\r\nnecessary steps:\r\n* Creation of a new cluster to run the unbounded table api test and\r\naddition of a step to run the job.\r\n* Addition of a new step to run the bounded table api testing job to the\r\nbounded-readwrite cluster.\r\n\r\nEDIT - Parameters modified.\r\n\r\n /gcbrun","shortMessageHtmlLink":"Adds Integration tests for Table API Implementation. (#141)"}},{"before":"a58e3bb719d65992ad048ac03dd381f9311e4386","after":"46a8ae055ed0f942cd7819eb39cfe07d48fe9c69","ref":"refs/heads/main","pushedAt":"2024-07-31T11:40:29.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"prashastia","name":"Prashasti Agarwal","path":"/prashastia","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/144427971?s=80&v=4"},"commit":{"message":"Documentation changes for 0.3.0 (#142)\n\n* Modified Readme\r\n* Added BigQueryTableExample\r\n* Successful\r\n[Cloudbuild](https://pantheon.corp.google.com/cloud-build/builds;region=global/f0cca6af-10ed-49f2-a774-8e6eb0bfa2c9;step=12?inv=1&invt=AbXrnQ&project=testproject-398714)\r\n[Edit]\r\nMerge PR #144 before reviewing and merging this PR.\r\n\r\n/gcbrun\r\n\r\n---------\r\n\r\nCo-authored-by: Jayant Jain ","shortMessageHtmlLink":"Documentation changes for 0.3.0 (#142)"}},{"before":"005be9a6a6366de93fa66bf99894f9322b3eda7b","after":"a58e3bb719d65992ad048ac03dd381f9311e4386","ref":"refs/heads/main","pushedAt":"2024-07-31T09:37:51.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"prashastia","name":"Prashasti Agarwal","path":"/prashastia","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/144427971?s=80&v=4"},"commit":{"message":"Adds more config options to the connector. (#144)\n\n* `sinkParallelism` - Integer value indicating the parallelism of the\r\nsink job\r\n\r\n/gcbrun\r\n\r\n---------\r\n\r\nCo-authored-by: Jayant Jain ","shortMessageHtmlLink":"Adds more config options to the connector. (#144)"}},{"before":"3d12acbad422b4b12d902b34354a0a400098126a","after":"005be9a6a6366de93fa66bf99894f9322b3eda7b","ref":"refs/heads/main","pushedAt":"2024-07-25T07:36:32.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"prashastia","name":"Prashasti Agarwal","path":"/prashastia","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/144427971?s=80&v=4"},"commit":{"message":"Implementation for `BigQueryDynamicSink` and `BigQueryDynamicSinkFactory` (#137)\n\n/gcbrun\r\n\r\n---------\r\n\r\nCo-authored-by: Jayant Jain ","shortMessageHtmlLink":"Implementation for BigQueryDynamicSink and `BigQueryDynamicSinkFact…"}},{"before":"ca107bb4765b62353e3a3361b5ffcf7127dc8b9e","after":"3d12acbad422b4b12d902b34354a0a400098126a","ref":"refs/heads/main","pushedAt":"2024-07-15T06:00:43.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"prashastia","name":"Prashasti Agarwal","path":"/prashastia","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/144427971?s=80&v=4"},"commit":{"message":"Table API Implementation: `BigQuerySinkTableConfig` and `BigQueryConnectorOptions` (#132)\n\n1. Adds DELIVERY_GUARANTEE in BigQueryConnectorOptions\r\n2. Adds builder to BigQuerySinkTableConfig\r\n3. Enables formation of BigQuerySinkTableConfig from\r\nBigQueryConnectorOptions\r\n4. Adds unbounded read mode to BigQueryDynamicTableSource\r\nand tests for the above...\r\n\r\nThe table Configuration for Read. \r\n```\r\nBigQueryTableConfig readTableConfig =\r\n BigQueryReadTableConfig.newBuilder()\r\n .table(sourceTableName)\r\n .project(sourceGcpProjectName)\r\n .dataset(sourceDatasetName)\r\n .testMode(false)\r\n .partitionDiscoveryInterval(partitionDiscoveryInterval)\r\n .boundedness(Boundedness.CONTINUOUS_UNBOUNDED)\r\n .build();\r\n```\r\n\r\nThe table Configuration for Sink. \r\n```\r\nBigQueryTableConfig sinkTableConfig =\r\n BigQuerySinkTableConfig.newBuilder()\r\n .table(destTableName)\r\n .project(destGcpProjectName)\r\n .dataset(destDatasetName)\r\n .testMode(false)\r\n .build();\r\n```\r\nPlease Note: (In Progress)\r\n1. `BIGNUMERIC` read will not work (error is values written)\r\n2. `TIME ` type read will not work (connector breaks)\r\n\r\n/gcbrun","shortMessageHtmlLink":"Table API Implementation: BigQuerySinkTableConfig and `BigQueryConn…"}},{"before":"716f1a8708ef21b303692881a3344361ee5ffa1d","after":"ca107bb4765b62353e3a3361b5ffcf7127dc8b9e","ref":"refs/heads/main","pushedAt":"2024-07-11T11:35:06.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jayehwhyehentee","name":"Jayant Jain","path":"/jayehwhyehentee","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/141257304?s=80&v=4"},"commit":{"message":"Modify storage client faker to create different instances (#140)","shortMessageHtmlLink":"Modify storage client faker to create different instances (#140)"}},{"before":"516efdb1f7b7a3365d7f217d62d0927d55a02d5a","after":null,"ref":"refs/heads/dependabot/pip/cloudbuild/nightly/scripts/python-scripts/certifi-2024.7.4","pushedAt":"2024-07-10T06:00:44.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"}},{"before":"c2afe363f280c9b28537f19226ef898d5e537cc0","after":"716f1a8708ef21b303692881a3344361ee5ffa1d","ref":"refs/heads/main","pushedAt":"2024-07-10T06:00:38.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"prashastia","name":"Prashasti Agarwal","path":"/prashastia","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/144427971?s=80&v=4"},"commit":{"message":"Bump certifi from 2023.11.17 to 2024.7.4 in /cloudbuild/nightly/scripts/python-scripts (#138)\n\nBumps [certifi](https://github.com/certifi/python-certifi) from\r\n2023.11.17 to 2024.7.4.\r\n
\r\nCommits\r\n
    \r\n
  • bd81538\r\n2024.07.04 (#295)
    • \r\n
  • 06a2cbf\r\nBump peter-evans/create-pull-request from 6.0.5 to 6.1.0 (#294)
    • \r\n
  • 13bba02\r\nBump actions/checkout from 4.1.6 to 4.1.7 (#293)
    • \r\n
  • e8abcd0\r\nBump pypa/gh-action-pypi-publish from 1.8.14 to 1.9.0 (#292)
    • \r\n
  • 124f4ad\r\n2024.06.02 (#291)
    • \r\n
  • c2196ce\r\n--- (#290)
    • \r\n
  • fefdeec\r\nBump actions/checkout from 4.1.4 to 4.1.5 (#289)
    • \r\n
  • 3c5fb15\r\nBump actions/download-artifact from 4.1.6 to 4.1.7 (#286)
    • \r\n
  • 4a9569a\r\nBump actions/checkout from 4.1.2 to 4.1.4 (#287)
    • \r\n
  • 1fc8086\r\nBump peter-evans/create-pull-request from 6.0.4 to 6.0.5 (#288)
    • \r\n
  • Additional commits viewable in compare\r\nview
    • \r\n
\r\n
\r\n
\r\n\r\n\r\n[![Dependabot compatibility\r\nscore](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=certifi&package-manager=pip&previous-version=2023.11.17&new-version=2024.7.4)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)\r\n\r\nDependabot will resolve any conflicts with this PR as long as you don't\r\nalter it yourself. You can also trigger a rebase manually by commenting\r\n`@dependabot rebase`.\r\n\r\n[//]: # (dependabot-automerge-start)\r\n[//]: # (dependabot-automerge-end)\r\n\r\n---\r\n\r\n
\r\nDependabot commands and options\r\n
\r\n\r\nYou can trigger Dependabot actions by commenting on this PR:\r\n- `@dependabot rebase` will rebase this PR\r\n- `@dependabot recreate` will recreate this PR, overwriting any edits\r\nthat have been made to it\r\n- `@dependabot merge` will merge this PR after your CI passes on it\r\n- `@dependabot squash and merge` will squash and merge this PR after\r\nyour CI passes on it\r\n- `@dependabot cancel merge` will cancel a previously requested merge\r\nand block automerging\r\n- `@dependabot reopen` will reopen this PR if it is closed\r\n- `@dependabot close` will close this PR and stop Dependabot recreating\r\nit. You can achieve the same result by closing it manually\r\n- `@dependabot show ignore conditions` will show all\r\nof the ignore conditions of the specified dependency\r\n- `@dependabot ignore this major version` will close this PR and stop\r\nDependabot creating any more for this major version (unless you reopen\r\nthe PR or upgrade to it yourself)\r\n- `@dependabot ignore this minor version` will close this PR and stop\r\nDependabot creating any more for this minor version (unless you reopen\r\nthe PR or upgrade to it yourself)\r\n- `@dependabot ignore this dependency` will close this PR and stop\r\nDependabot creating any more for this dependency (unless you reopen the\r\nPR or upgrade to it yourself)\r\nYou can disable automated security fix PRs for this repo from the\r\n[Security Alerts\r\npage](https://github.com/GoogleCloudDataproc/flink-bigquery-connector/network/alerts).\r\n\r\n
\r\n\r\nSigned-off-by: dependabot[bot] \r\nCo-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>","shortMessageHtmlLink":"Bump certifi from 2023.11.17 to 2024.7.4 in /cloudbuild/nightly/scrip…"}},{"before":"3445bbb51c0aa435840381715bef2a1ff981c2b0","after":"c2afe363f280c9b28537f19226ef898d5e537cc0","ref":"refs/heads/main","pushedAt":"2024-07-10T05:49:41.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"prashastia","name":"Prashasti Agarwal","path":"/prashastia","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/144427971?s=80&v=4"},"commit":{"message":"Adds implementation for `AvroToRowDataConvertors` (#136)\n\nPlease Review this PR After PR #130 is merged. Then proceed to PR #132. \r\n\r\n\r\n[AvroToRowDataConvertors](https://github.com/apache/flink/blob/master/flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/AvroToRowDataConverters.java)\r\nis a pre-existing implementation, however it does not take into account\r\nmicrosecond precision for `TIMESTAMP` and `DATETIME`\r\n(`TIMESTAMP_WITH_LOCAL_TIMEZONE` in Flink's LogicalType) which is\r\nrequired for reading `TIMESTAMP` and `DATETIME` BigQuery fields.
\r\nNote: Problems in Reading `TIME` type: \r\n* While reading from BigQuery, `TIME` type is read as a long value\r\nindicating the number of microseconds since EPOCH. However, when the\r\nread Avro Rows are converted to RowData (via AvroToRowDataConvertors) we\r\ncan convert it into `LONG` or`INT` type.\r\n* Ideally, the conversion should be to`LONG` type (since the\r\n`RowDataToProtoSerializer` is expecting a `LONG` value of TIME(6) type).\r\n* But RecordEmitter uses\r\n[RowDataSerializer](https://github.com/apache/flink/blob/ac4a275f0febb5af2599e481fdee48bcdec07988/flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/typeutils/RowDataSerializer.java#L170)\r\nwhich converts TIME type to\r\n[INT](https://github.com/apache/flink/blob/ac4a275f0febb5af2599e481fdee48bcdec07988/flink-table/flink-table-common/src/main/java/org/apache/flink/table/data/RowData.java#L243),\r\n[See SS](https://screenshot.googleplex.com/4FLV2GFwZpM7ANp) causing the\r\n[error](https://paste.googleplex.com/6342674712100864). Which is\r\ndisabling (throws the above described error) the read of time type from\r\nbigquery. Given correct RowData TIME type, the sink would function as\r\nexpected.\r\n* A [bug](https://b.corp.google.com/issues/341209747) has been created\r\nfor follow up.\r\n\r\n/gcbrun","shortMessageHtmlLink":"Adds implementation for AvroToRowDataConvertors (#136)"}},{"before":"96bfcd30b5f75b7bc09cdc6fed0b7cb658857fb8","after":null,"ref":"refs/heads/dev","pushedAt":"2024-07-08T10:47:27.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"jayehwhyehentee","name":"Jayant Jain","path":"/jayehwhyehentee","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/141257304?s=80&v=4"}},{"before":"3020e258a18f87d6ea7c345ee3b667affc49dcb3","after":"3445bbb51c0aa435840381715bef2a1ff981c2b0","ref":"refs/heads/main","pushedAt":"2024-07-08T10:47:22.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jayehwhyehentee","name":"Jayant Jain","path":"/jayehwhyehentee","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/141257304?s=80&v=4"},"commit":{"message":"Bump to next version (#139)","shortMessageHtmlLink":"Bump to next version (#139)"}},{"before":null,"after":"96bfcd30b5f75b7bc09cdc6fed0b7cb658857fb8","ref":"refs/heads/dev","pushedAt":"2024-07-08T09:43:01.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"jayehwhyehentee","name":"Jayant Jain","path":"/jayehwhyehentee","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/141257304?s=80&v=4"},"commit":{"message":"Bump to next version","shortMessageHtmlLink":"Bump to next version"}},{"before":null,"after":"516efdb1f7b7a3365d7f217d62d0927d55a02d5a","ref":"refs/heads/dependabot/pip/cloudbuild/nightly/scripts/python-scripts/certifi-2024.7.4","pushedAt":"2024-07-05T23:34:20.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"},"commit":{"message":"Bump certifi in /cloudbuild/nightly/scripts/python-scripts\n\nBumps [certifi](https://github.com/certifi/python-certifi) from 2023.11.17 to 2024.7.4.\n- [Commits](https://github.com/certifi/python-certifi/compare/2023.11.17...2024.07.04)\n\n---\nupdated-dependencies:\n- dependency-name: certifi\n dependency-type: direct:production\n...\n\nSigned-off-by: dependabot[bot] ","shortMessageHtmlLink":"Bump certifi in /cloudbuild/nightly/scripts/python-scripts"}},{"before":"d23a9da3b21c36542cb53294e2a8c08da9a1f20c","after":"3020e258a18f87d6ea7c345ee3b667affc49dcb3","ref":"refs/heads/main","pushedAt":"2024-07-02T04:24:16.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"prashastia","name":"Prashasti Agarwal","path":"/prashastia","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/144427971?s=80&v=4"},"commit":{"message":"Adds tests for `BigQueryReadTableConfig` and `BigQueryConnectorOptions` (#130)\n\n1. Adds tests for `BigQueryConnectorOptions`\r\n* Uses the `BigQueryReadTableConfig` for formation of `TableDescriptor`\r\nand `ReadOptions` rather than Map.\r\n* Consequently involves modification of `StorageClientFaker` to provide\r\nrecords via recordGenerator of the desired schema.\r\n* Also mocks `QueryDataClient`. `getTableSchema()` to provide BigQuery\r\nTable Schema.\r\n2. Also adds `MODE` (`BOUNDED` or `UNBOUNDED`) and\r\n`PARTITION_DISCOVERY_INTERVAL` as one of the connector options.\r\n\r\n/gcbrun","shortMessageHtmlLink":"Adds tests for BigQueryReadTableConfig and `BigQueryConnectorOption…"}},{"before":"757f17fca297f6bd1930e771557e1a67b22083ec","after":"d23a9da3b21c36542cb53294e2a8c08da9a1f20c","ref":"refs/heads/main","pushedAt":"2024-07-01T04:26:43.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"prashastia","name":"Prashasti Agarwal","path":"/prashastia","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/144427971?s=80&v=4"},"commit":{"message":"Adds more tests for `RowDataProtoSerializer` (#129)\n\n/gcbrun","shortMessageHtmlLink":"Adds more tests for RowDataProtoSerializer (#129)"}},{"before":"95aeb56403d8544eb8db37459424e75094c28956","after":"757f17fca297f6bd1930e771557e1a67b22083ec","ref":"refs/heads/main","pushedAt":"2024-06-25T10:44:14.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"prashastia","name":"Prashasti Agarwal","path":"/prashastia","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/144427971?s=80&v=4"},"commit":{"message":"Modifies Table API `AvroSchemaConvertor` implementation. (#128)\n\n* Adds implementation for `AvroSchemaConvertor` responsible for:\r\n - Convert Avro Schema to `DataType` schema and vice versa \r\n* Also adds tests for the same. \r\n* Test for `BigQueryTableSchemaProvider` to test the conversion of Avro\r\nSchema -> Data Type Schema (via invocation of `AvroSchemaConvertor`\r\n* Modifies `AvroToRowDataConvertor` to modify certain datatypes for the\r\nconnector (to facilitate read)\r\n\r\n/gcbrun","shortMessageHtmlLink":"Modifies Table API AvroSchemaConvertor implementation. (#128)"}},{"before":"120b8a819286be9671119a5462d88e87b5e007f6","after":null,"ref":"refs/heads/dependabot/pip/cloudbuild/nightly/scripts/python-scripts/urllib3-2.2.2","pushedAt":"2024-06-24T04:41:55.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"}},{"before":"7f43424306e88607bd39e6aa38280b1b4d2ab4ad","after":"95aeb56403d8544eb8db37459424e75094c28956","ref":"refs/heads/main","pushedAt":"2024-06-24T04:41:48.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"prashastia","name":"Prashasti Agarwal","path":"/prashastia","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/144427971?s=80&v=4"},"commit":{"message":"Bump urllib3 from 2.1.0 to 2.2.2 in /cloudbuild/nightly/scripts/python-scripts (#131)\n\nBumps [urllib3](https://github.com/urllib3/urllib3) from 2.1.0 to 2.2.2.\r\n
\r\nRelease notes\r\n

Sourced from urllib3's\r\nreleases.

\r\n
\r\n

2.2.2

\r\n

🚀 urllib3 is fundraising for HTTP/2 support

\r\n

urllib3\r\nis raising ~$40,000 USD to release HTTP/2 support and ensure\r\nlong-term sustainable maintenance of the project after a sharp decline\r\nin financial support for 2023. If your company or organization uses\r\nPython and would benefit from HTTP/2 support in Requests, pip, cloud\r\nSDKs, and thousands of other projects please consider contributing\r\nfinancially to ensure HTTP/2 support is developed sustainably and\r\nmaintained for the long-haul.

\r\n

Thank you for your support.

\r\n

Changes

\r\n
    \r\n
  • Added the Proxy-Authorization header to the list of\r\nheaders to strip from requests when redirecting to a different host. As\r\nbefore, different headers can be set via\r\nRetry.remove_headers_on_redirect.
    • \r\n
  • Allowed passing negative integers as amt to read\r\nmethods of http.client.HTTPResponse as an alternative to\r\nNone. (#3122)
    • \r\n
  • Fixed return types representing copying actions to use\r\ntyping.Self. (#3363)
    • \r\n
\r\n

Full Changelog: https://github.com/urllib3/urllib3/compare/2.2.1...2.2.2

\r\n

2.2.1

\r\n

🚀 urllib3 is fundraising for HTTP/2 support

\r\n

urllib3\r\nis raising ~$40,000 USD to release HTTP/2 support and ensure\r\nlong-term sustainable maintenance of the project after a sharp decline\r\nin financial support for 2023. If your company or organization uses\r\nPython and would benefit from HTTP/2 support in Requests, pip, cloud\r\nSDKs, and thousands of other projects please consider contributing\r\nfinancially to ensure HTTP/2 support is developed sustainably and\r\nmaintained for the long-haul.

\r\n

Thank you for your support.

\r\n

Changes

\r\n
    \r\n
  • Fixed issue where InsecureRequestWarning was emitted\r\nfor HTTPS connections when using Emscripten. (#3331)
    • \r\n
  • Fixed HTTPConnectionPool.urlopen to stop automatically\r\ncasting non-proxy headers to HTTPHeaderDict. This change\r\nwas premature as it did not apply to proxy headers and\r\nHTTPHeaderDict does not handle byte header values correctly\r\nyet. (#3343)
    • \r\n
  • Changed ProtocolError to\r\nInvalidChunkLength when response terminates before the\r\nchunk length is sent. (#2860)
    • \r\n
  • Changed ProtocolError to be more verbose on incomplete\r\nreads with excess content. (#3261)
    • \r\n
\r\n

2.2.0

\r\n

🖥️ urllib3 now works in the browser

\r\n

:tada: This release adds experimental support for using\r\nurllib3 in the browser with Pyodide! :tada:

\r\n

Thanks to Joe Marshall (@​joemarshall)\r\nfor contributing this feature. This change was possible thanks to work\r\ndone in urllib3 v2.0 to detach our API from http.client.\r\nPlease report all bugs to the urllib3 issue\r\ntracker.

\r\n

🚀 urllib3 is fundraising for HTTP/2 support

\r\n

urllib3\r\nis raising ~$40,000 USD to release HTTP/2 support and ensure\r\nlong-term sustainable maintenance of the project after a sharp decline\r\nin financial support for 2023. If your company or organization uses\r\nPython and would benefit from HTTP/2 support in Requests, pip, cloud\r\nSDKs, and thousands of other projects please consider contributing\r\nfinancially to ensure HTTP/2 support is developed sustainably and\r\nmaintained for the long-haul.

\r\n

Thank you for your support.

\r\n

Changes

\r\n
    \r\n
  • Added support for Emscripten\r\nand Pyodide, including streaming support in cross-origin isolated\r\nbrowser environments where threading is enabled. (#2951)
    • \r\n
  • Added support for HTTPResponse.read1() method. (#3186)
    • \r\n
  • Added rudimentary support for HTTP/2. (#3284)
    • \r\n
  • Fixed issue where requests against urls with trailing dots were\r\nfailing due to SSL errors\r\nwhen using proxy. (#2244)
    • \r\n
  • Fixed HTTPConnection.proxy_is_verified and\r\nHTTPSConnection.proxy_is_verified to be always set to a\r\nboolean after connecting to a proxy. It could be None in\r\nsome cases previously. (#3130)
    • \r\n
\r\n\r\n
\r\n

... (truncated)

\r\n
\r\n
\r\nChangelog\r\n

Sourced from urllib3's\r\nchangelog.

\r\n
\r\n

2.2.2 (2024-06-17)

\r\n
    \r\n
  • Added the Proxy-Authorization header to the list of\r\nheaders to strip from requests when redirecting to a different host. As\r\nbefore, different headers can be set via\r\nRetry.remove_headers_on_redirect.
    • \r\n
  • Allowed passing negative integers as amt to read\r\nmethods of http.client.HTTPResponse as an alternative to\r\nNone.\r\n([#3122](https://github.com/urllib3/urllib3/issues/3122)\r\n<https://github.com/urllib3/urllib3/issues/3122>__)
    • \r\n
  • Fixed return types representing copying actions to use\r\ntyping.Self.\r\n([#3363](https://github.com/urllib3/urllib3/issues/3363)\r\n<https://github.com/urllib3/urllib3/issues/3363>__)
    • \r\n
\r\n

2.2.1 (2024-02-16)

\r\n
    \r\n
  • Fixed issue where InsecureRequestWarning was emitted\r\nfor HTTPS connections when using Emscripten.\r\n([#3331](https://github.com/urllib3/urllib3/issues/3331)\r\n<https://github.com/urllib3/urllib3/issues/3331>__)
    • \r\n
  • Fixed HTTPConnectionPool.urlopen to stop automatically\r\ncasting non-proxy headers to HTTPHeaderDict. This change\r\nwas premature as it did not apply to proxy headers and\r\nHTTPHeaderDict does not handle byte header values correctly\r\nyet. ([#3343](https://github.com/urllib3/urllib3/issues/3343)\r\n<https://github.com/urllib3/urllib3/issues/3343>__)
    • \r\n
  • Changed InvalidChunkLength to\r\nProtocolError when response terminates before the chunk\r\nlength is sent.\r\n([#2860](https://github.com/urllib3/urllib3/issues/2860)\r\n<https://github.com/urllib3/urllib3/issues/2860>__)
    • \r\n
  • Changed ProtocolError to be more verbose on incomplete\r\nreads with excess content.\r\n([#3261](https://github.com/urllib3/urllib3/issues/3261)\r\n<https://github.com/urllib3/urllib3/issues/3261>__)
    • \r\n
\r\n

2.2.0 (2024-01-30)

\r\n
    \r\n
  • Added support for Emscripten and Pyodide\r\n<https://urllib3.readthedocs.io/en/latest/reference/contrib/emscripten.html>,\r\nincluding streaming support in cross-origin isolated browser\r\nenvironments where threading is enabled.\r\n([#2951](https://github.com/urllib3/urllib3/issues/2951)\r\n<https://github.com/urllib3/urllib3/issues/2951>)
    • \r\n
  • Added support for HTTPResponse.read1() method.\r\n([#3186](https://github.com/urllib3/urllib3/issues/3186)\r\n<https://github.com/urllib3/urllib3/issues/3186>__)
    • \r\n
  • Added rudimentary support for HTTP/2.\r\n([#3284](https://github.com/urllib3/urllib3/issues/3284)\r\n<https://github.com/urllib3/urllib3/issues/3284>__)
    • \r\n
  • Fixed issue where requests against urls with trailing dots were\r\nfailing due to SSL errors\r\nwhen using proxy.\r\n([#2244](https://github.com/urllib3/urllib3/issues/2244)\r\n<https://github.com/urllib3/urllib3/issues/2244>__)
    • \r\n
  • Fixed HTTPConnection.proxy_is_verified and\r\nHTTPSConnection.proxy_is_verified\r\nto be always set to a boolean after connecting to a proxy. It could be\r\nNone in some cases previously.\r\n([#3130](https://github.com/urllib3/urllib3/issues/3130)\r\n<https://github.com/urllib3/urllib3/issues/3130>__)
    • \r\n
  • Fixed an issue where headers passed in a request with\r\njson= would be mutated\r\n([#3203](https://github.com/urllib3/urllib3/issues/3203)\r\n<https://github.com/urllib3/urllib3/issues/3203>__)
    • \r\n
  • Fixed HTTPSConnection.is_verified to be set to\r\nFalse when connecting\r\nfrom a HTTPS proxy to an HTTP target. It was set to True\r\npreviously.\r\n([#3267](https://github.com/urllib3/urllib3/issues/3267)\r\n<https://github.com/urllib3/urllib3/issues/3267>__)
    • \r\n
  • Fixed handling of new error message from OpenSSL 3.2.0 when\r\nconfiguring an HTTP proxy as HTTPS\r\n([#3268](https://github.com/urllib3/urllib3/issues/3268)\r\n<https://github.com/urllib3/urllib3/issues/3268>__)
    • \r\n
  • Fixed TLS 1.3 post-handshake auth when the server certificate\r\nvalidation is disabled\r\n([#3325](https://github.com/urllib3/urllib3/issues/3325)\r\n<https://github.com/urllib3/urllib3/issues/3325>__)
    • \r\n
  • Note for downstream distributors: To run integration tests, you now\r\nneed to run the tests a second\r\ntime with the --integration pytest flag.\r\n([#3181](https://github.com/urllib3/urllib3/issues/3181)\r\n<https://github.com/urllib3/urllib3/issues/3181>__)
    • \r\n
\r\n
\r\n
\r\n
\r\nCommits\r\n
    \r\n
  • 27e2a5c\r\nRelease 2.2.2 (#3406)
    • \r\n
  • accff72\r\nMerge pull request from GHSA-34jh-p97f-mpxf
    • \r\n
  • 34be4a5\r\nPin CFFI to a new release candidate instead of a Git commit (#3398)
    • \r\n
  • da41058\r\nBump browser-actions/setup-chrome from 1.6.0 to 1.7.1 (#3399)
    • \r\n
  • b07a669\r\nBump github/codeql-action from 2.13.4 to 3.25.6 (#3396)
    • \r\n
  • b8589ec\r\nMeasure coverage with v4 of artifact actions (#3394)
    • \r\n
  • f3bdc55\r\nAllow triggering CI manually (#3391)
    • \r\n
  • 5239265\r\nFix HTTP version in debug log (#3316)
    • \r\n
  • b34619f\r\nBump actions/checkout to 4.1.4 (#3387)
    • \r\n
  • 9961d14\r\nBump browser-actions/setup-chrome from 1.5.0 to 1.6.0 (#3386)
    • \r\n
  • Additional commits viewable in compare\r\nview
    • \r\n
\r\n
\r\n
\r\n\r\n\r\n[![Dependabot compatibility\r\nscore](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=urllib3&package-manager=pip&previous-version=2.1.0&new-version=2.2.2)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)\r\n\r\nDependabot will resolve any conflicts with this PR as long as you don't\r\nalter it yourself. You can also trigger a rebase manually by commenting\r\n`@dependabot rebase`.\r\n\r\n[//]: # (dependabot-automerge-start)\r\n[//]: # (dependabot-automerge-end)\r\n\r\n---\r\n\r\n
\r\nDependabot commands and options\r\n
\r\n\r\nYou can trigger Dependabot actions by commenting on this PR:\r\n- `@dependabot rebase` will rebase this PR\r\n- `@dependabot recreate` will recreate this PR, overwriting any edits\r\nthat have been made to it\r\n- `@dependabot merge` will merge this PR after your CI passes on it\r\n- `@dependabot squash and merge` will squash and merge this PR after\r\nyour CI passes on it\r\n- `@dependabot cancel merge` will cancel a previously requested merge\r\nand block automerging\r\n- `@dependabot reopen` will reopen this PR if it is closed\r\n- `@dependabot close` will close this PR and stop Dependabot recreating\r\nit. You can achieve the same result by closing it manually\r\n- `@dependabot show ignore conditions` will show all\r\nof the ignore conditions of the specified dependency\r\n- `@dependabot ignore this major version` will close this PR and stop\r\nDependabot creating any more for this major version (unless you reopen\r\nthe PR or upgrade to it yourself)\r\n- `@dependabot ignore this minor version` will close this PR and stop\r\nDependabot creating any more for this minor version (unless you reopen\r\nthe PR or upgrade to it yourself)\r\n- `@dependabot ignore this dependency` will close this PR and stop\r\nDependabot creating any more for this dependency (unless you reopen the\r\nPR or upgrade to it yourself)\r\nYou can disable automated security fix PRs for this repo from the\r\n[Security Alerts\r\npage](https://github.com/GoogleCloudDataproc/flink-bigquery-connector/network/alerts).\r\n\r\n
\r\n\r\nSigned-off-by: dependabot[bot] \r\nCo-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>","shortMessageHtmlLink":"Bump urllib3 from 2.1.0 to 2.2.2 in /cloudbuild/nightly/scripts/pytho…"}},{"before":"79d3849e9731f37c10c2f341a03c9d5a560c5965","after":null,"ref":"refs/heads/dependabot/pip/cloudbuild/nightly/scripts/python-scripts/requests-2.32.0","pushedAt":"2024-06-19T12:25:55.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"}},{"before":"1b755b8e3f56021518d1f43c3a7c17f8462a0ddb","after":"7f43424306e88607bd39e6aa38280b1b4d2ab4ad","ref":"refs/heads/main","pushedAt":"2024-06-19T12:25:14.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"prashastia","name":"Prashasti Agarwal","path":"/prashastia","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/144427971?s=80&v=4"},"commit":{"message":"Initial implementation of the serializer for Table API Support. (#124)\n\nTable API support requires conversion of Row Data to Protobuf for\r\nwriting to BigQuery via the Storage Write API. This PR deals with the\r\ninitial implementation for the same.\r\n\r\nNote: \r\n* `BIGNUMERIC` , `DATETIME` and `TIME` Data is not supported yet. (Will\r\nbe done in future, since Read needs to be fixed.)\r\n* The serializer will not support INTERVAL_YEAR_MONTH,\r\nINTERVAL_DAY_TIME, MAP, MULTISET, NULL, SYMBOL, RAW, DISTINCT_TYPE,\r\nSTRUCTURED_TYPE, TIMESTAMP_WITH_TIME_ZONE in the MVP release of Table\r\nAPI Support.\r\n\r\n/gcbrun","shortMessageHtmlLink":"Initial implementation of the serializer for Table API Support. (#124)"}},{"before":null,"after":"120b8a819286be9671119a5462d88e87b5e007f6","ref":"refs/heads/dependabot/pip/cloudbuild/nightly/scripts/python-scripts/urllib3-2.2.2","pushedAt":"2024-06-17T22:37:19.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"},"commit":{"message":"Bump urllib3 in /cloudbuild/nightly/scripts/python-scripts\n\nBumps [urllib3](https://github.com/urllib3/urllib3) from 2.1.0 to 2.2.2.\n- [Release notes](https://github.com/urllib3/urllib3/releases)\n- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)\n- [Commits](https://github.com/urllib3/urllib3/compare/2.1.0...2.2.2)\n\n---\nupdated-dependencies:\n- dependency-name: urllib3\n dependency-type: direct:production\n...\n\nSigned-off-by: dependabot[bot] ","shortMessageHtmlLink":"Bump urllib3 in /cloudbuild/nightly/scripts/python-scripts"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0yMFQwOTowMjozOC4wMDAwMDBazwAAAAS7wAde","startCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0yMFQwOTowMjozOC4wMDAwMDBazwAAAAS7wAde","endCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wNi0xN1QyMjozNzoxOS4wMDAwMDBazwAAAARn2dyh"}},"title":"Activity · GoogleCloudDataproc/flink-bigquery-connector"}