Pravega Spark Connectors 0.13.0

Release 0.13.0 of Pravega Spark Connectors

This release support Spark version 3.4 on Scala 2.12. It is tested and validated with Pravega 0.13.0 release.

Highlight features:

• (#158) Support for Spark 3.4
  We have added support for Spark 3.4, along with this, the artifact name for Spark 3.4 connector is switched back to pravega-connectors-spark-3.4_2.12, you can now import the dependency like this

<dependency>
    <groupId>io.pravega</groupId>
    <artifactId>pravega-connectors-spark-3.4_2.12</artifactId>
    <version>0.13.0</version>
</dependency>

Here is the complete list of commits: changelog-spark.txt

Pravega Spark Connectors 0.12.0

Release 0.12.0 of Pravega Spark Connectors

This release support Spark version 2.4 on Scala 2.11 and 3.1+ on Scala 2.12. It is tested and validated with Pravega 0.12.0 release.

Spark 3 connector artifacts are listed in the assets. The release artifacts of the supported Spark versions are available on Maven Central.

Highlight features:

• (#149 #147) Unified support for Spark 3.1+
  Spark 3 connector now supports Spark 3.1, 3.2 and 3.3, along with this, the artifact name for Spark 3 connector is changed from pravega-connectors-spark-3.1_2.12 into a unified pravega-connectors-spark-3_2.12, you can now import the dependency like this

<dependency>
    <groupId>io.pravega</groupId>
    <artifactId>pravega-connectors-spark-3_2.12</artifactId>
    <version>0.12.0</version>
</dependency>

Here is the complete list of commits: changelog-spark.txt

Pravega Spark Connectors 0.11.0

Release 0.11.0 of Pravega Spark Connectors

This release support Spark version 2.4 on Scala 2.11 and 3.1 on Scala 2.12. It is tested and validated with Pravega 0.11.0 release.

Spark 3.1 connector artifacts are listed in the assets. The release artifacts of both the supported Spark versions are available on Maven Central.

Here is the complete list of commits: changelog-spark.txt

Pravega Spark Connectors 0.10.1

Release 0.10.1 of Spark Pravega Connectors

Summary of changes

• Adopt Github Actions
• Support Spark 3.1.2

This release support Spark version 2.4 on Scala 2.11 and 3.0/3.1 on Scala 2.12. It is tested and validated with Pravega 0.10.1 release.

Spark 3.1 connector artifacts are listed in the assets. The release artifacts of all the supported Spark versions are available on Maven Central.

Here is the complete list of commits: changelog-spark.txt

Pravega Spark Connectors 0.9.0

Release 0.9.0 of Spark Pravega Connectors

This is the first release of Spark Pravega Connector

• Support structured streaming source and sink.

• This release support Spark version 2.4 and 3.0 on Scala 2.12.

• Tested and validated with Pravega 0.9.0 release.