[SEDONA-306] Prepare release 1.4.1

R/DESCRIPTION

@@ -1,7 +1,7 @@
 Type: Package
 Package: apache.sedona
 Title: R Interface for Apache Sedona
-Version: 1.4.0.9000
+Version: 1.4.1
 Authors@R:
     c(person(family = "Apache Sedona",
              role = c("aut", "cre"),

R/R/dependencies.R

@@ -39,7 +39,7 @@ spark_dependencies <- function(spark_version, scala_version, ...) {
       paste0(
         "org.apache.sedona:sedona-",
         c("spark-shaded", "viz"),
-        sprintf("-%s_%s:1.4.0", spark_version, scala_version)
+        sprintf("-%s_%s:1.4.1", spark_version, scala_version)
       ),
       packages
     )

core/pom.xml

@@ -183,6 +183,14 @@
             <plugin>
                 <groupId>net.alchim31.maven</groupId>
                 <artifactId>scala-maven-plugin</artifactId>
+                <executions>
+                    <execution>
+                        <id>attach-javadocs</id>
+                        <configuration>
+                            <skip>true</skip>
+                        </configuration>
+                    </execution>
+                </executions>
             </plugin>
             <plugin>
                 <groupId>org.scalatest</groupId>

docs/community/snapshot.md

@@ -13,7 +13,7 @@ The detailed requirement is on [ASF Infra website](https://infra.apache.org/publ
 
 1. In your local Sedona Git repo under master branch, run
 ```bash
-echo " " > create-release.sh
+echo '#!/bin/bash' > create-release.sh
 chmod 777 create-release.sh
 ```
 2. Use your favourite GUI text editor to open `create-release.sh`.
@@ -28,29 +28,25 @@ In your Sedona GitHub repo, run this script:
 ```bash
 #!/bin/bash
 
-source ~/.bashrc
-
 git checkout master
 git pull
 
 rm -f release.*
 rm -f pom.xml.*
 
+# Validate the POMs and your credential setup
+mvn -q -B clean release:prepare -Dtag={{ sedona_create_release.current_git_tag }} -DreleaseVersion={{ sedona_create_release.current_version }} -DdevelopmentVersion={{ sedona_create_release.current_snapshot }} -Dresume=false -DdryRun=true -Penable-all-submodules -Darguments="-DskipTests"
+mvn -q -B release:clean -Penable-all-submodules
+
 # Spark 3.0 and Scala 2.12
-# Prepare the SNAPSHOTs
-mvn -q -B clean -Darguments="-DskipTests" release:prepare -Dtag={{ sedona_create_release.current_git_tag }} -DreleaseVersion={{ sedona_create_release.current_version }} -DdevelopmentVersion={{ sedona_create_release.current_snapshot }} -DdryRun=true -DautoVersionSubmodules=true -Dresume=false
-# Deploy the SNAPSHOTs
-mvn -q deploy -DskipTests
+mvn -q deploy -DskipTests -Dspark=3.0 -Dscala=2.12
 
-rm -f release.*
-rm -f pom.xml.*
+# Spark 3.0 and Scala 2.13
+mvn -q deploy -DskipTests -Dspark=3.0 -Dscala=2.13
 
-# Prepare for Spark 3.0 and Scala 2.13
-# Prepare the SNAPSHOTs
-mvn -q -B clean -Darguments="-DskipTests -Dscala=2.13" release:prepare  -Dtag={{ sedona_create_release.current_git_tag }} -DreleaseVersion={{ sedona_create_release.current_version }} -DdevelopmentVersion={{ sedona_create_release.current_snapshot }} -DdryRun=true -DautoVersionSubmodules=true -Dresume=false
-# Deploy the SNAPSHOTs
-mvn -q deploy -DskipTests -Dscala=2.13
+# Spark 3.4 and Scala 2.12
+mvn -q deploy -DskipTests -Dspark=3.4 -Dscala=2.12
 
-rm -f release.*
-rm -f pom.xml.*
-```
+# Spark 3.4 and Scala 2.13
+mvn -q deploy -DskipTests -Dspark=3.4 -Dscala=2.13
+```

docs/setup/release-notes.md

@@ -4,6 +4,117 @@
 !!!danger
 	Sedona Python currently only works with Shapely 1.x. If you use GeoPandas, please use <= GeoPandas `0.11.1`. GeoPandas > 0.11.1 will automatically install Shapely 2.0. If you use Shapely, please use <= `1.8.4`.
 
+## Sedona 1.4.1
+
+Sedona 1.4.1 is compiled against, Spark 3.3 / Spark 3.4 / Flink 1.12, Java 8.
+
+### Highlights
+
+* [X] **Sedona Spark** More raster functions and bridge RasterUDT and Map Algebra operators. See [Raster based operators](../../api/sql/Raster-operators/#raster-based-operators) and [Raster to Map Algebra operators](../../api/sql/Raster-operators/#raster-to-map-algebra-operators).
+* [X] **Sedona Spark & Flink** Added geodesic / geography functions:
+    * ST_DistanceSphere
+    * ST_DistanceSpheroid
+    * ST_AreaSpheroid
+    * ST_LengthSpheroid
+* [X] **Sedona Spark & Flink** Introduced `SedonaContext` to unify Sedona entry points.
+* [X] **Sedona Spark** Support Spark 3.4.
+* [X] **Sedona Spark** Added a number of new ST functions.
+* [X] **Zeppelin** Zeppelin helium plugin supports ploting geometries like linestring, polygon.
+
+### API change
+
+* **Sedona Spark & Flink** Introduced a new entry point called SedonaContext to unify all Sedona entry points in different compute engines and deprecate old Sedona register entry points. Users no longer have to register Sedona kryo serializer and import many tedious Python classes.
+    * **Sedona Spark**:
+        * Scala:
+        ```scala
+        import org.apache.sedona.spark.SedonaContext
+        val sedona = SedonaContext.create(SedonaContext.builder().master("local[*]").getOrCreate())
+        sedona.sql("SELECT ST_GeomFromWKT(XXX) FROM")
+        ```
+        * Python:
+        ```python
+        from sedona.spark import *
+
+        config = SedonaContext.builder().\
+           config('spark.jars.packages',
+               'org.apache.sedona:sedona-spark-shaded-3.0_2.12:1.4.1,'
+               'org.datasyslab:geotools-wrapper:1.4.0-28.2'). \
+           getOrCreate()
+        sedona = SedonaContext.create(config)
+        sedona.sql("SELECT ST_GeomFromWKT(XXX) FROM")
+        ```
+    * **Sedona Flink**:
+    ```java
+    import org.apache.sedona.flink.SedonaContext
+    StreamTableEnvironment sedona = SedonaContext.create(env, tableEnv);
+    sedona.sqlQuery("SELECT ST_GeomFromWKT(XXX) FROM")
+    ```
+
+### Bug
+
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-266'>SEDONA-266</a>] -         RS_Values throws UnsupportedOperationException for shuffled point arrays
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-267'>SEDONA-267</a>] -         Cannot pip install apache-sedona 1.4.0 from source distribution
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-273'>SEDONA-273</a>] -         Set a upper bound for Shapely, Pandas and GeoPandas
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-277'>SEDONA-277</a>] -         Sedona spark artifacts for scala 2.13 do not have proper POMs
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-283'>SEDONA-283</a>] -         Artifacts were deployed twice when running mvn clean deploy
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-284'>SEDONA-284</a>] -         Property values in dependency deduced POMs for shaded modules were not substituted
+</li>
+</ul>
+
+### New Feature
+
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-196'>SEDONA-196</a>] -         Add ST_Force3D to Sedona
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-239'>SEDONA-239</a>] -         Implement ST_NumPoints
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-264'>SEDONA-264</a>] -         zeppelin helium plugin supports ploting geometry like linestring, polygon
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-280'>SEDONA-280</a>] -         Add ST_GeometricMedian
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-281'>SEDONA-281</a>] -         Support geodesic / geography functions
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-286'>SEDONA-286</a>] -         Support optimized distance join on ST_DistanceSpheroid and ST_DistanceSphere
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-287'>SEDONA-287</a>] -         Use SedonaContext to unify Sedona entry points
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-292'>SEDONA-292</a>] -         Bridge Sedona Raster and Map Algebra operators
+</li>
+</ul>
+
+### Improvement
+
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-167'>SEDONA-167</a>] -         Add __pycache__ to Python .gitignore
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-265'>SEDONA-265</a>] -         Migrate all ST functions to Sedona Inferred Expressions
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-269'>SEDONA-269</a>] -         Add data source for writing binary files
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-270'>SEDONA-270</a>] -         Remove redundant serialization for rasters
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-271'>SEDONA-271</a>] -         Add raster function RS_SRID
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-274'>SEDONA-274</a>] -         Move all ST function logics to Sedona common
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-275'>SEDONA-275</a>] -         Add raster function RS_SetSRID
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-276'>SEDONA-276</a>] -         Add support for Spark 3.4
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-279'>SEDONA-279</a>] -         Sedona-Flink should not depend on Sedona-Spark modules
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-282'>SEDONA-282</a>] -         R – Add raster write function
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-290'>SEDONA-290</a>] -         RDD Spatial Joins should follow the iterator model
+</li>
+</ul>
+
 ## Sedona 1.4.0
 
 Sedona 1.4.0 is compiled against, Spark 3.3 / Flink 1.12, Java 8.

flink/pom.xml

@@ -121,12 +121,6 @@
             <artifactId>scala-library</artifactId>
             <version>${scala.version}</version>
         </dependency>
-        <dependency>
-            <groupId>org.scalatest</groupId>
-            <artifactId>scalatest_${scala.compat.version}</artifactId>
-            <version>${scalatest.version}</version>
-            <scope>test</scope>
-        </dependency>
         <dependency>
             <groupId>org.apache.logging.log4j</groupId>
             <artifactId>log4j-1.2-api</artifactId>
@@ -145,21 +139,5 @@
             <scope>compile</scope>
         </dependency>
     </dependencies>
-    <build>
-        <plugins>
-            <plugin>
-                <groupId>net.alchim31.maven</groupId>
-                <artifactId>scala-maven-plugin</artifactId>
-            </plugin>
-            <plugin>
-                <groupId>org.scalatest</groupId>
-                <artifactId>scalatest-maven-plugin</artifactId>
-            </plugin>
-            <plugin>
-                <groupId>org.scalastyle</groupId>
-                <artifactId>scalastyle-maven-plugin</artifactId>
-            </plugin>
-        </plugins>
-    </build>
 </project>
 

mkdocs.yml

@@ -131,11 +131,11 @@ extra:
     current_version: 1.4.0
     current_geotools: 1.4.0-28.2
   sedona_create_release:
-    current_version: 1.4.0
-    current_git_tag: sedona-1.4.0-rc1
-    current_rc: 1.4.0-rc1
-    current_snapshot: 1.4.1-SNAPSHOT
-    next_version: 1.4.1
+    current_version: 1.4.1
+    current_git_tag: sedona-1.4.1-rc1
+    current_rc: 1.4.1-rc1
+    current_snapshot: 1.5.0-SNAPSHOT
+    next_version: 1.5.0
 copyright: Copyright © 2023 The Apache Software Foundation
 markdown_extensions:
   - admonition

pom.xml

@@ -360,6 +360,18 @@
                     <artifactId>maven-shade-plugin</artifactId>
                     <version>3.4.1</version>
                 </plugin>
+                <plugin>
+                    <groupId>org.apache.maven.plugins</groupId>
+                    <artifactId>maven-release-plugin</artifactId>
+                    <version>3.0.1</version>
+                    <configuration>
+                        <autoResolveSnapshots>all</autoResolveSnapshots>
+                        <autoVersionSubmodules>true</autoVersionSubmodules>
+                        <!-- Don't enable all submodules when running the
+                             actual build using modified POMs -->
+                        <preparationProfiles>!enable-all-submodules</preparationProfiles>
+                    </configuration>
+                </plugin>
                 <plugin>
                     <groupId>net.alchim31.maven</groupId>
                     <artifactId>scala-maven-plugin</artifactId>
@@ -476,15 +488,6 @@
                 <groupId>org.apache.maven.plugins</groupId>
                 <artifactId>maven-gpg-plugin</artifactId>
                 <version>3.0.1</version>
-                <executions>
-                    <execution>
-                        <id>sign-artifacts</id>
-                        <phase>deploy</phase>
-                        <goals>
-                            <goal>sign</goal>
-                        </goals>
-                    </execution>
-                </executions>
             </plugin>
             <plugin>
                 <groupId>net.nicoulaj.maven.plugins</groupId>

python/sedona/version.py

@@ -15,4 +15,4 @@
 #  specific language governing permissions and limitations
 #  under the License.
 
-version = "1.4.0"
+version = "1.4.1"

sql/pom.xml

@@ -41,6 +41,18 @@
         <module>spark-${spark.compat.version}</module>
     </modules>
 
+    <!-- Add non-default submodules when running `mvn release:prepare
+         -Penable-all-submodules`, so that project versions of all submodules
+         will be substituted -->
+    <profiles>
+        <profile>
+            <id>enable-all-submodules</id>
+            <modules>
+                <module>spark-3.4</module>
+            </modules>
+        </profile>
+    </profiles>
+
     <dependencyManagement>
         <dependencies>
             <dependency>

sql/spark-3.0/pom.xml

@@ -25,7 +25,7 @@
         <version>1.4.1-SNAPSHOT</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
-	<artifactId>sedona-sql-${spark.compat.version}_${scala.compat.version}</artifactId>
+	<artifactId>sedona-sql-3.0_${scala.compat.version}</artifactId>
 
 	<name>${project.groupId}:${project.artifactId}</name>
 	<description>A cluster computing system for processing large-scale spatial data: SQL API for Spark 3.0 - 3.3.</description>

sql/spark-3.4/pom.xml

@@ -25,7 +25,7 @@
         <version>1.4.1-SNAPSHOT</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
-	<artifactId>sedona-sql-${spark.compat.version}_${scala.compat.version}</artifactId>
+	<artifactId>sedona-sql-3.4_${scala.compat.version}</artifactId>
 
 	<name>${project.groupId}:${project.artifactId}</name>
 	<description>A cluster computing system for processing large-scale spatial data: SQL API for Spark 3.4.</description>

viz/pom.xml

@@ -155,6 +155,14 @@
             <plugin>
                 <groupId>net.alchim31.maven</groupId>
                 <artifactId>scala-maven-plugin</artifactId>
+                <executions>
+                    <execution>
+                        <id>attach-javadocs</id>
+                        <configuration>
+                            <skip>true</skip>
+                        </configuration>
+                    </execution>
+                </executions>
             </plugin>
             <plugin>
                 <groupId>org.scalatest</groupId>

zeppelin/package.json

@@ -2,7 +2,7 @@
   "name": "apache-sedona",
   "description": "Zeppelin visualization support for Sedona",
   "author": "Apache Sedona, original authors are listed on https://github.com/myuwono/zeppelin-leaflet",
-  "version": "1.4.0",
+  "version": "1.4.1",
   "main": "index.js",
   "scripts": {
     "test": "echo \"Error: no test specified\" && exit 1",