Skip to content

Commit

Permalink
Upgrade to Spark 3.4.0 (#235)
Browse files Browse the repository at this point in the history
Test pass done on spark 3.4.0
  • Loading branch information
pp-akursar authored Sep 22, 2023
1 parent f1d79ef commit eb60462
Show file tree
Hide file tree
Showing 4 changed files with 7 additions and 6 deletions.
2 changes: 1 addition & 1 deletion .github/workflows/scala.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ jobs:
strategy:
matrix:
os: [ubuntu-latest, macOS-latest]
profile: ['spark33']
profile: ['spark34']
timeout-minutes: 15

steps:
Expand Down
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,7 @@ There are three version sets of the connector available through Maven, a 2.4.x,
| Spark 3.0.x compatible connector | `com.microsoft.azure:spark-mssql-connector_2.12:1.1.0` | 2.12 |
| Spark 3.1.x compatible connector | `com.microsoft.azure:spark-mssql-connector_2.12:1.2.0` | 2.12 |
| Spark 3.3.x compatible connector | `com.microsoft.azure:spark-mssql-connector_2.12:1.3.0` | 2.12 |
| Spark 3.4.x compatible connector | `com.microsoft.azure:spark-mssql-connector_2.12:1.4.0` | 2.12 |

## Current Releases

Expand Down
6 changes: 3 additions & 3 deletions pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
<groupId>com.microsoft.azure</groupId>
<artifactId>spark-mssql-connector</artifactId>
<packaging>jar</packaging>
<version>1.3.0</version>
<version>1.4.0</version>
<name>${project.groupId}:${project.artifactId}</name>
<description>The Apache Spark Connector for SQL Server and Azure SQL is a high-performance connector that enables you to use transactional data in big data analytics and persists results for ad-hoc queries or reporting.</description>
<url>https://github.com/microsoft/sql-spark-connector</url>
Expand Down Expand Up @@ -201,14 +201,14 @@
</build>
<profiles>
<profile>
<id>spark33</id>
<id>spark34</id>
<activation>
<activeByDefault>true</activeByDefault>
</activation>
<properties>
<scala.binary.version>2.12</scala.binary.version>
<scala.version>2.12.11</scala.version>
<spark.version>3.3.0</spark.version>
<spark.version>3.4.0</spark.version>
</properties>
<dependencies>
<dependency>
Expand Down
4 changes: 2 additions & 2 deletions test/scala_test/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -123,14 +123,14 @@
</build>
<profiles>
<profile>
<id>spark33</id>
<id>spark34</id>
<activation>
<activeByDefault>true</activeByDefault>
</activation>
<properties>
<scala.binary.version>2.12</scala.binary.version>
<scala.version>2.12.11</scala.version>
<spark.version>3.3.0</spark.version>
<spark.version>3.4.0</spark.version>
</properties>
</profile>
</profiles>
Expand Down

0 comments on commit eb60462

Please sign in to comment.