v0.20.4 - 2024-06-11
7cdee65
- Spark 3 uses Log4j2 (commit by @nightscape)
4e3c030
- Update spark-core, spark-hive, spark-sql from 3.3.3 to 3.3.4 (commit by @scala-steward)2cb9731
- Update log4j-api, log4j-core from 2.22.0 to 2.22.1 (commit by @scala-steward)46b2081
- Update poi-shared-strings from 2.7.1 to 2.8.0 (commit by @scala-steward)891c1c2
- Update mill-main from 0.11.6 to 0.11.7 (commit by @scala-steward)65192b9
- Update scalatest from 3.2.17 to 3.2.18 (commit by @scala-steward)fce7d50
- Update commons-compress from 1.25.0 to 1.26.0 (commit by @scala-steward)19b1ebd
- Update commons-codec from 1.16.0 to 1.16.1 (commit by @scala-steward)e8ff657
- Update spark-core, spark-hive, spark-sql from 3.5.0 to 3.5.1 (commit by @scala-steward)d06ba28
- Update scalafmt-core from 3.7.17 to 3.8.0 (commit by @scala-steward)c036ee2
- Update log4j-api, log4j-core from 2.22.1 to 2.23.0 (commit by @scala-steward)28cc1fc
- Update scala-library from 2.13.12 to 2.13.13 (commit by @scala-steward)f74995b
- Update commons-compress from 1.26.0 to 1.26.1 (commit by @scala-steward)48c19ac
- Update scala-library from 2.12.18 to 2.12.19 (commit by @scala-steward)13ab3f6
- Update log4j-api, log4j-core from 2.23.0 to 2.23.1 (commit by @scala-steward)ecdf54c
- Update excel-streaming-reader from 4.2.1 to 4.3.0 (commit by @scala-steward)e3c1d53
- Update scalafmt-core from 3.8.0 to 3.8.1 (commit by @scala-steward)89071ec
- Update commons-io from 2.15.1 to 2.16.0 (commit by @scala-steward)978d1cd
- Update commons-io from 2.16.0 to 2.16.1 (commit by @scala-steward)397a365
- Update scalacheck from 1.17.0 to 1.17.1 (commit by @scala-steward)313b1d3
- Update scala-collection-compat from 2.11.0 to 2.12.0 (commit by @scala-steward)acea137
- Update scalacheck from 1.17.1 to 1.18.0 (commit by @scala-steward)cc2e85b
- Update spark-core, spark-hive, spark-sql from 3.4.2 to 3.4.3 (commit by @scala-steward)01ac4f5
- Enhance issue template to ask people to use newest version (commit by @nightscape)0192e30
- Update commons-codec from 1.16.1 to 1.17.0 (commit by @scala-steward)f43f56c
- Update excel-streaming-reader from 4.3.0 to 4.3.1 (commit by @scala-steward)65669bd
- Update scala-library from 2.13.13 to 2.13.14 (commit by @scala-steward)d8e0269
- Update mill-ci-release from 0.1.9 to 0.1.10 (commit by @scala-steward)47d1458
- Update commons-compress from 1.26.1 to 1.26.2 (commit by @scala-steward)f619b1b
- Update xmlbeans from 5.2.0 to 5.2.1 (commit by @scala-steward)eac8a34
- Update cats-core from 2.10.0 to 2.12.0 (commit by @scala-steward)
v0.20.3 - 2023-12-06
83dfb22
- Update commons-io from 2.14.0 to 2.15.0 (PR #801 by @scala-steward)3acf3a7
- Update log4j-api, log4j-core from 2.21.1 to 2.22.0 (commit by @scala-steward)3918a56
- Update scalafmt-core from 3.7.16 to 3.7.17 (commit by @scala-steward)c84832c
- Update xmlbeans from 5.1.1 to 5.2.0 (commit by @scala-steward)01a2be7
- Update poi, poi-ooxml, poi-ooxml-lite from 5.2.4 to 5.2.5 (commit by @scala-steward)8bf8176
- Update poi-shared-strings from 2.7.0 to 2.7.1 (commit by @scala-steward)394243d
- Update excel-streaming-reader from 4.2.0 to 4.2.1 (PR #811 by @scala-steward)b44806d
- Update commons-compress from 1.24.0 to 1.25.0 (PR #805 by @scala-steward)67e69ab
- Update mill-main from 0.11.5 to 0.11.6 (commit by @scala-steward)4ae7658
- Update commons-io from 2.15.0 to 2.15.1 (commit by @scala-steward)d35d8b4
- Update spark-core, spark-hive, spark-sql from 3.4.1 to 3.4.2 (commit by @scala-steward)
v0.20.2 - 2023-11-14
af8172a
- Fix 3.5.0 compile issues (commit by @nightscape)
1f33039
- Update mill-main from 0.11.4 to 0.11.5 (commit by @scala-steward)132f202
- Update excel-streaming-reader from 4.1.2 to 4.2.0 (commit by @scala-steward)3ddb768
- Update excel-streaming-reader from 4.1.2 to 4.2.0 (commit by @scala-steward)037f34b
- Update poi-shared-strings from 2.6.1 to 2.7.0 (PR #791 by @scala-steward)5e94a11
- Update poi, poi-ooxml, poi-ooxml-lite from 5.2.3 to 5.2.4 (PR #793 by @scala-steward)775611b
- Update commons-io from 2.13.0 to 2.14.0 (PR #792 by @scala-steward)30bd048
- Update log4j-api, log4j-core from 2.20.0 to 2.21.0 (commit by @scala-steward)463fd87
- Update scalafmt-core from 3.7.14 to 3.7.15 (commit by @scala-steward)508116e
- Update log4j-api, log4j-core from 2.21.0 to 2.21.1 (commit by @scala-steward)c1a385f
- Update scalafmt-core from 3.7.15 to 3.7.16 (commit by @scala-steward)
v0.20.1 - 2023-09-28
faeefbd
- Update mill to 0.11.4 (commit by @nightscape)
v0.20.0 - 2023-09-19
f965333
- Update scalafmt-core from 3.7.4 to 3.7.11 (commit by @scala-steward)d26f939
- Update scala-collection-compat from 2.10.0 to 2.11.0 (commit by @scala-steward)c9d40b7
- Update commons-codec from 1.15 to 1.16.0 (commit by @scala-steward)3d47bd3
- Update poi-shared-strings from 2.5.6 to 2.6.0 (commit by @scala-steward)be92459
- Update excel-streaming-reader from 4.0.5 to 4.1.0 (PR #761 by @scala-steward)922458a
- Update scalafmt-core from 3.7.11 to 3.7.12 (commit by @scala-steward)e3419cb
- Update curvesapi from 1.07 to 1.08 (commit by @scala-steward)80834d9
- Update cats-core from 2.9.0 to 2.10.0 (commit by @scala-steward)c412e40
- Update poi-shared-strings from 2.6.0 to 2.6.1 (commit by @scala-steward)c83ab2a
- Update excel-streaming-reader from 4.1.0 to 4.1.1 (PR #768 by @scala-steward)1d5344d
- Update spark-core, spark-hive, spark-sql from 3.3.2 to 3.3.3 (commit by @scala-steward)f3d5212
- Update scalafmt-core from 3.7.12 to 3.7.13 (commit by @scala-steward)e14f473
- Update mill-main from 0.11.1 to 0.11.2 (commit by @scala-steward)111648e
- Update commons-compress from 1.23.0 to 1.24.0 (commit by @scala-steward)a302268
- Update scalatest from 3.2.16 to 3.2.17 (commit by @scala-steward)f632e72
- Update scalafmt-core from 3.7.13 to 3.7.14 (commit by @scala-steward)e133acb
- Update SparseBitSet from 1.2 to 1.3 (commit by @scala-steward)5031c9b
- Update scala-library from 2.13.11 to 2.13.12 (commit by @scala-steward)596c1a3
- Update excel-streaming-reader from 4.1.1 to 4.1.2 (commit by @scala-steward)8d6015d
- Update mill-main from 0.11.2 to 0.11.3 (commit by @scala-steward)0174550
- Update spark-core, spark-hive, spark-sql from 3.4.1 to 3.5.0 (commit by @scala-steward)
v0.19.0 - 2023-08-01
ff059db
- Update spark-core, spark-hive, spark-sql from 3.2.3 to 3.2.4 (commit by @scala-steward)ba5a122
- Update scala-collection-compat from 2.9.0 to 2.10.0 (commit by @scala-steward)406ecc2
- Update scalacheck-1-15 from 3.2.11.0 to 3.2.14.0 (commit by @scala-steward)5c9219e
- Update scalatest from 3.2.15 to 3.2.16 (commit by @scala-steward)2272117
- Update commons-io from 2.11.0 to 2.12.0 (commit by @scala-steward)1fa2f55
- Update scalafmt-core from 3.7.3 to 3.7.4 (commit by @scala-steward)2caa3ee
- Update scala-library from 2.13.10 to 2.13.11 (commit by @scala-steward)ed7e89c
- Update scala-library from 2.12.17 to 2.12.18 (PR #745 by @scala-steward)4b55f83
- Update commons-io from 2.12.0 to 2.13.0 (commit by @scala-steward)
v0.18.6 - 2023-04-03
a1d3d30
- Update sbt-dependency-tree from 1.7.1 to 1.7.3 (commit by @scala-steward)db92f01
- Update scalatest from 3.2.14 to 3.2.15 (commit by @scala-steward)708ccfa
- Update scalafmt-core from 3.6.1 to 3.7.0 (commit by @scala-steward)5b44894
- Update scalafmt-core from 3.7.0 to 3.7.1 (commit by @scala-steward)4db6f13
- Update spark-core, spark-hive, spark-sql from 3.3.1 to 3.3.2 (commit by @scala-steward)71daefa
- Update sbt-assembly from 2.1.0 to 2.1.1 (commit by @scala-steward)786b103
- Update sbt-assembly from 2.1.0 to 2.1.1 (commit by @scala-steward)b91df24
- Update scalafmt-core from 3.7.1 to 3.7.2 (commit by @scala-steward)eb21b38
- Update log4j-api, log4j-core from 2.19.0 to 2.20.0 (commit by @scala-steward)35a5b9b
- Update commons-compress from 1.22 to 1.23.0 (commit by @scala-steward)f2b74c6
- Update scalafmt-core from 3.7.2 to 3.7.3 (commit by @scala-steward)
v0.18.5 - 2022-11-09
db65e19
- Support Spark 3.3.X (PR #679 by @christianknoepfle)
79e398e
- Rename package v2.excel to excel.v2 (commit by @nightscape)
v0.18.4 - 2022-11-07
4ceca4f
- V2 streaming read (PR #653 by @pjfanning)
b86ce12
- Update scalafmt-core from 3.5.9 to 3.6.1 (PR #678 by @scala-steward)d09d232
- Update scalatest from 3.2.13 to 3.2.14 (PR #661 by @scala-steward)2344853
- Update poi-shared-strings from 2.5.4 to 2.5.5 (PR #659 by @scala-steward)1cd676e
- Update sbt-assembly from 1.2.0 to 2.0.0 (PR #665 by @scala-steward)ed97118
- Update excel-streaming-reader from 4.0.2 to 4.0.4 (PR #670 by @scala-steward)7c96184
- Update commons-compress from 1.21 to 1.22 (PR #676 by @scala-steward)
v0.18.0 - 2022-08-29
64521bb
- Update base version (commit by @nightscape)
- Feature: Add PlainNumberFormat that does not round or use scientific notations for long numbers.
Can be enabled by setting
usePlainNumberFormat=true
when reading the excel file. - Bugfix: Fixed SaveMode.Overwrite and SaveMode.Append for V2 API and spark >=3.0.1
- Feature: Writing partitioned file structure for V2 API and spark >=3.0.1
- Change: Switch to the better maintained https://github.com/pjfanning/excel-streaming-reader
- Bugfix: https://github.dev/mauch/spark-excel/pull/229
- Change: Rename
useHeader
option toheader
in order to better align with Spark's CSV reader.
- Bugfix: Properly handle empty spreadsheets
- Feature: Add `sheetNames' in shaded Workbook
- Bugfix: Shade xlsx-streamer. Should fix https://github.dev/mauch/spark-excel/issues/135
- Bugfix: Properly handle empty header cells (they get names like
_c1
) - Bugfix: Properly read non-String cells in a sheet without headers
- Change: Update POI to 4.1.0 and several other dependencies
- Bugfix: The Scala 2.12 version now actually fixes https://github.dev/mauch/spark-excel/issues/93
- Change: Cross-build for Scala 2.11 and 2.12
- Bugfix: Bundle and shade commons-compress to prevent exceptions at runtime (fixes https://github.dev/mauch/spark-excel/issues/93)
- Bugfix: Make
dataAddress
actually optional.
- Change:
dataAddress
as uniform way to specify where to read data from / write data to. Remove now obsoletesheetName
,startColumn
,endColumn
,skipFirstRows
. - Feature: Append to existing files.
Only the range implicitly or explicitly specified via
dataAddress
will be overwritten. - Change: Remove
preHeaderLines
. This is superseded by writing into a file that contains all the required pre-headers and footers.
- Bugfix: Shade commons-compress. Fixes https://github.dev/mauch/spark-excel/issues/93
- Change: Update to Apache POI 4.0.0
- Feature: Add
workbookPassword
option for reading encrypted excel spreadsheets
- Bugfix: Handle multi-line column headers properly
- Bugfix: Improve handling of columns where the first row doesn't contain any data
- Feature: Add
preHeader
option for writing rows/cells before the column headers - Feature: Add
skipFirstRows
option for skipping rows before the column headers
- Feature: Add handling of floats
- Feature: Improve performance by upgrading dependencies and instantiating date formatting lazily
- Bugfix: Infer schema for FORMULA cells
- Bugfix: Make sure files are closed after reading
- Feature: Added support for FORMULA cells when typing to String or Numeric types
- Bugfix: Shade Jackson dependency to avoid version conflicts
- Feature:
excerptSize
option determines how many rows to read when inferring schema
- Feature: Read file using streaming by specifying
maxRowsInMemory
- Feature: Serialize BigDecimals
- Feature: Detect date formatted columns when inferring schema #28
- Internal: Use scalafmt for code formatting
- Feature: Reading and writing timestamps
- Bugfix:
null
values in DataFrames are serialized as empty Strings. Thanks to @slehan
- Feature: Writing Excel files
- Change: Providing the path to the file is now either done via
.option("path", thePath)
or.load(thePath)
- Change: Some previously required parameters are now optional and have a default
- Feature: Respecting user-provided schema
- Bugfix: Several fixes to parsing