qsv v1.0.0 is here! π
After over 3 years of development, nearly 200 releases, and 11,000+ commits, qsv has finally reached v1.0.0!
What started as a hobby project to learn Rust during COVID has evolved into a powerful data wrangling tool used in multiple datHere products, open source projects, and even in several mission-critical production environments!
To mark this major milestone, this larger than usual release includes major performance improvements, new features, and various optimizations!
NOTE: If you want to find out more about how we use qsv in our production pipelines, join our webinar this Wednesday, Dec 4 at 1p EST - How to make your Data Useful, Usable & Used with Internal Data Portals (see accompanying blogpost for more info).
Added
joinp
: add--ignore-case
option #2287py
: add ability to load python expression from file #2295replace
: add--not-one
flag (resolves #2305) by @rzmk in #2307slice
: add--invert
option #2298stats
: add dataset-level stats #2297sqlp
: auto-decompression of gzip, zstd & zlib compressed csv files withread_csv
table function (implements suggestion from @wardi in #2301) #2315template
: add lookup support #2313- added
ui
feature to make it easier to make a headless build of qsv #2289 - added better panic handling #2304
- added new benchmark for
template
command cd7e480 - added π
lookup support
legend b46de73
Changed
- move qsv from personal Github repo to datHere GitHub org #2317
template
: parallelized template rendering for significant speedups #2273- simplify input format check #2309
- bump embedded
luau
from 0.650 to 0.653 986a1d3 - deps: Switch back to
simple-home-dir
fromsimple-expand-tilde
#2319 - deps: Add minijinja contrib #2276
- deps: bump pyo3 down to 0.21.2 because polars-mem-engine is not compatible with pyo3 0.23.x yet 7f9fc8a
- build(deps): bump base62 from 2.0.2 to 2.0.3 by @dependabot in #2281
- build(deps): bump bytemuck from 1.19.0 to 1.20.0 by @dependabot in #2299
- build(deps): bump bytes from 1.8.0 to 1.9.0 by @dependabot in #2314
- build(deps): bump file-format from 0.25.0 to 0.26.0 by @dependabot in #2277
- build(deps): bump hashbrown from 0.15.1 to 0.15.2 by @dependabot in #2310
- build(deps): bump itoa from 1.0.11 to 1.0.12 by @dependabot in #2300
- build(deps): bump itoa from 1.0.12 to 1.0.13 by @dependabot in #2302
- build(deps): bump itoa from 1.0.13 to 1.0.14 by @dependabot in #2311
- build(deps): bump mlua from 0.10.0 to 0.10.1 by @dependabot in #2280
- build(deps): bump mlua from 0.10.1 to 0.10.2 by @dependabot in #2316
- build(deps): bump serial_test from 3.1.1 to 3.2.0 by @dependabot in #2279
- build(deps): bump minijinja from 2.4.0 to 2.5.0 by @dependabot in #2284
- build(deps): bump minijinja-contrib from 2.3.1 to 2.5.0 by @dependabot in #2283
- build(deps): bump rfd from 0.15.0 to 0.15.1 by @dependabot in #2291
- build(deps): bump sanitize-filename from 0.5.0 to 0.6.0 by @dependabot in #2275
- build(deps): bump serde from 1.0.214 to 1.0.215 by @dependabot in #2286
- build(deps): bump serde_json from 1.0.132 to 1.0.133 by @dependabot in #2292
- build(deps): bump tempfile from 3.13.0 to 3.14.0 by @dependabot in #2278
- build(deps): bump tokio from 1.41.0 to 1.41.1 by @dependabot in #2274
- build(deps): bump url from 2.5.3 to 2.5.4 by @dependabot in #2306
- applied several clippy suggestions
- bumped numerous indirect dependencies to latest versions
- bumped MSRV to latest Rust stable (1.83.0)
- bumped Rust nightly from 2024-11-01 to 2024-11-28, the same version used by Polars
Fixed
- fix
get_stats_records()
helper to handle input files with embedded spaces (fixes #2294) #2296 - added better panic handling (fixes #2301) #2304
- implement simple format check for input files (fixes #2301) #2308
Removed
- removed
simple-expand-tilde
dependency in favor ofsimple-home-dir
#2318 - removed patched fork of
indicatif
now that 0.17.9 is released, fixing GH unmaintained advisory forinstant
33fa54a - removed
clipboard
command fromqsvlite
binary variant 9c663d8
Full Changelog: 0.138.0...1.0.0