Code

[FEAT] Implement standard deviation#3005

Code

Merged

raunakab merged 31 commits intomainEventual-Inc/Daft:mainfrom feat/stddevEventual-Inc/Daft:feat/stddevCopy head branch name to clipboardOct 8, 2024

+1,190-759

Commits

Commits on Oct 6, 2024

• Clean up code

  Show description for 818c076
  

  Raunak Bhagat

  committed
  818c076

  Copy full SHA for 818c076

• Add all structure for stddev

  

  Raunak Bhagat

  committed
  a53dfaa

  Copy full SHA for a53dfaa

Commits on Oct 7, 2024

• Implement structure for local and distributed stddev

  

  Raunak Bhagat

  committed
  2ae9d08

  Copy full SHA for 2ae9d08

• Implement non-grouped stddev

  Show description for c7f189c
  

  Raunak Bhagat

  committed
  c7f189c

  Copy full SHA for c7f189c

• Implement grouped standard deviation

  Show description for 797358f
  

  Raunak Bhagat

  committed
  797358f

  Copy full SHA for 797358f

• Remove unwraps that may have panicked because of invalid first element

  Show description for 93b125b
  

  Raunak Bhagat

  committed
  93b125b

  Copy full SHA for 93b125b

• Merge branch 'main' into feat/stddev

  

  Raunak Bhagat

  committed
  db48aa7

  Copy full SHA for db48aa7

• Add #[pyfunctions] functions to code

  Show description for a55ed2b
  

  Raunak Bhagat

  committed
  a55ed2b

  Copy full SHA for a55ed2b

• Add basic test for stddev

  

  Raunak Bhagat

  committed
  bd509d4

  Copy full SHA for bd509d4

• Add partition based testing

  Show description for 1b4d039
  

  Raunak Bhagat

  committed
  1b4d039

  Copy full SHA for 1b4d039

• Add first stage pass to stddev distributed implementation

  

  Raunak Bhagat

  committed
  633f486

  Copy full SHA for 633f486

• Add StddevMerge variant to finish the second stage aggregations

  

  Raunak Bhagat

  committed
  9b9ac18

  Copy full SHA for 9b9ac18

• Implement stddev_merge todo

  Show description for 9669a08
  

  Raunak Bhagat

  committed
  9669a08

  Copy full SHA for 9669a08

Commits on Oct 8, 2024

• Finish distribtued stddev

  

  Raunak Bhagat

  committed
  64bff42

  Copy full SHA for 64bff42

• Merge branch 'main' into feat/stddev

  

  Raunak Bhagat

  committed
  81d7f75

  Copy full SHA for 81d7f75

• Edit data-type of square_sum field in to_field impl

  

  Raunak Bhagat

  committed
  d825a21

  Copy full SHA for d825a21

• Fix errors in multi-partition aggregation planning

  

  Raunak Bhagat

  committed
  9b94626

  Copy full SHA for 9b94626

• Add some tests for stddev (single- and multi- partitioned)

  

  Raunak Bhagat

  committed
  70577ab

  Copy full SHA for 70577ab

• Finish tests for stddev feature

  

  Raunak Bhagat

  committed
  265a7a7

  Copy full SHA for 265a7a7

• Explicitly import typing module; fix lints

  

  Raunak Bhagat

  committed
  a76fade

  Copy full SHA for a76fade

• Remove SquareSum since it can just be implemented as AggExpr::Sum(Expr::Agg(AggExpr::BinaryOp { .. }))

  

  Raunak Bhagat

  committed
  7a5a36a

  Copy full SHA for 7a5a36a

• Add debug_assertions to length checking during stats calculations

  

  Raunak Bhagat

  committed
  c6eba4e

  Copy full SHA for c6eba4e

• Remove dead function and remove re-calculation of mean

  

  Raunak Bhagat

  committed
  4581104

  Copy full SHA for 4581104

• Change type of count to f64 to avoid casts in loop; remove panic assertion on re-insertion of id

  Show description for dd941b0
  

  Raunak Bhagat

  committed
  dd941b0

  Copy full SHA for dd941b0

• Change name of data-type function

  

  Raunak Bhagat

  committed
  823e3af

  Copy full SHA for 823e3af

• Add comment to populate_aggregation_stages; explains what each agg-stage is doing

  

  Raunak Bhagat

  committed
  53a0566

  Copy full SHA for 53a0566

• Add docs to dataframe stddev API

  

  Raunak Bhagat

  committed
  e4222f5

  Copy full SHA for e4222f5

• Change assert_eq to debug_assert_eq

  

  Raunak Bhagat

  committed
  0c976a4

  Copy full SHA for 0c976a4

• Update grouped-mean impl to use stats

  

  Raunak Bhagat

  committed
  65e443a

  Copy full SHA for 65e443a

• Merge branch 'main' into feat/stddev

  

  Raunak Bhagat

  committed
  04dcb04

  Copy full SHA for 04dcb04

• Add to docs

  

  Raunak Bhagat

  committed
  1874f43

  Copy full SHA for 1874f43