Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEAT] Streaming Local Writes for Native Executor #2871

Closed
wants to merge 9 commits into from

pq

c8708e7
Select commit
Loading
Failed to load commit list.
Closed

[FEAT] Streaming Local Writes for Native Executor #2871

pq
c8708e7
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch succeeded Sep 20, 2024 in 0s

93.12% of diff hit (target 65.48%)

View this Pull Request on Codecov

93.12% of diff hit (target 65.48%)

Annotations

Check warning on line 35 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L35

Added line #L35 was not covered by tests

Check warning on line 40 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L38-L40

Added lines #L38 - L40 were not covered by tests

Check warning on line 46 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L43-L46

Added lines #L43 - L46 were not covered by tests

Check warning on line 61 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L60-L61

Added lines #L60 - L61 were not covered by tests

Check warning on line 76 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L75-L76

Added lines #L75 - L76 were not covered by tests

Check warning on line 339 in src/daft-local-execution/src/pipeline.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-local-execution/src/pipeline.rs#L339

Added line #L339 was not covered by tests

Check warning on line 30 in src/daft-local-execution/src/sinks/buffer.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-local-execution/src/sinks/buffer.rs#L30

Added line #L30 was not covered by tests

Check warning on line 47 in src/daft-local-execution/src/sinks/buffer.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-local-execution/src/sinks/buffer.rs#L45-L47

Added lines #L45 - L47 were not covered by tests

Check warning on line 63 in src/daft-local-execution/src/sinks/buffer.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-local-execution/src/sinks/buffer.rs#L62-L63

Added lines #L62 - L63 were not covered by tests

Check warning on line 77 in src/daft-local-execution/src/sinks/buffer.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-local-execution/src/sinks/buffer.rs#L77

Added line #L77 was not covered by tests

Check warning on line 28 in src/daft-local-execution/src/sinks/physical_write.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-local-execution/src/sinks/physical_write.rs#L27-L28

Added lines #L27 - L28 were not covered by tests

Check warning on line 37 in src/daft-local-execution/src/sinks/physical_write.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-local-execution/src/sinks/physical_write.rs#L35-L37

Added lines #L35 - L37 were not covered by tests

Check warning on line 43 in src/daft-local-execution/src/sinks/physical_write.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-local-execution/src/sinks/physical_write.rs#L39-L43

Added lines #L39 - L43 were not covered by tests

Check warning on line 237 in src/daft-local-execution/src/sinks/physical_write.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-local-execution/src/sinks/physical_write.rs#L237

Added line #L237 was not covered by tests

Check warning on line 250 in src/daft-local-execution/src/sinks/physical_write.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-local-execution/src/sinks/physical_write.rs#L250

Added line #L250 was not covered by tests

Check warning on line 316 in src/daft-local-execution/src/sinks/physical_write.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-local-execution/src/sinks/physical_write.rs#L316

Added line #L316 was not covered by tests

Check warning on line 354 in src/daft-local-execution/src/sinks/physical_write.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-local-execution/src/sinks/physical_write.rs#L352-L354

Added lines #L352 - L354 were not covered by tests

Check warning on line 119 in src/daft-physical-plan/src/translate.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-physical-plan/src/translate.rs#L119

Added line #L119 was not covered by tests