Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PERF-#4494: Get partition widths/lengths in parallel instead of serially #4683

Draft
wants to merge 14 commits into
base: master
Choose a base branch
from

Fix lints

490778c
Select commit
Loading
Failed to load commit list.
Draft

PERF-#4494: Get partition widths/lengths in parallel instead of serially #4683

Fix lints
490778c
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch succeeded Oct 25, 2024 in 0s

67.93% of diff hit (target 30.00%)

View this Pull Request on Codecov

67.93% of diff hit (target 30.00%)

Annotations

Check warning on line 1234 in modin/core/dataframe/pandas/partitioning/partition_manager.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/dataframe/pandas/partitioning/partition_manager.py#L1234 

Added line #L1234 was not covered by tests

Check warning on line 1243 in modin/core/dataframe/pandas/partitioning/partition_manager.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/dataframe/pandas/partitioning/partition_manager.py#L1243 

Added line #L1243 was not covered by tests

Check warning on line 69 in modin/core/execution/dask/implementations/pandas_on_dask/dataframe/dataframe.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/dask/implementations/pandas_on_dask/dataframe/dataframe.py#L69 

Added line #L69 was not covered by tests

Check warning on line 72 in modin/core/execution/dask/implementations/pandas_on_dask/dataframe/dataframe.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/dask/implementations/pandas_on_dask/dataframe/dataframe.py#L72 

Added line #L72 was not covered by tests

Check warning on line 77 in modin/core/execution/dask/implementations/pandas_on_dask/dataframe/dataframe.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/dask/implementations/pandas_on_dask/dataframe/dataframe.py#L77 

Added line #L77 was not covered by tests

Check warning on line 277 in modin/core/execution/dask/implementations/pandas_on_dask/partitioning/partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/dask/implementations/pandas_on_dask/partitioning/partition.py#L277 

Added line #L277 was not covered by tests

Check warning on line 305 in modin/core/execution/dask/implementations/pandas_on_dask/partitioning/partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/dask/implementations/pandas_on_dask/partitioning/partition.py#L305 

Added line #L305 was not covered by tests

Check warning on line 385 in modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py#L385 

Added line #L385 was not covered by tests

Check warning on line 389 in modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py#L389 

Added line #L389 was not covered by tests

Check warning on line 395 in modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py#L392-L395 

Added lines #L392 - L395 were not covered by tests

Check warning on line 398 in modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py#L398 

Added line #L398 was not covered by tests

Check warning on line 419 in modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py#L419 

Added line #L419 was not covered by tests

Check warning on line 423 in modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py#L423 

Added line #L423 was not covered by tests

Check warning on line 429 in modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py#L426-L429 

Added lines #L426 - L429 were not covered by tests

Check warning on line 432 in modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/dask/implementations/pandas_on_dask/partitioning/virtual_partition.py#L432 

Added line #L432 was not covered by tests

Check warning on line 75 in modin/core/execution/ray/implementations/pandas_on_ray/dataframe/dataframe.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/ray/implementations/pandas_on_ray/dataframe/dataframe.py#L74-L75 

Added lines #L74 - L75 were not covered by tests

Check warning on line 79 in modin/core/execution/ray/implementations/pandas_on_ray/dataframe/dataframe.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/ray/implementations/pandas_on_ray/dataframe/dataframe.py#L79 

Added line #L79 was not covered by tests

Check warning on line 109 in modin/core/execution/ray/implementations/pandas_on_ray/dataframe/dataframe.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/ray/implementations/pandas_on_ray/dataframe/dataframe.py#L108-L109 

Added lines #L108 - L109 were not covered by tests

Check warning on line 117 in modin/core/execution/ray/implementations/pandas_on_ray/dataframe/dataframe.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/ray/implementations/pandas_on_ray/dataframe/dataframe.py#L116-L117 

Added lines #L116 - L117 were not covered by tests

Check warning on line 391 in modin/core/execution/ray/implementations/pandas_on_ray/partitioning/virtual_partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/ray/implementations/pandas_on_ray/partitioning/virtual_partition.py#L391 

Added line #L391 was not covered by tests

Check warning on line 395 in modin/core/execution/ray/implementations/pandas_on_ray/partitioning/virtual_partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/ray/implementations/pandas_on_ray/partitioning/virtual_partition.py#L395 

Added line #L395 was not covered by tests

Check warning on line 401 in modin/core/execution/ray/implementations/pandas_on_ray/partitioning/virtual_partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/ray/implementations/pandas_on_ray/partitioning/virtual_partition.py#L398-L401 

Added lines #L398 - L401 were not covered by tests

Check warning on line 404 in modin/core/execution/ray/implementations/pandas_on_ray/partitioning/virtual_partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/ray/implementations/pandas_on_ray/partitioning/virtual_partition.py#L404 

Added line #L404 was not covered by tests

Check warning on line 425 in modin/core/execution/ray/implementations/pandas_on_ray/partitioning/virtual_partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/ray/implementations/pandas_on_ray/partitioning/virtual_partition.py#L425 

Added line #L425 was not covered by tests

Check warning on line 429 in modin/core/execution/ray/implementations/pandas_on_ray/partitioning/virtual_partition.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

modin/core/execution/ray/implementations/pandas_on_ray/partitioning/virtual_partition.py#L429 

Added line #L429 was not covered by tests
View more details on Codecov