Skip to content

Commit

Permalink
Bump further to 2500+ columns (or similar)
Browse files Browse the repository at this point in the history
Signed-off-by: Sebastian Berg <[email protected]>
  • Loading branch information
seberg committed Jan 29, 2025
1 parent 8cf8ef0 commit dd55096
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 4 deletions.
4 changes: 2 additions & 2 deletions cpp/src/core/library.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -122,8 +122,8 @@ legate::Library create_and_registrate_library()
GlobalMemoryResource::set_as_default_mmr_resource();
}
// Set with_has_allocations globally since currently all tasks allocate (and libcudf may also)
// Also ensure we can generally work with 100+ return columns.
auto options = legate::VariantOptions{}.with_has_allocations(true).with_return_size(8192);
// Also ensure we can generally work with 2000+ return columns.
auto options = legate::VariantOptions{}.with_has_allocations(true).with_return_size(131072);
auto context =
legate::Runtime::get_runtime()->find_or_create_library(library_name,
legate::ResourceConfig{},
Expand Down
5 changes: 3 additions & 2 deletions python/tests/test_csv.py
Original file line number Diff line number Diff line change
Expand Up @@ -60,10 +60,11 @@ def test_read_single_rows(tmp_path):

def test_read_single_many_columns(tmp_path):
# Legate has a limit on number of returns which limnits the
# number of columns (currently). Make sure we support 100.
# number of columns (currently). Make sure we support 1250.
# 2500+ are OK, but requires higher `--czmem`.
file = tmp_path / "file.csv"
# Write a file with many columns (and a few rows)
ncols = 120
ncols = 1250
for i in range(5):
file.write_text(",".join([str(i) for i in range(ncols)]) + "\n")

Expand Down

0 comments on commit dd55096

Please sign in to comment.