Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] Enable using num_rows and skip_rows with ParquetReader #16249

Open
mhaseeb123 opened this issue Jul 11, 2024 · 0 comments
Open

[FEA] Enable using num_rows and skip_rows with ParquetReader #16249

mhaseeb123 opened this issue Jul 11, 2024 · 0 comments
Labels
0 - Blocked Cannot progress due to external reasons cuIO cuIO issue feature request New feature or request improvement Improvement / enhancement to an existing function non-breaking Non-breaking change
Milestone
Parquet continuou...

Comments

@mhaseeb123
Copy link
Member

mhaseeb123 commented Jul 11, 2024 •
edited
Loading

Is your feature request related to a problem? Please describe.
ParquetReader should be able to take in num_rows, skip_rows and (bonus) Expression filter and propagate them to the C++ Chunked PQ reader.

Describe the solution you'd like
ParquetReader should allow passing in additional options including num_rows, skip_rows and AST filters and propagate them to the C++ chunked parquet reader.

Describe alternatives you've considered
N/A

Additional context
N/A
@mhaseeb123 mhaseeb123 added feature request New feature or request good first issue Good for newcomers cuIO cuIO issue improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Jul 11, 2024
@mhaseeb123 mhaseeb123 changed the title [FEA] Allow using num_rows and skip_rows with ParquetReader [FEA] Enable using num_rows and skip_rows with ParquetReader Jul 11, 2024
@mhaseeb123 mhaseeb123 mentioned this issue Jul 11, 2024
Merged
3 tasks
@lithomas1 lithomas1 added 0 - Blocked Cannot progress due to external reasons and removed good first issue Good for newcomers labels Jul 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
0 - Blocked Cannot progress due to external reasons cuIO cuIO issue feature request New feature or request improvement Improvement / enhancement to an existing function non-breaking Non-breaking change
Projects
None yet
Milestone
Parquet continuous improvement
Development

No branches or pull requests
2 participants
@mhaseeb123 @lithomas1