Skip to content

feat: 3154 from_parquet should be able to read partial columns#3156

Merged
tcawlfield merged 5 commits into
mainfrom
3154-akfrom_parquet-should-be-able-to-read-partial-columns
Jun 24, 2024
Merged

feat: 3154 from_parquet should be able to read partial columns#3156
tcawlfield merged 5 commits into
mainfrom
3154-akfrom_parquet-should-be-able-to-read-partial-columns

Conversation

@tcawlfield

Copy link
Copy Markdown
Collaborator

This should fix a missing feature (or fix a bug, depending on your POV) from 2772.

Also taking the opportunity to clean up test_2772 a tiny little bit. This completes a misunderstanding of mine from issue 3131 (which can be closed or rejected).

This had been bugging me, and with a better understanding now I can improve
the unit tests. Mostly for future readability and correctness.
@tcawlfield
tcawlfield requested a review from jpivarski June 18, 2024 18:24
@tcawlfield tcawlfield self-assigned this Jun 18, 2024
@tcawlfield tcawlfield linked an issue Jun 18, 2024 that may be closed by this pull request

@jpivarski jpivarski left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks like a good test of partial read-back. This is going through the new metadata, right?

Comment thread tests/test_2772_parquet_extn_array_metadata.py
Comment thread tests/test_3154_parquet_subcolumn_select.py Outdated
@tcawlfield
tcawlfield merged commit 03f6169 into main Jun 24, 2024
@tcawlfield
tcawlfield deleted the 3154-akfrom_parquet-should-be-able-to-read-partial-columns branch June 24, 2024 21:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ak.from_parquet should be able to read partial columns

3 participants