-
Notifications
You must be signed in to change notification settings - Fork 891
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Small clean up to simplify column selection code in ORC reader #9444
Small clean up to simplify column selection code in ORC reader #9444
Conversation
Codecov Report
@@ Coverage Diff @@
## branch-21.12 #9444 +/- ##
================================================
+ Coverage 10.79% 10.82% +0.03%
================================================
Files 116 117 +1
Lines 18869 19043 +174
================================================
+ Hits 2036 2061 +25
- Misses 16833 16982 +149
Continue to review full report at Codecov.
|
rerun tests |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
*/ | ||
void add_column(std::vector<std::vector<orc_column_meta>>& selection, | ||
std::vector<SchemaType> const& types, | ||
const size_t level, | ||
const uint32_t id, | ||
bool& has_timestamp_column, | ||
bool& has_nested_column) | ||
bool& has_timestamp_column) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In case you ever add more flags like this it might be a good place to use a set of bit flags instead of multiple bools. Not actionable now, just a thought.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I would prefer to return pair/tuple of bools instead of having output argument.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm hoping to remove the remaining flag at some point.
rerun tests |
@gpucibot merge |
Remove
has_nested_column
from column selection and theimpl
class.Deduce the existence of nested columns from the depth of the schema instead.