Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

No records is returned until read.max.wait.ms is reached. #35

Closed
fhussonnois opened this issue Jun 3, 2020 · 0 comments
Closed

No records is returned until read.max.wait.ms is reached. #35

fhussonnois opened this issue Jun 3, 2020 · 0 comments

Comments

@fhussonnois
Copy link
Member

The RowFileInputReader waits for read.max.wait.ms for more records to be available when the reader reaches the end of file. Currently, the waiting process is applied into the RowFileInputIterator#hasNext() method which is invoked in different places. Unfortunately this blocks the processing of the latest read records.
@fhussonnois fhussonnois changed the title No records is returned unti read.max.wait.ms is reached. No records is returned until read.max.wait.ms is reached. Jun 3, 2020
fhussonnois added a commit that referenced this issue Jun 3, 2020
@fhussonnois
fix(plugin): do not wait for more data before returning available rec…
08b5a9d 
…ords

Refactor RowFileInputIterator class so that we only wait for more lines
when next records must be returned.

Resolves GH-27 and resolves GH-35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@fhussonnois