Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The PostCommit Java ValidatesRunner Samza job is flaky #31725

Closed
github-actions bot opened this issue Jun 29, 2024 · 3 comments · Fixed by #31773
Closed

The PostCommit Java ValidatesRunner Samza job is flaky #31725

github-actions bot opened this issue Jun 29, 2024 · 3 comments · Fixed by #31773

Comments

@github-actions
Copy link
Contributor

The PostCommit Java ValidatesRunner Samza is failing over 50% of the time.
Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Samza.yml?query=is%3Afailure+branch%3Amaster to see all failed workflow runs.
See also Grafana statistics: http://metrics.beam.apache.org/d/CTYdoxP4z/ga-post-commits-status?orgId=1&viewPanel=3&var-Workflow=PostCommit%20Java%20ValidatesRunner%20Samza

@Abacn
Copy link
Contributor

Abacn commented Jul 3, 2024

testWriteUnboundedWithCustomBatchParameters (org.apache.beam.sdk.io.TextIOWriteTest) failed
runners/samza/build/test-results/validatesRunner/TEST-org.apache.beam.sdk.io.TextIOWriteTest.xml [took 4s]

java.nio.file.NoSuchFileException: /tmp/junit8641709517257447332/testwrite7008721698045235481/file.txt-00000-of-00003
	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
	...
	at java.nio.file.Files.newBufferedReader(Files.java:2784)
	at org.apache.beam.sdk.io.TextIOWriteTest.readLinesFromFile(TextIOWriteTest.java:512)
	at org.apache.beam.sdk.io.TextIOWriteTest.assertOutputFiles(TextIOWriteTest.java:488)
	at org.apache.beam.sdk.io.TextIOWriteTest.testWriteUnboundedWithCustomBatchParameters(TextIOWriteTest.java:732)

the test is newly added in #31617

@Abacn
Copy link
Contributor

Abacn commented Jul 3, 2024

The SamzaRunner seems ignored the sharding. It just outputs a single file /tmp/junit2682757985616873256/testwrite6092321157975729343/file.txt

@Amar3tto
Copy link
Contributor

Amar3tto commented Jul 4, 2024

.take-issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants