Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The PostCommit Java ValidatesRunner Dataflow V2 job is flaky #33720

Closed
github-actions bot opened this issue Jan 22, 2025 · 8 comments · Fixed by #33921 or #34027
Closed

The PostCommit Java ValidatesRunner Dataflow V2 job is flaky #33720

github-actions bot opened this issue Jan 22, 2025 · 8 comments · Fixed by #33921 or #34027

Comments

@github-actions
Copy link
Contributor

The PostCommit Java ValidatesRunner Dataflow V2 is failing over 50% of the time.
Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_V2.yml?query=is%3Afailure+branch%3Amaster to see all failed workflow runs.
See also Grafana statistics: http://metrics.beam.apache.org/d/CTYdoxP4z/ga-post-commits-status?orgId=1&viewPanel=2&var-Workflow=PostCommit%20Java%20ValidatesRunner%20Dataflow%20V2

@Amar3tto
Copy link
Collaborator

Fixed after #33745

@github-actions github-actions bot added this to the 2.63.0 Release milestone Jan 24, 2025
@github-actions github-actions bot reopened this Feb 5, 2025
Copy link
Contributor Author

github-actions bot commented Feb 5, 2025

Reopening since the workflow is still flaky

@Amar3tto
Copy link
Collaborator

Amar3tto commented Feb 5, 2025

The culprit: #33385

@Amar3tto
Copy link
Collaborator

Amar3tto commented Feb 6, 2025

@rohitsinha54 ptal

Copy link
Contributor Author

Reopening since the workflow is still flaky

@rohitsinha54
Copy link
Contributor

I looked at the failures. It is WAI. Now in our backend we did a change where if the job has not specified --enable_lineage we don't store its stringset metric in spanner and hence backend can't return it for test to pass. We will need to update the test. I will work on it.

@Amar3tto
Copy link
Collaborator

I looked at the failures. It is WAI. Now in our backend we did a change where if the job has not specified --enable_lineage we don't store its stringset metric in spanner and hence backend can't return it for test to pass. We will need to update the test. I will work on it.

Please let me know if you need any help with this

@Abacn
Copy link
Contributor

Abacn commented Feb 19, 2025

opened #34027 for fix

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment