Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Flows: retry logic for failed tasks #400

Open
zaychenko-sergei opened this issue Dec 27, 2023 · 0 comments
Open

Flows: retry logic for failed tasks #400

zaychenko-sergei opened this issue Dec 27, 2023 · 0 comments
Assignees
@zaychenko-sergei
Labels
enhancement New feature or request rust Pull requests that update Rust code

Comments

@zaychenko-sergei
Copy link
Contributor

When flow associated task fails:

  • Allow retry logic (failures threshold, failures classification)
  • Recognized technical failures (executors failure) vs bad logic in queries (logical errors in the dataset)

Automatically disable scheduling rule (don’t reset it, just disable) for the flow after a logical failure. Enable it back after the user corrects the query, and the task succeeds.

Future: notify owner / owners of descendant datasets about interrupt effect in the flows
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zaychenko-sergei zaychenko-sergei

Labels
enhancement New feature or request rust Pull requests that update Rust code
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@zaychenko-sergei @s373r