Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Restarting a Batch #114

Open
michaeljrbc opened this issue Dec 14, 2021 · 2 comments
Open

Restarting a Batch #114

michaeljrbc opened this issue Dec 14, 2021 · 2 comments
Assignees
Labels
help wanted Extra attention is needed

Comments

@michaeljrbc
Copy link

Hi,

I ran the proc: EXECUTE [procfwk].[ResetExecution] for a failed batch middway of execution.

How then do I get it restarted because the proc says it will be ready for restart but if I execute the main pipeline it fails because it checks to see if a pipeline is running in sql which that proc makes it look like it is running but in reality nothing whatsoever is even happening ?

Regards,
Michael

@michaeljrbc michaeljrbc added the help wanted Extra attention is needed label Dec 14, 2021
@jamclaug
Copy link

If you update the procfwk.BatchExecution table and set the BatchStatus for the failed batch (that is currently at BatchStatus
'Running') to 'Stopped' you can then trigger the Parent pipeline with that batch name as a parameter to restart the batch.

That said, this should be done in the ResetExecution procedure or through some other mechanism - Ideally checking if the pipeline is ACTUALLY running for that batch and updating it on reset.

@jamclaug
Copy link

jamclaug commented Aug 9, 2022

The fix for this should be in 2.1 beta. Adding 3 retries for all activities that access the metadata db resolves a number of issues that leave the metadata in an inconsistent state. Errors accessing the metadata db have been our number 1 issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

3 participants