[Scons-users] Automatic Retry
Robert Zeigler
robert.zeigler at gmail.com
Mon Sep 5 12:45:16 EDT 2016
We've run into a similar issue, where there is a somewhat buggy version
of an absolutely necessary tool. 98% of the time, it works fine.
Sometimes, when processing large files and paging to disk, it crashes.
In our case, we already override the slurm_spawn function for other
purposes, and all of our tasks supply custom environments. So we added a
"MAX_RETRIES" environment variable that the spawn function examines to
determine how many times to rety a failed task.
Best,
Robert
> Bill Deegan <mailto:bill at baddogconsulting.com>
> September 5, 2016 at 9:27 AMvia Postbox
> <https://www.postbox-inc.com/?utm_source=email&utm_medium=sumlink&utm_campaign=reach>
> What platform are you running on?
> You could either wrap your tool with a script which retries on failure
> N times and then call that from scons,
> or change the command being run to have some bash scripted loop.
>
> -Bill
>
>
> _______________________________________________
> Scons-users mailing list
> Scons-users at scons.org
> https://pairlist4.pair.net/mailman/listinfo/scons-users
--
Sent from Postbox
<https://www.postbox-inc.com/?utm_source=email&utm_medium=siglink&utm_campaign=reach>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://pairlist4.pair.net/pipermail/scons-users/attachments/20160905/24e95c20/attachment.html>
More information about the Scons-users
mailing list