[Scons-users] sconsign recovery after segfault

Kenny, Jason L jason.l.kenny at intel.com
Wed Oct 24 14:18:02 EDT 2012



So just to add more to this.

Threading of python that is waiting on command tasks the GIL is not an issue. It only an issue for python tasks.
I have some experiments with Parts to try some extreme pickling code, which seems to say we could pickle most python builders to difference processes to get around this issue. My favorite idea is to use concurrent.futures which has a nice back port to python 2.7 ( maybe 2.6..i forget if this is true) to get around this issue, given something intelligent can be done with python based builders. (ie we could just say they execute in serial, which the other stuff does not). This library has the main work done to deal with dependencies between tasks, which could ( stress could) make life a lot easier.
We have to be careful with what is shared to the worker processes as processes require more mem than threads do.

Just a few thoughts on this subject

Jason


More information about the Scons-users mailing list