[Scons-users] sconsign recovery after segfault
Kenny, Jason L
jason.l.kenny at intel.com
Wed Oct 24 14:18:02 EDT 2012
So just to add more to this.
Threading of python that is waiting on command tasks the GIL is not an issue. It only an issue for python tasks.
I have some experiments with Parts to try some extreme pickling code, which seems to say we could pickle most python builders to difference processes to get around this issue. My favorite idea is to use concurrent.futures which has a nice back port to python 2.7 ( maybe 2.6..i forget if this is true) to get around this issue, given something intelligent can be done with python based builders. (ie we could just say they execute in serial, which the other stuff does not). This library has the main work done to deal with dependencies between tasks, which could ( stress could) make life a lot easier.
We have to be careful with what is shared to the worker processes as processes require more mem than threads do.
Just a few thoughts on this subject
Jason
More information about the Scons-users
mailing list