[Scons-users] import pandas into SConstruct
Bill Deegan
bill at baddogconsulting.com
Thu Mar 10 20:52:00 EST 2016
Seems to work for me.
Now have to make sure making that change doesn't break anything. Shouldn't
Python 3 doesn't have cpickle it just does the right thing. Python 2 you
need to try one and then use the other if the first isn't available.
-Bill
On Thu, Mar 10, 2016 at 8:24 PM, chris warth <cswarth at gmail.com> wrote:
> Thanks , Bill, I'll try your fix when I get off the bus.
>
> $ scons --version
> SCons by Steven Knight et al.:
> script: v2.4.1.rel_2.4.1:3453:73fefd3ea0b0, 2015/11/09 03:25:05,
> by bdbaddog on ubuntu1404-32bit
> engine: v2.4.1.rel_2.4.1:3453:73fefd3ea0b0, 2015/11/09 03:25:05,
> by bdbaddog on ubuntu1404-32bit
> engine path: ['/shared/silo_researcher
>
> On Thursday, March 10, 2016, Bill Deegan <bill at baddogconsulting.com>
> wrote:
>
>> O.k. Try commenting out this line:
>>
>> around line 85 in whatever your equivalent to:
>> /Users/bdbaddog/tmp/panda/venv/lib/python2.7/site-packages/scons-2.4.1/SCons/compat/__init__.py
>> is.
>>
>> # In 3.x, 'pickle' automatically loads the fast version if available.
>> #rename_module('pickle', 'cPickle')
>>
>>
>> On Thu, Mar 10, 2016 at 8:19 PM, Bill Deegan <bill at baddogconsulting.com>
>> wrote:
>>
>>> Chris,
>>>
>>> I see the problem. (in scons's compat.py renaming packages to prep for
>>> py3 compatibility).
>>> Which version of SCons are you using?
>>>
>>> -Bill
>>>
>>> On Thu, Mar 10, 2016 at 8:12 PM, chris warth <cswarth at gmail.com> wrote:
>>>
>>>> Thanks! If it's any help, I've reduced the example to one that doesn't
>>>> involve pandas at all. It seems that under scons, 'pkl.Unpickler' is a
>>>> function rather than a class.
>>>>
>>>> $ cat scons.py
>>>>
>>>> import pickle as pkl
>>>> print type(pkl.Unpickler)
>>>>
>>>> class Unpickler(pkl.Unpickler):
>>>> pass
>>>>
>>>> $ python scons.py
>>>>
>>>>
>>>>
>>>>
>>>> <type 'classobj'>
>>>>
>>>> $ scons -f scons.py
>>>>
>>>>
>>>>
>>>>
>>>> scons: Reading SConscript files ...
>>>> <type 'builtin_function_or_method'>
>>>> TypeError: Error when calling the metaclass bases
>>>> cannot create 'builtin_function_or_method' instances:
>>>> File "/path/explore/scons.py", line 5:
>>>> class Unpickler(pkl.Unpickler):
>>>>
>>>>
>>>> On Thu, Mar 10, 2016 at 5:09 PM, Bill Deegan <bill at baddogconsulting.com
>>>> > wrote:
>>>>
>>>>> Just built a virtualenv with pandas and scons.
>>>>> Get same stack trace.
>>>>> Let me take a quick look and see if it's something simple.
>>>>>
>>>>> -Bill
>>>>>
>>>>> On Thu, Mar 10, 2016 at 7:49 PM, William Blevins <
>>>>> wblevins001 at gmail.com> wrote:
>>>>>
>>>>>> See inline.
>>>>>>
>>>>>> On Thu, Mar 10, 2016 at 10:39 PM, chris warth <cswarth at gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> I am having trouble importing the pandas package into an SConstruct
>>>>>>> file.
>>>>>>> Can anyone confirm if this is real defect or just something in my
>>>>>>> environment?
>>>>>>>
>>>>>>> Thanks for any help,
>>>>>>>
>>>>>>> - Chris
>>>>>>>
>>>>>>>
>>>>>>> $ cat >scons.test
>>>>>>>> import pandas as pd
>>>>>>>> ^D
>>>>>>>> $ scons -f scons.test
>>>>>>>> scons: Reading SConscript files ...
>>>>>>>> TypeError: Error when calling the metaclass bases
>>>>>>>> cannot create 'builtin_function_or_method' instances:
>>>>>>>> File "/path/explore/scons.test", line 1:
>>>>>>>> import pandas as pd
>>>>>>>> File
>>>>>>>> "/path/venv/local/lib/python2.7/site-packages/pandas/__init__.py", line 48:
>>>>>>>> from pandas.io.api import *
>>>>>>>> File
>>>>>>>> "/path/venv/local/lib/python2.7/site-packages/pandas/io/api.py", line 14:
>>>>>>>> from pandas.io.pickle import read_pickle, to_pickle
>>>>>>>> File
>>>>>>>> "/path/venv/local/lib/python2.7/site-packages/pandas/io/pickle.py", line 1:
>>>>>>>> from pandas.compat import cPickle as pkl, pickle_compat as pc,
>>>>>>>> PY3
>>>>>>>> File
>>>>>>>> "/path/venv/local/lib/python2.7/site-packages/pandas/compat/pickle_compat.py",
>>>>>>>> line 57:
>>>>>>>> class Unpickler(pkl.Unpickler):
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>> This error isn't coming from SCons. This error is coming from trying
>>>>>> to import from the pandas library. Right? Is the version of pandas
>>>>>> installed setup for python3 rather than python2?
>>>>>>
>>>>>>
>>>>>>> $ python --version
>>>>>>>> Python 2.7.6
>>>>>>>> $ scons --version
>>>>>>>> SCons by Steven Knight et al.:
>>>>>>>> script: v2.4.1.rel_2.4.1:3453:73fefd3ea0b0, 2015/11/09
>>>>>>>> 03:25:05, by bdbaddog on ubuntu1404-32bit
>>>>>>>> engine: v2.4.1.rel_2.4.1:3453:73fefd3ea0b0, 2015/11/09
>>>>>>>> 03:25:05, by bdbaddog on ubuntu1404-32bit
>>>>>>>> engine path:
>>>>>>>> ['/shared/silo_researcher/Matsen_F/MatsenGrp/working/cwarth/founder-inference-bakeoff/venv/lib/scons-2.4.1/SCons']
>>>>>>>> Copyright (c) 2001 - 2015 The SCons Foundation
>>>>>>>> $ python -c 'import pandas as pd; print pd.__version__'
>>>>>>>> 0.17.1
>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Scons-users mailing list
>>>>>>> Scons-users at scons.org
>>>>>>> https://pairlist4.pair.net/mailman/listinfo/scons-users
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Scons-users mailing list
>>>>>> Scons-users at scons.org
>>>>>> https://pairlist4.pair.net/mailman/listinfo/scons-users
>>>>>>
>>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Scons-users mailing list
>>>>> Scons-users at scons.org
>>>>> https://pairlist4.pair.net/mailman/listinfo/scons-users
>>>>>
>>>>>
>>>>
>>>> _______________________________________________
>>>> Scons-users mailing list
>>>> Scons-users at scons.org
>>>> https://pairlist4.pair.net/mailman/listinfo/scons-users
>>>>
>>>>
>>>
>>
> _______________________________________________
> Scons-users mailing list
> Scons-users at scons.org
> https://pairlist4.pair.net/mailman/listinfo/scons-users
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://pairlist4.pair.net/pipermail/scons-users/attachments/20160310/ecf2fed4/attachment.html>
More information about the Scons-users
mailing list