[Scons-users] Trouble installing package on a supercomputer.
Damien
damien at khubla.com
Wed Sep 10 17:23:55 EDT 2014
Ray,
The mpixx wrappers always call the full C/C++/Fortran compilers anyway.
It's just a wrapper, so even if you built OpenMPI with that compiler on
another machine and installed it you still need the compiler available
on your path (with a license) in order for mpicc to work on that machine.
Damien
On 2014-09-10 3:18 PM, Ray Sheppard wrote:
> Hi Jason,
> Thanks for the help. I apologize I have tried to shorten my
> explanations to save space. I know I am getting the mpicc wrapper
> from the OpenMPI build, I built it. There is no Intel mpicc on the
> system. I (well actually Jim Dietz maintains the Intel compiler) did
> not install the Intel MPI package. We spun off the compiler and I
> used that to build the MPI. It is properly in my path and the build
> system sees and uses it. It also goes off on its own to look for a
> license that does not exist. OpenMPI does not have one. Somewhere,
> the system has been told that if it is going to use MPI, there is a
> license file needed. I am sorry but it is wrong. As with most
> software, it is fairly hard headed about it until I can find where it
> might think that.
> So, I decided that it might think differently about GNU. I built an
> OpenMPI for GNU and swapped paths. I did much better. It now
> assembles a compile line. I have never been a fan of parallel
> compilations, so it likely has a long way to go, but the intermediate
> files are compiling as mpicc and mpiCC by telling scons.py cxx=gcc and
> extras=mpi,static. Thanks for the help, but if I can't turn off the
> license, GNU will have to do. The scary part is that I am just
> building on the cluster for practice. The original request from the
> Cell and Virus Theory Center was to put this beast on the Cray.
> Ray
>
> On 9/10/2014 4:46 PM, Kenny, Jason L wrote:
>>
>> Hi,
>>
>> So there are a lot of details that go in to a MPI build. As I
>> understand it the Intel MPI is based on the MPICH as well. From what
>> I can pull out from the e-mail ( and note I am not a MPI/cluster
>> expert .. the team next to me is, so this is more their suggestion)
>> is that you probably are having a path issue at the moment. Since
>> your are pulling you shell path in to the scons build, you souls
>> check to see which mpicxx you are using. You have it hard coded in to
>> replace the cxx with mpicxx... This is just a general mpi compiler
>> wrapper that is not explicit to Intel or Cray versions of the
>> compiler. It could call anything depending on your current shell
>> environment.
>>
>> So at the moment form what I understand of your setup, this is not as
>> much a scons issues but what tools are being called in the toolchain.
>> I am pretty sure given what you have shown so far, this would not be
>> any different using gmake.
>>
>> Jason
>>
>> *From:*Scons-users [mailto:scons-users-bounces at scons.org] *On Behalf
>> Of *Ray Sheppard
>> *Sent:* Wednesday, September 10, 2014 3:11 PM
>> *To:* SCons users mailing list
>> *Subject:* Re: [Scons-users] Trouble installing package on a
>> supercomputer.
>>
>> Thanks,
>> The real problem is that there is no license file. It keeps
>> looking for an Intel compiler license file but we do not use Intel
>> MPI. I do have an Intel built OpenMPI on the cluster. So, I have
>> tried to just get that to build. This package seems happier (less
>> initial errors) on the cluster than the originally requested Cray.
>> The package understands and uses the proper mpicc/CC, but then
>> expects it to be Intel and need a license, which it isn't and
>> doesn't. I would love to just turn that off somehow.
>>
>> The Cray uses its own MPI, which is based on MPICH2. That has a
>> license associated with it, but it has larger issues. The Cade
>> automatically searches for library calls in the source code and links
>> things like MPI and various math libraries without an external
>> compiler wrapper like mpicc or explicit links like -llapack. That
>> seemed to drive the build nuts in various ways.
>>
>> Thanks again for the help,
>> Ray
>>
>> On 9/10/2014 3:16 PM, Kenny, Jason L wrote:
>>
>> HI,
>>
>> Looks like you are using the MPI compiler. SCons ( and my
>> extension Parts) don't directly support the MPI compiler at the
>> moment via a tool. From what I see below it look like you the
>> path needed for the license to be seen by the compiler is missing.
>>
>> There are two ways to fix this.
>>
>> 1)Add the intelc tool to the toolchain you are using. This should
>> setup the stuff needed to find the license file.
>>
>> 2)The script you would normally run to source the path to run
>> this compiler would add a variable INTEL_LICENSE_FILE to the
>> shell environment. If you take this value and add it to the
>> env["EVV"] value the compiler should work. Form below I think
>> this added line should work.
>>
>> "overrides" : {
>> "ENV" : {
>> "LIBRARY_PATH":os.environ["LIBRARY_PATH"],
>> "LD_LIBRARY_PATH":os.environ["LD_LIBRARY_PATH"],
>> "CPATH":os.environ["CPATH"],
>> "PATH":os.environ["PATH"],
>> "MODULEPATH":os.environ["MODULEPATH"],
>> "MODULESHOME":os.environ["MODULESHOME"],
>>
>> *"INTEL_LICENSE_FILE":**os.environ[**"INTEL_LICENSE_FILE"**],**
>> * }
>> },
>>
>>
>> Hope this helps
>>
>> Jason
>>
>>
>
>
>
> _______________________________________________
> Scons-users mailing list
> Scons-users at scons.org
> https://pairlist4.pair.net/mailman/listinfo/scons-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://pairlist4.pair.net/pipermail/scons-users/attachments/20140910/bbf2c552/attachment-0001.html>
More information about the Scons-users
mailing list