Installation in SGI Altix ICE 8400 EX (2304 cores) HPC

Asked by Mathan

We aware that Yede package is trailer made for the Debian based OS and I would like to install the YEDE on our
linux based SGI Altix ICE 8400 EX (2304 cores) HPC which is having

192 nodes, 2 sockets/node, 12 cores/node, 24 GB memory/node
Six core Intel Xeon 5670 processor @ 2.93 GHz with 12 MB cache/socket
Total of 384 sockets, 2304 processor cores with 4.6 TB memory
Dual rail 4x QDR IB interconnect
Enhanced hypercube, fully non-blocking
30 TB storage with Lustre parallel file system

Operating System & Management
SLES 11 OS (64-bit)
SGI ProPack 7.0 and utilities

Applications
Intel Fortran 95 & C++ compilers and debuggers
Intel Cluster Toolkit
Intel Math Kernel Libraries
Intel VTune Performance Analyzer

We have tried to build the individual prerequisites and static libraries to install the Yade and failed.
It would be great if we get more guidelines in this installation.

Question information

Language:
English Edit question
Status:
Answered
For:
Yade Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
Christian Jakob (jakob-ifgt) said :
#1

Hi Mathan,

Before you start to try anything on this cluster, please note that ...

Yade is parallelized with OpenMP, which can be used on shared memory systems (like single workstations with N cpu cores). It will definitely not work on a distributed memory system (like the most of HPCs are)! There you should look to another DEM code, which is parallelized with MPI... I think ESys is MPI based, not sure ...
If SGI Altix ICE 8400 EX is a shared memory system, you can try to run yade on it.
Otherwise you can use yade only on one node!

cheers,

christian

Revision history for this message
Mathan (rmsdiscover) said :
#2

Thank you Christian,

Unfortunately SGI Altix ICE 8400 EX is based on distributed memory system and chances of running YADE in our HPC is least.
I would like to discuss about the another idea, like conversion of openMPI to MPI which support distributed memory system. Please comment on this idea as well as if there is any another ways to install this ?

Regards
MathanJ Raja

Revision history for this message
Anton Gladky (gladky-anton) said :
#3

2012/12/11 Mathan <email address hidden>:
> I would like to discuss about the another idea, like conversion of openMPI to MPI which support distributed memory system. Please comment on this idea as well as if there is any another ways to install this ?

I think it will be easier for you to install another DEM-software,
which is MPI-oriented.

Anton

Revision history for this message
Christian Jakob (jakob-ifgt) said :
#4
Revision history for this message
Bruno Chareyre (bruno-chareyre) said :
#5

Hi Mathan,

If you need help for compilation, please report compilation errors, else we can't do much. This is independant on parallelism.

>conversion of openMPI to MPI

Maybe a misunderstanding here. Yade is not based on openMPI, it is based on openMP.
openMP to MPI is not a "conversion", it is more like writing a new parallelization from scratch.

Sticking with the current openmp implementation would let you run yade in parallel with 12 threads max (since you have 12 cores/node).

Revision history for this message
Anton Gladky (gladky-anton) said :
#6

2012/12/11 Chareyre <email address hidden>:ion from scratch.
>
> Sticking with the current openmp implementation would let you run yade
> in parallel with 12 threads max (since you have 12 cores/node).

And in many cases it is enough, because more threads require more time for
"communication" and "synchronisation". You can try to use both openmp-
and mpi-based programs and choose the most suitable for you.

Cheers,

Anton

Revision history for this message
Mathan (rmsdiscover) said :
#7

Thank you Anton, Bruno Chareyre and Christian for your useful commands. I have dropped my installation idea on the SGI Altix ICE 8400 EX(distributed memory system. Alternatively, I trying to install it on SGI Altix 4700 Compute (288 cores)
and fulfilled all the prerequisites, but presently I am stuck with compilation error.
Anton has provided some suggestions for solving that bug, but still I am facing the same problem.
Please advise me further,

https://answers.launchpad.net/yade/+question/220027

regards
MathanK Raja

Can you help with this problem?

Provide an answer of your own, or ask Mathan for more information if necessary.

To post a message you must log in.