Compilation and Running on HPC cluster -Centos 7

Asked by Gianni Pellegrini

Hello,
could you please advise if the following steps are correct in order to install and run yade in a cluster?

1) Compile YADE and pre-requisites . For compiling YADE, it should be used -DENABLE_OAR=1 option to cmake to enable it.
2) if successful, run YADE through the following command:
yade-oar --oar-project=<your project name> --oar-script=job.sh --oar-walltime=hh:mm:ss parameters.table simulation.py

where it needs a batch file (such as for yade-batch) and a bash file for the jobs.

Is that correct?
I was confused with the guidance in https://yade-dem.org/doc/mpy.html

Thanks for the support

Question information

Language:
English Edit question
Status:
Answered
For:
Yade Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:

This question was reopened

Revision history for this message
Jérôme Duriez (jduriez) said :
#1

Hi,

If I were you, I would first focus on the operating system of your intended machine, which is not the most YADE-classical (which is Ubuntu) if I understand correctly your title.

The OAR thing would come a bit second (or, at least, not first) I would say, if you confirm to us this is the scheduler tool used on your cluster.

Revision history for this message
Gianni Pellegrini (antrox) said :
#2

Hi Jerome,
Ok, we will try to compile it first in CentOS.
The current scheduler is Slurm
https://slurm.schedmd.com/documentation.html
Would it be a problem ? Do I need to follow this guidance https://yade-dem.org/doc/mpy.html for this case?
thank you

Revision history for this message
Janek Kozicki (cosurgi) said :
#3

There is an ongoing effort to compile yade on centos, it is not finished yet, see:

https://gitlab.com/yade-dev/docker-yade/-/issues/5
https://gitlab.com/yade-dev/trunk/-/issues/253

good luck!

Revision history for this message
Gianni Pellegrini (antrox) said :
#4

Thank you Janek,
so I think it is much above my skills!
I will have a go but I believe I need to wait for you : )

thanks

Revision history for this message
Gianni Pellegrini (antrox) said :
#5

Thanks Janek Kozicki, that solved my question.

Revision history for this message
Janek Kozicki (cosurgi) said :
#6

To be clear, I never used CentOS. The effort to port yade to CentOS is by Tóth János and Danny van der Haven.

You will have more luck with one of the distributions listed in the color table at the top here: https://yade-dem.org/doc/installation.html#packages

Revision history for this message
Bruno Chareyre (bruno-chareyre) said :
#7

Hi,
In your situation, I would first check if the host HPC has Singularity (maybe) or Docker (unlikely) available.
If so, you don't need to compile. Just run a virtual machine.

ENABLE_OAR is unrelated to the problem, and it is not a requirement even for submitting OAR jobs.

Neither is https://yade-dem.org/doc/mpy.html supposed to provide any guidance on the issue at hand.

Revision history for this message
Gianni Pellegrini (antrox) said :
#8

thank you Bruno,
we are following this approach and i hope to have good news soon
cheers

Revision history for this message
Gianni Pellegrini (antrox) said :
#9

Hello,
we installed UBUNTU 16 on CentOS through Singularity
Yade has been installed correctly.

I have a few trivial questions:
1) is yadedaily the latest version although Ubuntu version is 16? When I launch yadedaily it shows: Welcome to Yade 20220429-6506~6b71c48~xenial1
Is this the 2022 version?

2) In order to exploit the server, do I need to change anything in YADE or just launch yadedaily-batch params.txt main.py ?

Thank you very much

Revision history for this message
Jérôme Duriez (jduriez) said :
#10

1) In Yade 20220429-6506~6b71c48~xenial1
20220429 stands for the day of production of that version of the package = April 29, 2022 and 6b71c48 stands for the git hash of the particular version of the source code behind that version.

I.e. https://gitlab.com/yade-dev/trunk/-/commit/6b71c48c21e379e01536f9ac399b1b911ed946ef which came out on April 25, a bit before package production.

If what you call as the "2022 version" is our official 2022 "release" 2022.01a from https://gitlab.com/yade-dev/trunk/-/releases which came out mid-January 2022, the answer is no, you do have a more recent version.

To have an even more recent version, you would need to update your packages on the server at some point (then the question arrives for how long we will build packages for the quite old Ubuntu 16 but I have no idea about that)

2) I'm not sure I completely understood this part but I would say no, using Yade is the same on a server or on a personal laptop from Yade software point of view (from your server point of view, maybe there are some specificities like job submission but this is not YADE-related)

Can you help with this problem?

Provide an answer of your own, or ask Gianni Pellegrini for more information if necessary.

To post a message you must log in.