MadGraph5_aMC@NLO

running madgraph jobs on condor without transferring PDF files

Asked by Simone Amoroso

Dear madgraph authors,

Recently the configuration of the condor cluster I used to send madgraph jobs
 changed to enforce a maximum transferrable amount of data by each job.
Since then I am unable to integrate madgraph processes on condor,
as the jobs are directly put in "Hold" state.

I have seen in the configuration file a cluster_local_path variable which seems to have been made exactly for this case.
While setting this variables makes the jobs run, they then fail with the following error:
"Could not find PDFsets directory, quitting"

I have tried setting this variable to my process folder, to the "lhapdf-config --datadir" folder,
and to the process_folder/lib/PDFsets, but neither of this worked.

Can I ask you how should this variable be set such that the PDFs are found?

cheers, Simone

Question information

Language:
English Edit question
Status:
Answered
For:
MadGraph5_aMC@NLO Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said : 		#1

Hi,

On condor, madgraph is using the condor file transfer option such that they are no direct read/write to the shared filesystem.
Is the system that you sys-admin vetoed?

The biggest IO file transfer is the PDF grid associated to the job (just transfer to node from the central filesystem not getting it back obviously). You can avoid such constant transfer of PDF file by pre-installing such PDF on the node directly (typically done via cvmfs) and then specify the directory where such file are available via cluster_local_path.

In our cluster this is set to:
/cvmfs/cp3.uclouvain.be/madgraph/

 ls /cvmfs/cp3.uclouvain.be/madgraph/
Pdfdata
[omatt@ingrid-ui1 madgraph5]$ ls /cvmfs/cp3.uclouvain.be/madgraph/Pdfdata/
ct14qed.tgz cteq6m.tbl NNPDF23nlo_as_0119_qed_mem0.grid
cteq5l.tbl mrsb.dat ph0.00_Proton.pds
cteq5m.tbl mrse.dat ph0.07_Proton.pds
cteq6d.tbl mrst2002nlo.dat ph0.14_Proton.pds
cteq6l1.tbl NNPDF23_lo_as_0119_qed_mem0.grid ph0.21_Proton.pds
cteq6l.tbl NNPDF23_lo_as_0130_qed_mem0.grid

But this typically needs your sys-admin to setup such type of directory obviously.

Cheers,

Olivier

Can you help with this problem?

Provide an answer of your own, or ask Simone Amoroso for more information if necessary.

To post a message you must log in.