Event generation fails (boost-1_62: binary operator expected)

Asked by Neofytos on 2020-12-14

Dear experts,
I have been successfully generating events for the Keung Senjanovic process, using the lrsm_1_3_2_UFO model, for a while now.

In the last few days, though, and using the exact same configuration, the generation fails and I am getting an error that I haven't managed to solve.
Boost/1.62.0-c1b05/x86_64-centos7-gcc62-opt/include/boost-1_62: binary operator expected

Any help would be much appreciated.

The full log file and relevant files to reproduce the issue can be found in:
https://cernbox.cern.ch/index.php/s/00aZOwoc5zGyDTn

The steps I am following:

setupATLAS
asetup 21.6.23,AthGeneration
Gen_tf.py --ecmEnergy=13000. --maxEvents=-1 --firstEvent=1 --randomSeed=123456 --outputEVNTFile="EVNT.root" --jobConfig="JO/"

The error (only relevant lines):

generate 10:37:08 INFO: load configuration from /eos/home-n/nethemis/BW5000_WR5200_NR700_ATLAS_cutdecaysoff_fixedwidth_COPY/PROC_lrsm_1_3_2_UFO_0/Cards/me5_configuration.txt
generate 10:37:08 INFO: load configuration from /cvmfs/atlas.cern.ch/repo/sw/software/21.6/sw/lcg/releases/MCGenerators/madgraph5amc/2.6.7p3.atlas5-4bfe1/x86_64-slc6-gcc62-opt/input/mg5_configuration.txt
generate 10:37:08 INFO: load configuration from /eos/home-n/nethemis/BW5000_WR5200_NR700_ATLAS_cutdecaysoff_fixedwidth_COPY/PROC_lrsm_1_3_2_UFO_0/Cards/me5_configuration.txt
generate 10:37:08 Using default eps viewer "evince". Set another one in ./input/mg5_configuration.txt
generate 10:37:08 Using default web browser "firefox". Set another one in ./input/mg5_configuration.txt
generate 10:37:08 generate_events -f run_01 --nb_core=1
generate 10:37:08 stty: standard input: Inappropriate ioctl for device
generate 10:37:09 Generating 10500 events with run name run_01
generate 10:37:09 survey run_01
generate 10:37:09 INFO: compile directory
generate 10:37:10 /eos/home-n/nethemis/BW5000_WR5200_NR700_ATLAS_cutdecaysoff_fixedwidth_COPY/lhapdf-config: line 51: [: /cvmfs/atlas.cern.ch/repo/sw/software/21.6/sw/lcg/releases/Boost/1.62.0-c1b05/x86_64-centos7-gcc62-opt/include/boost-1_62: binary operator expected
generate 10:37:10 INFO: Using LHAPDF v6.2.3 interface for PDFs
generate 10:37:10 /eos/home-n/nethemis/BW5000_WR5200_NR700_ATLAS_cutdecaysoff_fixedwidth_COPY/lhapdf-config: line 51: [: /cvmfs/atlas.cern.ch/repo/sw/software/21.6/sw/lcg/releases/Boost/1.62.0-c1b05/x86_64-centos7-gcc62-opt/include/boost-1_62: binary operator expected
generate 10:37:11 /eos/home-n/nethemis/BW5000_WR5200_NR700_ATLAS_cutdecaysoff_fixedwidth_COPY/lhapdf-config: line 51: [: /cvmfs/atlas.cern.ch/repo/sw/software/21.6/sw/lcg/releases/Boost/1.62.0-c1b05/x86_64-centos7-gcc62-opt/include/boost-1_62: binary operator expected
generate 10:37:12 /eos/home-n/nethemis/BW5000_WR5200_NR700_ATLAS_cutdecaysoff_fixedwidth_COPY/lhapdf-config: line 51: [: /cvmfs/atlas.cern.ch/repo/sw/software/21.6/sw/lcg/releases/Boost/1.62.0-c1b05/x86_64-centos7-gcc62-opt/include/boost-1_62: binary operator expected
generate 10:37:13 /eos/home-n/nethemis/BW5000_WR5200_NR700_ATLAS_cutdecaysoff_fixedwidth_COPY/lhapdf-config: line 51: [: /cvmfs/atlas.cern.ch/repo/sw/software/21.6/sw/lcg/releases/Boost/1.62.0-c1b05/x86_64-centos7-gcc62-opt/include/boost-1_62: binary operator expected
generate 10:37:14 compile Source Directory
generate 10:39:33 Using random number seed offset = 123456
generate 10:39:33 INFO: Running Survey
generate 10:39:33 Creating Jobs
generate 10:39:33 Working on SubProcesses
generate 10:39:33 INFO: P1_udx_w2p_w2p_epn1_n1_emudx
generate 10:39:34 Error detected in "generate_events -f run_01 --nb_core=1"
generate 10:39:34 write debug file /eos/home-n/nethemis/BW5000_WR5200_NR700_ATLAS_cutdecaysoff_fixedwidth_COPY/PROC_lrsm_1_3_2_UFO_0/run_01_tag_1_debug.log
generate 10:39:34 If you need help with this issue please contact us on https://answers.launchpad.net/mg5amcnlo
generate 10:39:34 MadGraph5Error : A compilation Error occurs when trying to compile /eos/home-n/nethemis/BW5000_WR5200_NR700_ATLAS_cutdecaysoff_fixedwidth_COPY/PROC_lrsm_1_3_2_UFO_0/SubProcesses/P1_udx_w2p_w2p_epn1_n1_emudx.
generate 10:39:34 The compilation fails with the following output message:
generate 10:39:34 /cvmfs/sft.cern.ch/lcg/releases/gcc/6.2.0-b9934/x86_64-slc6/bin/gfortran -O -w -fbounds-check -fPIC -ffixed-line-length-132 -w -c symmetry.f -I../../Source/
generate 10:39:34 /cvmfs/sft.cern.ch/lcg/releases/gcc/6.2.0-b9934/x86_64-slc6/bin/gfortran -O -w -fbounds-check -fPIC -ffixed-line-length-132 -w -c idenparts.f -I../../Source/
generate 10:39:34 /eos/home-n/nethemis/BW5000_WR5200_NR700_ATLAS_cutdecaysoff_fixedwidth_COPY/lhapdf-config: line 51: [: /cvmfs/atlas.cern.ch/repo/sw/software/21.6/sw/lcg/releases/Boost/1.62.0-c1b05/x86_64-centos7-gcc62-opt/include/boost-1_62: binary operator expected
generate 10:39:34 /cvmfs/sft.cern.ch/lcg/releases/gcc/6.2.0-b9934/x86_64-slc6/bin/gfortran -o gensym symmetry.o idenparts.o -L../../lib/ -lmodel -lgeneric -lpdf -I/cvmfs/atlas.cern.ch/repo/sw/software/21.6/sw/lcg/releases/LCG_88/MCGenerators/lhapdf/6.2.3/x86_64-slc6-gcc62-opt/share/LHAPDF/../../include -I/cvmfs/atlas.cern.ch/repo/sw/software/21.6/sw/lcg/releases/Boost/1.62.0-c1b05/x86_64-centos7-gcc62-opt/include/boost-1_62 /cvmfs/atlas.cern.ch/repo/sw/software/21.6/sw/lcg/releases/Boost/1.62.0-c1b05/x86_64-slc6-gcc62-opt/include/boost-1_62 -L/cvmfs/atlas.cern.ch/repo/sw/software/21.6/sw/lcg/releases/LCG_88/MCGenerators/lhapdf/6.2.3/x86_64-slc6-gcc62-opt/share/LHAPDF/../../lib -lLHAPDF -lLHAPDF -lstdc++
generate 10:39:34 /cvmfs/atlas.cern.ch/repo/sw/software/21.6/sw/lcg/releases/Boost/1.62.0-c1b05/x86_64-slc6-gcc62-opt/include/boost-1_62: file not recognized: Is a directory
generate 10:39:34 collect2: error: ld returned 1 exit status
generate 10:39:34 make: *** [gensym] Error 1
generate 10:39:34
generate 10:39:34 Please try to fix this compilations issue and retry.
generate 10:39:34 Help might be found at https://answers.launchpad.net/mg5amcnlo.
generate 10:39:34 If you think that this is a bug, you can report this at https://bugs.launchpad.net/mg5amcnlo
generate 10:39:34 quit
generate 10:39:34 INFO:
generate 10:39:35 Py:MadGraphUtils INFO Restoring original LHAPDF env variables:
generate 10:39:35 Py:MadGraphUtils INFO LHAPATH=/cvmfs/atlas.cern.ch/repo/sw/software/21.6/sw/lcg/releases/LCG_88/MCGenerators/lhapdf/6.2.3/x86_64-slc6-gcc62-opt/share/LHAPDF:/cvmfs/sft.cern.ch/lcg/external/lhapdfsets/current
generate 10:39:35 Py:MadGraphUtils INFO LHAPDF_DATA_PATH=/cvmfs/atlas.cern.ch/repo/sw/software/21.6/sw/lcg/releases/LCG_88/MCGenerators/lhapdf/6.2.3/x86_64-slc6-gcc62-opt/share/LHAPDF:/cvmfs/sft.cern.ch/lcg/external/lhapdfsets/current
generate 10:39:35 Py:MadGraphUtils INFO Finished at Mon Dec 14 10:39:35 2020
generate 10:39:35 Py:MadGraphUtils INFO Unzipping generated events.
generate 10:39:35 gzip: /eos/home-n/nethemis/BW5000_WR5200_NR700_ATLAS_cutdecaysoff_fixedwidth_COPY/PROC_lrsm_1_3_2_UFO_0/Events/run_01/events.lhe.gz: No such file or directory
generate 10:39:35 Py:MadGraphUtils INFO Putting a copy in place for the transform.
generate 10:39:35 Shortened traceback (most recent user call last):
generate 10:39:35 File "/cvmfs/atlas.cern.ch/repo/sw/software/21.6/AthGeneration/21.6.23/InstallArea/x86_64-slc6-gcc62-opt/jobOptions/EvgenJobTransforms/skel.GENtoEVGEN.py", line 249, in <module>
generate 10:39:35 include(jofile)
generate 10:39:35 File "JO/mc.MGPyEG_lrsm_WR5200_NR700.py", line 69, in <module>
generate 10:39:35 arrange_output(process_dir=process_dir,runArgs=runArgs)
generate 10:39:35 File "/cvmfs/atlas.cern.ch/repo/sw/software/21.6/AthGeneration/21.6.23/InstallArea/x86_64-slc6-gcc62-opt/python/MadGraphControl/MadGraphUtils.py", line 1021, in arrange_output
generate 10:39:35 with open(orig_input,'r') as fileobject:
generate 10:39:35 IOError: [Errno 2] No such file or directory: '/eos/home-n/nethemis/BW5000_WR5200_NR700_ATLAS_cutdecaysoff_fixedwidth_COPY/PROC_lrsm_1_3_2_UFO_0/Events/run_01/events.lhe'
generate 10:39:35 Py:Athena INFO leaving with code 8: "an unknown exception occurred"
PyJobTransforms.trfExe.execute 2020-12-14 10:39:35,553 INFO generate executor returns 8
PyJobTransforms.trfExe.validate 2020-12-14 10:39:36,560 ERROR Validation of return code failed: Non-zero return code from generate (8) (Error code 65)
PyJobTransforms.trfExe.validate 2020-12-14 10:39:36,573 INFO Scanning logfile log.generate for errors in substep None
PyJobTransforms.trfValidation.scanLogFile 2020-12-14 10:39:36,686 WARNING Detected python exception - activating python exception grabber
PyJobTransforms.transform.execute 2020-12-14 10:39:36,686 CRITICAL Transform executor raised TransformValidationException: Non-zero return code from generate (8); Logfile error in log.generate: "IOError: [Errno 2] No such file or directory: '/eos/home-n/nethemis/BW5000_WR5200_NR700_ATLAS_cutdecaysoff_fixedwidth_COPY/PROC_lrsm_1_3_2_UFO_0/Events/run_01/events.lhe'"
PyJobTransforms.transform.execute 2020-12-14 10:39:39,847 WARNING Transform now exiting early with exit code 65 (Non-zero return code from generate (8); Logfile error in log.generate: "IOError: [Errno 2] No such file or directory: '/eos/home-n/nethemis/BW5000_WR5200_NR700_ATLAS_cutdecaysoff_fixedwidth_COPY/PROC_lrsm_1_3_2_UFO_0/Events/run_01/events.lhe'")

Neofytos

Question information

Language:
English Edit question
Status:
Solved
For:
MadGraph5_aMC@NLO Edit question
Assignee:
No assignee Edit question
Solved by:
Neofytos
Solved:
2020-12-17
Last query:
2020-12-17
Last reply:
2020-12-15

Hi,

Could you run this outside of Athena?
or at least join the madgraph debug file?
I found athena type of output very confusing.

Maybe the issue is with lhapdf but I have the feeling that multiple stream are writting in your log and this complexify any diagnostic.
In any case this seems to be an installation issue (likely of lhapdf) so maybe the solution is to re-install lhapdf.
(I guess that you can not do that yourself and will need to contact someone from Athena support for that)

Cheers,

Olivier

Neofytos (nthemi01) said : #2

Hi Oliver,

thank you for the reply.

I'm closing this since it appears to be an ATLAS issue and not an MG one.

Robert Hankache (rhankache) said : #3

Hi Neofytos,

Can you please explain how did you solve this issue?
I am having the same problem and I am also running on the ATLAS environment.

Best regards,
Robert

Neofytos (nthemi01) said : #4

Hi Robert,

Hopefully, I'm able to help. In my case, the Athena release I was using became obsolete due to the migration to CentOS 7. Switching to a newer release (>21.6.51) fixed the issue.

One more thing is that the release I was using appeared to be valid in the ATLAS MG twiki[1] but it is shown as forbidden in the PMG recommendation twiki[2].

Neofytos

[1] https://twiki.cern.ch/twiki/bin/viewauth/AtlasProtected/MadGraph5aMCatNLOForAtlas#Release_history
[2] https://twiki.cern.ch/twiki/bin/viewauth/AtlasProtected/PmgMcSoftware#Versions

Robert Hankache (rhankache) said : #5

Hi Neofytos,

That solved my problem.
Thanks a lot.

Robert