madgraph+pythia8 NLO+PS example failing on fedora 36

Asked by Gustavs Kehris

Hello,

I have been trying to run madgraph and pythia8 locally on fedora 36, but have encountered several issues.

For starters, the automatic madgraph installation of StdHep (as well as the python interface of LHAPDF) failed.

Hoping that pythia8 wouldn't use StdHep, I proceeded with an example usinig pythia8 despite the unsuccessful StdHep installation.

Everything seems to work fine until showering, but at this point I encounter the error:

INFO: Compiling MCatNLO for PYTHIA8...
INFO: ... done
INFO: Showering events...
INFO: (Running in /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/MCatNLO/RUN_PYTHIA8_1)
INFO: Idle: 1, Running: 0, Completed: 0 [ current time: 10h42 ]
mv: cannot stat 'Pythia8.hep': No such file or directory
gzip: events.hepmc: No such file or directory
INFO: Idle: 0, Running: 0, Completed: 1 [ 0.78s ]
INFO: Idle: 0, Running: 0, Completed: 0 [ current time: 10h42 ]
Error detected in "launch auto "
write debug file /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/run_01_tag_1_debug.log
If you need help with this issue please contact us on https://answers.launchpad.net/mg5amcnlo
str : No file has been generated, an error occurred. More information in /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/amcatnlo_run.log
quit

opening /path/to/MG5_aMC_v2_9_11/my_ttbar_test/run_01_tag_1_debug.log I find:

launch auto
Traceback (most recent call last):
  File "/usr/lib64/python3.10/shutil.py", line 815, in move
    os.rename(src, real_dst)
FileNotFoundError: [Errno 2] No such file or directory: '/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/MCatNLO/RUN_PYTHIA8_1/events.hepmc.gz' -> '/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/Events/run_01/events_PYTHIA8_0.hepmc.gz'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/madgraph/interface/amcatnlo_run_interface.py", line 3939, in run_mcatnlo
    files.mv(os.path.join(rundir, 'events.%s.gz' % ext), hep_file)
  File "/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/madgraph/iolibs/files.py", line 186, in mv
    shutil.move(path1, path2)
  File "/usr/lib64/python3.10/shutil.py", line 835, in move
    copy_function(src, real_dst)
  File "/usr/lib64/python3.10/shutil.py", line 434, in copy2
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib64/python3.10/shutil.py", line 254, in copyfile
    with open(src, 'rb') as fsrc:
FileNotFoundError: [Errno 2] No such file or directory: '/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/MCatNLO/RUN_PYTHIA8_1/events.hepmc.gz'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/madgraph/interface/extended_cmd.py", line 1541, in onecmd
    return self.onecmd_orig(line, **opt)
  File "/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/madgraph/interface/extended_cmd.py", line 1490, in onecmd_orig
    return func(arg, **opt)
  File "/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/madgraph/interface/amcatnlo_run_interface.py", line 1718, in do_launch
    self.run_mcatnlo(evt_file, options)
  File "/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/madgraph/interface/amcatnlo_run_interface.py", line 3955, in run_mcatnlo
    raise aMCatNLOError('No file has been generated, an error occurred.'+\
madgraph.interface.amcatnlo_run_interface.aMCatNLOError: No file has been generated, an error occurred. More information in /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/amcatnlo_run.log

For completeness, here are some notes I took on the installation and running the example:

MG 2.9

0. sudo dnf install python3-devel
1. unpack MG5_aMC_v2.9.11.tar.gz
2. cd ./MG5_aMC_v2_9_11
3. ./bin/mg5_aMC
4. install pythia8
   a. MG installed HEPmc (success)
   b. MG installed zlib (success)
   c. MG installed pythia8 (success)
   d. MG installed mg5amc_py8_interface (success)
5. generate p p > t t~ [QCD]
6. output my_ttbar_test
   a. prompt comes up asking to install: cuttools, iregi, ninja, collier, golem
   b. I hit 'enter'
   c. MG installs OneLOop (success)
   d. MG installs ninja (success)
   e. MG "compiles" CutTools (success)
   f. MG "compiles" IREGI (success)
   g. MG tries to compile StdHep, but fails:
      WARNING: StdHep failed to compiled. This forbids to run NLO+PS with PY6 and Herwig6
      INFO: details on the compilation error are available on /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/vendor/StdHEP/fail
      INFO: if you want to retry the compilation automatically, you have to remove that file first
7. launch
   a. fixed_order=OFF
   b. shower=PYTHIA8
   c. enter
   d. confirm that run_card.dat has PYTHIA8 = parton_shower
   e. add nothing to shower_card.dat
   g.

INFO: Compiling MCatNLO for PYTHIA8...
INFO: ... done
INFO: Showering events...
INFO: (Running in /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/MCatNLO/RUN_PYTHIA8_1)
INFO: Idle: 1, Running: 0, Completed: 0 [ current time: 10h42 ]
mv: cannot stat 'Pythia8.hep': No such file or directory
gzip: events.hepmc: No such file or directory
INFO: Idle: 0, Running: 0, Completed: 1 [ 0.78s ]
INFO: Idle: 0, Running: 0, Completed: 0 [ current time: 10h42 ]
Error detected in "launch auto "
write debug file /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/run_01_tag_1_debug.log
If you need help with this issue please contact us on https://answers.launchpad.net/mg5amcnlo
str : No file has been generated, an error occurred. More information in /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/amcatnlo_run.log
quit

in the log file:

launch auto
Traceback (most recent call last):
  File "/usr/lib64/python3.10/shutil.py", line 815, in move
    os.rename(src, real_dst)
FileNotFoundError: [Errno 2] No such file or directory: '/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/MCatNLO/RUN_PYTHIA8_1/events.hepmc.gz' -> '/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/Events/run_01/events_PYTHIA8_0.hepmc.gz'

Best,
Gustavs

Question information

Language:
English Edit question
Status:
Open
For:
MadGraph5_aMC@NLO Edit question
Assignee:
marco zaro Edit question
Last query:
Last reply:
Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#1

What is the content of the file:
/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/amcatnlo_run.log

Cheers,

Olivier

Revision history for this message
Gustavs Kehris (gkehris) said :
#2

Technically I do not have such a file. However, the same directory contains:

ME5_debug -> /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/run_01_tag_1_debug.log

I have copy pasted the full contents of file:///home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/run_01_tag_1_debug.log below:

#************************************************************
#* MadGraph5_aMC@NLO *
#* *
#* * * *
#* * * * * *
#* * * * * 5 * * * * *
#* * * * * *
#* * * *
#* *
#* *
#* VERSION 2.9.11 2022-06-03 *
#* *
#* The MadGraph5_aMC@NLO Development Team - Find us at *
#* https://server06.fynu.ucl.ac.be/projects/madgraph *
#* and *
#* http://amcatnlo.cern.ch *
#* *
#************************************************************
#* *
#* Command File for aMCatNLO *
#* *
#* run as ./bin/aMCatNLO.py filename *
#* *
#************************************************************
launch auto
Traceback (most recent call last):
  File "/usr/lib64/python3.10/shutil.py", line 815, in move
    os.rename(src, real_dst)
FileNotFoundError: [Errno 2] No such file or directory: '/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/MCatNLO/RUN_PYTHIA8_1/events.hepmc.gz' -> '/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/Events/run_01/events_PYTHIA8_0.hepmc.gz'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/madgraph/interface/amcatnlo_run_interface.py", line 3939, in run_mcatnlo
    files.mv(os.path.join(rundir, 'events.%s.gz' % ext), hep_file)
  File "/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/madgraph/iolibs/files.py", line 186, in mv
    shutil.move(path1, path2)
  File "/usr/lib64/python3.10/shutil.py", line 835, in move
    copy_function(src, real_dst)
  File "/usr/lib64/python3.10/shutil.py", line 434, in copy2
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib64/python3.10/shutil.py", line 254, in copyfile
    with open(src, 'rb') as fsrc:
FileNotFoundError: [Errno 2] No such file or directory: '/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/MCatNLO/RUN_PYTHIA8_1/events.hepmc.gz'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/madgraph/interface/extended_cmd.py", line 1541, in onecmd
    return self.onecmd_orig(line, **opt)
  File "/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/madgraph/interface/extended_cmd.py", line 1490, in onecmd_orig
    return func(arg, **opt)
  File "/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/madgraph/interface/amcatnlo_run_interface.py", line 1718, in do_launch
    self.run_mcatnlo(evt_file, options)
  File "/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/madgraph/interface/amcatnlo_run_interface.py", line 3955, in run_mcatnlo
    raise aMCatNLOError('No file has been generated, an error occurred.'+\
madgraph.interface.amcatnlo_run_interface.aMCatNLOError: No file has been generated, an error occurred. More information in /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/amcatnlo_run.log
Value of current Options:
             pythia8_path : /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/HEPTools/pythia8
                hwpp_path : None
              thepeg_path : None
               hepmc_path : None
         madanalysis_path : None
        madanalysis5_path : None
          pythia-pgs_path : None
                  td_path : None
             delphes_path : None
      exrootanalysis_path : None
             syscalc_path : None
                  timeout : 60
              web_browser : None
               eps_viewer : None
              text_editor : None
         fortran_compiler : None
            f2py_compiler : None
        f2py_compiler_py2 : None
        f2py_compiler_py3 : None
             cpp_compiler : None
             cluster_type : condor
            cluster_queue : None
    cluster_status_update : (600, 30)
                  fastjet : None
                    golem : None
                  samurai : None
                    ninja : /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/HEPTools/lib
                  collier : None
                   lhapdf : lhapdf-config
               lhapdf_py2 : None
               lhapdf_py3 : None
                 applgrid : applgrid-config
                  amcfast : amcfast-config
        cluster_temp_path : None
mg5amc_py8_interface_path : /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/HEPTools/MG5aMC_PY8_interface
       cluster_local_path : None
                      OLP : MadLoop
         cluster_nb_retry : 1
       cluster_retry_wait : 300
             cluster_size : 100
      output_dependencies : external
           crash_on_error : False
       auto_convert_model : False
       group_subprocesses : Auto
ignore_six_quark_processes : False
low_mem_multicore_nlo_generation : False
      complex_mass_scheme : False
                    gauge : unitary
             stdout_level : 20
    loop_optimized_output : True
         loop_color_flows : False
   max_npoint_for_channel : 0
  default_unset_couplings : 99
        max_t_for_channel : 99
       zerowidth_tchannel : True
              auto_update : 7
   automatic_html_opening : False
                 run_mode : 2
                  nb_core : 8
      notification_center : True
                 mg5_path : /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11

Best,
Gustavs

Revision history for this message
Gustavs Kehris (gkehris) said :
#3

Just incase, I am also adding the contents of the following log file below as well.

/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/mcatnlo.log

 USING PYTHIA 8.3xy
g++ -std=c++11 -O -I/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/HEPTools/pythia8/include \
  -I/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/MCatNLO/include Pythia83.cc -o Pythia8.exe \
  -L/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/HEPTools/pythia8/lib -lpythia8 \
  -I/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/HEPTools/hepmc/include -L/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/HEPTools/hepmc/lib -Wl,-rpath,/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/HEPTools/hepmc/lib -lHepMC -L../lib -L/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/HEPTools/pythia8//lib -Ll,-rpath,/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/HEPTools/pythia8//lib -L/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/HEPTools/zlib/lib -Ll,-rpath,/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/HEPTools/zlib/lib -lpythia8 -lz -ldl -lstdc++ \

***** Now ready for showering 10000 events with PYTHIA8

Revision history for this message
marco zaro (marco-zaro) said :
#4

Hi,
can you look how this log file
home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/MCatNLO/RUN_PYTHIA8_1/mcatnlo_run.log

ends?

Marco

Revision history for this message
Gustavs Kehris (gkehris) said :
#5

Hi Marco,

Since creating this thread I learned that my lhapdf installation did not have write privileges to the folder where it downloads PDFs. I fixed this. Now, after executing `launch`, the final output before the run concludes is:

INFO: Preparing MCatNLO run
INFO: Using LHAPDF v6.4.0 interface for PDFs
WARNING: Could not link /usr/lib64/libLHAPDF.a at position: /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/lib
INFO: Compiling MCatNLO for PYTHIA8...
INFO: ... done
INFO: Showering events...
INFO: (Running in /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/MCatNLO/RUN_PYTHIA8_2)
INFO: Idle: 1, Running: 0, Completed: 0 [ current time: 11h06 ]
/home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/MCatNLO/RUN_PYTHIA8_2/shower.sh: line 44: 6048 Aborted (core dumped) ./Pythia8.exe Pythia8.cmd > mcatnlo_run.log 2>&1
INFO: Idle: 0, Running: 0, Completed: 1 [ 0.98s ]
INFO: Idle: 0, Running: 0, Completed: 0 [ current time: 11h06 ]
INFO: The file /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/Events/run_02/events_PYTHIA8_0.hepmc.gz has been generated.
It contains showered and hadronized events in the HEPMC format obtained showering the parton-level event file /home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/Events/run_02/events.lhe.gz with PYTHIA8
INFO: Run complete

The log file
home/gk/workspace/MadGraph/MG5_aMC_v2_9_11/my_ttbar_test/MCatNLO/RUN_PYTHIA8_2/mcatnlo_run.log

reads:

 *----------------------- SusyLesHouches SUSY/BSM Interface ------------------------*
 | Last Change 12 Apr 2017 - P. Skands
 | Parsing: events.lhe
 | (SLHA::readFile) line 99 - storing non-SLHA(2) block: yukawa
 | (SLHA::readFile) line 132 - storing QNUMBERS for id = 82 gh
 *------------------------------------------------------------------------------------*
 PYTHIA Info from SLHAinterface::initSLHA: No MODSEL found, keeping internal SUSY switched off
 PYTHIA Warning in SLHAinterface::initSLHA: ignoring QNUMBERS for id = 82 (already exists)
 PYTHIA Warning in SLHAinterface::initSLHA: ignoring MASS entries for id = {1,2,3,4,5,11,12,13,14,15,16,21,22,23,24} (m0 < SLHA:minMassSM)
 PYTHIA Warning in SLHAinterface::initSLHA: ignoring DECAY tables for id = {23,24,1,2,3,4,5,11,12,13,14,15,16,21,22} (m0 < SLHA:minMassSM)
 PYTHIA Warning in SLHAinterface::initSLHA: ignoring empty DECAY tables for id = {6,25} (total width provided but no Branching Ratios)
LHAPDF 6.4.0 loading /usr/share/LHAPDF/NNPDF23_nlo_as_0119_qed/NNPDF23_nlo_as_0119_qed_0000.dat
NNPDF23_nlo_as_0119_qed PDF set, member #0, version 5; LHAPDF ID = 244800
LHAPDF 6.4.0 loading /usr/share/LHAPDF/NNPDF23_nlo_as_0119_qed/NNPDF23_nlo_as_0119_qed_0000.dat
NNPDF23_nlo_as_0119_qed PDF set, member #0, version 5; LHAPDF ID = 244800

 *------- PYTHIA Process Initialization --------------------------*
 | |
 | We collide p+ with p+ at a CM energy of 1.300e+04 GeV |
 | |
 |------------------------------------------------------------------|
 | | |
 | Subprocess Code | Estimated |
 | | max (mb) |
 | | |
 |------------------------------------------------------------------|
 | | |
 | Les Houches User Process(es) 9999 | 1.000e-09 |
 | |
 *------- End PYTHIA Process Initialization -----------------------*

 *------- PYTHIA Flag + Mode + Parm + Word + FVec + MVec + PVec + WVec Settings (changes only) ------------------*
 | |
 | Name | Now | Default Min Max |
 | | | |
 | BeamRemnants:primordialKT | off | on |
 | Beams:frameType | 4 | 1 1 5 |
 | Beams:LHEF | events.lhe | void |
 | Check:epTolErr | 0.0010000 | 1.0000e-04 |
 | Init:showChangedParticleData | off | on |
 | Main:numberOfEvents | 10000 | 1000 0 |
 | Main:spareMode1 | 10000 | 0 |
 | Main:spareWord1 | average | void |
 | Main:timesAllowErrors | 1001 | 10 0 |
 | Next:numberShowEvent | 2 | 1 0 |
 | PartonLevel:MPI | off | on |
 | PDF:pSet | LHAPDF6:NNPDF23_nlo_as_0119_qed | 13 |
 | SpaceShower:alphaEMorder | 0 | 1 -1 1 |
 | SpaceShower:alphaSvalue | 0.11800 | 0.13650 0.0600000 0.25000 |
 | SpaceShower:MEcorrections | off | on |
 | SpaceShower:pTmaxMatch | 1 | 0 0 2 |
 | SpaceShower:QEDshowerByL | off | on |
 | SpaceShower:QEDshowerByQ | off | on |
 | SpaceShower:rapidityOrder | off | on |
 | TimeShower:alphaEMorder | 0 | 1 -1 1 |
 | TimeShower:alphaSvalue | 0.11800 | 0.13650 0.0600000 0.25000 |
 | TimeShower:dampenBeamRecoil | off | on |
 | TimeShower:globalRecoil | on | off |
 | TimeShower:globalRecoilMode | 2 | 0 0 2 |
 | TimeShower:limitPTmaxGlobal | on | off |
 | TimeShower:MEcorrections | off | on |
 | TimeShower:nMaxGlobalBranch | 1 | -1 |
 | TimeShower:nMaxGlobalRecoil | 1 | 2 1 |
 | TimeShower:QEDshowerByGamma | off | on |
 | TimeShower:QEDshowerByL | off | on |
 | TimeShower:QEDshowerByQ | off | on |
 | TimeShower:weightGluonToQuark | 1 | 4 1 8 |
 | |
 *------- End PYTHIA Flag + Mode + Parm + Word + FVec + MVec + PVec + WVec Settings -----------------------------*
/usr/include/c++/12/bits/stl_vector.h:1141: std::vector<_Tp, _Alloc>::const_reference std::vector<_Tp, _Alloc>::operator[](size_type) const [with _Tp = double; _Alloc = std::allocator<double>; const_reference = const double&; size_type = long unsigned int]: Assertion '__n < this->size()' failed.

Thanks for helping out.

Best,
Gustavs

Can you help with this problem?

Provide an answer of your own, or ask Gustavs Kehris for more information if necessary.

To post a message you must log in.