Exception: ['.//sps/atlas/g/goyc/MG5_aMC_v2_5_5/bin/PROC_sm_0/bin/internal/gen_jpeg-pl'] fails with no such file or di

Asked by Corinne Goy

MG5 > output wz_ewk

Exception: ['.//sps/atlas/g/goyc/MG5_aMC_v2_5_5/bin/PROC_sm_0/bin/internal/gen_jpeg-pl'] fails with no such file or directory

The file exists but the build-in path is wrong .//sps/.... (/sps/atlas is the right one)

Thank you

Question information

Language:
English Edit question
Status:
Answered
For:
MadGraph5_aMC@NLO Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
Corinne Goy (goyc) said :
#1

In the title , the output directory is the standard one PROC_sm_0 ; I wanted to verify if it changed something

Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#2

The path itself is correct.

When /sps/atlas/g/goyc/MG5_aMC_v2_5_5/bin/PROC_sm_0/bin/internal/gen_jpeg-pl
fails we try to recover by adding ./ since on some os it can help to recover (in presence of local path obviously)

So the wrong path is due to our recovery mecanism.

Can you try with the latest version of the code if this still occurs?

Cheers,

Olivier

Revision history for this message
Corinne Goy (goyc) said :
#3

I tried with the version 3 and I have the same error message

Command "output wz_ewk" interrupted with error:
Exception : ['.//sps/atlas/g/goyc/MG5_aMC_v3_0_0/bin/wz_ewk/bin/internal/gen_jpeg-pl'] fails with no such file or directory
Please report this bug on https://bugs.launchpad.net/mg5amcnlo
More information is found in 'MG5_debug'.
Please attach this file to your report

Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#4

Can you copy paste the content of the debug file?

I will not bw able to look at it this week (not working on this project).
but a quick workaround should be to do
output XXXX -nojpeg
instead of
output XXXX

Cheers,

Olivier

> On 17 Jul 2018, at 15:17, Corinne Goy <email address hidden> wrote:
>
> Question #670904 on MadGraph5_aMC@NLO changed:
> https://answers.launchpad.net/mg5amcnlo/+question/670904
>
> Corinne Goy posted a new comment:
> I tried with the version 3 and I have the same error message
>
> Command "output wz_ewk" interrupted with error:
> Exception : ['.//sps/atlas/g/goyc/MG5_aMC_v3_0_0/bin/wz_ewk/bin/internal/gen_jpeg-pl'] fails with no such file or directory
> Please report this bug on https://bugs.launchpad.net/mg5amcnlo
> More information is found in 'MG5_debug'.
> Please attach this file to your report
>
> --
> You received this question notification because you are an answer
> contact for MadGraph5_aMC@NLO.

Revision history for this message
Corinne Goy (goyc) said :
#5

I hope the format is readable enough :

cca003:csh[150] more MG5_debug
#************************************************************
#* MadGraph5_aMC@NLO *
#* *
#* * * *
#* * * * * *
#* * * * * 5 * * * * *
#* * * * * *
#* * * *
#* *
#* *
#* VERSION 3.0.0 2018-05-01 *
#* *
#* The MadGraph5_aMC@NLO Development Team - Find us at *
#* https://server06.fynu.ucl.ac.be/projects/madgraph *
#* *
#************************************************************
#* *
#* Command File for MadGraph5_aMC@NLO *
#* *
#* run as ./bin/mg5_aMC filename *
#* *
#************************************************************
set default_unset_couplings 99
set group_subprocesses Auto
set ignore_six_quark_processes False
set loop_optimized_output True
set include_lepton_initiated_processes False
set loop_color_flows False
set gauge unitary
set complex_mass_scheme False
set max_npoint_for_channel 0
import model sm
define p = g u c d s u~ c~ d~ s~
define j = g u c d s u~ c~ d~ s~
define l+ = e+ mu+
define l- = e- mu-
define vl = ve vm vt
define vl~ = ve~ vm~ vt~
generate p p > W+ Z j j QCD=0
output wz_ewk
Traceback (most recent call last):
  File "/sps/atlas/g/goyc/MG5_aMC_v3_0_0/madgraph/interface/extended_cmd.py", line 1504, in onecmd
    return self.onecmd_orig(line, **opt)
  File "/sps/atlas/g/goyc/MG5_aMC_v3_0_0/madgraph/interface/extended_cmd.py", line 1453, in onecmd_orig
    return func(arg, **opt)
  File "/sps/atlas/g/goyc/MG5_aMC_v3_0_0/madgraph/interface/master_interface.py", line 292, in do_output
    self.cmd.do_output(self, line, *args, **opts)
  File "/sps/atlas/g/goyc/MG5_aMC_v3_0_0/madgraph/interface/madgraph_interface.py", line 7636, in do_output
    self.finalize(nojpeg, flaglist=flaglist)
  File "/sps/atlas/g/goyc/MG5_aMC_v3_0_0/madgraph/interface/madgraph_interface.py", line 7957, in finalize
    flaglist)
  File "/sps/atlas/g/goyc/MG5_aMC_v3_0_0/madgraph/iolibs/export_v4.py", line 5356, in finalize
    super(ProcessExporterFortranMEGroup, self).finalize(*args, **opts)
  File "/sps/atlas/g/goyc/MG5_aMC_v3_0_0/madgraph/iolibs/export_v4.py", line 3850, in finalize
    stdout = devnull, cwd=pjoin(subpath, Pdir))
  File "/sps/atlas/g/goyc/MG5_aMC_v3_0_0/madgraph/various/misc.py", line 887, in deco_f
    % arg
Exception: ['.//sps/atlas/g/goyc/MG5_aMC_v3_0_0/bin/wz_ewk/bin/internal/gen_jpeg-pl'] fails with no such file or directory
                          MadGraph5_aMC@NLO Options
                          ----------------
        complex_mass_scheme : False
    default_unset_couplings : 99
                      gauge : unitary
         group_subprocesses : Auto
  ignore_six_quark_processes : False
  include_lepton_initiated_processes : False
           loop_color_flows : False
      loop_optimized_output : True
  low_mem_multicore_nlo_generation : False
     max_npoint_for_channel : 0
               stdout_level : 20 (user set)

                         MadEvent Options
                          ----------------
     automatic_html_opening : True
                    nb_core : None
        notification_center : True
                   run_mode : 2

                      Configuration Options
                      ---------------------
                        OLP : MadLoop
                    amcfast : amcfast-config
                   applgrid : applgrid-config
                auto_update : 7
         cluster_local_path : None
           cluster_nb_retry : 1
              cluster_queue : None (user set)
         cluster_retry_wait : 300
               cluster_size : 100
      cluster_status_update : (600, 30)
          cluster_temp_path : None
               cluster_type : condor
                    collier : ./HEPTools/lib
               cpp_compiler : None
             crash_on_error : False
               delphes_path : ./Delphes
                 eps_viewer : None
        exrootanalysis_path : ./ExRootAnalysis
              f2py_compiler : None
                    fastjet : None (user set)
           fortran_compiler : None
                      golem : None (user set)
                 hepmc_path : None (user set)
                  hwpp_path : None (user set)
                     lhapdf : lhapdf-config
          madanalysis5_path : None (user set)
           madanalysis_path : ./MadAnalysis
  mg5amc_py8_interface_path : None (user set)
                      ninja : ./HEPTools/lib
        output_dependencies : external
                      pjfry : None (user set)
            pythia-pgs_path : ./pythia-pgs
               pythia8_path : None (user set)
                    samurai : None
               syscalc_path : ./SysCalc
                    td_path : ./td
                text_editor : None
                thepeg_path : None (user set)
                    timeout : 60
                web_browser : None
cca003:csh[151]

Revision history for this message
Corinne Goy (goyc) said :
#6

Following your suggestion, I bumped into a similar issue

Command "output -nojpeg " interrupted in sub-command:
"output -nojpeg" with error:
Exception : ['.//sps/atlas/g/goyc/MG5_aMC_v3_0_0/bin/PROC_sm_0/bin/internal/gen_cardhtml-pl'] fails with no such file or directory
Please report this bug on https://bugs.launchpad.net/mg5amcnlo
More information is found in 'MG5_debug'.
Please attach this file to your report.

So I wait until next week or so
Cheers. Corinne

Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#7

Ok, then the problem is the lack of perl interpreter on your machine
(or a not compatible one)
Which version of perl do you have on your machine?

Cheers,

Olivier

Revision history for this message
Corinne Goy (goyc) said :
#8

Bonjour,

I am running on a main frame
It seems that the Perl version is V3.20

I tried to run at CERN - lxplus with the same issue.
 At CERN, the Perl version is v3.14_04
Below, the debug at CERN :
#************************************************************
#* MadGraph5_aMC@NLO *
#* *
#* * * *
#* * * * * *
#* * * * * 5 * * * * *
#* * * * * *
#* * * *
#* *
#* *
#* VERSION 2.5.5 2017-05-26 *
#* *
#* The MadGraph5_aMC@NLO Development Team - Find us at *
#* https://server06.fynu.ucl.ac.be/projects/madgraph *
#* *
#************************************************************
#* *
#* Command File for MadGraph5_aMC@NLO *
#* *
#* run as ./bin/mg5_aMC filename *
#* *
#************************************************************
set group_subprocesses Auto
set ignore_six_quark_processes False
set loop_optimized_output True
set loop_color_flows False
set gauge unitary
set complex_mass_scheme False
set max_npoint_for_channel 0
import model sm
define p = g u c d s u~ c~ d~ s~
define j = g u c d s u~ c~ d~ s~
define l+ = e+ mu+
define l- = e- mu-
define vl = ve vm vt
define vl~ = ve~ vm~ vt~
generate p p > W+ Z j j QCD=0
output wz_ewk_2
Traceback (most recent call last):
  File "/afs/cern.ch/user/g/goyc1/MG5_aMC_v2_5_5/madgraph/interface/extended_cmd.py", line 1430, in onecmd
    return self.onecmd_orig(line, **opt)
  File "/afs/cern.ch/user/g/goyc1/MG5_aMC_v2_5_5/madgraph/interface/extended_cmd.py", line 1384, in onecmd_orig
    return func(arg, **opt)
  File "/afs/cern.ch/user/g/goyc1/MG5_aMC_v2_5_5/madgraph/interface/master_interface.py", line 287, in do_output
    self.cmd.do_output(self, line, *args, **opts)
  File "/afs/cern.ch/user/g/goyc1/MG5_aMC_v2_5_5/madgraph/interface/madgraph_interface.py", line 7454, in do_output
    self.finalize(nojpeg, flaglist=flaglist)
  File "/afs/cern.ch/user/g/goyc1/MG5_aMC_v2_5_5/madgraph/interface/madgraph_interface.py", line 7774, in finalize
    flaglist)
  File "/afs/cern.ch/user/g/goyc1/MG5_aMC_v2_5_5/madgraph/iolibs/export_v4.py", line 5185, in finalize
    super(ProcessExporterFortranMEGroup, self).finalize(*args, **opts)
  File "/afs/cern.ch/user/g/goyc1/MG5_aMC_v2_5_5/madgraph/iolibs/export_v4.py", line 3679, in finalize
    stdout = devnull, cwd=pjoin(subpath, Pdir))
  File "/afs/cern.ch/user/g/goyc1/MG5_aMC_v2_5_5/madgraph/various/misc.py", line 808, in deco_f
    % arg
Exception: ['.//afs/cern.ch/user/g/goyc1/MG5_aMC_v2_5_5/bin/wz_ewk_2/bin/internal/gen_jpeg-pl'] fails with no such file or directory
                          MadGraph5_aMC@NLO Options
                          ----------------
        complex_mass_scheme : False
                      gauge : unitary
         group_subprocesses : Auto
  ignore_six_quark_processes : False
           loop_color_flows : False
      loop_optimized_output : True
  low_mem_multicore_nlo_generation : False
     max_npoint_for_channel : 0
               stdout_level : 20 (user set)

                         MadEvent Options
                          ----------------
     automatic_html_opening : True
                    nb_core : None
        notification_center : True
                   run_mode : 2

                      Configuration Options
                      ---------------------
                        OLP : MadLoop
                    amcfast : amcfast-config
                   applgrid : applgrid-config
                auto_update : 7
         cluster_local_path : None
           cluster_nb_retry : 1
              cluster_queue : None (user set)
         cluster_retry_wait : 300
               cluster_size : 100
      cluster_status_update : (600, 30)
          cluster_temp_path : None
               cluster_type : condor
                    collier : ./HEPTools/lib
               cpp_compiler : None
             crash_on_error : False
               delphes_path : ./Delphes
                 eps_viewer : None
        exrootanalysis_path : ./ExRootAnalysis
              f2py_compiler : None
                    fastjet : None (user set)
           fortran_compiler : None
                      golem : None (user set)
                 hepmc_path : None (user set)
                  hwpp_path : None (user set)
                     lhapdf : lhapdf-config
          madanalysis5_path : None (user set)
           madanalysis_path : ./MadAnalysis
  mg5amc_py8_interface_path : None (user set)
                      ninja : ./HEPTools/lib
        output_dependencies : external
                      pjfry : None (user set)
            pythia-pgs_path : ./pythia-pgs
               pythia8_path : None (user set)
                    samurai : None
               syscalc_path : ./SysCalc
                    td_path : ./td
                text_editor : None
                thepeg_path : None (user set)
                    timeout : 60
                web_browser : None

Regards, Corinne

Revision history for this message
David Straub (davidmichaelstraub) said :
#9

I just ran into the same issue and I think I solved it.

The problem was that the source directory was synced between two machines but permissions were lost underway; so the perl script didn't have the x flag and couldn't be executed. Unfortunately, this was very painful to debug because you hide the actual error in madgraph.various.misc.call:

def call(arg, *args, **opt):
    """nice way to call an external program with nice error treatment"""
    try:
        return subprocess.call(arg, *args, **opt)
    except OSError:
        arg[0] = './%s' % arg[0]
        return subprocess.call(arg, *args, **opt)

This returned

Exception : ['.//MY_PATH/MadGraph/MG5_aMC_v2_6_5/bin/tmp/bin/internal/gen_cardhtml-pl'] fails with no such file or directory

which does not make any sense. To keep the proper exception in case the path-fix fails, I suggest to call the original one again:

def call(arg, *args, **opt):
    """nice way to call an external program with nice error treatment"""
    try:
        return subprocess.call(arg, *args, **opt)
    except OSError: # try if we find the file with relative path
        fix_arg = arg.copy()
        fix_arg[0] = './%s' % fix_arg[0]
        return subprocess.call(fix_arg, *args, **opt)
    except OSError: # give up and re-raise the original error
        return subprocess.call(arg, *args, **opt)

Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#10

Hi,

Thanks for your findings/feedback.

Your proposed syntax is actually not valid but I see the idea.

 The problem here is that sometimes the first error stack is the one you want and sometimes, the second.
With Python3, both will be printed. So I think I will just wait for the python3 version of the code to be released in this particular case.

Cheers and thanks,

Olivier

> On 8 Jul 2019, at 11:04, David Straub <email address hidden> wrote:
>
> Question #670904 on MadGraph5_aMC@NLO changed:
> https://answers.launchpad.net/mg5amcnlo/+question/670904
>
> David Straub posted a new comment:
> I just ran into the same issue and I think I solved it.
>
> The problem was that the source directory was synced between two
> machines but permissions were lost underway; so the perl script didn't
> have the x flag and couldn't be executed. Unfortunately, this was very
> painful to debug because you hide the actual error in
> madgraph.various.misc.call:
>
>
> def call(arg, *args, **opt):
> """nice way to call an external program with nice error treatment"""
> try:
> return subprocess.call(arg, *args, **opt)
> except OSError:
> arg[0] = './%s' % arg[0]
> return subprocess.call(arg, *args, **opt)
>
> This returned
>
> Exception : ['.//MY_PATH/MadGraph/MG5_aMC_v2_6_5/bin/tmp/bin/internal
> /gen_cardhtml-pl'] fails with no such file or directory
>
> which does not make any sense. To keep the proper exception in case the
> path-fix fails, I suggest to call the original one again:
>
> def call(arg, *args, **opt):
> """nice way to call an external program with nice error treatment"""
> try:
> return subprocess.call(arg, *args, **opt)
> except OSError: # try if we find the file with relative path
> fix_arg = arg.copy()
> fix_arg[0] = './%s' % fix_arg[0]
> return subprocess.call(fix_arg, *args, **opt)
> except OSError: # give up and re-raise the original error
> return subprocess.call(arg, *args, **opt)
>
> --
> You received this question notification because you are an answer
> contact for MadGraph5_aMC@NLO.

Can you help with this problem?

Provide an answer of your own, or ask Corinne Goy for more information if necessary.

To post a message you must log in.