Error finding file for aMC@NLO with HERWIG

Asked by Juanpe

Hi,

I am trying to run a simple t t~ process using MC@NLO but it seems not to run because it canno find a file which is actually there.

My proc looks like this:

set group_subprocesses Auto
set ignore_six_quark_processes False
set gauge unitary
set complex_mass_scheme False
import model sm
define p = g u c d s u~ c~ d~ s~
define j = g u c d s u~ c~ d~ s~
define l+ = e+ mu+
define l- = e- mu-
define vl = ve vm vt
define vl~ = ve~ vm~ vt~
import model loop_sm
generate p p > t t~ [QCD]
output ttbartest

and I run using Madspin for the decays and ask for showering with HERWIG. It runs fine untill the showering when it stops saying;

INFO: Compiling MCatNLO for HERWIG6...
INFO: ... done
INFO: Showering events...
INFO: (Running in /home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/ttbartest/MCatNLO/RUN_HERWIG6_1)
INFO: All jobs finished
INFO: All jobs finished

Command "launch auto " interrupted with error:
IOError : [Errno 2] No such file or directory: '/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/ttbartest/MCatNLO/RUN_HERWIG6_1/events.hep.gz'
Please report this bug on https://bugs.launchpad.net/madgraph5
More information is found in '/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/ttbartest/run_01_decayed_1_tag_1_debug.log'.
Please attach this file to your report.

The problem is that if I look there, that file is actually there. Do you know if I am missing something or how can I make the code notice that the file is there?

Thanks a lot in advance,
Juanpe.

Question information

Language:
English Edit question
Status:
Solved
For:
MadGraph5_aMC@NLO Edit question
Assignee:
Paolo Torrielli Edit question
Solved by:
Paolo Torrielli
Solved:
Last query:
Last reply:
Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#1

Could you copy-paste the content of the debug file?
This will indicate me which line is responsible for such crash.

Thanks,

Olivier
On Sep 17, 2014, at 12:43 PM, Juanpe <email address hidden> wrote:

> New question #254622 on MadGraph5_aMC@NLO:
> https://answers.launchpad.net/mg5amcnlo/+question/254622
>
> Hi,
>
> I am trying to run a simple t t~ process using MC@NLO but it seems not to run because it canno find a file which is actually there.
>
> My proc looks like this:
>
> set group_subprocesses Auto
> set ignore_six_quark_processes False
> set gauge unitary
> set complex_mass_scheme False
> import model sm
> define p = g u c d s u~ c~ d~ s~
> define j = g u c d s u~ c~ d~ s~
> define l+ = e+ mu+
> define l- = e- mu-
> define vl = ve vm vt
> define vl~ = ve~ vm~ vt~
> import model loop_sm
> generate p p > t t~ [QCD]
> output ttbartest
>
> and I run using Madspin for the decays and ask for showering with HERWIG. It runs fine untill the showering when it stops saying;
>
> INFO: Compiling MCatNLO for HERWIG6...
> INFO: ... done
> INFO: Showering events...
> INFO: (Running in /home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/ttbartest/MCatNLO/RUN_HERWIG6_1)
> INFO: All jobs finished
> INFO: All jobs finished
>
> Command "launch auto " interrupted with error:
> IOError : [Errno 2] No such file or directory: '/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/ttbartest/MCatNLO/RUN_HERWIG6_1/events.hep.gz'
> Please report this bug on https://bugs.launchpad.net/madgraph5
> More information is found in '/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/ttbartest/run_01_decayed_1_tag_1_debug.log'.
> Please attach this file to your report.
>
> The problem is that if I look there, that file is actually there. Do you know if I am missing something or how can I make the code notice that the file is there?
>
> Thanks a lot in advance,
> Juanpe.
>
>
> --
> You received this question notification because you are an answer
> contact for MadGraph5_aMC@NLO.

Revision history for this message
Juanpe (erjuanpea) said :
#2

Hi again Olivier,

I have tracked down the problem and I think I found that this happen only in cluster mode when trying to copy the final hep file. In multicore mode it doesn't happen and thus the file get copied and everything is fine. In case, everything has ran fine but the problem is only copying the result to the Events/run* folder. In the debug file I have the following:

launch auto
Traceback (most recent call last):
  File "/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/madgraph/interface/extended_cmd.py", line 879, in onecmd
    return self.onecmd_orig(line, **opt)
  File "/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/madgraph/interface/extended_cmd.py", line 872, in onecmd_orig
    return func(arg, **opt)
  File "/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/madgraph/interface/amcatnlo_run_interface.py", line 1199, in do_launch
    self.run_mcatnlo(evt_file)
  File "/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/madgraph/interface/amcatnlo_run_interface.py", line 2384, in run_mcatnlo
    files.mv(os.path.join(rundir, 'events.%s.gz' % ext), hep_file)
  File "/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/madgraph/iolibs/files.py", line 173, in mv
    shutil.move(path1, path2)
  File "/usr/lib64/python2.6/shutil.py", line 260, in move
    copy2(src, real_dst)
  File "/usr/lib64/python2.6/shutil.py", line 95, in copy2
    copyfile(src, dst)
  File "/usr/lib64/python2.6/shutil.py", line 50, in copyfile
    with open(src, 'rb') as fsrc:
IOError: [Errno 2] No such file or directory: '/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/testcluster/MCatNLO/RUN_PYTHIA6Q_1/events.hep.gz'
Value of current Options:
              text_editor : None
              web_browser : None
        cluster_temp_path : None
       group_subprocesses : False
                  timeout : 60
            cluster_queue : lipq
         madanalysis_path : /home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/MadAnalysis
                   lhapdf : lhapdf-config
ignore_six_quark_processes : False
             stdout_level : 20
    loop_optimized_output : True
    cluster_status_update : (600, 30)
               hepmc_path : None
             pythia8_path : None
                hwpp_path : None
   automatic_html_opening : False
       cluster_retry_wait : 300
      output_dependencies : external
          pythia-pgs_path : /home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/pythia-pgs
                 mg5_path : /home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2
                  td_path : /home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/td
             delphes_path : /home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/Delphes
              thepeg_path : None
             cluster_type : sge
      exrootanalysis_path : /home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/ExRootAnalysis
         fortran_compiler : None
                  nb_core : 6
                      OLP : MadLoop
              auto_update : 7
         cluster_nb_retry : 1
               eps_viewer : None
             syscalc_path : None
                  fastjet : None
                    gauge : unitary
      complex_mass_scheme : False
             cpp_compiler : None
                 run_mode : 1

Is that part enough or should I upload all the file?

Thanks!
Juanpe.

Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#3

Thanks,

This is enough. I will come back to you later today or tomorrow.

Cheers,

olivier

On Sep 17, 2014, at 2:06 PM, Juanpe <email address hidden> wrote:

> Question #254622 on MadGraph5_aMC@NLO changed:
> https://answers.launchpad.net/mg5amcnlo/+question/254622
>
> Status: Answered => Open
>
> Juanpe is still having a problem:
> Hi again Olivier,
>
> I have tracked down the problem and I think I found that this happen
> only in cluster mode when trying to copy the final hep file. In
> multicore mode it doesn't happen and thus the file get copied and
> everything is fine. In case, everything has ran fine but the problem is
> only copying the result to the Events/run* folder. In the debug file I
> have the following:
>
>
> launch auto
> Traceback (most recent call last):
> File "/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/madgraph/interface/extended_cmd.py", line 879, in onecmd
> return self.onecmd_orig(line, **opt)
> File "/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/madgraph/interface/extended_cmd.py", line 872, in onecmd_orig
> return func(arg, **opt)
> File "/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/madgraph/interface/amcatnlo_run_interface.py", line 1199, in do_launch
> self.run_mcatnlo(evt_file)
> File "/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/madgraph/interface/amcatnlo_run_interface.py", line 2384, in run_mcatnlo
> files.mv(os.path.join(rundir, 'events.%s.gz' % ext), hep_file)
> File "/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/madgraph/iolibs/files.py", line 173, in mv
> shutil.move(path1, path2)
> File "/usr/lib64/python2.6/shutil.py", line 260, in move
> copy2(src, real_dst)
> File "/usr/lib64/python2.6/shutil.py", line 95, in copy2
> copyfile(src, dst)
> File "/usr/lib64/python2.6/shutil.py", line 50, in copyfile
> with open(src, 'rb') as fsrc:
> IOError: [Errno 2] No such file or directory: '/home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/testcluster/MCatNLO/RUN_PYTHIA6Q_1/events.hep.gz'
> Value of current Options:
> text_editor : None
> web_browser : None
> cluster_temp_path : None
> group_subprocesses : False
> timeout : 60
> cluster_queue : lipq
> madanalysis_path : /home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/MadAnalysis
> lhapdf : lhapdf-config
> ignore_six_quark_processes : False
> stdout_level : 20
> loop_optimized_output : True
> cluster_status_update : (600, 30)
> hepmc_path : None
> pythia8_path : None
> hwpp_path : None
> automatic_html_opening : False
> cluster_retry_wait : 300
> output_dependencies : external
> pythia-pgs_path : /home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/pythia-pgs
> mg5_path : /home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2
> td_path : /home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/td
> delphes_path : /home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/Delphes
> thepeg_path : None
> cluster_type : sge
> exrootanalysis_path : /home/local/atlas/jespinosa/theory/MG5_aMC_v2_1_2/ExRootAnalysis
> fortran_compiler : None
> nb_core : 6
> OLP : MadLoop
> auto_update : 7
> cluster_nb_retry : 1
> eps_viewer : None
> syscalc_path : None
> fastjet : None
> gauge : unitary
> complex_mass_scheme : False
> cpp_compiler : None
> run_mode : 1
>
> Is that part enough or should I upload all the file?
>
> Thanks!
> Juanpe.
>
> --
> You received this question notification because you are an answer
> contact for MadGraph5_aMC@NLO.

Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#4

I have actually no idea,
I will pass the hand to the expert in that part of the code.

Cheers,

Olivier

Revision history for this message
Best Paolo Torrielli (paolo-torrielli) said :
#5

Hi Juanpe,

I've talked to Marco Zaro (whom I've subscribed to this thread) about this, and it may be a latency
problem, namely when python checks the existence of the file, the latter has not yet been copied
back from the cluster node.

It would be useful if you could make sure that the file events.hep.gz (or events.hep) in RUN_HERWIG*
is there and is not empty. If it is empty, it means that something went wrong before. If the file is not
empty, then try to go in MG5_aMC_v2_1_2/ ttbartest/bin/internal/amcatnlo_run_interface and write

time.sleep(10)

just below the command

self.wait_for_complete('shower')

which in your version should be at line 2355. (If you want to apply this change directly to every newly
created physics process, you have to also edit the file MG5_aMC_v2_1_2/madgraph/interface/
amcatnlo_run_interface).

Let me know if this solves the problem.
Cheers.
Paolo

Revision history for this message
Juanpe (erjuanpea) said :
#6

Hello Paolo,

fixed! It was actually the problem. Once I set the timer it worked fine.

Cheers,
Juanpe.

Revision history for this message
Juanpe (erjuanpea) said :
#7

Thanks Paolo Torrielli, that solved my question.