Problem running process generated locally with mg5

Asked by Ezio Maina

I am trying to run a process generated on my linux box with mg5. I am using a Torque queue system.
I launch generate events and everything works for a while then it crasheswhen combining events.

The screen output is the following:

No module named madgraph.interface.extended_cmd
No module named madgraph.various.misc
************************************************************
* *
* W E L C O M E to M A D G R A P H 5 *
* M A D E V E N T *
* *
* * * *
* * * * * *
* * * * * 5 * * * * *
* * * * * *
* * * *
* *
* VERSION 5.1.4.4 *
* *
* The MadGraph Development Team - Please visit us at *
* https://server06.fynu.ucl.ac.be/projects/madgraph *
* *
* Type 'help' for in-line help. *
* *
************************************************************
load configuration from Cards/me5_configuration.txt
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
 LANGUAGE = (unset),
 LC_ALL = (unset),
 LC_CTYPE = "UTF-8",
 LANG = "en_US.UTF-8"
    are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Using default text editor "vi". Set another one in ./input/mg5_configuration.txt
Using default eps viewer "gv". Set another one in ./input/mg5_configuration.txt
Using default web browser "firefox". Set another one in ./input/mg5_configuration.txt
generate_events
Will run in mode parton
Do you want to edit one cards (press enter to bypass editing)?
  1 / param : param_card.dat (be carefull about parameter consistency, especially widths)
  2 / run : run_card.dat
  Path to a valid card.
 [0, done, 1, param, 2, run, enter path][20s to answer]
0
Generating 100000 events with run name run_01
survey run_01
compile directory

(firefox:18157): Gtk-WARNING **: Locale not supported by C library.
 Using the fallback 'C' locale.
Running Survey
Creating Jobs
Working on SubProcesses
    P0_qq_wpwm
 Idle: 0 Running: 2 Finish: 0

(Gecko:18157): Gdk-WARNING **: locale not supported by C library
INFO: All jobs finished
End survey
refine 100000
Creating Jobs
Refine results to 100000
Using random number seed offset = 41
    P0_qq_wpwm
 Idle: 48 Running: 8 Finish: 0
 Idle: 30 Running: 8 Finish: 18
 Idle: 6 Running: 8 Finish: 42
INFO: All jobs finished
Combining runs
^[[Afinish refine
refine 100000
Creating Jobs
Refine results to 100000
Using random number seed offset = 41
    P0_qq_wpwm
INFO: All jobs finished
Combining runs
finish refine
combine_events
Combining Events
qstat: Unknown Job Id 508.teofarm02.to.infn.it
Command "generate_events " interrupted in sub-command:
"generate_events" with error:
IOError : [Errno 2] No such file or directory: '/home/maina/MadEvent5/MadGraph5_v1_4_4/jj2wpwm/SubProcesses/combine.log'
Please report this bug on https://bugs.launchpad.net/madgraph5
More information is found in '/home/maina/MadEvent5/MadGraph5_v1_4_4/jj2wpwm/run_01_tag_1_debug.log'.
Please attach this file to your report.
quit

The log is as follows:

#************************************************************
#* MadGraph/MadEvent 5 *
#* *
#* * * *
#* * * * * *
#* * * * * 5 * * * * *
#* * * * * *
#* * * *
#* *
#* *
#* VERSION 5.1.4.4 *
#* *
#* The MadGraph Development Team - Please visit us at *
#* https://server06.fynu.ucl.ac.be/projects/madgraph *
#* *
#************************************************************
#* *
#* Command File for MadEvent *
#* *
#* run as ./bin/madevent.py filename *
#* *
#************************************************************
generate_events
Traceback (most recent call last):
  File "/home/maina/MadEvent5/MadGraph5_v1_4_4/jj2wpwm/bin/internal/extended_cmd.py", line 548, in onecmd
    return cmd.Cmd.onecmd(self, line)
  File "/usr/local/lib/python2.7/cmd.py", line 221, in onecmd
    return func(arg)
  File "/home/maina/MadEvent5/MadGraph5_v1_4_4/jj2wpwm/bin/internal/madevent_interface.py", line 1750, in do_generate_events
    self.exec_cmd('combine_events', postcmd=False)
  File "/home/maina/MadEvent5/MadGraph5_v1_4_4/jj2wpwm/bin/internal/extended_cmd.py", line 586, in exec_cmd
    stop = cmd.Cmd.onecmd(current_interface, line)
  File "/usr/local/lib/python2.7/cmd.py", line 221, in onecmd
    return func(arg)
  File "/home/maina/MadEvent5/MadGraph5_v1_4_4/jj2wpwm/bin/internal/madevent_interface.py", line 2137, in do_combine_events
    output = open(pjoin(self.me_dir,'SubProcesses','combine.log')).read()
IOError: [Errno 2] No such file or directory: '/home/maina/MadEvent5/MadGraph5_v1_4_4/jj2wpwm/SubProcesses/combine.log'
Value of current Options:
              web_browser : None
              text_editor : None
          pythia-pgs_path :
                  td_path :
             delphes_path :
             cluster_type : pbs
         madanalysis_path :
            cluster_queue : batch
       group_subprocesses : Auto
         fortran_compiler : None
                  nb_core : 2
      exrootanalysis_path :
               eps_viewer : None
                  timeout : 20
   automatic_html_opening : False
             cluster_mode : 1
             pythia8_path :
ignore_six_quark_processes : False
                 run_mode : 1

Any clue?
Thanks

Question information

Language:
English Edit question
Status:
Answered
For:
MadGraph5_aMC@NLO Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#1

Hi Ezio,

I can see multiple reasons:

1) The job is not yet finished on the cluster but the command qstat
fail to find it.
> qstat: Unknown Job Id 508.teofarm02.to.infn.it

2) The jobs is indeed finished but the log file is not yet written on
the disk (a typical file synchronization problem)

If this is a filesystem problem this should be intermittent. So I
think that this is the first problem.
So few question:
1) Do you see the run with the qstat command?
2) If so could you check the command qstat ID (where ID is the ID of
the job)
3) is the ID the same as the one given in the (new) error
> qstat: Unknown Job Id XXXX.teofarm02.to.infn.it

I hope that with those information, I could be able to provide a patch
working on your Torque installation.

Cheers,

Olivier

On Apr 23, 2012, at 6:55 AM, Ezio Maina wrote:

> New question #194470 on MadGraph5:
> https://answers.launchpad.net/madgraph5/+question/194470
>
> I am trying to run a process generated on my linux box with mg5. I
> am using a Torque queue system.
> I launch generate events and everything works for a while then it
> crasheswhen combining events.
>
> The screen output is the following:
>
>
> No module named madgraph.interface.extended_cmd
> No module named madgraph.various.misc
> ************************************************************
> * *
> * W E L C O M E to M A D G R A P H 5 *
> * M A D E V E N T *
> * *
> * * * *
> * * * * * *
> * * * * * 5 * * * * *
> * * * * * *
> * * * *
> * *
> * VERSION 5.1.4.4 *
> * *
> * The MadGraph Development Team - Please visit us at *
> * https://server06.fynu.ucl.ac.be/projects/madgraph *
> * *
> * Type 'help' for in-line help. *
> * *
> ************************************************************
> load configuration from Cards/me5_configuration.txt
> perl: warning: Setting locale failed.
> perl: warning: Please check that your locale settings:
> LANGUAGE = (unset),
> LC_ALL = (unset),
> LC_CTYPE = "UTF-8",
> LANG = "en_US.UTF-8"
> are supported and installed on your system.
> perl: warning: Falling back to the standard locale ("C").
> Using default text editor "vi". Set another one in ./input/
> mg5_configuration.txt
> Using default eps viewer "gv". Set another one in ./input/
> mg5_configuration.txt
> Using default web browser "firefox". Set another one in ./input/
> mg5_configuration.txt
> generate_events
> Will run in mode parton
> Do you want to edit one cards (press enter to bypass editing)?
> 1 / param : param_card.dat (be carefull about parameter
> consistency, especially widths)
> 2 / run : run_card.dat
> Path to a valid card.
> [0, done, 1, param, 2, run, enter path][20s to answer]
> 0
> Generating 100000 events with run name run_01
> survey run_01
> compile directory
>
> (firefox:18157): Gtk-WARNING **: Locale not supported by C library.
> Using the fallback 'C' locale.
> Running Survey
> Creating Jobs
> Working on SubProcesses
> P0_qq_wpwm
> Idle: 0 Running: 2 Finish: 0
>
> (Gecko:18157): Gdk-WARNING **: locale not supported by C library
> INFO: All jobs finished
> End survey
> refine 100000
> Creating Jobs
> Refine results to 100000
> Using random number seed offset = 41
> P0_qq_wpwm
> Idle: 48 Running: 8 Finish: 0
> Idle: 30 Running: 8 Finish: 18
> Idle: 6 Running: 8 Finish: 42
> INFO: All jobs finished
> Combining runs
> ^[[Afinish refine
> refine 100000
> Creating Jobs
> Refine results to 100000
> Using random number seed offset = 41
> P0_qq_wpwm
> INFO: All jobs finished
> Combining runs
> finish refine
> combine_events
> Combining Events
> qstat: Unknown Job Id 508.teofarm02.to.infn.it
> Command "generate_events " interrupted in sub-command:
> "generate_events" with error:
> IOError : [Errno 2] No such file or directory: '/home/maina/
> MadEvent5/MadGraph5_v1_4_4/jj2wpwm/SubProcesses/combine.log'
> Please report this bug on https://bugs.launchpad.net/madgraph5
> More information is found in '/home/maina/MadEvent5/MadGraph5_v1_4_4/
> jj2wpwm/run_01_tag_1_debug.log'.
> Please attach this file to your report.
> quit
>
>
>
> The log is as follows:
>
>
> #************************************************************
> #* MadGraph/MadEvent 5 *
> #* *
> #* * * *
> #* * * * * *
> #* * * * * 5 * * * * *
> #* * * * * *
> #* * * *
> #* *
> #* *
> #* VERSION 5.1.4.4 *
> #* *
> #* The MadGraph Development Team - Please visit us at *
> #* https://server06.fynu.ucl.ac.be/projects/madgraph *
> #* *
> #************************************************************
> #* *
> #* Command File for MadEvent *
> #* *
> #* run as ./bin/madevent.py filename *
> #* *
> #************************************************************
> generate_events
> Traceback (most recent call last):
> File "/home/maina/MadEvent5/MadGraph5_v1_4_4/jj2wpwm/bin/internal/
> extended_cmd.py", line 548, in onecmd
> return cmd.Cmd.onecmd(self, line)
> File "/usr/local/lib/python2.7/cmd.py", line 221, in onecmd
> return func(arg)
> File "/home/maina/MadEvent5/MadGraph5_v1_4_4/jj2wpwm/bin/internal/
> madevent_interface.py", line 1750, in do_generate_events
> self.exec_cmd('combine_events', postcmd=False)
> File "/home/maina/MadEvent5/MadGraph5_v1_4_4/jj2wpwm/bin/internal/
> extended_cmd.py", line 586, in exec_cmd
> stop = cmd.Cmd.onecmd(current_interface, line)
> File "/usr/local/lib/python2.7/cmd.py", line 221, in onecmd
> return func(arg)
> File "/home/maina/MadEvent5/MadGraph5_v1_4_4/jj2wpwm/bin/internal/
> madevent_interface.py", line 2137, in do_combine_events
> output =
> open(pjoin(self.me_dir,'SubProcesses','combine.log')).read()
> IOError: [Errno 2] No such file or directory: '/home/maina/MadEvent5/
> MadGraph5_v1_4_4/jj2wpwm/SubProcesses/combine.log'
> Value of current Options:
> web_browser : None
> text_editor : None
> pythia-pgs_path :
> td_path :
> delphes_path :
> cluster_type : pbs
> madanalysis_path :
> cluster_queue : batch
> group_subprocesses : Auto
> fortran_compiler : None
> nb_core : 2
> exrootanalysis_path :
> eps_viewer : None
> timeout : 20
> automatic_html_opening : False
> cluster_mode : 1
> pythia8_path :
> ignore_six_quark_processes : False
> run_mode : 1
>
>
>
> Any clue?
> Thanks
>
>
> --
> You received this question notification because you are a member of
> MadTeam, which is an answer contact for MadGraph5.

Can you help with this problem?

Provide an answer of your own, or ask Ezio Maina for more information if necessary.

To post a message you must log in.