error in cluster run

Asked by Juhi Dutta

Hi,

I am running MG5_aMC_v2_2_3 on a pbs cluster. My process is p p > t t~ . I made the necessary change in me5_configuration.txt setting:

 run_mode = 1

#! Cluster Type [pbs|sge|condor|lsf|ge|slurm|htcaas|htcaas2] Use for cluster run only
#! And cluster queue (or partition for slurm)
 cluster_type = pbs
 cluster_queue = default

#! Path to a node directory to avoid direct writting on the central disk
#! Note that condor cluster avoid direct writting by default (therefore this
#! options didn't modify condor cluster)
 cluster_temp_path = None

I run a script with

cd t2
bin/madevent generate_events -f

However my run stops with the following error:

generate_events -f
Traceback (most recent call last):
  File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/extended_cmd.py", line 879, in onecmd
    return self.onecmd_orig(line, **opt)
  File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/extended_cmd.py", line 872, in onecmd_orig
    return func(arg, **opt)
  File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/madevent_interface.py", line 1924, in do_generate_events
    postcmd=False)
  File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/extended_cmd.py", line 919, in exec_cmd
    stop = Cmd.onecmd_orig(current_interface, line, **opt)
  File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/extended_cmd.py", line 872, in onecmd_orig
    return func(arg, **opt)
  File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/madevent_interface.py", line 2358, in do_survey
    run_type='survey on %s (%s/%s)' % (subdir,nb_proc+1,len(subproc)))
  File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/madevent_interface.py", line 3248, in launch_job
    required_output=required_output)
  File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/cluster.py", line 69, in deco_f_store
    id = f(self, **args)
  File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/cluster.py", line 127, in submit2
    required_output=required_output, nb_submit=nb_submit)
  File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/misc.py", line 242, in deco_f_retry
    raise error.__class__, '[Fail %i times] \n %s ' % (i+1, error)
Exception: [Fail 5 times]
 ['qsub', '-o', '/dev/null', '-N', 'a53b609c1653b4', '-e', '/dev/null', '-V', '-q', 'default'] fails with no such file or directory

 Please help me resolve this issue.

Regards,

Juhi

Question information

Language:
English Edit question
Status:
Solved
For:
MadGraph5_aMC@NLO Edit question
Assignee:
Rikkert Frederix Edit question
Solved by:
Rikkert Frederix
Solved:
Last query:
Last reply:
Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#1

Hi,

Did you check that you have the executable qsub on your system?
The error seems to indicate that you do not have that executable.
If you do not have such executable this means that you do not have a PBS cluster.
I guess that you need to contact your sys admin for more details.

Cheers,

Olivier

> On Mar 26, 2016, at 10:27, Juhi Dutta <email address hidden> wrote:
>
> New question #289243 on MadGraph5_aMC@NLO:
> https://answers.launchpad.net/mg5amcnlo/+question/289243
>
> Hi,
>
> I am running MG5_aMC_v2_2_3 on a pbs cluster. My process is p p > t t~ . I made the necessary change in me5_configuration.txt setting:
>
> run_mode = 1
>
> #! Cluster Type [pbs|sge|condor|lsf|ge|slurm|htcaas|htcaas2] Use for cluster run only
> #! And cluster queue (or partition for slurm)
> cluster_type = pbs
> cluster_queue = default
>
> #! Path to a node directory to avoid direct writting on the central disk
> #! Note that condor cluster avoid direct writting by default (therefore this
> #! options didn't modify condor cluster)
> cluster_temp_path = None
>
> I run a script with
>
> cd t2
> bin/madevent generate_events -f
>
> However my run stops with the following error:
>
>
> generate_events -f
> Traceback (most recent call last):
> File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/extended_cmd.py", line 879, in onecmd
> return self.onecmd_orig(line, **opt)
> File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/extended_cmd.py", line 872, in onecmd_orig
> return func(arg, **opt)
> File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/madevent_interface.py", line 1924, in do_generate_events
> postcmd=False)
> File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/extended_cmd.py", line 919, in exec_cmd
> stop = Cmd.onecmd_orig(current_interface, line, **opt)
> File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/extended_cmd.py", line 872, in onecmd_orig
> return func(arg, **opt)
> File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/madevent_interface.py", line 2358, in do_survey
> run_type='survey on %s (%s/%s)' % (subdir,nb_proc+1,len(subproc)))
> File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/madevent_interface.py", line 3248, in launch_job
> required_output=required_output)
> File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/cluster.py", line 69, in deco_f_store
> id = f(self, **args)
> File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/cluster.py", line 127, in submit2
> required_output=required_output, nb_submit=nb_submit)
> File "/c8scratch/juhiD/MG5_aMC_v2_2_3/t2/bin/internal/misc.py", line 242, in deco_f_retry
> raise error.__class__, '[Fail %i times] \n %s ' % (i+1, error)
> Exception: [Fail 5 times]
> ['qsub', '-o', '/dev/null', '-N', 'a53b609c1653b4', '-e', '/dev/null', '-V', '-q', 'default'] fails with no such file or directory
>
> Please help me resolve this issue.
>
> Regards,
>
> Juhi
>
>
>
> --
> You received this question notification because you are an answer
> contact for MadGraph5_aMC@NLO.

Revision history for this message
Juhi Dutta (dutta-juhi91) said :
#2

Hi,

Is there a particular command to check it? some of the processes are running like the SM ones. Ok I will follow it up with the cluster admin as well.

I had another query regarding gnuplot in mg5. In the plot card I see a option to see the output in td or gnuplot. I changed that to gnuplot however didnot see any plots after the run.

These are the lines in the me5_configuration.txt.

#! gnuplot PATH
#! Path to the directory containing td executables
#! relative path start from main directory
 gnuplot_path = gnuplot

Also in the plot card,

# Begin Classes # This is TAG. Do not modify this line
jet 1 -1 2 -2 3 -3 4 -4 21 # Class number 1
b 5 -5 # Class number 2
mET 12 -12 14 -14 16 -16 1000039 # Missing ET class, name is reserved

photons class is not mentioned, i.e, a 22 yet I see a photon plot after run. It is taken by default?

Regards,

Juhi

Revision history for this message
Rikkert Frederix (frederix) said :
#3

Dear Juhi

You get a data file compatible with gnuplot after the run. You have to read this file in with gnuplot yourself.

Particles that are in your event file, but not in a class are still plotted (and given a class for for their own automatically).

Best regards,
Rikkert

Revision history for this message
Juhi Dutta (dutta-juhi91) said :
#4

should the data file be present in the Events/run_01 directory? I don't
find it there. Am I missing something here?

On Tue, Mar 29, 2016 at 4:07 PM, Rikkert Frederix <
<email address hidden>> wrote:

> Your question #289243 on MadGraph5_aMC@NLO changed:
> https://answers.launchpad.net/mg5amcnlo/+question/289243
>
> Status: Open => Answered
>
> Rikkert Frederix proposed the following answer:
> Dear Juhi
>
> You get a data file compatible with gnuplot after the run. You have to
> read this file in with gnuplot yourself.
>
> Particles that are in your event file, but not in a class are still
> plotted (and given a class for for their own automatically).
>
> Best regards,
> Rikkert
>
> --
> If this answers your question, please go to the following page to let us
> know that it is solved:
>
> https://answers.launchpad.net/mg5amcnlo/+question/289243/+confirm?answer_id=2
>
> If you still need help, you can reply to this email or go to the
> following page to enter your feedback:
> https://answers.launchpad.net/mg5amcnlo/+question/289243
>
> You received this question notification because you asked the question.
>

Revision history for this message
Best Rikkert Frederix (frederix) said :
#5

Should be in HTML/run_01/plots_parton/plots.top

As you can see, the gnuplot interface is not very well developed ---non of the MG5_aMC developers has used it in many years...

Best,
Rikkert

Revision history for this message
Juhi Dutta (dutta-juhi91) said :
#6

Thanks Rikkert Frederix, that solved my question.

Revision history for this message
Juhi Dutta (dutta-juhi91) said :
#7

Ok that solves my problem. I found the data file to use. Thank you for your
help !

Best Regards,

Juhi

On Tue, Mar 29, 2016 at 5:52 PM, Rikkert Frederix <
<email address hidden>> wrote:

> Your question #289243 on MadGraph5_aMC@NLO changed:
> https://answers.launchpad.net/mg5amcnlo/+question/289243
>
> Status: Open => Answered
>
> Rikkert Frederix proposed the following answer:
> Should be in HTML/run_01/plots_parton/plots.top
>
> As you can see, the gnuplot interface is not very well developed ---non
> of the MG5_aMC developers has used it in many years...
>
> Best,
> Rikkert
>
> --
> If this answers your question, please go to the following page to let us
> know that it is solved:
>
> https://answers.launchpad.net/mg5amcnlo/+question/289243/+confirm?answer_id=4
>
> If you still need help, you can reply to this email or go to the
> following page to enter your feedback:
> https://answers.launchpad.net/mg5amcnlo/+question/289243
>
> You received this question notification because you asked the question.
>