Gridpacks unable to generate LHE

Asked by 张凯栗

Dear experts,

I am generating sample for a SM bkg process, using MG5 2.6.0. In the first run it works well with LHE files. I can use these LHE file to generate samples.

Then I reuse the gridpacks to generate more samples. I foIlow the step on https://cp3.irmp.ucl.ac.be/projects/madgraph/wiki/GridDevelopment . Then I can compile it without errors but when I type ./run.sh, it showes error messages like:

 ./run.sh 100 244
Updating grid_card.dat...
Now generating 100 events with random seed 244 and granularity -1
P1_qq_aatapvltamvl
P1_qq_aalvllvl
P1_qq_aalvltamvl
P1_qq_aatapvllvl
../bin/internal/run_combine: line 14: 26039 Segmentation fault (core dumped) ../bin/internal/combine_events 2> fail_combine.log
No handlers could be found for logger "madevent.stdout"
Traceback (most recent call last):
  File "./bin/gridrun", line 84, in <module>
    cmd_line = cmd_interface.GridPackCmd(me_dir=root_path, nb_event=args[0], seed=args[1])
  File "~grid/madevent/bin/internal/madevent_interface.py", line 6258, in __init__
    self.launch(nb_event, seed)
  File "~grid/madevent/bin/internal/madevent_interface.py", line 6283, in launch
    self.exec_cmd('combine_events')
  File "~grid/madevent/bin/internal/extended_cmd.py", line 1465, in exec_cmd
    stop = Cmd.onecmd_orig(current_interface, line, **opt)
  File "~grid/madevent/bin/internal/extended_cmd.py", line 1392, in onecmd_orig
    return func(arg, **opt)
  File "~grid/madevent/bin/internal/madevent_interface.py", line 3214, in do_combine_events
    out=pjoin(self.me_dir,'Events', self.run_name, 'events.lhe'))
  File "~grid/madevent/bin/internal/misc.py", line 371, in deco_f_retry
    raise error.__class__, '[Fail %i times] \n %s ' % (i+1, error)
IOError: [Fail 5 times]
 [Errno 2] No such file or directory: '~grid/madevent/Events/events.lhe'
Error: event file not found !

I found in the previous discussion in this forum, some met the same problem with me. the problem with madevent.stdout
But at the first time I can run it successfully. So I am wondering why at gridrun it doesn't work.
I don't think it's a problem of format, since my scirpt is very simple:

import model sm
define l+=e+ mu+ ta+
define l-=e- mu- ta-
generate p p > a a l+ vl l- vl~
output sm_Nov7_decay
launch

1

set gridpack True
set nevents 6000
set ebeam1 6500
set ebeam2 6500
set mmaa 50.00
done

I have tested the run with/without ATLAS environment (setupATLAS), there are some difference in warning message when compiling, but both can compile without bugs.
So I am wondering why I can't reuse the gridpacks. Please comment.

Question information

Language:
English Edit question
Status:
Solved
For:
MadGraph5_aMC@NLO Edit question
Assignee:
No assignee Edit question
Solved by:
张凯栗
Solved:
Last query:
Last reply:
Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#1

Hi,

I do not have enough cpu to generate such gridpack locally. Can you put it somewhere online such that I can
download it and test it locally?

Thanks,

Olivier

> On Dec 2, 2017, at 09:03, 张凯栗 <email address hidden> wrote:
>
> New question #661344 on MadGraph5_aMC@NLO:
> https://answers.launchpad.net/mg5amcnlo/+question/661344
>
> Dear experts,
>
> I am generating sample for a SM bkg process, using MG5 2.6.0. In the first run it works well with LHE files. I can use these LHE file to generate samples.
>
> Then I reuse the gridpacks to generate more samples. I foIlow the step on https://cp3.irmp.ucl.ac.be/projects/madgraph/wiki/GridDevelopment . Then I can compile it without errors but when I type ./run.sh, it showes error messages like:
>
> ./run.sh 100 244
> Updating grid_card.dat...
> Now generating 100 events with random seed 244 and granularity -1
> P1_qq_aatapvltamvl
> P1_qq_aalvllvl
> P1_qq_aalvltamvl
> P1_qq_aatapvllvl
> ../bin/internal/run_combine: line 14: 26039 Segmentation fault (core dumped) ../bin/internal/combine_events 2> fail_combine.log
> No handlers could be found for logger "madevent.stdout"
> Traceback (most recent call last):
> File "./bin/gridrun", line 84, in <module>
> cmd_line = cmd_interface.GridPackCmd(me_dir=root_path, nb_event=args[0], seed=args[1])
> File "~grid/madevent/bin/internal/madevent_interface.py", line 6258, in __init__
> self.launch(nb_event, seed)
> File "~grid/madevent/bin/internal/madevent_interface.py", line 6283, in launch
> self.exec_cmd('combine_events')
> File "~grid/madevent/bin/internal/extended_cmd.py", line 1465, in exec_cmd
> stop = Cmd.onecmd_orig(current_interface, line, **opt)
> File "~grid/madevent/bin/internal/extended_cmd.py", line 1392, in onecmd_orig
> return func(arg, **opt)
> File "~grid/madevent/bin/internal/madevent_interface.py", line 3214, in do_combine_events
> out=pjoin(self.me_dir,'Events', self.run_name, 'events.lhe'))
> File "~grid/madevent/bin/internal/misc.py", line 371, in deco_f_retry
> raise error.__class__, '[Fail %i times] \n %s ' % (i+1, error)
> IOError: [Fail 5 times]
> [Errno 2] No such file or directory: '~grid/madevent/Events/events.lhe'
> Error: event file not found !
>
> I found in the previous discussion in this forum, some met the same problem with me. the problem with madevent.stdout
> But at the first time I can run it successfully. So I am wondering why at gridrun it doesn't work.
> I don't think it's a problem of format, since my scirpt is very simple:
>
> import model sm
> define l+=e+ mu+ ta+
> define l-=e- mu- ta-
> generate p p > a a l+ vl l- vl~
> output sm_Nov7_decay
> launch
>
> 1
>
> set gridpack True
> set nevents 6000
> set ebeam1 6500
> set ebeam2 6500
> set mmaa 50.00
> done
>
> I have tested the run with/without ATLAS environment (setupATLAS), there are some difference in warning message when compiling, but both can compile without bugs.
> So I am wondering why I can't reuse the gridpacks. Please comment.
>
> --
> You received this question notification because you are an answer
> contact for MadGraph5_aMC@NLO.

Revision history for this message
张凯栗 (zkl543030) said :
#2

Hi Olivier,
I uploaded the gridpack file on:
https://drive.google.com/file/d/1FuiYVgDZxY-FaBFTnkwhNrAgg1aQFgYF/view?usp=sharing
it's about 62MB size and you can check it.

Thanks.
Kaili

Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#3

Can you double check the link.

I thought originally that the problem was my network but I have tried from a third network today and it still fails to download.

Cheers,

Olivier
> On 11 Dec 2017, at 13:22, 张凯栗 <email address hidden> wrote:
>
> Question #661344 on MadGraph5_aMC@NLO changed:
> https://answers.launchpad.net/mg5amcnlo/+question/661344
>
> Status: Answered => Open
>
> 张凯栗 is still having a problem:
> Hi Olivier,
> I uploaded the gridpack file on:
> https://drive.google.com/file/d/1FuiYVgDZxY-FaBFTnkwhNrAgg1aQFgYF/view?usp=sharing
> it's about 62MB size and you can check it.
>
> Thanks.
> Kaili
>
> --
> You received this question notification because you are an answer
> contact for MadGraph5_aMC@NLO.

Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#4

Hi,

This is still running since more than a week on my laptop.
Still waiting for the code to hit the crash.

Cheers,

Olivier

> On 11 Dec 2017, at 13:22, 张凯栗 <email address hidden> wrote:
>
> Question #661344 on MadGraph5_aMC@NLO changed:
> https://answers.launchpad.net/mg5amcnlo/+question/661344
>
> Status: Answered => Open
>
> 张凯栗 is still having a problem:
> Hi Olivier,
> I uploaded the gridpack file on:
> https://drive.google.com/file/d/1FuiYVgDZxY-FaBFTnkwhNrAgg1aQFgYF/view?usp=sharing
> it's about 62MB size and you can check it.
>
> Thanks.
> Kaili
>
> --
> You received this question notification because you are an answer
> contact for MadGraph5_aMC@NLO.

Revision history for this message
张凯栗 (zkl543030) said :
#5

Hi Oliver,
sorry for the inconvienience.
For the production step it works fine. after a very long run it produces a LHE and gridpacks.
My problem is for the first run the LHE works well, but when I want to use the gridpacks to regenearate LHEs it cause problems.
The gridpacks I used is https://www.dropbox.com/s/o6mwngvtvv74zqb/wwrr_gridpack_50.tar.gz?dl=0
You can check this gridpacks to save time, I thought?

Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#6

Hi,

The run finally finishes and I was actually able to reproduce the run.
The part of the code were the script was originated was completely removed in the recent version of the code.
So since it takes more than a week to run your gridpack and to get to the bug, I think that the best would be to first try with the latest version of the code to
check if the problem is still present. Can you do that?
I'm afraid that investigating such bug on 2.5.4 is quite irrelevant.

Cheers,

Olivier

> On 11 Jan 2018, at 06:12, 张凯栗 <email address hidden> wrote:
>
> Question #661344 on MadGraph5_aMC@NLO changed:
> https://answers.launchpad.net/mg5amcnlo/+question/661344
>
> Status: Answered => Open
>
> 张凯栗 is still having a problem:
> Hi Oliver,
> sorry for the inconvienience.
> For the production step it works fine. after a very long run it produces a LHE and gridpacks.
> My problem is for the first run the LHE works well, but when I want to use the gridpacks to regenearate LHEs it cause problems.
> The gridpacks I used is https://www.dropbox.com/s/o6mwngvtvv74zqb/wwrr_gridpack_50.tar.gz?dl=0
> You can check this gridpacks to save time, I thought?
>
> --
> You received this question notification because you are an answer
> contact for MadGraph5_aMC@NLO.

Revision history for this message
张凯栗 (zkl543030) said :
#7

Hi all,

if there is some still looking at this problem, I'd say the problem sovled.
At first when you extract the gridpack file, the webpage says you can compile and run ./bin/clean4grid
Then after these the error will occur.
But if you don't compile and clean4grid, just directly run the run.sh, the LHE can be generated.

I don't know the principle but somehow it works (It's been a time and I remembered this problem today)
Thanks all the enthusiastic experts.