Error with CKKW(L) Merging

Asked by Jack Y. Araz on 2019-12-22

Dear MG5 Team

I'm trying to run a process using CKKW-L merging (MG5 v3.0.1, model MSSM_SLHA2, also tried with the MSSM from feynrules database) The process that I want to run is as follows;

import model MSSM_SLHA2 --modelname
p p > sd3 sd3~
p p > sd3 sd3~ j
p p > sd3 sd3~ j j

(also tried with @0,1,2) to set up the run card and Pythia I'm using the following variables (mostly taken from
https://answers.launchpad.net/mg5amcnlo/+question/671046
and
https://indico.cern.ch/event/333239/contributions/777451/attachments/649911/893775/ERCWorkShop.pdf);

set ickkw 0
set xqcut 0
set sys_pdf none
set use_syst False
set jetmatching:merge off
set merging:njetmax 2
set merging:process pp>sd3sd3~
set merging:tms 275.0 # M sd3 : 1100 GeV
set merging:doptlundmerging on

But I'm constantly getting "rm: cannot remove ‘results.dat’: No such file or directory" while running the subprocesses.

Could you please point me out what I'm missing?

Thank you very much

Jack

-----------------------------------------
The log file is as follows;

Error when reading /home/jack/packages/MG5_aMC_v3_0_1/sbottomProdjj/SubProcesses/P3_gg_sd3sd3xgg/G5.06/results.dat
Command "generate_events run_01" interrupted with error:
ValueError : need more than 5 values to unpack
---------------------------------------
generate_events run_01
Traceback (most recent call last):
  File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/extended_cmd.py", line 1504, in onecmd
    return self.onecmd_orig(line, **opt)
  File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/extended_cmd.py", line 1453, in onecmd_orig
    return func(arg, **opt)
  File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/madevent_interface.py", line 2469, in do_generate_events
    self.run_generate_events(switch_mode, args)
  File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/common_run_interface.py", line 6806, in new_fct
    original_fct(obj, *args, **opts)
  File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/madevent_interface.py", line 2511, in run_generate_events
    self.exec_cmd('refine %s' % nb_event, postcmd=False)
  File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/extended_cmd.py", line 1531, in exec_cmd
    stop = Cmd.onecmd_orig(current_interface, line, **opt)
  File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/extended_cmd.py", line 1453, in onecmd_orig
    return func(arg, **opt)
  File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/madevent_interface.py", line 3421, in do_refine
    x_improve.launch() # create the ajob for the refinment.
  File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/madevent/gen_ximprove.py", line 861, in launch
    main_dir=pjoin(self.cmd.me_dir,'SubProcesses')) #main_dir is for gridpack readonly mode
  File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/madevent/sum_html.py", line 735, in collect_result
    P_comb.add_results(os.path.basename(G), path, mfactors[G])
  File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/madevent/sum_html.py", line 413, in add_results
    oneresult.read_results(filepath)
  File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/madevent/sum_html.py", line 307, in read_results
    self.xsec = data[:10]
ValueError: need more than 5 values to unpack

                              Run Options
                              -----------
               stdout_level : 20 (user set)

                         MadEvent Options
                         ----------------
     automatic_html_opening : False (user set)
        notification_center : True
          cluster_temp_path : None
             cluster_memory : None (user set)
               cluster_size : 100
              cluster_queue : None
                    nb_core : 8 (user set)
               cluster_time : 8 (user set)
                   run_mode : 2

                      Configuration Options
                      ---------------------
                text_editor : emacs -nw (user set)
         cluster_local_path : None
      cluster_status_update : (600, 30)
               pythia8_path : /home/jack/packages/pythia8240 (user set)
                  hwpp_path : None (user set)
            pythia-pgs_path : None (user set)
                    td_path : None (user set)
               delphes_path : None (user set)
                thepeg_path : None (user set)
               cluster_type : condor
          madanalysis5_path : None (user set)
           cluster_nb_retry : 1
                 eps_viewer : None
                web_browser : None
               syscalc_path : None (user set)
           madanalysis_path : None (user set)
                     lhapdf : /usr/local/bin/lhapdf-config (user set)
              f2py_compiler : None
                 hepmc_path : /home/jack/packages/MG5_aMC_v3_0_1/HEPTools/hepmc (user set)
         cluster_retry_wait : 300
           fortran_compiler : None
                auto_update : 7 (user set)
        exrootanalysis_path : None (user set)
                    timeout : 60
               cpp_compiler : None

Question information

Language:
English Edit question
Status:
Open
For:
MadGraph5_aMC@NLO Edit question
Assignee:
Stefan Prestel Edit question
Last query:
2019-12-23
Last reply:
2019-12-22

Hi,

What I found suspicious in your computation is that you do not set the
 -1.0 = ptlund
parameter this is important to have that cut to prevent singularities.
Additionally, I guess that you have to set ptj and mmjj to be consistent with that cut (softer).
I'm not an expert in that type of merging, but as far as I understand, you can set that cut to the merging scale (so 275)

Now this might not be your issue at all since you crash before going to PY8.
Would be better to use 2.6.x here. This is more recent and bug report are typically better.
Otherwise you need to find which channel of integration returns this error,
And look at the log file in the associated directory to understand the reason of the crash.
If this is a "stop 3" then it is likely that this is already solved in 2.6.7 ( 3.0.1 is sync with 2.6.4)

Cheers,

Olivier

> On 22 Dec 2019, at 18:43, Jack Y. Araz <email address hidden> wrote:
>
> New question #687442 on MadGraph5_aMC@NLO:
> https://answers.launchpad.net/mg5amcnlo/+question/687442
>
> Dear MG5 Team
>
> I'm trying to run a process using CKKW-L merging (MG5 v3.0.1, model MSSM_SLHA2, also tried with the MSSM from feynrules database) The process that I want to run is as follows;
>
> import model MSSM_SLHA2 --modelname
> p p > sd3 sd3~
> p p > sd3 sd3~ j
> p p > sd3 sd3~ j j
>
> (also tried with @0,1,2) to set up the run card and Pythia I'm using the following variables (mostly taken from
> https://answers.launchpad.net/mg5amcnlo/+question/671046
> and
> https://indico.cern.ch/event/333239/contributions/777451/attachments/649911/893775/ERCWorkShop.pdf);
>
> set ickkw 0
> set xqcut 0
> set sys_pdf none
> set use_syst False
> set jetmatching:merge off
> set merging:njetmax 2
> set merging:process pp>sd3sd3~
> set merging:tms 275.0 # M sd3 : 1100 GeV
> set merging:doptlundmerging on
>
> But I'm constantly getting "rm: cannot remove ‘results.dat’: No such file or directory" while running the subprocesses.
>
> Could you please point me out what I'm missing?
>
> Thank you very much
>
> Jack
>
> -----------------------------------------
> The log file is as follows;
>
> Error when reading /home/jack/packages/MG5_aMC_v3_0_1/sbottomProdjj/SubProcesses/P3_gg_sd3sd3xgg/G5.06/results.dat
> Command "generate_events run_01" interrupted with error:
> ValueError : need more than 5 values to unpack
> ---------------------------------------
> generate_events run_01
> Traceback (most recent call last):
> File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/extended_cmd.py", line 1504, in onecmd
> return self.onecmd_orig(line, **opt)
> File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/extended_cmd.py", line 1453, in onecmd_orig
> return func(arg, **opt)
> File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/madevent_interface.py", line 2469, in do_generate_events
> self.run_generate_events(switch_mode, args)
> File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/common_run_interface.py", line 6806, in new_fct
> original_fct(obj, *args, **opts)
> File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/madevent_interface.py", line 2511, in run_generate_events
> self.exec_cmd('refine %s' % nb_event, postcmd=False)
> File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/extended_cmd.py", line 1531, in exec_cmd
> stop = Cmd.onecmd_orig(current_interface, line, **opt)
> File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/extended_cmd.py", line 1453, in onecmd_orig
> return func(arg, **opt)
> File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/interface/madevent_interface.py", line 3421, in do_refine
> x_improve.launch() # create the ajob for the refinment.
> File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/madevent/gen_ximprove.py", line 861, in launch
> main_dir=pjoin(self.cmd.me_dir,'SubProcesses')) #main_dir is for gridpack readonly mode
> File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/madevent/sum_html.py", line 735, in collect_result
> P_comb.add_results(os.path.basename(G), path, mfactors[G])
> File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/madevent/sum_html.py", line 413, in add_results
> oneresult.read_results(filepath)
> File "/home/jack/packages/MG5_aMC_v3_0_1/madgraph/madevent/sum_html.py", line 307, in read_results
> self.xsec = data[:10]
> ValueError: need more than 5 values to unpack
>
>
> Run Options
> -----------
> stdout_level : 20 (user set)
>
> MadEvent Options
> ----------------
> automatic_html_opening : False (user set)
> notification_center : True
> cluster_temp_path : None
> cluster_memory : None (user set)
> cluster_size : 100
> cluster_queue : None
> nb_core : 8 (user set)
> cluster_time : 8 (user set)
> run_mode : 2
>
> Configuration Options
> ---------------------
> text_editor : emacs -nw (user set)
> cluster_local_path : None
> cluster_status_update : (600, 30)
> pythia8_path : /home/jack/packages/pythia8240 (user set)
> hwpp_path : None (user set)
> pythia-pgs_path : None (user set)
> td_path : None (user set)
> delphes_path : None (user set)
> thepeg_path : None (user set)
> cluster_type : condor
> madanalysis5_path : None (user set)
> cluster_nb_retry : 1
> eps_viewer : None
> web_browser : None
> syscalc_path : None (user set)
> madanalysis_path : None (user set)
> lhapdf : /usr/local/bin/lhapdf-config (user set)
> f2py_compiler : None
> hepmc_path : /home/jack/packages/MG5_aMC_v3_0_1/HEPTools/hepmc (user set)
> cluster_retry_wait : 300
> fortran_compiler : None
> auto_update : 7 (user set)
> exrootanalysis_path : None (user set)
> timeout : 60
> cpp_compiler : None
>
>
>
> --
> You received this question notification because you are an answer
> contact for MadGraph5_aMC@NLO.

Jack Y. Araz (jackaraz) said : #2

Dear Oliver

Thanks for the quick response! I tried with v2.6.7 and I did not encounter the same issue. However, py8 doesn't stop working (has been over 12h) since I realised it started to occupy more than 100 GB space in the computer I checked the log files and realised that It's just printing an error message saying

PYTHIA Abort from Pythia::next: not properly initialized so cannot generate events

I tried to change the cuts that you said above, but the same problem continues. Note that it doesn't crash just constantly writes the above phrase in the log file. Thus I believe I'm missing input in Pythia card but I include all the commands provided in

https://indico.cern.ch/event/333239/contributions/777451/attachments/649911/893775/ERCWorkShop.pdf

page 12. What else should I include in the Pythia and/or run card?

Thanks

Best regards

Jack

Can you help with this problem?

Provide an answer of your own, or ask Jack Y. Araz for more information if necessary.

To post a message you must log in.