Z+jets events decrease when generate from gridpack

Hi,

When looking at those parameters, I'm worried about some of the parameter.
But I'm not the most expert in CKKW-L, so I will pass this to Valentin.

To my point of view
1) I would put ptj to ktduram value (i.e. 30) this should help the integration and maybe solve the issue
2) the cut on mmjj seems too hard compare to ktdurham value. I would naively say that this sounds an inconsistent setup (Valentin should confirm)
3) I'm also not sure about the drjj, ... I would also have naively thought that those should be put to zero for CKKW-L (again Valentin should confirm)

Cheers,

Olivier

> On 28 Jul 2017, at 23:18, Jing Chen <email address hidden> wrote:
>
> New question #654078 on MadGraph5_aMC@NLO:
> https://answers.launchpad.net/mg5amcnlo/+question/654078
>
> Dear experts,
> I used MG5_aMC_v2_5_5 to produce Z+jets samples, I defined these process:
> #Set run mode
> set run_mode 1
> #Define multiparticle labels
> import model sm-no_b_mass
> define p = g u c d s u~ c~ d~ s~
> define j = g u c d s b u~ c~ d~ s~ b~
> define q = u c d s b u~ c~ d~ s~ b~
> define w = w+ w-
> define v = vl vl~
> generate p p > mu+ mu-
> add process p p > mu+ mu- j
> add process p p > mu+ mu- j j
> add process p p > mu+ mu- j j j
> output Zmumujets
> ...
>
> I set gridpack True, then I got the gridpack. I unpacked the gridpack, then generate from gridpack.
> When I run "./run.sh 1000 $RANDOM", I got the events.lhe.gz file. There are 1000 events:
> <MGGenerationInfo>
> # Number of Events : 1000
> # Integrated weight (pb) : 0.59609E+04
> # Truncated wgt (pb) : 0.16222E+00
> # Unit wgt : 0.59609E+01
>
> That seems no problem.
>
> When I run "./run.sh 10000 $RANDOM", I also got a events.lhe.gz. But there are only 121 events:
> <MGGenerationInfo>
> # Number of Events : 121
> # Integrated weight (pb) : 0.61573E+04
> # Truncated wgt (pb) : 0.55976E+02
> # Unit wgt : 0.50887E+02
>
> Do you have any idea about this?
> Thanks in advance,
> Jing
>
> Here is my run_card.dat, in case you need these information:
> #*********************************************************************
> # MadGraph5_aMC@NLO *
> # *
> # run_card.dat MadEvent *
> # *
> # This file is used to set the parameters of the run. *
> # *
> # Some notation/conventions: *
> # *
> # Lines starting with a '# ' are info or comments *
> # *
> # mind the format: value = variable ! comment *
> #*********************************************************************
> #
> #*******************
> # Running parameters
> #*******************
> #
> #*********************************************************************
> # Tag name for the run (one word) *
> #*********************************************************************
> tag_1 = run_tag ! name of the run
> #*********************************************************************
> # Number of events and rnd seed *
> # Warning: Do not generate more than 1M events in a single run *
> # If you want to run Pythia, avoid more than 50k events in a run. *
> #*********************************************************************
> 10 = nevents ! Number of unweighted events requested
> 0 = iseed ! rnd seed (0=assigned automatically=default))
> #*********************************************************************
> # Collider type and energy *
> # lpp: 0=No PDF, 1=proton, -1=antiproton, 2=photon from proton, *
> # 3=photon from electron *
> #*********************************************************************
> 1 = lpp1 ! beam 1 type
> 1 = lpp2 ! beam 2 type
> 6500.0 = ebeam1 ! beam 1 total energy in GeV
> 6500.0 = ebeam2 ! beam 2 total energy in GeV
> #*********************************************************************
> # Beam polarization from -100 (left-handed) to 100 (right-handed) *
> #*********************************************************************
> 0.0 = polbeam1 ! beam polarization for beam 1
> 0.0 = polbeam2 ! beam polarization for beam 2
> #*********************************************************************
> # PDF CHOICE: this automatically fixes also alpha_s and its evol. *
> #*********************************************************************
> nn23lo1 = pdlabel ! PDF set
> 230000 = lhaid ! if pdlabel=lhapdf, this is the lhapdf number
> #*********************************************************************
> # Renormalization and factorization scales *
> #*********************************************************************
> False = fixed_ren_scale ! if .true. use fixed ren scale
> False = fixed_fac_scale ! if .true. use fixed fac scale
> 91.188 = scale ! fixed ren scale
> 91.188 = dsqrt_q2fact1 ! fixed fact scale for pdf1
> 91.188 = dsqrt_q2fact2 ! fixed fact scale for pdf2
> -1 = dynamical_scale_choice ! Choose one of the preselected dynamical choices
> 1.0 = scalefact ! scale factor for event-by-event scales
> #*********************************************************************
> # Type and output format
> #*********************************************************************
> True = gridpack !True = setting up the grid pack
> -1.0 = time_of_flight ! threshold (in mm) below which the invariant livetime is not written (-1 means not written)
> 3.0 = lhe_version ! Change the way clustering information pass to shower.
> True = clusinfo ! include clustering tag in output
> average = event_norm ! average/sum. Normalization of the weight in the LHEF
>
> #*********************************************************************
> # Matching parameter (MLM only)
> #*********************************************************************
> 0 = ickkw ! 0 no matching, 1 MLM
> 1.0 = alpsfact ! scale factor for QCD emission vx
> False = chcluster ! cluster only according to channel diag
> 4 = asrwgtflavor ! highest quark flavor for a_s reweight
> True = auto_ptj_mjj ! Automatic setting of ptj and mjj if xqcut >0
> ! (turn off for VBF and single top processes)
> 0.0 = xqcut ! minimum kt jet measure between partons
> #*********************************************************************
> #
> #*********************************************************************
> # handling of the helicities:
> # 0: sum over all helicities
> # 1: importance sampling over helicities
> #*********************************************************************
> 0 = nhel ! using helicities importance sampling or not.
> #*********************************************************************
> # Generation bias, check the wiki page below for more information: *
> # 'cp3.irmp.ucl.ac.be/projects/madgraph/wiki/LOEventGenerationBias' *
> #*********************************************************************
> None = bias_module ! Bias type of bias, [None, ptj_bias, -custom_folder-]
> {} = bias_parameters ! Specifies the parameters of the module.
> #
> #*******************************
> # Parton level cuts definition *
> #*******************************
> #
> #
> #*********************************************************************
> # BW cutoff (M+/-bwcutoff*Gamma) ! Define on/off-shell for "$" and decay
> #*********************************************************************
> 15.0 = bwcutoff ! (M+/-bwcutoff*Gamma)
> #*********************************************************************
> # Apply pt/E/eta/dr/mij/kt_durham cuts on decay products or not
> # (note that etmiss/ptll/ptheavy/ht/sorted cuts always apply)
> #*********************************************************************
> True = cut_decays ! Cut decay products
> #*********************************************************************
> # Standard Cuts *
> #*********************************************************************
> # Minimum and maximum pt's (for max, -1 means no cut) *
> #*********************************************************************
> 10.0 = ptj ! minimum pt for the jets
> 0.0 = ptb ! minimum pt for the b
> 5.0 = pta ! minimum pt for the photons
> 5.0 = ptl ! minimum pt for the charged leptons
> 0.0 = misset ! minimum missing Et (sum of neutrino's momenta)
> 0.0 = ptheavy ! minimum pt for one heavy final state
> -1.0 = ptjmax ! maximum pt for the jets
> -1.0 = ptbmax ! maximum pt for the b
> -1.0 = ptamax ! maximum pt for the photons
> -1.0 = ptlmax ! maximum pt for the charged leptons
> -1.0 = missetmax ! maximum missing Et (sum of neutrino's momenta)
> #*********************************************************************
> # Minimum and maximum E's (in the center of mass frame) *
> #*********************************************************************
> 0.0 = ej ! minimum E for the jets
> 0.0 = eb ! minimum E for the b
> 0.0 = ea ! minimum E for the photons
> 0.0 = el ! minimum E for the charged leptons
> -1.0 = ejmax ! maximum E for the jets
> -1.0 = ebmax ! maximum E for the b
> -1.0 = eamax ! maximum E for the photons
> -1.0 = elmax ! maximum E for the charged leptons
> #*********************************************************************
> # Maximum and minimum absolute rapidity (for max, -1 means no cut) *
> #*********************************************************************
> -1.0 = etaj ! max rap for the jets
> -1.0 = etab ! max rap for the b
> -1.0 = etaa ! max rap for the photons
> -1.0 = etal ! max rap for the charged leptons
> 0.0 = etajmin ! min rap for the jets
> 0.0 = etabmin ! min rap for the b
> 0.0 = etaamin ! min rap for the photons
> 0.0 = etalmin ! main rap for the charged leptons
> #*********************************************************************
> # Minimum and maximum DeltaR distance *
> #*********************************************************************
> 0.2 = drjj ! min distance between jets
> 0.2 = drbb ! min distance between b's
> 0.05 = drll ! min distance between leptons
> 0.0 = draa ! min distance between gammas
> 0.2 = drbj ! min distance between b and jet
> 0.0 = draj ! min distance between gamma and jet
> 0.2 = drjl ! min distance between jet and lepton
> 0.0 = drab ! min distance between gamma and b
> 0.2 = drbl ! min distance between b and lepton
> 0.0 = dral ! min distance between gamma and lepton
> -1.0 = drjjmax ! max distance between jets
> -1.0 = drbbmax ! max distance between b's
> -1.0 = drllmax ! max distance between leptons
> -1.0 = draamax ! max distance between gammas
> -1.0 = drbjmax ! max distance between b and jet
> -1.0 = drajmax ! max distance between gamma and jet
> -1.0 = drjlmax ! max distance between jet and lepton
> -1.0 = drabmax ! max distance between gamma and b
> -1.0 = drblmax ! max distance between b and lepton
> -1.0 = dralmax ! maxdistance between gamma and lepton
> #*********************************************************************
> # Minimum and maximum invariant mass for pairs *
> # WARNING: for four lepton final state mmll cut require to have *
> # different lepton masses for each flavor! *
> #*********************************************************************
> 50 = mmjj ! min invariant mass of a jet pair
> 50 = mmbb ! min invariant mass of a b pair
> 0.0 = mmaa ! min invariant mass of gamma gamma pair
> 40 = mmll ! min invariant mass of l+l- (same flavour) lepton pair
> -1.0 = mmjjmax ! max invariant mass of a jet pair
> -1.0 = mmbbmax ! max invariant mass of a b pair
> -1.0 = mmaamax ! max invariant mass of gamma gamma pair
> -1.0 = mmllmax ! max invariant mass of l+l- (same flavour) lepton pair
> #*********************************************************************
> # Minimum and maximum invariant mass for all letpons *
> #*********************************************************************
> 0.0 = mmnl ! min invariant mass for all letpons (l+- and vl)
> -1.0 = mmnlmax ! max invariant mass for all letpons (l+- and vl)
> #*********************************************************************
> # Minimum and maximum pt for 4-momenta sum of leptons *
> #*********************************************************************
> 0.0 = ptllmin ! Minimum pt for 4-momenta sum of leptons(l and vl)
> -1.0 = ptllmax ! Maximum pt for 4-momenta sum of leptons(l and vl)
> #*********************************************************************
> # Inclusive cuts *
> #*********************************************************************
> 0.0 = xptj ! minimum pt for at least one jet
> 0.0 = xptb ! minimum pt for at least one b
> 0.0 = xpta ! minimum pt for at least one photon
> 0.0 = xptl ! minimum pt for at least one charged lepton
> #*********************************************************************
> # Control the pt's of the jets sorted by pt *
> #*********************************************************************
> 0.0 = ptj1min ! minimum pt for the leading jet in pt
> 0.0 = ptj2min ! minimum pt for the second jet in pt
> 0.0 = ptj3min ! minimum pt for the third jet in pt
> 0.0 = ptj4min ! minimum pt for the fourth jet in pt
> -1.0 = ptj1max ! maximum pt for the leading jet in pt
> -1.0 = ptj2max ! maximum pt for the second jet in pt
> -1.0 = ptj3max ! maximum pt for the third jet in pt
> -1.0 = ptj4max ! maximum pt for the fourth jet in pt
> 0 = cutuse ! reject event if fails any (0) / all (1) jet pt cuts
> #*********************************************************************
> # Control the pt's of leptons sorted by pt *
> #*********************************************************************
> 0.0 = ptl1min ! minimum pt for the leading lepton in pt
> 0.0 = ptl2min ! minimum pt for the second lepton in pt
> 0.0 = ptl3min ! minimum pt for the third lepton in pt
> 0.0 = ptl4min ! minimum pt for the fourth lepton in pt
> -1.0 = ptl1max ! maximum pt for the leading lepton in pt
> -1.0 = ptl2max ! maximum pt for the second lepton in pt
> -1.0 = ptl3max ! maximum pt for the third lepton in pt
> -1.0 = ptl4max ! maximum pt for the fourth lepton in pt
> #*********************************************************************
> # Control the Ht(k)=Sum of k leading jets *
> #*********************************************************************
> 0.0 = htjmin ! minimum jet HT=Sum(jet pt)
> -1.0 = htjmax ! maximum jet HT=Sum(jet pt)
> 0.0 = ihtmin !inclusive Ht for all partons (including b)
> -1.0 = ihtmax !inclusive Ht for all partons (including b)
> 0.0 = ht2min ! minimum Ht for the two leading jets
> 0.0 = ht3min ! minimum Ht for the three leading jets
> 0.0 = ht4min ! minimum Ht for the four leading jets
> -1.0 = ht2max ! maximum Ht for the two leading jets
> -1.0 = ht3max ! maximum Ht for the three leading jets
> -1.0 = ht4max ! maximum Ht for the four leading jets
> #***********************************************************************
> # Photon-isolation cuts, according to hep-ph/9801442 *
> # When ptgmin=0, all the other parameters are ignored *
> # When ptgmin>0, pta and draj are not going to be used *
> #***********************************************************************
> 0.0 = ptgmin ! Min photon transverse momentum
> 0.4 = r0gamma ! Radius of isolation code
> 1.0 = xn ! n parameter of eq.(3.4) in hep-ph/9801442
> 1.0 = epsgamma ! epsilon_gamma parameter of eq.(3.4) in hep-ph/9801442
> True = isoem ! isolate photons from EM energy (photons and leptons)
> #*********************************************************************
> # WBF cuts *
> #*********************************************************************
> 0.0 = xetamin ! minimum rapidity for two jets in the WBF case
> 0.0 = deltaeta ! minimum rapidity for two jets in the WBF case
> #***********************************************************************
> # Turn on either the ktdurham or ptlund cut to activate *
> # CKKW(L) merging with Pythia8 [arXiv:1410.3012, arXiv:1109.4829] *
> #***********************************************************************
> 30.0 = ktdurham
> 0.4 = dparameter
> -1.0 = ptlund
> 1, 2, 3, 4, 5, 6, 21 = pdgs_for_merging_cut ! PDGs for two cuts above
> #*********************************************************************
> # maximal pdg code for quark to be considered as a light jet *
> # (otherwise b cuts are applied) *
> #*********************************************************************
> 5 = maxjetflavor ! Maximum jet pdg code
> #*********************************************************************
> #
> #*********************************************************************
> # Store info for systematics studies *
> # WARNING: Do not use for interference type of computation *
> #*********************************************************************
> False = use_syst ! Enable systematics studies
> #
> #**************************************
> # Parameter of the systematics study
> # will be used by SysCalc (if installed)
> #**************************************
> #
> 0.5 1 2 = sys_scalefact # factorization/renormalization scale factor
> 0.5 1 2 = sys_alpsfact # \alpha_s emission scale factors
> auto = sys_matchscale # variation of merging scale
> # PDF sets and number of members (0 or none for all members).
> NNPDF23_lo_as_0130_qed = sys_pdf # list of pdf sets
> # MSTW2008nlo68cl.LHgrid 1 = sys_pdf
> #
>
>
>
>
> --
> You received this question notification because you are an answer
> contact for MadGraph5_aMC@NLO.

Dear Olivier，
Thanks for your reply. I changed ptj to 30, mjj to 0, drjj, drll, drjl ... to 0. Then try "./run.sh 10000 $RANDOM" again. The problem didn't fixed.
Cheers,
Jing

Dear experts,
I also changed the parameter settings. Does that matter?
Best regards,
Jing

######################################################################
## PARAM_CARD AUTOMATICALY GENERATED BY MG5 ####
######################################################################
###################################
## INFORMATION FOR MASS
###################################
BLOCK MASS #
      6 1.725000e+02 # mt
      15 1.776820e+00 # mta
      23 9.118760e+01 # mz
      25 1.250000e+02 # mh
      1 0.000000e+00 # d : 0.0
      2 0.000000e+00 # u : 0.0
      3 0.000000e+00 # s : 0.0
      4 0.000000e+00 # c : 0.0
      5 0.000000e+00 # b : 0.0
      11 0.000000e+00 # e- : 0.0
      12 0.000000e+00 # ve : 0.0
      13 0.000000e+00 # mu- : 0.0
      14 0.000000e+00 # vm : 0.0
      16 0.000000e+00 # vt : 0.0
      21 0.000000e+00 # g : 0.0
      22 0.000000e+00 # a : 0.0
      24 8.039900e+01 # w+ : cmath.sqrt(mz__exp__2/2. + cmath.sqrt(mz__exp__4/4. - (aew*cmath.pi*mz__exp__2)/(gf*sqrt__2)))
###################################
## INFORMATION FOR SMINPUTS
###################################
BLOCK SMINPUTS #
      1 1.323489e+02 # aewm1
      2 1.166370e-05 # gf
      3 1.184000e-01 # as
###################################
## INFORMATION FOR YUKAWA
###################################
BLOCK YUKAWA #
      6 1.725000e+02 # ymt
      15 1.777000e+00 # ymtau
###################################
## INFORMATION FOR DECAY
###################################
DECAY 6 1.320000e+00 # wt
DECAY 23 2.495200e+00 # wz
DECAY 24 2.085000e+00 # ww
DECAY 25 4.150000e-03 # wh
DECAY 1 0.000000e+00 # d : 0.0
DECAY 2 0.000000e+00 # u : 0.0
DECAY 3 0.000000e+00 # s : 0.0
DECAY 4 0.000000e+00 # c : 0.0
DECAY 5 0.000000e+00 # b : 0.0
DECAY 11 0.000000e+00 # e- : 0.0
DECAY 12 0.000000e+00 # ve : 0.0
DECAY 13 0.000000e+00 # mu- : 0.0
DECAY 14 0.000000e+00 # vm : 0.0
DECAY 15 0.000000e+00 # ta- : 0.0
DECAY 16 0.000000e+00 # vt : 0.0
DECAY 21 0.000000e+00 # g : 0.0
DECAY 22 0.000000e+00 # a : 0.0

We should first determine if this is related to the gridpack mode or not.

Can you try again *without using gridpack*, disabling all jet cuts, and check if you again get this large difference in efficiency when going from 1K to 10K events?

Dear Valentin，
Thanks for your reply. I'll try without using gridpack.
Best,
Jing

Dear Valentin,
I tried without using gridpack, the decrease still exists. I set nevents is 5000,but only 114 events got.
...
INFO: Combining Events
INFO: fail to reach target 5000
  === Results Summary for run: run_01 tag: tag_1 ===

     Cross-section : 6216 +- 15.76 pb
     Nb of events : 114

store_events
INFO: Storing parton level results
INFO: End Parton
...
Best,
Jing

Hi,
I check my gridpack and found the number of events is 0, but I set nevent is 10. Does this matter?
  === Results Summary for run: run_01 tag: tag_1 ===

     Cross-section : 6079 +- 53.41 pb
     Nb of events : 0

INFO: End survey
combine_events
INFO: Combining Events
store_events
INFO: Storing parton level results
INFO: End Parton
decay_events -from_cards
create_gridpack
INFO: Creating gridpack
P4_gg_llgqq
P4_gq_llggq
P4_qq_llggg
P4_gq_llqqq
P4_qq_llgqq
P3_gg_llqq
P3_gq_llgq
P3_qq_llqq
P3_qq_llgg
P2_gq_llq
P2_qq_llg
P1_qq_ll
Cleaning SubProcesses............
INFO: gridpack created
quit
INFO: storing files of previous run
INFO: Done

Best,
Jing

Hi,

No that's completely normal.

I would actually be interested to see if you face the same problem with the MLM method.
The support of CKKW-L is quite new in MG (thanks to Valentin). On the other hand, we support MLM since many years
(First Johan and then I made the support), I would not be surprise that we are much more efficient for MLM than for CKKW-L and therefore that we do not have such issue for MLM. Unfortunately, I will not have the time to run it myself before at least week.

Cheers,

Olivier

> On 8 Aug 2017, at 17:03, Jing Chen <email address hidden> wrote:
>
> Question #654078 on MadGraph5_aMC@NLO changed:
> https://answers.launchpad.net/mg5amcnlo/+question/654078
>
> Jing Chen gave more information on the question:
> Hi,
> I check my gridpack and found the number of events is 0, but I set nevent is 10. Does this matter?
> === Results Summary for run: run_01 tag: tag_1 ===
>
> Cross-section : 6079 +- 53.41 pb
> Nb of events : 0
>
> INFO: End survey
> combine_events
> INFO: Combining Events
> store_events
> INFO: Storing parton level results
> INFO: End Parton
> decay_events -from_cards
> create_gridpack
> INFO: Creating gridpack
> P4_gg_llgqq
> P4_gq_llggq
> P4_qq_llggg
> P4_gq_llqqq
> P4_qq_llgqq
> P3_gg_llqq
> P3_gq_llgq
> P3_qq_llqq
> P3_qq_llgg
> P2_gq_llq
> P2_qq_llg
> P1_qq_ll
> Cleaning SubProcesses............
> INFO: gridpack created
> quit
> INFO: storing files of previous run
> INFO: Done
>
> Best,
> Jing
>
> --
> You received this question notification because you are an answer
> contact for MadGraph5_aMC@NLO.

Dear Olivier,
I plan to do the merging in parton shower, so I set ickkw=0 here. Do you mean I should set ickkw=1 here then I can use MLM method?
Best,
Jing

Hi Jing,

The merging always occur at Parton shower time.
If you set ickkw=1, we perform at our level the PDF and alphas reweighing allowing to increase the number of events passing the cuts at merging time.
Unfortunately such technique is valid only for MLM.

So yes, if you want to use MLM, you have to set ickkw=1, and then do not use ktdurham, but use instead xqcut.

Cheers,

Olivier

PS: Note that the merging scale need to be bigger than xqcut by at least 10 GeV (sometimes more)

> On 8 Aug 2017, at 18:17, Jing Chen <email address hidden> wrote:
>
> Question #654078 on MadGraph5_aMC@NLO changed:
> https://answers.launchpad.net/mg5amcnlo/+question/654078
>
> Status: Answered => Open
>
> Jing Chen is still having a problem:
> Dear Olivier,
> I plan to do the merging in parton shower, so I set ickkw=0 here. Do you mean I should set ickkw=1 here then I can use MLM method?
> Best,
> Jing
>
> --
> You received this question notification because you are an answer
> contact for MadGraph5_aMC@NLO.