Crash when reweighting at NLO

Asked by Alfredo Glioti

Hello,

I had several crashes when trying to do some reweighting at NLO. I am now using MadGraph 3.1.0, but the same crash was happening for earlier versions.

For a minimal example I am using the default SM model for a p p > e+ e- [QCD] process and then in the reweighting card I have added

   change mode NLO

   launch
   set mass 6:[100,150,200]

as in the online example. The generation of the events looks fine but when the reweighting process start it seems like there are some compilation problems and we can't figure out what is causing it.

Here is the debug log of this failed run. Please tell me if you need more information about the machine that we are running Madgraph with.

Thank you.

#************************************************************
#* MadGraph5_aMC@NLO *
#* *
#* * * *
#* * * * * *
#* * * * * 5 * * * * *
#* * * * * *
#* * * *
#* *
#* *
#* VERSION 5.3.1.0 20xx-xx-xx *
#* *
#* The MadGraph5_aMC@NLO Development Team - Find us at *
#* https://server06.fynu.ucl.ac.be/projects/madgraph *
#* and *
#* http://amcatnlo.cern.ch *
#* *
#************************************************************
#* *
#* Command File for aMCatNLO *
#* *
#* run as ./bin/aMCatNLO.py filename *
#* *
#************************************************************
reweight /data3/MadGraph/MG5_aMC_v3_1_0/runs/sm/Events/run_01/events.lhe.gz_0.lhe -from_cards --multicore=create
Traceback (most recent call last):
  File "/data3/MadGraph/MG5_aMC_v3_1_0/runs/sm/bin/internal/extended_cmd.py", line 1544, in onecmd
    return self.onecmd_orig(line, **opt)
  File "/data3/MadGraph/MG5_aMC_v3_1_0/runs/sm/bin/internal/extended_cmd.py", line 1493, in onecmd_orig
    return func(arg, **opt)
  File "/data3/MadGraph/MG5_aMC_v3_1_0/runs/sm/bin/internal/common_run_interface.py", line 2184, in do_reweight
    reweight_cmd.import_command_file(path)
  File "/data3/MadGraph/MG5_aMC_v3_1_0/madgraph/interface/extended_cmd.py", line 1692, in import_command_file
    self.exec_cmd(line, precmd=True)
  File "/data3/MadGraph/MG5_aMC_v3_1_0/madgraph/interface/extended_cmd.py", line 1573, in exec_cmd
    stop = Cmd.onecmd_orig(current_interface, line, **opt)
  File "/data3/MadGraph/MG5_aMC_v3_1_0/madgraph/interface/extended_cmd.py", line 1493, in onecmd_orig
    return func(arg, **opt)
  File "/data3/MadGraph/MG5_aMC_v3_1_0/madgraph/various/misc.py", line 109, in f_with_no_logger
    out = f(self, *args, **opt)
  File "/data3/MadGraph/MG5_aMC_v3_1_0/madgraph/interface/reweight_interface.py", line 504, in do_launch
    self.compile()
  File "/data3/MadGraph/MG5_aMC_v3_1_0/madgraph/interface/reweight_interface.py", line 1796, in compile
    misc.compile(['allmatrix2py.so'], cwd=pdir, nb_core=nb_core)
  File "/data3/MadGraph/MG5_aMC_v3_1_0/madgraph/various/misc.py", line 546, in compile
    raise MadGraph5Error(error_text)
madgraph.MadGraph5Error: A compilation Error occurs when trying to compile /data3/MadGraph/MG5_aMC_v3_1_0/runs/sm/rw_mevirt/SubProcesses.
The compilation fails with the following output message:
    ar rcs libMadLoop.a MadLoopParamReader.o MadLoopCommons.o P3_gg_epem/polynomial.o P2_ddx_epem/polynomial.o P0_uux_epem/polynomial.o P3_gg_epem/loop_matrix.o P2_ddx_epem/loop_matrix.o P0_uux_epem/loop_matrix.o P3_gg_epem/improve_ps.o P2_ddx_epem/improve_ps.o P0_uux_epem/improve_ps.o P2_ddx_epem/born_matrix.o P0_uux_epem/born_matrix.o P3_gg_epem/CT_interface.o P2_ddx_epem/CT_interface.o P0_uux_epem/CT_interface.o P3_gg_epem/loop_num.o P2_ddx_epem/loop_num.o P0_uux_epem/loop_num.o P3_gg_epem/helas_calls_ampb_1.o P2_ddx_epem/helas_calls_ampb_1.o P0_uux_epem/helas_calls_ampb_1.o P3_gg_epem/mp_compute_loop_coefs.o P2_ddx_epem/mp_compute_loop_coefs.o P0_uux_epem/mp_compute_loop_coefs.o P3_gg_epem/mp_helas_calls_ampb_1.o P2_ddx_epem/mp_helas_calls_ampb_1.o P0_uux_epem/mp_helas_calls_ampb_1.o P3_gg_epem/coef_construction_1.o P2_ddx_epem/coef_construction_1.o P0_uux_epem/coef_construction_1.o P3_gg_epem/loop_CT_calls_1.o P2_ddx_epem/loop_CT_calls_1.o P0_uux_epem/loop_CT_calls_1.o P3_gg_epem/mp_coef_construction_1.o P2_ddx_epem/mp_coef_construction_1.o P0_uux_epem/mp_coef_construction_1.o P3_gg_epem/TIR_interface.o P2_ddx_epem/TIR_interface.o P0_uux_epem/TIR_interface.o P3_gg_epem/COLLIER_interface.o P2_ddx_epem/COLLIER_interface.o P0_uux_epem/COLLIER_interface.o P3_gg_epem/compute_color_flows.o
    mv libMadLoop.a ../lib/libMadLoop.a
    touch __init__.py
    f2py ../lib/libMadLoop.a -m allmatrix2py -c all_matrix.f P3_gg_epem/f2py_wrapper.f P2_ddx_epem/f2py_wrapper.f P0_uux_epem/f2py_wrapper.f --f77exec=gfortran -L../lib/ -ldhelas -lmodel -L../lib/ -lcts -liregi -L/data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/lib/ -lninja -L/data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/lib/ -lavh_olo -L/data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/lib/ -lcollier -lstdc++
    running build
    running config_cc
    unifing config_cc, config, build_clib, build_ext, build commands --compiler options
    running config_fc
    unifing config_fc, config, build_clib, build_ext, build commands --fcompiler options
    running build_src
    build_src
    building extension "allmatrix2py" sources
    f2py options: []
    f2py:> /tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/allmatrix2pymodule.c
    creating /tmp/tmpzfjpsqhp/src.linux-x86_64-3.8
    Reading fortran codes...
     Reading file 'all_matrix.f' (format:fix,strict)
    Line #13 in all_matrix.f:" CALL SETPARA(PATH) !first call to setup the paramaters"
     analyzeline: No name/args pattern found for line.
     Reading file '../Source/MODEL/input.inc' (format:fix)
     Reading file '../Source/MODEL/coupl.inc' (format:fix)
     Reading file '../Source/MODEL/mp_coupl.inc' (format:fix)
     Reading file '../Source/MODEL/mp_input.inc' (format:fix)
     Reading file 'P3_gg_epem/f2py_wrapper.f' (format:fix,strict)
     Reading file 'coupl.inc' (format:fix)
     Reading file 'P3_gg_epem/nexternal.inc' (format:fix)
     Reading file 'coupl.inc' (format:fix)
     Reading file 'P3_gg_epem/ngraphs.inc' (format:fix)
     Reading file 'P3_gg_epem/nsquaredSO.inc' (format:fix)
     Reading file 'P3_gg_epem/pmass.inc' (format:fix)
     Reading file 'P2_ddx_epem/f2py_wrapper.f' (format:fix,strict)
     Reading file 'coupl.inc' (format:fix)
     Reading file 'P2_ddx_epem/nexternal.inc' (format:fix)
     Reading file 'coupl.inc' (format:fix)
     Reading file 'P2_ddx_epem/ngraphs.inc' (format:fix)
     Reading file 'P2_ddx_epem/nsquaredSO.inc' (format:fix)
     Reading file 'P2_ddx_epem/pmass.inc' (format:fix)
     Reading file 'P0_uux_epem/f2py_wrapper.f' (format:fix,strict)
     Reading file 'coupl.inc' (format:fix)
     Reading file 'P0_uux_epem/nexternal.inc' (format:fix)
     Reading file 'coupl.inc' (format:fix)
     Reading file 'P0_uux_epem/ngraphs.inc' (format:fix)
     Reading file 'P0_uux_epem/nsquaredSO.inc' (format:fix)
     Reading file 'P0_uux_epem/pmass.inc' (format:fix)
    Post-processing...
     Block: allmatrix2py
       Block: initialise
       Block: change_para
       Block: update_all_coup
       Block: set_madloop_path
       Block: smatrixhel
       Block: get_pdg_order
       Block: get_prefix
       Block: ml5_3_initialise
       Block: ml5_3_get_me
       Block: ml5_2_initialise
       Block: ml5_2_get_me
       Block: ml5_0_initialise
       Block: ml5_0_get_me
    Post-processing (stage 2)...
    Building modules...
     Building module "allmatrix2py"...
      Constructing wrapper function "initialise"...
        initialise(path)
      Constructing wrapper function "change_para"...
        change_para(name,value)
      Constructing wrapper function "update_all_coup"...
        update_all_coup()
      Constructing wrapper function "set_madloop_path"...
        set_madloop_path(path)
      Constructing wrapper function "smatrixhel"...
        ans,returncode = smatrixhel(pdgs,procid,p,alphas,scales2,nhel,[npdg])
      Constructing wrapper function "get_pdg_order"...
        out,allproc = get_pdg_order()
      Constructing wrapper function "get_prefix"...
        prefix = get_prefix()
      Constructing wrapper function "ml5_3_initialise"...
        ml5_3_initialise(path)
      Constructing wrapper function "ml5_3_get_me"...
        ans,returncode = ml5_3_get_me(p,alphas,scale2,nhel)
      Constructing wrapper function "ml5_2_initialise"...
        ml5_2_initialise(path)
      Constructing wrapper function "ml5_2_get_me"...
        ans,returncode = ml5_2_get_me(p,alphas,scale2,nhel)
      Constructing wrapper function "ml5_0_initialise"...
        ml5_0_initialise(path)
      Constructing wrapper function "ml5_0_get_me"...
        ans,returncode = ml5_0_get_me(p,alphas,scale2,nhel)
      Constructing COMMON block support for "params_r"...
        mdl_sqrt__as,mdl_g__exp__4,mdl_g__exp__2,mdl_r2mixedfactor_fin_,mdl_g__exp__3,mdl_mu_r__exp__2,mdl_conjg__ckm22,mdl_conjg__ckm3x3,mdl_ckm33,mdl_lhv,mdl_ckm3x3,mdl_ckm22,mdl_ncol,mdl_ca,mdl_tf,mdl_cf,mdl_mz__exp__2,mdl_mz__exp__4,mdl_sqrt__2,mdl_mh__exp__2,mdl_ncol__exp__2,mdl_mb__exp__2,mdl_mt__exp__2,mdl_aew,mdl_sqrt__aew,mdl_ee,mdl_mw__exp__2,mdl_sw2,mdl_cw,mdl_sqrt__sw2,mdl_sw,mdl_g1,mdl_gw,mdl_v,mdl_v__exp__2,mdl_lam,mdl_yb,mdl_yt,mdl_ytau,mdl_muh,mdl_axialzup,mdl_axialzdown,mdl_vectorzup,mdl_vectorzdown,mdl_vectoraup,mdl_vectoradown,mdl_vectorwmdxu,mdl_axialwmdxu,mdl_vectorwpuxd,mdl_axialwpuxd,mdl_gw__exp__2,mdl_cw__exp__2,mdl_ee__exp__2,mdl_sw__exp__2,mdl_yb__exp__2,mdl_yt__exp__2,aewm1,mdl_gf,as,mdl_ymb,mdl_ymt,mdl_ymtau
      Constructing COMMON block support for "params_c"...
        mdl_complexi,mdl_i1x33,mdl_i2x33,mdl_i3x33,mdl_i4x33,mdl_vector_tbgp,mdl_axial_tbgp,mdl_vector_tbgm,mdl_axial_tbgm
      Constructing COMMON block support for "strong"...
        g
      Constructing COMMON block support for "weak"...
        gal
      Constructing COMMON block support for "rscale"...
        mu_r
      Constructing COMMON block support for "masses"...
        mdl_mt,mdl_mw,mdl_mta,mdl_mh,mdl_mb,mdl_mz
      Constructing COMMON block support for "widths"...
        mdl_wh,mdl_wt,mdl_wz,mdl_ww
      Constructing COMMON block support for "couplings"...
        gc_5,r2_dda,r2_uua,r2_ddz_v2,r2_ddz_v3,r2_ggzdown,gc_1,gc_2,gc_21,gc_23,gc_24,gc_25
      Constructing COMMON block support for "mp_strong"...
        mp__g
      Constructing COMMON block support for "mp_weak"...
        mp__gal
      Constructing COMMON block support for "mp_rscale"...
        mp__mu_r
      Constructing COMMON block support for "mp_masses"...
        mp__mdl_mt,mp__mdl_mw,mp__mdl_mta,mp__mdl_mh,mp__mdl_mb,mp__mdl_mz
      Constructing COMMON block support for "mp_widths"...
        mp__mdl_wh,mp__mdl_wt,mp__mdl_wz,mp__mdl_ww
      Constructing COMMON block support for "mp_couplings"...
        mp__gc_5,mp__r2_dda,mp__r2_uua,mp__r2_ddz_v2,mp__r2_ddz_v3,mp__r2_ggzdown,mp__gc_1,mp__gc_2,mp__gc_21,mp__gc_23,mp__gc_24,mp__gc_25
      Constructing COMMON block support for "mp_params_r"...
        mp__mdl_sqrt__as,mp__mdl_g__exp__4,mp__mdl_g__exp__2,mp__mdl_r2mixedfactor_fin_,mp__mdl_g__exp__3,mp__mdl_mu_r__exp__2,mp__mdl_conjg__ckm22,mp__mdl_conjg__ckm3x3,mp__mdl_ckm33,mp__mdl_lhv,mp__mdl_ckm3x3,mp__mdl_ckm22,mp__mdl_ncol,mp__mdl_ca,mp__mdl_tf,mp__mdl_cf,mp__mdl_mz__exp__2,mp__mdl_mz__exp__4,mp__mdl_sqrt__2,mp__mdl_mh__exp__2,mp__mdl_ncol__exp__2,mp__mdl_mb__exp__2,mp__mdl_mt__exp__2,mp__mdl_aew,mp__mdl_sqrt__aew,mp__mdl_ee,mp__mdl_mw__exp__2,mp__mdl_sw2,mp__mdl_cw,mp__mdl_sqrt__sw2,mp__mdl_sw,mp__mdl_g1,mp__mdl_gw,mp__mdl_v,mp__mdl_v__exp__2,mp__mdl_lam,mp__mdl_yb,mp__mdl_yt,mp__mdl_ytau,mp__mdl_muh,mp__mdl_axialzup,mp__mdl_axialzdown,mp__mdl_vectorzup,mp__mdl_vectorzdown,mp__mdl_vectoraup,mp__mdl_vectoradown,mp__mdl_vectorwmdxu,mp__mdl_axialwmdxu,mp__mdl_vectorwpuxd,mp__mdl_axialwpuxd,mp__mdl_gw__exp__2,mp__mdl_cw__exp__2,mp__mdl_ee__exp__2,mp__mdl_sw__exp__2,mp__mdl_yb__exp__2,mp__mdl_yt__exp__2,mp__aewm1,mp__mdl_gf,mp__as,mp__mdl_ymb,mp__mdl_ymt,mp__mdl_ymtau
      Constructing COMMON block support for "mp_params_c"...
        mp__mdl_complexi,mp__mdl_i1x33,mp__mdl_i2x33,mp__mdl_i3x33,mp__mdl_i4x33,mp__mdl_vector_tbgp,mp__mdl_axial_tbgp,mp__mdl_vector_tbgm,mp__mdl_axial_tbgm
      Constructing COMMON block support for "ml5_3_chosen_loop_sqso"...
        chosen_loop_so_configs
      Constructing COMMON block support for "ml5_2_chosen_loop_sqso"...
        chosen_loop_so_configs
      Constructing COMMON block support for "ml5_0_chosen_loop_sqso"...
        chosen_loop_so_configs
     Wrote C/API module "allmatrix2py" to file "/tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/allmatrix2pymodule.c"
     Fortran 77 wrappers are saved to "/tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/allmatrix2py-f2pywrappers.f"
      adding '/tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/fortranobject.c' to sources.
      adding '/tmp/tmpzfjpsqhp/src.linux-x86_64-3.8' to include_dirs.
    copying /home/aglioti/anaconda3/lib/python3.8/site-packages/numpy/f2py/src/fortranobject.c -> /tmp/tmpzfjpsqhp/src.linux-x86_64-3.8
    copying /home/aglioti/anaconda3/lib/python3.8/site-packages/numpy/f2py/src/fortranobject.h -> /tmp/tmpzfjpsqhp/src.linux-x86_64-3.8
      adding '/tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/allmatrix2py-f2pywrappers.f' to sources.
    build_src: building npy-pkg config files
    running build_ext
    customize UnixCCompiler
    customize UnixCCompiler using build_ext
    get_default_fcompiler: matching types: '['gnu95', 'intel', 'lahey', 'pg', 'absoft', 'nag', 'vast', 'compaq', 'intele', 'intelem', 'gnu', 'g95', 'pathf95', 'nagfor']'
    customize Gnu95FCompiler
    Found executable /usr/bin/gfortran
    customize Gnu95FCompiler
    customize Gnu95FCompiler using build_ext
    building 'allmatrix2py' extension
    compiling C sources
    C compiler: gcc -pthread -B /home/aglioti/anaconda3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC

    creating /tmp/tmpzfjpsqhp/tmp
    creating /tmp/tmpzfjpsqhp/tmp/tmpzfjpsqhp
    creating /tmp/tmpzfjpsqhp/tmp/tmpzfjpsqhp/src.linux-x86_64-3.8
    compile options: '-I/tmp/tmpzfjpsqhp/src.linux-x86_64-3.8 -I/home/aglioti/anaconda3/lib/python3.8/site-packages/numpy/core/include -I/home/aglioti/anaconda3/include/python3.8 -c'
    gcc: /tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/fortranobject.c
    gcc: /tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/allmatrix2pymodule.c
    In file included from /home/aglioti/anaconda3/lib/python3.8/site-packages/numpy/core/include/numpy/ndarraytypes.h:1822,
                     from /home/aglioti/anaconda3/lib/python3.8/site-packages/numpy/core/include/numpy/ndarrayobject.h:12,
                     from /home/aglioti/anaconda3/lib/python3.8/site-packages/numpy/core/include/numpy/arrayobject.h:4,
                     from /tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/fortranobject.h:13,
                     from /tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/fortranobject.c:2:
    /home/aglioti/anaconda3/lib/python3.8/site-packages/numpy/core/include/numpy/npy_1_7_deprecated_api.h:17:2: warning: #warning "Using deprecated NumPy API, disable it with " "#define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION" [-Wcpp]
       17 | #warning "Using deprecated NumPy API, disable it with " \
          | ^~~~~~~
    In file included from /home/aglioti/anaconda3/lib/python3.8/site-packages/numpy/core/include/numpy/ndarraytypes.h:1822,
                     from /home/aglioti/anaconda3/lib/python3.8/site-packages/numpy/core/include/numpy/ndarrayobject.h:12,
                     from /home/aglioti/anaconda3/lib/python3.8/site-packages/numpy/core/include/numpy/arrayobject.h:4,
                     from /tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/fortranobject.h:13,
                     from /tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/allmatrix2pymodule.c:16:
    /home/aglioti/anaconda3/lib/python3.8/site-packages/numpy/core/include/numpy/npy_1_7_deprecated_api.h:17:2: warning: #warning "Using deprecated NumPy API, disable it with " "#define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION" [-Wcpp]
       17 | #warning "Using deprecated NumPy API, disable it with " \
          | ^~~~~~~
    /tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/allmatrix2pymodule.c:142:12: warning: ‘f2py_size’ defined but not used [-Wunused-function]
      142 | static int f2py_size(PyArrayObject* var, ...)
          | ^~~~~~~~~
    compiling Fortran sources
    Fortran f77 compiler: gfortran -Wall -g -ffixed-form -fno-second-underscore -fPIC -O3 -funroll-loops
    Fortran f90 compiler: /usr/bin/gfortran -Wall -g -fno-second-underscore -fPIC -O3 -funroll-loops
    Fortran fix compiler: /usr/bin/gfortran -Wall -g -ffixed-form -fno-second-underscore -Wall -g -fno-second-underscore -fPIC -O3 -funroll-loops
    creating /tmp/tmpzfjpsqhp/P3_gg_epem
    creating /tmp/tmpzfjpsqhp/P2_ddx_epem
    creating /tmp/tmpzfjpsqhp/P0_uux_epem
    compile options: '-I/tmp/tmpzfjpsqhp/src.linux-x86_64-3.8 -I/home/aglioti/anaconda3/lib/python3.8/site-packages/numpy/core/include -I/home/aglioti/anaconda3/include/python3.8 -c'
    gfortran:f77: P0_uux_epem/f2py_wrapper.f
    gfortran:f77: all_matrix.f
    gfortran:f77: P2_ddx_epem/f2py_wrapper.f
    gfortran:f77: P3_gg_epem/f2py_wrapper.f
    gfortran:f77: /tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/allmatrix2py-f2pywrappers.f
    all_matrix.f:150:46:

      150 | SUBROUTINE SMATRIXHEL(PDGS, PROCID, NPDG, P, ALPHAS, SCALES2,
          | 1
    Warning: Unused dummy argument ‘npdg’ at (1) [-Wunused-dummy-argument]
    all_matrix.f:166:38:

      166 | DOUBLE PRECISION ANS, ALPHAS, PI,SCALES2
          | 1
    Warning: Unused variable ‘pi’ declared at (1) [-Wunused-variable]
    /usr/bin/gfortran -Wall -g -Wall -g -shared /tmp/tmpzfjpsqhp/tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/allmatrix2pymodule.o /tmp/tmpzfjpsqhp/tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/fortranobject.o /tmp/tmpzfjpsqhp/all_matrix.o /tmp/tmpzfjpsqhp/P3_gg_epem/f2py_wrapper.o /tmp/tmpzfjpsqhp/P2_ddx_epem/f2py_wrapper.o /tmp/tmpzfjpsqhp/P0_uux_epem/f2py_wrapper.o /tmp/tmpzfjpsqhp/tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/allmatrix2py-f2pywrappers.o ../lib/libMadLoop.a -L../lib/ -L../lib/ -L/data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/lib/ -L/data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/lib/ -L/data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/lib/ -L/usr/lib/gcc/x86_64-linux-gnu/9 -L/usr/lib/gcc/x86_64-linux-gnu/9 -ldhelas -lmodel -lcts -liregi -lninja -lavh_olo -lcollier -lstdc++ -lgfortran -o ./allmatrix2py.cpython-38-x86_64-linux-gnu.so
    /usr/bin/ld: /data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/lib//libcollier.a(DD_3pt.F.o): relocation R_X86_64_PC32 against symbol `__dd_global_MOD_cout_on' can not be used when making a shared object; recompile with -fPIC
    /usr/bin/ld: final link failed: bad value
    collect2: error: ld returned 1 exit status
    updatevars:pdgs: attempt to change 'dimension(npdg)' to 'dimension(*)'. Ignoring.
    updatevars:p: attempt to change 'dimension(0:3,npdg)' to 'dimension(*)'. Ignoring.
    analyzevars: character array "character*20 prefix(5)" is considered as "character prefix(5,20)"; "intent(c)" is forced.
    analyzevars: character array "character*20 pref(5)" is considered as "character pref(5,20)"; "intent(c)" is forced.
    analyzevars: character array "character*20 chosen_loop_so_indices(1)" is considered as "character chosen_loop_so_indices(1,20)"; "intent(c)" is forced.
    analyzevars: character array "character*20 chosen_loop_so_indices(1)" is considered as "character chosen_loop_so_indices(1,20)"; "intent(c)" is forced.
    analyzevars: character array "character*20 chosen_loop_so_indices(1)" is considered as "character chosen_loop_so_indices(1,20)"; "intent(c)" is forced.
    error: Command "/usr/bin/gfortran -Wall -g -Wall -g -shared /tmp/tmpzfjpsqhp/tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/allmatrix2pymodule.o /tmp/tmpzfjpsqhp/tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/fortranobject.o /tmp/tmpzfjpsqhp/all_matrix.o /tmp/tmpzfjpsqhp/P3_gg_epem/f2py_wrapper.o /tmp/tmpzfjpsqhp/P2_ddx_epem/f2py_wrapper.o /tmp/tmpzfjpsqhp/P0_uux_epem/f2py_wrapper.o /tmp/tmpzfjpsqhp/tmp/tmpzfjpsqhp/src.linux-x86_64-3.8/allmatrix2py-f2pywrappers.o ../lib/libMadLoop.a -L../lib/ -L../lib/ -L/data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/lib/ -L/data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/lib/ -L/data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/lib/ -L/usr/lib/gcc/x86_64-linux-gnu/9 -L/usr/lib/gcc/x86_64-linux-gnu/9 -ldhelas -lmodel -lcts -liregi -lninja -lavh_olo -lcollier -lstdc++ -lgfortran -o ./allmatrix2py.cpython-38-x86_64-linux-gnu.so" failed with exit status 1
    make: *** [makefile:126: allmatrix2py.so] Error 1

Please try to fix this compilations issue and retry.
Help might be found at https://answers.launchpad.net/mg5amcnlo.
If you think that this is a bug, you can report this at https://bugs.launchpad.net/mg5amcnlo
Value of current Options:
             pythia8_path : None
                hwpp_path : None
              thepeg_path : None
               hepmc_path : None
         madanalysis_path : None
        madanalysis5_path : None
          pythia-pgs_path : None
                  td_path : None
             delphes_path : None
      exrootanalysis_path : None
             syscalc_path : None
                   lhapdf : /data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/lhapdf6_py3/bin/lhapdf-config
               lhapdf_py2 : None
               lhapdf_py3 : /data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/lhapdf6_py3/bin/lhapdf-config
                  timeout : 60
            f2py_compiler : None
        f2py_compiler_py2 : None
        f2py_compiler_py3 : None
              web_browser : None
               eps_viewer : None
              text_editor : None
         fortran_compiler : None
             cpp_compiler : None
              auto_update : 7
             cluster_type : condor
    cluster_status_update : (600, 30)
         cluster_nb_retry : 1
       cluster_local_path : None
       cluster_retry_wait : 300
             stdout_level : None
   automatic_html_opening : True
      notification_center : True
                 run_mode : 2
            cluster_queue : None
             cluster_time : None
             cluster_size : 100
           cluster_memory : None
                  nb_core : 32
        cluster_temp_path : None
                 mg5_path : /data3/MadGraph/MG5_aMC_v3_1_0
                    golem : None
                    ninja : /data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/lib
                  collier : /data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/lib
#************************************************************
#* MadGraph5_aMC@NLO *
#* *
#* * * *
#* * * * * *
#* * * * * 5 * * * * *
#* * * * * *
#* * * *
#* *
#* *
#* VERSION 3.1.0 2021-03-30 *
#* *
#* The MadGraph5_aMC@NLO Development Team - Find us at *
#* https://server06.fynu.ucl.ac.be/projects/madgraph *
#* *
#************************************************************
#* *
#* Command File for MadGraph5_aMC@NLO *
#* *
#* run as ./bin/mg5_aMC filename *
#* *
#************************************************************
set group_subprocesses Auto
set ignore_six_quark_processes False
set low_mem_multicore_nlo_generation False
set complex_mass_scheme False
set include_lepton_initiated_processes False
set gauge unitary
set loop_optimized_output True
set loop_color_flows False
set max_npoint_for_channel 0
set default_unset_couplings 99
set max_t_for_channel 99
set zerowidth_tchannel True
set nlo_mixed_expansion True
import model sm
define p = g u c d s u~ c~ d~ s~
define j = g u c d s u~ c~ d~ s~
define l+ = e+ mu+
define l- = e- mu-
define vl = ve vm vt
define vl~ = ve~ vm~ vt~
import model loop_sm
generate p p > e+ e- [QCD]
output runs/sm
######################################################################
## PARAM_CARD AUTOMATICALY GENERATED BY MG5 FOLLOWING UFO MODEL ####
######################################################################
## ##
## Width set on Auto will be computed following the information ##
## present in the decay.py files of the model. ##
## See arXiv:1402.1178 for more details. ##
## ##
######################################################################

###################################
## INFORMATION FOR MASS
###################################
Block mass
    5 4.700000e+00 # MB
    6 1.730000e+02 # MT
   15 1.777000e+00 # MTA
   23 9.118800e+01 # MZ
   25 1.250000e+02 # MH
## Dependent parameters, given by model restrictions.
## Those values should be edited following the
## analytical expression. MG5 ignores those values
## but they are important for interfacing the output of MG5
## to external program such as Pythia.
  1 0.000000e+00 # d : 0.0
  2 0.000000e+00 # u : 0.0
  3 0.000000e+00 # s : 0.0
  4 0.000000e+00 # c : 0.0
  11 0.000000e+00 # e- : 0.0
  12 0.000000e+00 # ve : 0.0
  13 0.000000e+00 # mu- : 0.0
  14 0.000000e+00 # vm : 0.0
  16 0.000000e+00 # vt : 0.0
  21 0.000000e+00 # g : 0.0
  22 0.000000e+00 # a : 0.0
  24 8.041900e+01 # w+ : cmath.sqrt(MZ__exp__2/2. + cmath.sqrt(MZ__exp__4/4. - (aEW*cmath.pi*MZ__exp__2)/(Gf*sqrt__2)))

###################################
## INFORMATION FOR SMINPUTS
###################################
Block sminputs
    1 1.325070e+02 # aEWM1
    2 1.166390e-05 # Gf
    3 1.180000e-01 # aS (Note that Parameter not used if you use a PDF set)

###################################
## INFORMATION FOR YUKAWA
###################################
Block yukawa
    5 4.700000e+00 # ymb
    6 1.730000e+02 # ymt
   15 1.777000e+00 # ymtau

###################################
## INFORMATION FOR DECAY
###################################
DECAY 6 1.491500e+00 # WT
DECAY 23 2.441404e+00 # WZ
DECAY 24 2.047600e+00 # WW
DECAY 25 6.382339e-03 # WH
## Dependent parameters, given by model restrictions.
## Those values should be edited following the
## analytical expression. MG5 ignores those values
## but they are important for interfacing the output of MG5
## to external program such as Pythia.
DECAY 1 0.000000e+00 # d : 0.0
DECAY 2 0.000000e+00 # u : 0.0
DECAY 3 0.000000e+00 # s : 0.0
DECAY 4 0.000000e+00 # c : 0.0
DECAY 5 0.000000e+00 # b : 0.0
DECAY 11 0.000000e+00 # e- : 0.0
DECAY 12 0.000000e+00 # ve : 0.0
DECAY 13 0.000000e+00 # mu- : 0.0
DECAY 14 0.000000e+00 # vm : 0.0
DECAY 15 0.000000e+00 # ta- : 0.0
DECAY 16 0.000000e+00 # vt : 0.0
DECAY 21 0.000000e+00 # g : 0.0
DECAY 22 0.000000e+00 # a : 0.0
#===========================================================
# QUANTUM NUMBERS OF NEW STATE(S) (NON SM PDG CODE)
#===========================================================

Block QNUMBERS 82 # gh
        1 0 # 3 times electric charge
        2 1 # number of spin states (2S+1)
        3 8 # colour rep (1: singlet, 3: triplet, 8: octet)
        4 1 # Particle/Antiparticle distinction (0=own anti)
#***********************************************************************
# MadGraph5_aMC@NLO *
# *
# run_card.dat aMC@NLO *
# *
# This file is used to set the parameters of the run. *
# *
# Some notation/conventions: *
# *
# Lines starting with a hash (#) are info or comments *
# *
# mind the format: value = variable ! comment *
# *
# Some of the values of variables can be list. These can either be *
# comma or space separated. *
# *
# To display additional parameter, you can use the command: *
# update to_full *
#***********************************************************************
#
#*******************
# Running parameters
#*******************
#
#***********************************************************************
# Tag name for the run (one word) *
#***********************************************************************
  tag_1 = run_tag ! name of the run
#***********************************************************************
# Number of LHE events (and their normalization) and the required *
# (relative) accuracy on the Xsec. *
# These values are ignored for fixed order runs *
#***********************************************************************
  10000 = nevents ! Number of unweighted events requested
  -1.0 = req_acc ! Required accuracy (-1=auto determined from nevents)
  -1 = nevt_job ! Max number of events per job in event generation.
                 ! (-1= no split).
#***********************************************************************
# Normalize the weights of LHE events such that they sum or average to *
# the total cross section *
#***********************************************************************
  average = event_norm ! valid settings: average, sum, bias
#***********************************************************************
# Number of points per itegration channel (ignored for aMC@NLO runs) *
#***********************************************************************
  0.01 = req_acc_fo ! Required accuracy (-1=ignored, and use the
                     ! number of points and iter. below)
# These numbers are ignored except if req_acc_FO is equal to -1
  5000 = npoints_fo_grid ! number of points to setup grids
  4 = niters_fo_grid ! number of iter. to setup grids
  10000 = npoints_fo ! number of points to compute Xsec
  6 = niters_fo ! number of iter. to compute Xsec
#***********************************************************************
# Random number seed *
#***********************************************************************
  0 = iseed ! rnd seed (0=assigned automatically=default))
#***********************************************************************
# Collider type and energy *
#***********************************************************************
  1 = lpp1 ! beam 1 type (0 = no PDF)
  1 = lpp2 ! beam 2 type (0 = no PDF)
  6500.0 = ebeam1 ! beam 1 energy in GeV
  6500.0 = ebeam2 ! beam 2 energy in GeV
#***********************************************************************
# PDF choice: this automatically fixes also alpha_s(MZ) and its evol. *
#***********************************************************************
  nn23nlo = pdlabel ! PDF set
  244600 = lhaid ! If pdlabel=lhapdf, this is the lhapdf number. Only
              ! numbers for central PDF sets are allowed. Can be a list;
              ! PDF sets beyond the first are included via reweighting.
#***********************************************************************
# Include the NLO Monte Carlo subtr. terms for the following parton *
# shower (HERWIG6 | HERWIGPP | PYTHIA6Q | PYTHIA6PT | PYTHIA8) *
# WARNING: PYTHIA6PT works only for processes without FSR!!!! *
#***********************************************************************
  HERWIG6 = parton_shower
  1.0 = shower_scale_factor ! multiply default shower starting
                                  ! scale by this factor
#***********************************************************************
# Renormalization and factorization scales *
# (Default functional form for the non-fixed scales is the sum of *
# the transverse masses divided by two of all final state particles *
# and partons. This can be changed in SubProcesses/set_scales.f or via *
# dynamical_scale_choice option) *
#***********************************************************************
  False = fixed_ren_scale ! if .true. use fixed ren scale
  False = fixed_fac_scale ! if .true. use fixed fac scale
  91.118 = mur_ref_fixed ! fixed ren reference scale
  91.118 = muf_ref_fixed ! fixed fact reference scale
  -1 = dynamical_scale_choice ! Choose one (or more) of the predefined
           ! dynamical choices. Can be a list; scale choices beyond the
           ! first are included via reweighting
  1.0 = mur_over_ref ! ratio of current muR over reference muR
  1.0 = muf_over_ref ! ratio of current muF over reference muF
#***********************************************************************
# Reweight variables for scale dependence and PDF uncertainty *
#***********************************************************************
  1.0, 2.0, 0.5 = rw_rscale ! muR factors to be included by reweighting
  1.0, 2.0, 0.5 = rw_fscale ! muF factors to be included by reweighting
  True = reweight_scale ! Reweight to get scale variation using the
            ! rw_rscale and rw_fscale factors. Should be a list of
            ! booleans of equal length to dynamical_scale_choice to
            ! specify for which choice to include scale dependence.
  False = reweight_pdf ! Reweight to get PDF uncertainty. Should be a
            ! list booleans of equal length to lhaid to specify for
            ! which PDF set to include the uncertainties.
#***********************************************************************
# Store reweight information in the LHE file for off-line model- *
# parameter reweighting at NLO+PS accuracy *
#***********************************************************************
  True = store_rwgt_info ! Store info for reweighting in LHE file
#***********************************************************************
# ickkw parameter: *
# 0: No merging *
# 3: FxFx Merging - WARNING! Applies merging only at the hard-event *
# level. After showering an MLM-type merging should be applied as *
# well. See http://amcatnlo.cern.ch/FxFx_merging.htm for details. *
# 4: UNLOPS merging (with pythia8 only). No interface from within *
# MG5_aMC available, but available in Pythia8. *
# -1: NNLL+NLO jet-veto computation. See arxiv:1412.8408 [hep-ph]. *
#***********************************************************************
  0 = ickkw
#***********************************************************************
#
#***********************************************************************
# BW cutoff (M+/-bwcutoff*Gamma). Determines which resonances are *
# written in the LHE event file *
#***********************************************************************
  15.0 = bwcutoff
#***********************************************************************
# Cuts on the jets. Jet clustering is performed by FastJet. *
# - If gamma_is_j, photons are also clustered *
# - When matching to a parton shower, these generation cuts should be *
# considerably softer than the analysis cuts. *
# - More specific cuts can be specified in SubProcesses/cuts.f *
#***********************************************************************
  1.0 = jetalgo ! FastJet jet algorithm (1=kT, 0=C/A, -1=anti-kT)
  0.7 = jetradius ! The radius parameter for the jet algorithm
  10.0 = ptj ! Min jet transverse momentum
  -1.0 = etaj ! Max jet abs(pseudo-rap) (a value .lt.0 means no cut)
  True = gamma_is_j ! Wether to cluster photons as jets or not
#***********************************************************************
# Cuts on the charged leptons (e+, e-, mu+, mu-, tau+ and tau-) *
# More specific cuts can be specified in SubProcesses/cuts.f *
#***********************************************************************
  0.0 = ptl ! Min lepton transverse momentum
  -1.0 = etal ! Max lepton abs(pseudo-rap) (a value .lt.0 means no cut)
  0.0 = drll ! Min distance between opposite sign lepton pairs
  0.0 = drll_sf ! Min distance between opp. sign same-flavor lepton pairs
  0.0 = mll ! Min inv. mass of all opposite sign lepton pairs
  30.0 = mll_sf ! Min inv. mass of all opp. sign same-flavor lepton pairs
#***********************************************************************
# Fermion-photon recombination parameters *
# If Rphreco=0, no recombination is performed *
#***********************************************************************
  0.1 = rphreco ! Minimum fermion-photon distance for recombination
  -1.0 = etaphreco ! Maximum abs(pseudo-rap) for photons to be recombined (a value .lt.0 means no cut)
  True = lepphreco ! Recombine photons and leptons together
  True = quarkphreco ! Recombine photons and quarks together
#***********************************************************************
# Photon-isolation cuts, according to hep-ph/9801442 *
# Not applied if gamma_is_j *
# When ptgmin=0, all the other parameters are ignored *
# More specific cuts can be specified in SubProcesses/cuts.f *
#***********************************************************************
  20.0 = ptgmin ! Min photon transverse momentum
  -1.0 = etagamma ! Max photon abs(pseudo-rap)
  0.4 = r0gamma ! Radius of isolation code
  1.0 = xn ! n parameter of eq.(3.4) in hep-ph/9801442
  1.0 = epsgamma ! epsilon_gamma parameter of eq.(3.4) in hep-ph/9801442
  True = isoem ! isolate photons from EM energy (photons and leptons)
#***********************************************************************
# Cuts associated to MASSIVE particles identified by their PDG codes. *
# All cuts are applied to both particles and anti-particles, so use *
# POSITIVE PDG CODES only. Example of the syntax is {6 : 100} or *
# {6:100, 25:200} for multiple particles *
#***********************************************************************
  {} = pt_min_pdg ! Min pT for a massive particle
  {} = pt_max_pdg ! Max pT for a massive particle
  {} = mxx_min_pdg ! inv. mass for any pair of (anti)particles
#***********************************************************************
# Use PineAPPL to generate PDF-independent fast-interpolation grid *
# (https://zenodo.org/record/3992765#.X2EWy5MzbVo) *
#***********************************************************************
  False = pineappl ! PineAPPL switch
#***********************************************************************

Question information

Language:
English Edit question
Status:
Solved
For:
MadGraph5_aMC@NLO Edit question
Assignee:
No assignee Edit question
Solved by:
Olivier Mattelaer
Solved:
Last query:
Last reply:
Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#1

Hi,

The issue might be the syntax that you are using:
set mass 6:[100,150,200]
should be
set mass 6 scan:[100,150,200]

even if the error "relocation R_X86_64_PC32 against symbol `__dd_global_MOD_cout_on' can not be used when making a shared object; recompile with -fPIC"

which is linked to a compiler issue as reported in the error message or in stack-overflow:
https://stackoverflow.com/questions/19768267/relocation-r-x86-64-32s-against-linking-error

Did you define some FFLAGS in your use environment (or similar) that would prevent the -fPIC to be present during the compilation?

Cheers,

Olivier

Revision history for this message
Alfredo Glioti (aglioti) said :
#2

Hi,

sorry for the syntax error, that's my fault. I typed it from memory instead of copying and I forgot to write "scan". I can assure you that in the reweight card we used the syntax was correct.

FFLAGS is not a variable in my environment and compiling a simple "hello world" program using "gcc program.c -fPIC" worked.

Do you know of any tests I can do to find out if there is something wrong with our configuration?

Thanks for your answer,

Alfredo

Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said :
#3

If I understand correctly the error it is collier which is not correctly compiled.

the line to compile collier does explicitly specify that flag:
 ${CMAKEPATH}/bin/cmake -Dstatic=ON -Dextra_fortran_flags=-fPIC ..

So it seems that for some reason CMAKE decide to ignore that flag.
in the directory
/data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/collier
you should have a file
collier_install.log where you might have information about that flag ignored

Cheers,

Olivier

Revision history for this message
Alfredo Glioti (aglioti) said :
#4

The collier debug log says

...
Building COLLIER as static library
Collier install include prefix: /usr/local/include
Collier install library prefix: /usr/local/lib
-- Configuring done
 -- Generating done
CMake Warning:
Manually-specified variables were not used by the project: extra_fortran_flags
...

So it seems like it's not using those flags in the installation as you were saying. I can't find any reason for this though.

I also found inside /build/CMakeCache.txt the following, but I don't know if it is relevant:

...
//Value Computed by CMake
collier_SOURCE_DIR:STATIC=/data3/MadGraph/MG5_aMC_v3_1_0/HEPTools/collier/COLLIER-1.2.5
                                                                                                                                                                                                                                                                                                                       //No help, variable specified on the command line.
extra_fortran_flags:UNINITIALIZED=-fPIC
                                                                                                                                                                                                                                                                                                                                                                       //shared_libraries
static:BOOL=ON
...

Revision history for this message
Best Olivier Mattelaer (olivier-mattelaer) said :
#5

I have tried to update the installation script to force -fPIC compilation, if you retry in ~40 min (21h40 ECT) you should try that new version and we will see if this improves the situation or not.

Cheers,

Olivier

Revision history for this message
Alfredo Glioti (aglioti) said :
#6

Hi,

first of all thank you very much! I would say this fix was mostly a success.

My original problem was to reweight on some new physics parameter of the SMEFTatNLO model and this seems to be working, based on a couple of tests I just made.

However the reweighting on MT on the simplified problem I posted here (but that I don't need for my work) is still crashing but for a different reason. It seems that at some point it tries to convert a float to an int during the reweighting procedure.

...
"/data3/MadGraph/MG5_aMC_v3_1_0/madgraph/various/lhe_parser.py", line 2767, in parse self.born_related = int(data[flag+7])
ValueError: invalid literal for int() with base 10: '0.12625182e+01'
...

I put here the full debug log (sorry it got messed up when copying text from console...): https://pastebin.com/Xh03Zk4B

This is most likely unrelated to the original problem I had so please tell me if I should report it as a separate bug.

Thanks again!
Alfredo

Revision history for this message
Alfredo Glioti (aglioti) said :
#7

Thanks Olivier Mattelaer, that solved my question.

Revision history for this message
Alfredo Glioti (aglioti) said :
#8

Hi,

sorry I just want to add that when I said that I managed to reweight on new physics parameters earlier, I had a setting wrong in the reweight_card and the reweight was done at LO. Changing the mode to NLO produces the same int conversion bug that I already reported.

Thanks again,
Alfredo