error : can't start new thread

Asked by Ilirjan Margjeka on 2018-09-28

Hi there,

I have a problem with the "launch" execution:

Command "launch gg_HH_prova1/" interrupted with error:
error : can't start new thread
Please report this bug on https://bugs.launchpad.net/mg5amcnlo
More information is found in 'MG5_debug'.
Please attach this file to your report.

************************************************************
#* MadGraph5_aMC@NLO *
#* *
#* * * *
#* * * * * *
#* * * * * 5 * * * * *
#* * * * * *
#* * * *
#* *
#* *
#* VERSION 2.6.1 2017-12-12 *
#* *
#* The MadGraph5_aMC@NLO Development Team - Find us at *
#* https://server06.fynu.ucl.ac.be/projects/madgraph *
#* *
#************************************************************
#* *
#* Command File for MadGraph5_aMC@NLO *
#* *
#* run as ./bin/mg5_aMC filename *
#* *
#************************************************************
set group_subprocesses Auto
set ignore_six_quark_processes False
set loop_optimized_output True
set loop_color_flows False
set gauge unitary
set complex_mass_scheme False
set max_npoint_for_channel 0
import model sm
define p = g u c d s u~ c~ d~ s~
define j = g u c d s u~ c~ d~ s~
define l+ = e+ mu+
define l- = e- mu-
define vl = ve vm vt
define vl~ = ve~ vm~ vt~
import model /lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/models/BSM_gg_hh
generate p p > h h
output gg_HH_prova1
launch gg_HH_prova1/
Traceback (most recent call last):
  File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/extended_cmd.py", line 1467, in onecmd
    return self.onecmd_orig(line, **opt)
  File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/extended_cmd.py", line 1421, in onecmd_orig
    return func(arg, **opt)
  File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/master_interface.py", line 488, in do_launch
    return self.cmd.do_launch(self, line, *argss, **opts)
  File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/madgraph_interface.py", line 6845, in do_launch
    ext_program.run()
File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/launch_ext_program.py", line 65, in run
    self.launch_program()
  File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/launch_ext_program.py", line 620, in launch_program
    usecmd = ME.MadEventCmdShell(me_dir=self.running_dir, options=self.options)
  File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/madevent_interface.py", line 2106, in __init__
    CmdExtended.__init__(self, me_dir, options, *completekey, **stdin)
  File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/madevent_interface.py", line 207, in __init__
    super(CmdExtended, self).__init__(me_dir, options, *arg, **opt)
  File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/common_run_interface.py", line 653, in __init__
    self.set_configuration()
  File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/madevent_interface.py", line 2146, in set_configuration
    final=final, **opt)
  File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/common_run_interface.py", line 3337, in set_configuration
    return self.set_configuration(config_path=me5_config, final=final,initdir=self.me_dir)
  File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/madevent_interface.py", line 2146, in set_configuration
    final=final, **opt)
  File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/common_run_interface.py", line 3419, in set_configuration
    self.configure_run_mode(self.options['run_mode'])
  File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/common_run_interface.py", line 3109, in configure_run_mode
    self.cluster = cluster.MultiCore(**self.options)
  File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/various/cluster.py", line 610, in __init__
    self.start_demon()
  File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/various/cluster.py", line 617, in start_demon
    t.start()
  File "/cvmfs/cms.cern.ch/slc6_amd64_gcc530/external/python/2.7.11-ikhhed2/lib/python2.7/threading.py", line 736, in start
    _start_new_thread(self.__bootstrap, ())
error: can't start new thread
                          MadGraph5_aMC@NLO Options
                          ----------------
        complex_mass_scheme : False
                      gauge : unitary
         group_subprocesses : Auto
 ignore_six_quark_processes : False
           loop_color_flows : False
      loop_optimized_output : True
  low_mem_multicore_nlo_generation : False
     max_npoint_for_channel : 0 (user set)
               stdout_level : 20 (user set)

                         MadEvent Options
                          ----------------
     automatic_html_opening : True
                    nb_core : 24 (user set)
        notification_center : True
                   run_mode : 2

                      Configuration Options
                      ---------------------
                       OLP : MadLoop
                    amcfast : amcfast-config
                   applgrid : applgrid-config
                auto_update : 7 (user set)
         cluster_local_path : None
           cluster_nb_retry : 1
              cluster_queue : None (user set)
         cluster_retry_wait : 300
               cluster_size : 100
      cluster_status_update : (600, 30)
          cluster_temp_path : None
               cluster_type : condor
                    collier : ./HEPTools/lib
               cpp_compiler : None
             crash_on_error : False
               delphes_path : None (user set)
                eps_viewer : None
        exrootanalysis_path : /lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/ExRootAnalysis (user set)
              f2py_compiler : None
                    fastjet : None (user set)
           fortran_compiler : None
                      golem : None (user set)
                 hepmc_path : None (user set)
                  hwpp_path : None (user set)
                     lhapdf : /lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/HEPTools/lhapdf6/bin/lhapdf-config (user set)
          madanalysis5_path : None (user set)
           madanalysis_path : None (user set)
  mg5amc_py8_interface_path : /lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/HEPTools/MG5aMC_PY8_interface (user set)
                      ninja : ./HEPTools/lib
        output_dependencies : external
                      pjfry : None (user set)
            pythia-pgs_path : /lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/pythia-pgs (user set)
               pythia8_path : /lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/HEPTools/pythia8 (user set)
                    samurai : None
               syscalc_path : None (user set)
                    td_path : None (user set)
                text_editor : None
                thepeg_path : None (user set)
                    timeout : 60
                web_browser : None

How do I solve this?

Thank you a lot!
Cheers!

Question information

Language:
English Edit question
Status:
Solved
For:
MadGraph5_aMC@NLO Edit question
Assignee:
No assignee Edit question
Solved by:
Olivier Mattelaer
Solved:
2018-09-29
Last query:
2018-09-29
Last reply:
2018-09-28

Hi,

Is this within a scan or something?
Otherwise, it means that you have very strict limitation on the number of thread that you can run on that machine. But such hard restriction sounds weird and the only reason I can see why a sys admin will put such hard restriction would be via SLURM( or any scheduller) if you request a single core/task (and even in that case).

If that's the case, you should ask to run MG5aMC in a single core setup (since you ask for that to your scheduller). Otherwise you can also try to reduce the option nb_core to reduce the number of thread use.
(You curently have it to 24)

Cheers,

Olivier

If not, can you monitor the number

> On 28 Sep 2018, at 12:02, Ilirjan Margjeka <email address hidden> wrote:
>
> New question #674474 on MadGraph5_aMC@NLO:
> https://answers.launchpad.net/mg5amcnlo/+question/674474
>
> Hi there,
>
> I have a problem with the "launch" execution:
>
> Command "launch gg_HH_prova1/" interrupted with error:
> error : can't start new thread
> Please report this bug on https://bugs.launchpad.net/mg5amcnlo
> More information is found in 'MG5_debug'.
> Please attach this file to your report.
>
> ************************************************************
> #* MadGraph5_aMC@NLO *
> #* *
> #* * * *
> #* * * * * *
> #* * * * * 5 * * * * *
> #* * * * * *
> #* * * *
> #* *
> #* *
> #* VERSION 2.6.1 2017-12-12 *
> #* *
> #* The MadGraph5_aMC@NLO Development Team - Find us at *
> #* https://server06.fynu.ucl.ac.be/projects/madgraph *
> #* *
> #************************************************************
> #* *
> #* Command File for MadGraph5_aMC@NLO *
> #* *
> #* run as ./bin/mg5_aMC filename *
> #* *
> #************************************************************
> set group_subprocesses Auto
> set ignore_six_quark_processes False
> set loop_optimized_output True
> set loop_color_flows False
> set gauge unitary
> set complex_mass_scheme False
> set max_npoint_for_channel 0
> import model sm
> define p = g u c d s u~ c~ d~ s~
> define j = g u c d s u~ c~ d~ s~
> define l+ = e+ mu+
> define l- = e- mu-
> define vl = ve vm vt
> define vl~ = ve~ vm~ vt~
> import model /lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/models/BSM_gg_hh
> generate p p > h h
> output gg_HH_prova1
> launch gg_HH_prova1/
> Traceback (most recent call last):
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/extended_cmd.py", line 1467, in onecmd
> return self.onecmd_orig(line, **opt)
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/extended_cmd.py", line 1421, in onecmd_orig
> return func(arg, **opt)
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/master_interface.py", line 488, in do_launch
> return self.cmd.do_launch(self, line, *argss, **opts)
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/madgraph_interface.py", line 6845, in do_launch
> ext_program.run()
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/launch_ext_program.py", line 65, in run
> self.launch_program()
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/launch_ext_program.py", line 620, in launch_program
> usecmd = ME.MadEventCmdShell(me_dir=self.running_dir, options=self.options)
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/madevent_interface.py", line 2106, in __init__
> CmdExtended.__init__(self, me_dir, options, *completekey, **stdin)
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/madevent_interface.py", line 207, in __init__
> super(CmdExtended, self).__init__(me_dir, options, *arg, **opt)
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/common_run_interface.py", line 653, in __init__
> self.set_configuration()
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/madevent_interface.py", line 2146, in set_configuration
> final=final, **opt)
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/common_run_interface.py", line 3337, in set_configuration
> return self.set_configuration(config_path=me5_config, final=final,initdir=self.me_dir)
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/madevent_interface.py", line 2146, in set_configuration
> final=final, **opt)
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/common_run_interface.py", line 3419, in set_configuration
> self.configure_run_mode(self.options['run_mode'])
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/interface/common_run_interface.py", line 3109, in configure_run_mode
> self.cluster = cluster.MultiCore(**self.options)
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/various/cluster.py", line 610, in __init__
> self.start_demon()
> File "/lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/madgraph/various/cluster.py", line 617, in start_demon
> t.start()
> File "/cvmfs/cms.cern.ch/slc6_amd64_gcc530/external/python/2.7.11-ikhhed2/lib/python2.7/threading.py", line 736, in start
> _start_new_thread(self.__bootstrap, ())
> error: can't start new thread
> MadGraph5_aMC@NLO Options
> ----------------
> complex_mass_scheme : False
> gauge : unitary
> group_subprocesses : Auto
> ignore_six_quark_processes : False
> loop_color_flows : False
> loop_optimized_output : True
> low_mem_multicore_nlo_generation : False
> max_npoint_for_channel : 0 (user set)
> stdout_level : 20 (user set)
>
> MadEvent Options
> ----------------
> automatic_html_opening : True
> nb_core : 24 (user set)
> notification_center : True
> run_mode : 2
>
> Configuration Options
> ---------------------
> OLP : MadLoop
> amcfast : amcfast-config
> applgrid : applgrid-config
> auto_update : 7 (user set)
> cluster_local_path : None
> cluster_nb_retry : 1
> cluster_queue : None (user set)
> cluster_retry_wait : 300
> cluster_size : 100
> cluster_status_update : (600, 30)
> cluster_temp_path : None
> cluster_type : condor
> collier : ./HEPTools/lib
> cpp_compiler : None
> crash_on_error : False
> delphes_path : None (user set)
> eps_viewer : None
> exrootanalysis_path : /lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/ExRootAnalysis (user set)
> f2py_compiler : None
> fastjet : None (user set)
> fortran_compiler : None
> golem : None (user set)
> hepmc_path : None (user set)
> hwpp_path : None (user set)
> lhapdf : /lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/HEPTools/lhapdf6/bin/lhapdf-config (user set)
> madanalysis5_path : None (user set)
> madanalysis_path : None (user set)
> mg5amc_py8_interface_path : /lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/HEPTools/MG5aMC_PY8_interface (user set)
> ninja : ./HEPTools/lib
> output_dependencies : external
> pjfry : None (user set)
> pythia-pgs_path : /lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/pythia-pgs (user set)
> pythia8_path : /lustrehome/imargjek/CMSSW_8_0_2/src/MG5_aMC_v2_6_1/HEPTools/pythia8 (user set)
> samurai : None
> syscalc_path : None (user set)
> td_path : None (user set)
> text_editor : None
> thepeg_path : None (user set)
> timeout : 60
> web_browser : None
>
> How do I solve this?
>
> Thank you a lot!
> Cheers!
>
> --
> You received this question notification because you are an answer
> contact for MadGraph5_aMC@NLO.

Ilirjan Margjeka (ilir92) said : #2

Thanks Olivier Mattelaer, that solved my question.