MadGraph5_aMC@NLO

timeout error during card update (and eventual pdf copying)

Asked by Hannes

Hi,

we are recently seeing a lot of crashes in ATLAS production with errors like the one pasted on the bottom of the mail.
We (ATLAS) discussed a similar issue in 708223 but this particular one is fairly urgent at the moment, hence I wanted to discuss it separately.

From looking at the stack, to me it looks like during a card update/consistency check, missing lhapdf sets are copied and eventually we run into a timeout, which crashes the job. It also looks like only 20s time are allowed for this step to finish.
If that's the case, it's no surprise this times out, as we have seen that the copy of files from the cvmfs file system (where the lhapdf data lives) sometimes takes a bit longer.

What would be the best way to fix this issue? Is there something we can do immediately on our end or do we need a patch for MG5_aMC to become more patient with the filesystem?

Cheers,
Hannes

---

generate 22:32:27 Py:MadGraphUtils ERROR Command "generate_events run_01" interrupted with error:
generate 22:32:27 Py:MadGraphUtils ERROR TimeOutError :
generate 22:32:27 Py:MadGraphUtils ERROR Please report this bug on https://bugs.launchpad.net/mg5amcnlo
generate 22:32:27 Py:MadGraphUtils ERROR More information is found in 'ME5_debug'.
generate 22:32:27 Py:MadGraphUtils ERROR Please attach this file to your report.
generate 22:32:27 Py:MadGraphUtils ERROR MadGraph5_aMC@NLO appears to have crashed. Debug file output follows.
generate 22:32:27 Py:MadGraphUtils ERROR #************************************************************
generate 22:32:27 Py:MadGraphUtils ERROR #* MadGraph5_aMC@NLO/MadEvent *
generate 22:32:27 Py:MadGraphUtils ERROR #* *
generate 22:32:27 Py:MadGraphUtils ERROR #* * * *
generate 22:32:27 Py:MadGraphUtils ERROR #* * * * * *
generate 22:32:27 Py:MadGraphUtils ERROR #* * * * * 5 * * * * *
generate 22:32:27 Py:MadGraphUtils ERROR #* * * * * *
generate 22:32:27 Py:MadGraphUtils ERROR #* * * *
generate 22:32:27 Py:MadGraphUtils ERROR #* *
generate 22:32:27 Py:MadGraphUtils ERROR #* *
generate 22:32:27 Py:MadGraphUtils ERROR #* VERSION 3.5.1 2023-07-11 *
generate 22:32:27 Py:MadGraphUtils ERROR #* *
generate 22:32:27 Py:MadGraphUtils ERROR #* The MadGraph5_aMC@NLO Development Team - Find us at *
generate 22:32:27 Py:MadGraphUtils ERROR #* https://server06.fynu.ucl.ac.be/projects/madgraph *
generate 22:32:27 Py:MadGraphUtils ERROR #* *
generate 22:32:27 Py:MadGraphUtils ERROR #************************************************************
generate 22:32:27 Py:MadGraphUtils ERROR #* *
generate 22:32:27 Py:MadGraphUtils ERROR #* Command File for MadEvent *
generate 22:32:27 Py:MadGraphUtils ERROR #* *
generate 22:32:27 Py:MadGraphUtils ERROR #* run as ./bin/madevent.py filename *
generate 22:32:27 Py:MadGraphUtils ERROR #* *
generate 22:32:27 Py:MadGraphUtils ERROR #************************************************************
generate 22:32:27 Py:MadGraphUtils ERROR generate_events run_01
generate 22:32:27 Py:MadGraphUtils ERROR Traceback (most recent call last):
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/extended_cmd.py", line 1543, in onecmd
generate 22:32:27 Py:MadGraphUtils ERROR return self.onecmd_orig(line, **opt)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/extended_cmd.py", line 1492, in onecmd_orig
generate 22:32:27 Py:MadGraphUtils ERROR return func(arg, **opt)
generate 22:32:27 Py:MadGraphUtils ERROR File "/builds/art/art-submit/art-local/main/AthGeneration/x86_64-centos7-gcc11-opt/2024-03-04T2101/EvgenJobTransforms/test_gen_mgpy8eg_tWgamma_madspin/PROC_sm-no_b_mass_0/bin/internal/madevent_interface.py", line 2395, in do_generate_events
generate 22:32:27 Py:MadGraphUtils ERROR switch_mode = self.ask_run_configuration(mode, args)
generate 22:32:27 Py:MadGraphUtils ERROR File "/builds/art/art-submit/art-local/main/AthGeneration/x86_64-centos7-gcc11-opt/2024-03-04T2101/EvgenJobTransforms/test_gen_mgpy8eg_tWgamma_madspin/PROC_sm-no_b_mass_0/bin/internal/madevent_interface.py", line 6441, in ask_run_configuration
generate 22:32:27 Py:MadGraphUtils ERROR self.ask_edit_cards(cards, plot=False, first_cmd=first_cmd)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 1039, in ask_edit_cards
generate 22:32:27 Py:MadGraphUtils ERROR self.ask_edit_card_static(cards, mode, plot, self.options['timeout'],
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 1111, in ask_edit_card_static
generate 22:32:27 Py:MadGraphUtils ERROR out = ask(question, '0', possible_answer, timeout=int(1.5*timeout),
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/extended_cmd.py", line 1148, in ask
generate 22:32:27 Py:MadGraphUtils ERROR value = Cmd.timed_input(question, default, timeout=timeout,
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/extended_cmd.py", line 1759, in timed_input
generate 22:32:27 Py:MadGraphUtils ERROR result = fct(question)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/extended_cmd.py", line 2130, in __call__
generate 22:32:27 Py:MadGraphUtils ERROR return self.cmdloop()
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/extended_cmd.py", line 2298, in cmdloop
generate 22:32:27 Py:MadGraphUtils ERROR super(SmartQuestion,self).cmdloop(intro)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/extended_cmd.py", line 178, in cmdloop
generate 22:32:27 Py:MadGraphUtils ERROR stop = self.postcmd(stop, line)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 6584, in postcmd
generate 22:32:27 Py:MadGraphUtils ERROR self.do_update('dependent', timer=20)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 6634, in do_update
generate 22:32:27 Py:MadGraphUtils ERROR self.update_dependent(self.mother_interface, self.me_dir, self.param_card,
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 6764, in update_dependent
generate 22:32:27 Py:MadGraphUtils ERROR mecmd.copy_lhapdf_set([lhaid], pdfsetsdir)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 4534, in copy_lhapdf_set
generate 22:32:27 Py:MadGraphUtils ERROR self.install_lhapdf_pdfset(pdfsets_dir, pdfset)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 4545, in install_lhapdf_pdfset
generate 22:32:27 Py:MadGraphUtils ERROR return self.install_lhapdf_pdfset_static(self.options['lhapdf'],
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 4600, in install_lhapdf_pdfset_static
generate 22:32:27 Py:MadGraphUtils ERROR misc.call([getdata, 'install', filename], cwd = pdfsets_dir)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/various/misc.py", line 913, in deco_f
generate 22:32:27 Py:MadGraphUtils ERROR return f(arg, *args, **opt)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/various/misc.py", line 944, in call
generate 22:32:27 Py:MadGraphUtils ERROR return subprocess.call(arg, *args, **opt)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/Python/3.9.12/x86_64-centos7-gcc11-opt/lib/python3.9/subprocess.py", line 351, in call
generate 22:32:27 Py:MadGraphUtils ERROR return p.wait(timeout=timeout)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/Python/3.9.12/x86_64-centos7-gcc11-opt/lib/python3.9/subprocess.py", line 1189, in wait
generate 22:32:27 Py:MadGraphUtils ERROR return self._wait(timeout=timeout)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/Python/3.9.12/x86_64-centos7-gcc11-opt/lib/python3.9/subprocess.py", line 1917, in _wait
generate 22:32:27 Py:MadGraphUtils ERROR (pid, sts) = self._try_wait(0)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/Python/3.9.12/x86_64-centos7-gcc11-opt/lib/python3.9/subprocess.py", line 1875, in _try_wait
generate 22:32:27 Py:MadGraphUtils ERROR (pid, sts) = os.waitpid(self.pid, wait_flags)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 6714, in handle_alarm
generate 22:32:27 Py:MadGraphUtils ERROR raise TimeOutError
generate 22:32:27 Py:MadGraphUtils ERROR madgraph.interface.common_run_interface.AskforEditCard.update_dependent.<locals>.TimeOutError
generate 22:32:27 Py:MadGraphUtils ERROR generate_events run_01
generate 22:32:27 Py:MadGraphUtils ERROR Traceback (most recent call last):
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/extended_cmd.py", line 1543, in onecmd
generate 22:32:27 Py:MadGraphUtils ERROR return self.onecmd_orig(line, **opt)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/extended_cmd.py", line 1492, in onecmd_orig
generate 22:32:27 Py:MadGraphUtils ERROR return func(arg, **opt)
generate 22:32:27 Py:MadGraphUtils ERROR File "/builds/art/art-submit/art-local/main/AthGeneration/x86_64-centos7-gcc11-opt/2024-03-04T2101/EvgenJobTransforms/test_gen_mgpy8eg_tWgamma_madspin/PROC_sm-no_b_mass_0/bin/internal/madevent_interface.py", line 2395, in do_generate_events
generate 22:32:27 Py:MadGraphUtils ERROR switch_mode = self.ask_run_configuration(mode, args)
generate 22:32:27 Py:MadGraphUtils ERROR File "/builds/art/art-submit/art-local/main/AthGeneration/x86_64-centos7-gcc11-opt/2024-03-04T2101/EvgenJobTransforms/test_gen_mgpy8eg_tWgamma_madspin/PROC_sm-no_b_mass_0/bin/internal/madevent_interface.py", line 6441, in ask_run_configuration
generate 22:32:27 Py:MadGraphUtils ERROR self.ask_edit_cards(cards, plot=False, first_cmd=first_cmd)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 1039, in ask_edit_cards
generate 22:32:27 Py:MadGraphUtils ERROR self.ask_edit_card_static(cards, mode, plot, self.options['timeout'],
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 1111, in ask_edit_card_static
generate 22:32:27 Py:MadGraphUtils ERROR out = ask(question, '0', possible_answer, timeout=int(1.5*timeout),
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/extended_cmd.py", line 1148, in ask
generate 22:32:27 Py:MadGraphUtils ERROR value = Cmd.timed_input(question, default, timeout=timeout,
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/extended_cmd.py", line 1759, in timed_input
generate 22:32:27 Py:MadGraphUtils ERROR result = fct(question)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/extended_cmd.py", line 2130, in __call__
generate 22:32:27 Py:MadGraphUtils ERROR return self.cmdloop()
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/extended_cmd.py", line 2298, in cmdloop
generate 22:32:27 Py:MadGraphUtils ERROR super(SmartQuestion,self).cmdloop(intro)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/extended_cmd.py", line 178, in cmdloop
generate 22:32:27 Py:MadGraphUtils ERROR stop = self.postcmd(stop, line)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 6584, in postcmd
generate 22:32:27 Py:MadGraphUtils ERROR self.do_update('dependent', timer=20)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 6634, in do_update
generate 22:32:27 Py:MadGraphUtils ERROR self.update_dependent(self.mother_interface, self.me_dir, self.param_card,
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 6764, in update_dependent
generate 22:32:27 Py:MadGraphUtils ERROR mecmd.copy_lhapdf_set([lhaid], pdfsetsdir)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 4534, in copy_lhapdf_set
generate 22:32:27 Py:MadGraphUtils ERROR self.install_lhapdf_pdfset(pdfsets_dir, pdfset)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 4545, in install_lhapdf_pdfset
generate 22:32:27 Py:MadGraphUtils ERROR return self.install_lhapdf_pdfset_static(self.options['lhapdf'],
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 4600, in install_lhapdf_pdfset_static
generate 22:32:27 Py:MadGraphUtils ERROR misc.call([getdata, 'install', filename], cwd = pdfsets_dir)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/various/misc.py", line 913, in deco_f
generate 22:32:27 Py:MadGraphUtils ERROR return f(arg, *args, **opt)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/various/misc.py", line 944, in call
generate 22:32:27 Py:MadGraphUtils ERROR return subprocess.call(arg, *args, **opt)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/Python/3.9.12/x86_64-centos7-gcc11-opt/lib/python3.9/subprocess.py", line 351, in call
generate 22:32:27 Py:MadGraphUtils ERROR return p.wait(timeout=timeout)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/Python/3.9.12/x86_64-centos7-gcc11-opt/lib/python3.9/subprocess.py", line 1189, in wait
generate 22:32:27 Py:MadGraphUtils ERROR return self._wait(timeout=timeout)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/Python/3.9.12/x86_64-centos7-gcc11-opt/lib/python3.9/subprocess.py", line 1917, in _wait
generate 22:32:27 Py:MadGraphUtils ERROR (pid, sts) = self._try_wait(0)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/Python/3.9.12/x86_64-centos7-gcc11-opt/lib/python3.9/subprocess.py", line 1875, in _try_wait
generate 22:32:27 Py:MadGraphUtils ERROR (pid, sts) = os.waitpid(self.pid, wait_flags)
generate 22:32:27 Py:MadGraphUtils ERROR File "/cvmfs/atlas-nightlies.cern.ch/repo/sw/main_AthGeneration_x86_64-centos7-gcc11-opt/sw/lcg/releases/LCG_104d_ATLAS_7/MCGenerators/madgraph5amc/3.5.1.atlas3/x86_64-centos7-gcc11-opt/madgraph/interface/common_run_interface.py", line 6714, in handle_alarm
generate 22:32:27 Py:MadGraphUtils ERROR raise TimeOutError
generate 22:32:27 Py:MadGraphUtils ERROR madgraph.interface.common_run_interface.AskforEditCard.update_dependent.<locals>.TimeOutError

Question information

Language:
English Edit question
Status:
Answered
For:
MadGraph5_aMC@NLO Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
Sihyun Jeon (shjeon) said : 		#1

if you do "update dependent"

i think it will wait for the dependent parameters to be fully updated without exiting due to timer time limit

Revision history for this message
Sihyun Jeon (shjeon) said : 		#2

not sure if it's a sane thing to do but doing a git patch before running madgraph to change values 20 to 200 might be worth trying

https://github.com/mg5amcnlo/mg5amcnlo/blob/3.x/madgraph/interface/common_run_interface.py#L6619
https://github.com/mg5amcnlo/mg5amcnlo/blob/3.x/madgraph/interface/common_run_interface.py#L6952

Revision history for this message
had the (ug87vyf) said : 		#3

how can we get ride of these scam cails? I want to do the football practice jerseys of my career in can anyone help me regarding this?http://alpha-performance.com/

Revision history for this message
Olivier Mattelaer (olivier-mattelaer) said : 		#4

The main problem is the same as the other thread...

The timer was started assuming that lhpadf part was instateneous and therefore the part of lhapdf is not protected versus timeout error. So indeed increasing the timer is one solution:

The solution implemented in the official code was that one:
https://github.com/mg5amcnlo/mg5amcnlo/commit/b13bf420ceef0fd6b682b8dc6875437a088cbe07

Where I have start the timer after the lhapdf section. Indeed if that section takes time, it is likely related to IO issue as you mention above and it does make sense to wait since in any case those file/ressources will be needed by the fortran code later.

Cheers,

Olivier

Can you help with this problem?

Provide an answer of your own, or ask Hannes for more information if necessary.

To post a message you must log in.