MadAnalysis 5

failure of reconstruction at hadron level

Asked by Jun Gao

I've recently installed Pythia8 and MadAnalysis5 from within MG5aMC@NLO. I tried to analyses some simple processes at hadron level using default settings of MA5 and always get the error message of "failed to create reconstructed event files" as in the attached screenshot. Also the output files didn't seem to include any histograms. I went back to check the log file which seems OK except some warning message. Could you please help to check which part is wrong? Thank you!

Question information

Language:
English Edit question
Status:
Solved
For:
MadAnalysis 5 Edit question
Assignee:
No assignee Edit question
Solved by:
Benjamin Fuks
Solved:
Last query:
Last reply:
Revision history for this message
Jun Gao (jung49) said : 		#1

INFO: storing files of previous run
INFO: Storing Pythia8 files of previous run
INFO: Done
INFO: Running MadAnalysis5 [arXiv:1206.1599]
INFO: Hadron input files considered:
INFO: --> /root/Local/madnew/MG5_aMC_v2_6_5/bin/test/Events/run_01/tag_1_pythia8_events.hepmc.gz
INFO: MadAnalysis5 now running the reconstruction 'BasicReco'...
INFO: Follow Madanalysis5 run with the following command in a separate terminal:
INFO: tail -f /root/Local/madnew/MG5_aMC_v2_6_5/bin/test/Events/run_01/tag_1_MA5__reco_BasicReco.log
Error detected in "generate_events run_01"
write debug file /root/Local/madnew/MG5_aMC_v2_6_5/bin/test/run_01_tag_1_debug.log
If you need help with this issue please contact us on https://answers.launchpad.net/mg5amcnlo
MadGraph5Error : MadAnalysis5 failed to produce the reconstructed event file for reconstruction 'BasicReco'.
quit
INFO:

Revision history for this message
Jun Gao (jung49) said : 		#2

*************************************************************
* W E L C O M E to M A D A N A L Y S I S 5 *
* *
* MA5 release : 1.8.44 2020/04/17 *
* *
* Comput. Phys. Commun. 184 (2013) 222-256 *
* Eur. Phys. J. C74 (2014) 3103 *
*************************************************************
Executing the commands from the script
...
ma5>define invisible = 12 14 16 -12 -14 -16
ma5>set main.fastsim.package = fastjet
ma5>set main.fastsim.algorithm = antikt
ma5>set main.fastsim.radius = 0.4
ma5>set main.fastsim.ptmin = 5.0
ma5>set main.fastsim.bjet_id.matching_dr = 0.4
ma5>set main.fastsim.bjet_id.efficiency = 1.0
ma5>set main.fastsim.bjet_id.misid_cjet = 0.0
ma5>set main.fastsim.bjet_id.misid_ljet = 0.0
ma5>set main.fastsim.tau_id.efficiency = 1.0
ma5>set main.fastsim.tau_id.misid_ljet = 0.0
ma5>import /root/Local/madnew/MG5_aMC_v2_6_5/bin/test/Events/run_01/tag_1_pythia8_events.hepmc.gz as reco_events
   -> Storing the file 'tag_1_pythia8_events.hepmc.gz' in the dataset 'reco_events'.
ma5>set main.outputfile=tag_1_pythia8_BasicReco.lhe.gz
ma5>submit /root/Local/madnew/MG5_aMC_v2_6_5/bin/test/MA5_HADRON_ANALYSIS_reco_BasicReco_1
   Creating folder 'MA5_HADRON_ANALYSIS_reco_BasicReco_1'...
   Copying 'SampleAnalyzer' source files...
   Inserting your selection into 'SampleAnalyzer'...
   Writing the list of datasets...
   Writing the command line history...
   Creating Makefiles...
   Compiling 'SampleAnalyzer'...
   Linking 'SampleAnalyzer'...
   Running 'SampleAnalyzer' over dataset 'reco_events'...
    *******************************************************
    * SampleAnalyzer for MadAnalysis 5 - Welcome.
    * Initializing all components
    - version: 1.8.44 (2020/04/17)
    - general: everything is default.
    - extracting the list of event samples...
    - analyzer 'MadAnalysis5job'
    - writer corresponding to output file 'tag_1_pythia8_BasicReco.lhe.gz'
    - jet clusterer 'anti kt'
    with algo: R=0.4 ; p=-1 ; PTmin=5
    with bjet: dR=0.4 ; Exclusive ; IDeff=1 ; MisID(c)=0 ; MisID(q)=0
    with tau: IDeff=1 ; MisID(q)=0
    * Running over files ...
    * 1/1 /root/Local/madnew/MG5_aMC_v2_6_5/bin/test/Events/run_01/tag_1_pythia8_events.hepmc.gz
    => file size: 63.98 Mo
    => sample format: HEPMC file produced by an unknown generator (cross section assumed in pb).
    #--------------------------------------------------------------------------
    # FastJet release 3.2.2
    # M. Cacciari, G.P. Salam and G. Soyez
    # A software package for jet finding and analysis at colliders
    # http://fastjet.fr
    #
    # Please cite EPJC72(2012)1896 [arXiv:1111.6097] if you use this package
    # for scientific work and optionally PLB641(2006)57 [hep-ph/0512210].
    #
    # FastJet is provided without warranty under the terms of the GNU GPLv2.
    # It uses T. Chan's closest pair algorithm, S. Fortune's Voronoi code
    # and 3rd party plugin jet algorithms. See COPYING file for details.
    #--------------------------------------------------------------------------

    WARNING: --------------------------------------------------------------------------------
    WARNING: Msg | HEPMC linecode unknown
    WARNING: Details | 
    WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
    WARNING: --------------------------------------------------------------------------------

    WARNING: --------------------------------------------------------------------------------
    WARNING: Msg | HEPMC linecode unknown
    WARNING: Details | 
    WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
    WARNING: --------------------------------------------------------------------------------

    WARNING: --------------------------------------------------------------------------------
    WARNING: Msg | HEPMC linecode unknown
    WARNING: Details | 
    WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
    WARNING: --------------------------------------------------------------------------------

    WARNING: --------------------------------------------------------------------------------
    WARNING: Msg | HEPMC linecode unknown
    WARNING: Details | 
    WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
    WARNING: --------------------------------------------------------------------------------

    WARNING: --------------------------------------------------------------------------------
    WARNING: Msg | HEPMC linecode unknown
    WARNING: Details | 
    WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
    WARNING: --------------------------------------------------------------------------------

    WARNING: --------------------------------------------------------------------------------
    WARNING: Msg | HEPMC linecode unknown
    WARNING: Details | 
    WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
    WARNING: --------------------------------------------------------------------------------

    WARNING: --------------------------------------------------------------------------------
    WARNING: Msg | HEPMC linecode unknown
    WARNING: Details | 
    WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
    WARNING: --------------------------------------------------------------------------------

    WARNING: --------------------------------------------------------------------------------
    WARNING: Msg | HEPMC linecode unknown
    WARNING: Details | 
    WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
    WARNING: --------------------------------------------------------------------------------

    WARNING: --------------------------------------------------------------------------------
    WARNING: Msg | HEPMC linecode unknown
    WARNING: Details | 
    WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
    WARNING: --------------------------------------------------------------------------------

    => total number of events: 1000 ( analyzed: 1000 ; skipped: 0 )
    * Finalizing all components ...
    * Total number of processed events: 1000.
    +----------------------------------------------------------------------------------------------------------------------+
    | LogReport-Warning |
    +----------------------------------------------------------------------------------------------------------------------+
    | Message NIterations @ File Line |
    |----------------------------------------------------------------------------------------------------------------------|
    | HEPMC linecode unknown 9 Reader/HEPMCReader.cpp 331 |
    +----------------------------------------------------------------------------------------------------------------------+
    * Goodbye.
    *******************************************************
   Checking SampleAnalyzer output...
   Extracting data from the output files...
   Preparing data for the reports ...
   Generating all plots ...
   Generating the HMTL report ...
     -> To open this HTML report, please type 'open'.
   Generating the PDF report ...
     -> To open this PDF report, please type 'open test/MA5_HADRON_ANALYSIS_reco_BasicReco_1/Output/PDF/MadAnalysis5job_0'.
   Generating the DVI report ...
   Well done! Elapsed time = 25.97 seconds
ma5>remove reco_events

Revision history for this message
Benjamin Fuks (fuks) said : 		#3

Hi Jun,

It seems there are some issues with the events, that cannot be read by madanalysis 5. I don't understand why.

Can you possibly generate a Pythia8 event file with 10 events and share it in some way? On the other hand, can you download v1.8.44 from launchpad and try to run MA5 externally to see whether the problem persists?

Thanks in advance!

Cheers,

Benjamin

Revision history for this message
Jun Gao (jung49) said : 		#4

Hi Benjamin,

Thank you very much for the reply! Indeed I was able to read the event file generated by Pythia8 (*.hepmc.gz) using MA5 externally with reconstruction mode (ma5 -R ...). I am not sure how the steering program in MG5 works. Could the problem occur in a stage that it tries to write the reconstructed events into .lhe file for example? Even though MG5 raises errors in previous case I can still see the reconstructed .lhe file in output directory "Output/SAF/_reco_events" rather than "Output/_reco_events".

   Best,

     Jun

Revision history for this message
Benjamin Fuks (fuks) said : 		#5

Hi
[Adding Olivier (you have nothing to do for now) and Jack in cc;]

We found the issue and will fix it asap. The structure of the MA5 output directory as changed and we forgot to teach mg5_amc about it. We will let you know when this will be solved. In the meantime, you can still use MA5 externally. This works like a charm.

Cheers,

Benjamin

> On 29 Apr 2020, at 04:43 , Jun Gao <email address hidden> wrote:
>
> Question #690163 on MadAnalysis 5 changed:
> https://answers.launchpad.net/madanalysis5/+question/690163
>
> Status: Needs information => Open
>
> Jun Gao gave more information on the question:
> Hi Benjamin,
>
> Thank you very much for the reply! Indeed I was able to read the event
> file generated by Pythia8 (*.hepmc.gz) using MA5 externally with
> reconstruction mode (ma5 -R ...). I am not sure how the steering program
> in MG5 works. Could the problem occur in a stage that it tries to write
> the reconstructed events into .lhe file for example? Even though MG5
> raises errors in previous case I can still see the reconstructed .lhe
> file in output directory "Output/SAF/_reco_events" rather than
> "Output/_reco_events".
>
> Best,
>
> Jun
>
> --
> You received this question notification because you are an answer
> contact for MadAnalysis 5.

Revision history for this message
Best Benjamin Fuks (fuks) said : 		#6

Hi Jun,

We have fixed the issue in MadAnalysis 5 Please reinstall the code as usual. In addition, you need to open the file
  madgraph/interface/common_run_interface.py
and change three lines in there. Please find the following occurrences in that file:
  pjoin(…, 'Output','_reco_events',…)
(you can look for the word 'Output' in the file). You should get three of them. You need to replace them by
  pjoin(…,'Output','SAF','_reco_events',…)
The argument 'SAF' must be added after Output.

This should fix everything. Thanks for reporting this!

Benjamin

PS: we have asked the mg5_aMC authors to push the changes in their code.

Revision history for this message
Jun Gao (jung49) said : 		#7

Thanks Benjamin Fuks, that solved my question.