HEPMC linecode unknown error

Hi,

In the meantime, we fixed a small issue relevant for the mg5_ma5 interface. Can you please retry with the version
  https://madanalysis.irmp.ucl.ac.be/raw-attachment/wiki/MA5SandBox/ma5_latest.tgz <https://madanalysis.irmp.ucl.ac.be/raw-attachment/wiki/MA5SandBox/ma5_latest.tgz>

If this does not solve the issue, could you by any chance generate a Pythia file with 10 events, so that I could try to reproduce the bug locally and fix it? Thanks in advance.

Regards,

Benjamin

> On 5 May 2020, at 15:48 , Shubhani Jain <email address hidden> wrote:
>
> New question #690469 on MadAnalysis 5:
> https://answers.launchpad.net/madanalysis5/+question/690469
>
> Hello
>
> I have been trying to do analysis on pythia8 hepmc.gz file obtained from MG5_aMC_v2_7_2 . But every time I try to do this it gives me hepmc linecode error even when using MadAnalysis externally. I have followed the previous thread with same error to remove it but the situation is still the same:
>
>
> MA5:
> MA5: *************************************************************
> MA5: * *
> MA5: * W E L C O M E to M A D A N A L Y S I S 5 *
> MA5: * ______ ______ *
> MA5: * /'\_/`\/\ __ \/\ ___\ *
> MA5: * /\ \ \ \_\ \ \ \__/ *
> MA5: * \ \ \__\ \ \ __ \ \___``\ *
> MA5: * \ \ \_/\ \ \ \/\ \/\ \_\ \ *
> MA5: * \ \_\\ \_\ \_\ \_\ \____/ *
> MA5: * \/_/ \/_/\/_/\/_/\/___/ *
> MA5: * *
> MA5: * MA5 release : 1.8.44 2020/04/17 *
> MA5: * *
> MA5: * Comput. Phys. Commun. 184 (2013) 222-256 *
> MA5: * Eur. Phys. J. C74 (2014) 3103 *
> MA5: * *
> MA5: * The MadAnalysis Development Team - Please visit us at *
> MA5: * https://launchpad.net/madanalysis5 *
> MA5: * *
> MA5: * Type 'help' for in-line help. *
> MA5: * *
> MA5: *************************************************************
> MA5: Platform: Linux 2.6.32-754.el6.x86_64 [Linux mode]
> MA5: Reading user settings ...
> MA5: Checking mandatory packages:
> MA5: - Python [OK]
> MA5: - GNU GCC g++ [OK]
> MA5: - GNU Make [OK]
> MA5: Checking optional packages devoted to data processing:
> MA5: - Zlib [OK]
> MA5: - FastJet [OK]
> MA5: - Root [OK]
> MA5: - Delphes [OK]
> MA5: - Delphes-MA5tune [DISABLED]
> MA5: Checking the MadAnalysis 5 core library:
> MA5: => MadAnalysis libraries found.
> MA5: => MadAnalysis test program works.
> MA5: Reading user settings ...
> MA5: Checking optional packages devoted to reinterpretation:
> MA5: - SciPy [OK]
> MA5: - PAD [OK]
> MA5: - PADForMA5tune [DISABLED]
> MA5: - PADForSFS [DISABLED]
> MA5: - pyhf [DISABLED]
> MA5: Checking optional packages devoted to histogramming:
> MA5: - Root [OK]
> MA5: - Matplotlib [OK]
> MA5: - gnuplot [OK]
> MA5: - pdflatex [OK]
> MA5: - latex [OK]
> MA5: Package used for graphical rendering: Root
> MA5: *************************************************************
> MA5: Particle labels exported from madanalysis/input/particles_name_default.txt
> MA5: => 87 particles successfully exported.
> MA5: Multiparticle labels exported from madanalysis/input/multiparticles_default.txt
> MA5: => Creation of the label 'invisible' (-> missing energy).
> MA5: => Creation of the label 'hadronic' (-> jet energy).
> MA5: => 8 multiparticles successfully exported.
> ma5>import /scratch/sj1n19/MG5/MG5_aMC_v2_7_2/RUN1/Events/run_01/tag_1_pythia8_events.hepmc.gz
> MA5: -> Storing the file 'tag_1_pythia8_events.hepmc.gz' in the dataset 'defaultset'.
> ma5>plot PT(mu)
> MA5-ERROR: 'mu' is not a defined (multi)particle.
> ma5>define mu=mu+ mu-
> ma5>plot PT(mu)
> ma5>import /scratch/sj1n19/MG5/MG5_aMC_v2_7_2/RUN1/Events/run_01/tag_1_pythia8_events.hepmc.gz
> MA5: -> Storing the file 'tag_1_pythia8_events.hepmc.gz' in the dataset 'defaultset'.
> ma5>submit
> MA5: Creating folder 'ANALYSIS_1'...
> MA5: Copying 'SampleAnalyzer' source files...
> MA5: Inserting your selection into 'SampleAnalyzer'...
> MA5: Writing the list of datasets...
> MA5: Writing the command line history...
> MA5: Creating Makefiles...
> MA5: Compiling 'SampleAnalyzer'...
> MA5: Linking 'SampleAnalyzer'...
> MA5: Running 'SampleAnalyzer' over dataset 'defaultset'...
> MA5: *******************************************************
> * SampleAnalyzer for MadAnalysis 5 - Welcome.
> * Initializing all components
> - version: 1.8.44 (2020/04/17)
> - general: everything is default.
> - extracting the list of event samples...
> - analyzer 'MadAnalysis5job'
> * Running over files ...
> * 1/1 /scratch/sj1n19/MG5/MG5_aMC_v2_7_2/RUN1/Events/run_01/tag_1_pythia8_events.hepmc.gz
> => file size: 882.72 Mo
> => sample format: HEPMC file produced by an unknown generator (cross section assumed in pb).
> => progress: [=> ]
> WARNING: --------------------------------------------------------------------------------
> WARNING: Msg | HEPMC linecode unknown
> WARNING: Details |
> WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
> WARNING: --------------------------------------------------------------------------------
>
> => progress: [==> ]
> WARNING: --------------------------------------------------------------------------------
> WARNING: Msg | HEPMC linecode unknown
> WARNING: Details |
> WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
> WARNING: --------------------------------------------------------------------------------
>
> => progress: [====> ]
> WARNING: --------------------------------------------------------------------------------
> WARNING: Msg | HEPMC linecode unknown
> WARNING: Details |
> WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
> WARNING: --------------------------------------------------------------------------------
>
> => progress: [======> ]
> WARNING: --------------------------------------------------------------------------------
> WARNING: Msg | HEPMC linecode unknown
> WARNING: Details |
> WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
> WARNING: --------------------------------------------------------------------------------
>
> => progress: [=======> ]
> WARNING: --------------------------------------------------------------------------------
> WARNING: Msg | HEPMC linecode unknown
> WARNING: Details |
> WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
> WARNING: --------------------------------------------------------------------------------
>
> => progress: [=========> ]
> WARNING: --------------------------------------------------------------------------------
> WARNING: Msg | HEPMC linecode unknown
> WARNING: Details |
> WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
> WARNING: --------------------------------------------------------------------------------
>
> => progress: [==========> ]
> WARNING: --------------------------------------------------------------------------------
> WARNING: Msg | HEPMC linecode unknown
> WARNING: Details |
> WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
> WARNING: --------------------------------------------------------------------------------
>
> => progress: [============> ]
> WARNING: --------------------------------------------------------------------------------
> WARNING: Msg | HEPMC linecode unknown
> WARNING: Details |
> WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
> WARNING: --------------------------------------------------------------------------------
>
> => progress: [=============> ]
> WARNING: --------------------------------------------------------------------------------
> WARNING: Msg | HEPMC linecode unknown
> WARNING: Details |
> WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
> WARNING: --------------------------------------------------------------------------------
>
> => progress: [===============> ]
> WARNING: --------------------------------------------------------------------------------
> WARNING: Msg | HEPMC linecode unknown
> WARNING: Details |
> WARNING: Where | Function = FillEvent ; File=Reader/HEPMCReader.cpp ; Line=331
> WARNING: --------------------------------------------------------------------------------
>
> => progress: [===================================]
> => total number of events: 10000 ( analyzed: 10000 ; skipped: 0 )
> * Finalizing all components ...
> * Total number of processed events: 10000.
> +----------------------------------------------------------------------------------------------------------------------+
> | LogReport-Warning |
> +----------------------------------------------------------------------------------------------------------------------+
> | Message NIterations @ File Line |
> |----------------------------------------------------------------------------------------------------------------------|
> | HEPMC linecode unknown 15 Reader/HEPMCReader.cpp 331 |
> +----------------------------------------------------------------------------------------------------------------------+
> * Goodbye.
> MA5: *******************************************************
> MA5: Checking SampleAnalyzer output...
> MA5: Extracting data from the output files...
> MA5: Preparing data for the reports ...
> MA5: Generating all plots ...
> MA5: Generating the HMTL report ...
> MA5: -> To open this HTML report, please type 'open'.
> MA5: Generating the PDF report ...
> MA5: -> To open this PDF report, please type 'open ANALYSIS_1/Output/PDF/MadAnalysis5job_0'.
> MA5: Generating the DVI report ...
> MA5: Well done! Elapsed time = 3 minutes 38 seconds
>
> I have also added 'SAF' in my common_interface file as well.
> Is there any solution for it?
>
> Regards
> Shubhani
>
> --
> You received this question notification because you are an answer
> contact for MadAnalysis 5.

Hi Benjamin

Yes , I can try this.

Thanks
Regards
Shubhani

Hi Benjamin

The problem still there. I have generated Pythia8 file with 10 events:
The path of the file is

/scratch/sj1n19/MG5/MG5_aMC_v2_7_2/RUN1/Events/run_01/tag_1_pythia8_events.hepmc.gz

Thanks
Shubhani

Hi Benjamin

Sorry for keep spamming. But this might be a valuable information to you. For 10 events it works fine but as you increase the events to 1000 and 10000 it again gives you same error. So it might be its not handling the no of events very well?

Path for 1000 events:
/scratch/sj1n19/MG5/MG5_aMC_v2_7_2/RUN2/Events/run_01/tag_1_pythia8_events.hepmc.gz

Regards
Shubhani

Hi Shubhani,

How could I access your local scratch space?

Cheers,

Benjamin

Hi Benjamin

Can I email you my files?

Regards
Shubhani

Hi Shubhani,

No; those are too heavy for my mail client. Please put them instead on some shared space (dropbox, google drive, cernbox, etc.).

Cheers,

Benjamin

> On 11 May 2020, at 12:38 , Shubhani Jain <email address hidden> wrote:
>
> Question #690469 on MadAnalysis 5 changed:
> https://answers.launchpad.net/madanalysis5/+question/690469
>
> Shubhani Jain posted a new comment:
> Hi Benjamin
>
> Can I email you my files?
>
> Regards
> Shubhani
>
> --
> You received this question notification because you are an answer
> contact for MadAnalysis 5.

Hi

For 10 events:
https://www.dropbox.com/sh/wq6zz5nqd8l9o7m/AACxyX3xMXtuSjU5QBYPprv6a?dl=0
https://www.dropbox.com/sh/jagor6vtm3vfdf5/AACrRaoZe4rM9HP1l1iXIfZIa?dl=0

For 1000 events:
https://www.dropbox.com/sh/jagor6vtm3vfdf5/AACrRaoZe4rM9HP1l1iXIfZIa?dl=0
https://www.dropbox.com/sh/jagor6vtm3vfdf5/AACrRaoZe4rM9HP1l1iXIfZIa?dl=0

Regards
Shubhani

Hi Shubhani,

I do not have access to the files anymore. Do you mind updating the links?

Cheers,

Benjamin

> On 11 May 2020, at 13:23 , Shubhani Jain <email address hidden> wrote:
>
> Question #690469 on MadAnalysis 5 changed:
> https://answers.launchpad.net/madanalysis5/+question/690469
>
> Shubhani Jain posted a new comment:
> Hi
>
>
> For 10 events:
> https://www.dropbox.com/sh/wq6zz5nqd8l9o7m/AACxyX3xMXtuSjU5QBYPprv6a?dl=0
> https://www.dropbox.com/sh/jagor6vtm3vfdf5/AACrRaoZe4rM9HP1l1iXIfZIa?dl=0
>
> For 1000 events:
> https://www.dropbox.com/sh/jagor6vtm3vfdf5/AACrRaoZe4rM9HP1l1iXIfZIa?dl=0
> https://www.dropbox.com/sh/jagor6vtm3vfdf5/AACrRaoZe4rM9HP1l1iXIfZIa?dl=0
>
> Regards
> Shubhani
>
> --
> You received this question notification because you are an answer
> contact for MadAnalysis 5.

Hi Benjamin

These are the new links for the files:

https://www.dropbox.com/sh/vgiunsob814f4hg/AAB0ociZA0qH27sx_DXWulNFa?dl=0
https://www.dropbox.com/sh/asvw0v02zj8a6u4/AADH1O8mxnxDTge9JK7qkddza?dl=0

Regards
Shubhani

Hi Shubhani,

The reason of the warning is that the second hepmc file is faulty. The line
```HepMC::IO_GenEvent-START_EVENT_LISTING```
appears many times. However, it should only appears once at the beginning of the file (and always come with an associated closing tag). If you remove this by hand, everything is fine.

Cheers,

Benjamin

Thanks Benjamin. Is there a permanent fix to this problem because I am generating 100 k events file and going through it would be a lot work?

Regards
Shubhani

Hi Shubhani,

I don't understand the request. Why should I fix anything in MadAnalysis 5, as the problem is related to the events you generated (and not to MadAnalysis 5). The events are not compliant with the hepmc format. Accordingly, MadAnalysis 5 generates an error.

Cheers,

Benjamin

> On 2 Jun 2020, at 12:20 , Shubhani Jain <email address hidden> wrote:
>
> Question #690469 on MadAnalysis 5 changed:
> https://answers.launchpad.net/madanalysis5/+question/690469
>
> Shubhani Jain posted a new comment:
> Thanks Benjamin. Is there a permanent fix to this problem because I am
> generating 100 k events file and going through it would be a lot work?
>
> Regards
> Shubhani
>
> --
> You received this question notification because you are an answer
> contact for MadAnalysis 5.

Hi

Sorry about the confusion, what I meant was that do you know something as to how to permanently solve the problem so that hepmc file is produced without this error so that I don't have to fix this everytime. Not to do anything with Madanalysis at all.

Regards
Shubhani

Hi

Sorry about the confusion, what I meant was that do you know something as to how to permanently solve the problem so that hepmc file is produced without this error so that I don't have to fix this everytime. Not to do anything with Madanalysis at all.

Regards
Shubhani

Hi,

I have no idea about how you generated your event sample, so I cannot help you here. You should ask to the people maintaining the software you used.

Regards,

Benjamin

> On 2 Jun 2020, at 12:55 , Shubhani Jain <email address hidden> wrote:
>
> Question #690469 on MadAnalysis 5 changed:
> https://answers.launchpad.net/madanalysis5/+question/690469
>
> Shubhani Jain posted a new comment:
> Hi
>
> Sorry about the confusion, what I meant was that do you know something
> as to how to permanently solve the problem so that hepmc file is
> produced without this error so that I don't have to fix this everytime.
> Not to do anything with Madanalysis at all.
>
> Regards
> Shubhani
>
> --
> You received this question notification because you are an answer
> contact for MadAnalysis 5.

Hi

Okay, thanks I will ask Madgraph team about it.

Thanks
Shubhani