Central instalation of madanalysis5

Dear Goncalo,

Could you please send me a copy of the log files with the errors?

Regards,

Benjamin

Hi Benjamin...
Thank you for getting back.
The first error I am getting is the following:
1./ For test purposes, I am installing madanalysis5 in /tmp as root (the idea is that it goes after to a NFS server).
$ ll /tmp/sw/sl6/gcc481/python274/x86_64/madanalysis5/total 68drwxr-xr-x  2 root root  4096 May 26 06:37 bin-rw-r--r--  1 root root 35147 May 26 06:13 COPYINGdrwxr-xr-x 17 root root  4096 May 26 06:22 madanalysis-rw-r--r--  1 root root 13703 May 26 06:13 READMEdrwxr-xr-x  5 root root  4096 May 26 06:15 tools-rw-r--r--  1 root root    85 May 26 06:13 version.txt
--- * ---
 2./ If I run it as root, everything seems OK (at least I get the ma5 prompt):
# /tmp/sw/sl6/gcc481/python274/x86_64/madanalysis5/bin/ma5

**************************************************************                                                           **        W E L C O M E  to  M A D A N A L Y S I S  5        **                         ______  ______                    **                 /'\_/`\/\  __ \/\  ___\                   **                /\      \ \ \_\ \ \ \__/                   **                \ \ \__\ \ \  __ \ \___``\                 **                 \ \ \_/\ \ \ \/\ \/\ \_\ \                **                  \ \_\\ \_\ \_\ \_\ \____/                **                   \/_/ \/_/\/_/\/_/\/___/                 **                                                           **   MA5 release : 1.1.11                       2014/09/15   **                                                           **         Comput. Phys. Commun. 184 (2013) 222-256          **           J. Phys. Conf. Ser. 123 (2014) 012032           **                  arXiv:1405.3982 [hep-ph]                 **                                                           **   The MadAnalysis Development Team - Please visit us at   **            https://launchpad.net/madanalysis5             **                                                           **              Type 'help' for in-line help.                **                                                           **************************************************************Platform: Linux 2.6.32-504.16.2.el6.x86_64 [Linux mode]Reading user settings ...Checking mandatory packages:     - python                   [OK]     - python library: numpy    [OK]     - g++                      [OK]     - GNU Make                 [OK]     - Root                     [OK]     - PyRoot libraries         [OK]Checking optional packages:     - pdflatex                 [OK]     - latex                    [OK]     - dvipdf                   [OK]     - zlib                     [OK]     - FastJet                  [DISABLED] ** WARNING: The FastJet is package not found. ** WARNING: JetClustering algorithms will be disabled. ** WARNING: To enable this functionnality, please type 'install fastjet'.     - Delphes                  [DISABLED] ** WARNING: Header file called '/modules/ParticlePropagator.h' not found. ** WARNING: Delphes ROOT format will be disabled. ** WARNING: To enable this format, please type 'install delphes'.     - Delphes-MA5tune          [DISABLED] ** WARNING: DelphesMA5tune folder not found. ** WARNING: Delphes-MA5tune ROOT format will be disabled. ** WARNING: To enable this format, please type 'install delphesMA5tune'.     - Recasting tools          [DISABLED] ** WARNING: Recasting tools are not found and will be disabled. ** WARNING: To enable this functionnality, please type 'install RecastingTools'.Checking the MadAnalysis library:  => MadAnalysis libraries found.  => MadAnalysis test program works.*************************************************************MadGraph 5 NOT found:  => Particle labels from input/particles_name_default.txt  => 87 particles successfully exported.  => Multiparticle labels from madanalysis/input/multiparticles_default.txt  => Creation of the label 'invisible' (-> missing energy).  => Creation of the label 'hadronic' (-> jet energy).  => 8 multiparticles successfully exported.ma5>
--- *  ---
3./ If I run it as a normal user, diferent from the one which did the initial installation and compilation, I get
$ /tmp/sw/sl6/gcc481/python274/x86_64/madanalysis5/bin/ma5/tmp/sw/sl6/gcc481/python274/x86_64/madanalysis5
**************************************************************                                                           **        W E L C O M E  to  M A D A N A L Y S I S  5        **                         ______  ______                    **                 /'\_/`\/\  __ \/\  ___\                   **                /\      \ \ \_\ \ \ \__/                   **                \ \ \__\ \ \  __ \ \___``\                 **                 \ \ \_/\ \ \ \/\ \/\ \_\ \                **                  \ \_\\ \_\ \_\ \_\ \____/                **                   \/_/ \/_/\/_/\/_/\/___/                 **                                                           **   MA5 release : 1.1.11                       2014/09/15   **                                                           **         Comput. Phys. Commun. 184 (2013) 222-256          **           J. Phys. Conf. Ser. 123 (2014) 012032           **                  arXiv:1405.3982 [hep-ph]                 **                                                           **   The MadAnalysis Development Team - Please visit us at   **            https://launchpad.net/madanalysis5             **                                                           **              Type 'help' for in-line help.                **                                                           **************************************************************Platform: Linux 2.6.32-504.16.2.el6.x86_64 [Linux mode]Reading user settings ...Checking mandatory packages:     - python                   [OK]     - python library: numpy    [OK]     - g++                      [OK]     - GNU Make                 [OK]     - Root                     [OK]     - PyRoot libraries         [OK]Checking optional packages:     - pdflatex                 [OK]     - latex                    [OK]     - dvipdf                   [OK]     - zlib                     [OK]     - FastJet                  [DISABLED] ** WARNING: The FastJet is package not found. ** WARNING: JetClustering algorithms will be disabled. ** WARNING: To enable this functionnality, please type 'install fastjet'.     - Delphes                  [DISABLED] ** WARNING: Header file called '/modules/ParticlePropagator.h' not found. ** WARNING: Delphes ROOT format will be disabled. ** WARNING: To enable this format, please type 'install delphes'.     - Delphes-MA5tune          [DISABLED] ** WARNING: DelphesMA5tune folder not found. ** WARNING: Delphes-MA5tune ROOT format will be disabled. ** WARNING: To enable this format, please type 'install delphesMA5tune'.     - Recasting tools          [DISABLED] ** WARNING: Recasting tools are not found and will be disabled. ** WARNING: To enable this functionnality, please type 'install RecastingTools'.Checking the MadAnalysis library:  => MadAnalysis libraries found.  => System configuration has changed since the last use. Need to rebuild the library. ** ERROR: impossible to write the configuration file '/tmp/sw/sl6/gcc481/python274/x86_64/madanalysis5/tools/architecture.ma5'
--- * ---
So, as you can see, it detects that something is different and tries to rebuild the library. However, it can't because it does not has write access to the installation directory (which is the good behaviour since in a central instalation we just provide read access to all users, not write access).
CheersGoncalo

     On Tuesday, May 26, 2015 5:26 PM, Benjamin Fuks <email address hidden> wrote:

 Your question #267373 on MadAnalysis 5 changed:
https://answers.launchpad.net/madanalysis5/+question/267373

    Status: Open => Needs information

Benjamin Fuks requested more information:
Dear Goncalo,

Could you please send me a copy of the log files with the errors?

Regards,

Benjamin

--
To answer this request for more information, you can either reply to
this email or enter your reply at the following page:
https://answers.launchpad.net/madanalysis5/+question/267373

You received this question notification because you asked the question.

Hi Goncalo,

Could you please try to run the code in DEBUG mode and check the differences at the level of the system configuration by comparing the screen output?

Cheers,

Benjamin

On 27 May 2015, at 08:31 , Goncalo <email address hidden> wrote:

> Question #267373 on MadAnalysis 5 changed:
> https://answers.launchpad.net/madanalysis5/+question/267373
>
> Status: Needs information => Open
>
> Goncalo gave more information on the question:
> Hi Benjamin...
> Thank you for getting back.
> The first error I am getting is the following:
> 1./ For test purposes, I am installing madanalysis5 in /tmp as root (the idea is that it goes after to a NFS server).
> $ ll /tmp/sw/sl6/gcc481/python274/x86_64/madanalysis5/total 68drwxr-xr-x 2 root root 4096 May 26 06:37 bin-rw-r--r-- 1 root root 35147 May 26 06:13 COPYINGdrwxr-xr-x 17 root root 4096 May 26 06:22 madanalysis-rw-r--r-- 1 root root 13703 May 26 06:13 READMEdrwxr-xr-x 5 root root 4096 May 26 06:15 tools-rw-r--r-- 1 root root 85 May 26 06:13 version.txt
> --- * ---
> 2./ If I run it as root, everything seems OK (at least I get the ma5 prompt):
> # /tmp/sw/sl6/gcc481/python274/x86_64/madanalysis5/bin/ma5
>
> ************************************************************** ** W E L C O M E to M A D A N A L Y S I S 5 ** ______ ______ ** /'\_/`\/\ __ \/\ ___\ ** /\ \ \ \_\ \ \ \__/ ** \ \ \__\ \ \ __ \ \___``\ ** \ \ \_/\ \ \ \/\ \/\ \_\ \ ** \ \_\\ \_\ \_\ \_\ \____/ ** \/_/ \/_/\/_/\/_/\/___/ ** ** MA5 release : 1.1.11 2014/09/15 ** ** Comput. Phys. Commun. 184 (2013) 222-256 ** J. Phys. Conf. Ser. 123 (2014) 012032 ** arXiv:1405.3982 [hep-ph] ** ** The MadAnalysis Development Team - Please visit us at ** https://launchpad.net/madanalysis5 ** ** Type 'help' for in-line help. ** **************************************************************Platform: Linux 2.6.32-504.16.2.el6.x86_64 [Linux mode]Reading user settings ...Checking mandatory packages: - python [OK] - python library: numpy [OK] - g++ [OK] - GNU Make [OK] - Root [OK] - PyRoot libraries [OK]Checking optional packages: - pdflatex [OK] - latex [OK] - dvipdf [OK] - zlib [OK] - FastJet [DISABLED] ** WARNING: The FastJet is package not found. ** WARNING: JetClustering algorithms will be disabled. ** WARNING: To enable this functionnality, please type 'install fastjet'. - Delphes [DISABLED] ** WARNING: Header file called '/modules/ParticlePropagator.h' not found. ** WARNING: Delphes ROOT format will be disabled. ** WARNING: To enable this format, please type 'install delphes'. - Delphes-MA5tune [DISABLED] ** WARNING: DelphesMA5tune folder not found. ** WARNING: Delphes-MA5tune ROOT format will be disabled. ** WARNING: To enable this format, please type 'install delphesMA5tune'. - Recasting tools [DISABLED] ** WARNING: Recasting tools are not found and will be disabled. ** WARNING: To enable this functionnality, please type 'install RecastingTools'.Checking the MadAnalysis library: => MadAnalysis libraries found. => MadAnalysis test program works.*************************************************************MadGraph 5 NOT found: => Particle labels from input/particles_name_default.txt => 87 particles successfully exported. => Multiparticle labels from madanalysis/input/multiparticles_default.txt => Creation of the label 'invisible' (-> missing energy). => Creation of the label 'hadronic' (-> jet energy). => 8 multiparticles successfully exported.ma5>
> --- * ---
> 3./ If I run it as a normal user, diferent from the one which did the initial installation and compilation, I get
> $ /tmp/sw/sl6/gcc481/python274/x86_64/madanalysis5/bin/ma5/tmp/sw/sl6/gcc481/python274/x86_64/madanalysis5
> ************************************************************** ** W E L C O M E to M A D A N A L Y S I S 5 ** ______ ______ ** /'\_/`\/\ __ \/\ ___\ ** /\ \ \ \_\ \ \ \__/ ** \ \ \__\ \ \ __ \ \___``\ ** \ \ \_/\ \ \ \/\ \/\ \_\ \ ** \ \_\\ \_\ \_\ \_\ \____/ ** \/_/ \/_/\/_/\/_/\/___/ ** ** MA5 release : 1.1.11 2014/09/15 ** ** Comput. Phys. Commun. 184 (2013) 222-256 ** J. Phys. Conf. Ser. 123 (2014) 012032 ** arXiv:1405.3982 [hep-ph] ** ** The MadAnalysis Development Team - Please visit us at ** https://launchpad.net/madanalysis5 ** ** Type 'help' for in-line help. ** **************************************************************Platform: Linux 2.6.32-504.16.2.el6.x86_64 [Linux mode]Reading user settings ...Checking mandatory packages: - python [OK] - python library: numpy [OK] - g++ [OK] - GNU Make [OK] - Root [OK] - PyRoot libraries [OK]Checking optional packages: - pdflatex [OK] - latex [OK] - dvipdf [OK] - zlib [OK] - FastJet [DISABLED] ** WARNING: The FastJet is package not found. ** WARNING: JetClustering algorithms will be disabled. ** WARNING: To enable this functionnality, please type 'install fastjet'. - Delphes [DISABLED] ** WARNING: Header file called '/modules/ParticlePropagator.h' not found. ** WARNING: Delphes ROOT format will be disabled. ** WARNING: To enable this format, please type 'install delphes'. - Delphes-MA5tune [DISABLED] ** WARNING: DelphesMA5tune folder not found. ** WARNING: Delphes-MA5tune ROOT format will be disabled. ** WARNING: To enable this format, please type 'install delphesMA5tune'. - Recasting tools [DISABLED] ** WARNING: Recasting tools are not found and will be disabled. ** WARNING: To enable this functionnality, please type 'install RecastingTools'.Checking the MadAnalysis library: => MadAnalysis libraries found. => System configuration has changed since the last use. Need to rebuild the library. ** ERROR: impossible to write the configuration file '/tmp/sw/sl6/gcc481/python274/x86_64/madanalysis5/tools/architecture.ma5'
> --- * ---
> So, as you can see, it detects that something is different and tries to rebuild the library. However, it can't because it does not has write access to the installation directory (which is the good behaviour since in a central instalation we just provide read access to all users, not write access).
> CheersGoncalo
>
>
> On Tuesday, May 26, 2015 5:26 PM, Benjamin Fuks <email address hidden> wrote:
>
>
> Your question #267373 on MadAnalysis 5 changed:
> https://answers.launchpad.net/madanalysis5/+question/267373
>
> Status: Open => Needs information
>
> Benjamin Fuks requested more information:
> Dear Goncalo,
>
> Could you please send me a copy of the log files with the errors?
>
> Regards,
>
> Benjamin
>
> --
> To answer this request for more information, you can either reply to
> this email or enter your reply at the following page:
> https://answers.launchpad.net/madanalysis5/+question/267373
>
> You received this question notification because you asked the question.
>
> You received this question notification because you are an answer
> contact for MadAnalysis 5.

Hi Benjamin...
In attachment I am sending the result of the two executions in debug. The result of a diff is also included. However, the debug execution does not help since it does not provide any further information why madanalysis5 thinks that the system configuration changed just because it is being invoked by other user.
I've looked into the code, and in madanalysis5/madanalysis/core/main.py there is the following check
    def BuildLibrary(self,forced=False):        builder = LibraryBuilder(self.archi_info)        UpdateNeed=False        FirstUse, Missing = builder.checkMA5()        if not FirstUse and not Missing:            UpdateNeed = not builder.compare()
        rebuild = forced or FirstUse or UpdateNeed or Missing        (...)
builder is an instance of the  LibraryBuilder class which is defined in madanalysis5/madanalysis/core/library_builder.py, and has a compare method. From what I have understood from the code, madanalysis tries to gather information about the system where it is running, and compares it is with the information stored in madanalysis5/tools/architecture.ma5. If it is different, than the UpdateNeed variables becomes true, and it tries to recompile and regenerate the  madanalysis5/tools/architecture.ma5 file. However, the debug information, which dumps the content of madanalysis5/tools/architecture.ma5 file does not show any difference. So, I do not know exactly what it is causing the issue.
CheersG.

I found the (1st?) issue but I do not have a clear way to solve it.
When I am running as a different user than the one which initially installed and compiled the core, madanalysis5 will try to recompile because of the following piece of code in madanalysis5/madanalysis/core/main.py
           precompiler = LibraryWriter('lib',self)            if not precompiler.Run('TestSampleAnalyzer',[],self.archi_info.ma5dir+'/tools/SampleAnalyzer/Bin/',silent=True):                UpdateNeed=True
It seems that the condition is triggered because the normal user can not write to madanalysis5/tools/SampleAnalyzer/Bin/TestSampleAnalyzer.log.
If in my test environment I give world write permission to this file, the normal user can start madanalysis, running it from a central point. Obviously, in a production environment, we do not want to do this. I also wonder if this is just the first catch and if there are other similar things which come up afterwards/
So, it seems to me that madanalysis is simple not prepared to run through centralized installation.
Can you comment on that? Do you have other suggestions?
CheersGoncalo

     On Wednesday, May 27, 2015 11:31 AM, Goncalo <email address hidden> wrote:

 Your question #267373 on MadAnalysis 5 changed:
https://answers.launchpad.net/madanalysis5/+question/267373

    Status: Answered => Open

You are still having a problem:
Hi Benjamin...
In attachment I am sending the result of the two executions in debug. The result of a diff is also included. However, the debug execution does not help since it does not provide any further information why madanalysis5 thinks that the system configuration changed just because it is being invoked by other user.
I've looked into the code, and in madanalysis5/madanalysis/core/main.py there is the following check
    def BuildLibrary(self,forced=False):        builder = LibraryBuilder(self.archi_info)        UpdateNeed=False        FirstUse, Missing = builder.checkMA5()        if not FirstUse and not Missing:            UpdateNeed = not builder.compare()
        rebuild = forced or FirstUse or UpdateNeed or Missing        (...)
builder is an instance of the  LibraryBuilder class which is defined in madanalysis5/madanalysis/core/library_builder.py, and has a compare method. From what I have understood from the code, madanalysis tries to gather information about the system where it is running, and compares it is with the information stored in madanalysis5/tools/architecture.ma5. If it is different, than the UpdateNeed variables becomes true, and it tries to recompile and regenerate the  madanalysis5/tools/architecture.ma5 file. However, the debug information, which dumps the content of madanalysis5/tools/architecture.ma5 file does not show any difference. So, I do not know exactly what it is causing the issue.
CheersG.

--
You received this question notification because you asked the question.

Hi Goncalo,

> So, it seems to me that madanalysis is simple not prepared to run through centralized installation.
That's true. We have never considered having a shared copy of the program between various users. Maybe could you just comment in the code the tests of the architecture. This should be enough for having the program running properly.

Cheers,

Benjamin