Installing Yade from source code on AWS

Did you try "yade AWS" in your search engine? ;)
B

Hi Bruno,

What search engine? google, YADE Documentation or AWS itself? I know it is possible to install yade daily on AWS (EC2) but don't know if it is possible to install yade from source code on it or not. As you know AWS might not free for many hours of simulations (limited hours are free for the first year) and that is why I need to ensure that I'll be able to install from source code before activating my account there. What I have found so far is https://yade-dem.org/doc/amazonEC2.html which mainly explains about installing yadedaily. I need to know if anyone has installed YADE from source code (I mean new contact models,....)on AWS (EC2).

Thanks sincerely

NG

Oh, sorry, I thought you did not find https://yade-dem.org/doc/amazonEC2.html
Nevertheless, looking at that page suggests that you can do on AWS nearly everything as if you were on a ubuntu desktop (with admin rights).
I don't expect special problems to compile yade then, but I don't know if anyone tried before.
Bruno

Thanks Bruno,

I have tried a lot to install YADE on some fast computing cloud systems before but no success. I now have to run large simulations (number of particles might exceed 1000000) and even though I have a super fast workstation, I am sure this needs too much power.

Thanks so much,

NG

Well, we can help if you have specific compilation problems. "No success" is not that kind. :)
B

Hi Nima
I'm working on HPC now, and I found the performance will not be increased significantly.
>>number of particles might exceed 1000000
not sure this will ok. Cause I'm running about 20k-particle simulations, the perfromance will be the best at -j 8. More cores will only slow down the simulation. not sure about the 100k simulation, may be esys-particle software is a option?

for compilation problem you can post new questions and we might konw the solution...

Sorry that is 200k and 1000k particles

1e6 particles is not a problem. It may take time of course, but it will run. And it will probably benefit from 20+ cores.
B

Hi JIPEIQI

Thanks for your advice.
1- Have you installed yade from source code or just installed yade-daily as explained in documentation?

2-sorry I didn't get this" may be esys-particle software is a option?"

Regards,

Nima

Hi Bruno,

I installed yadedaily successfully and run a simulation (although the instance I use is a free one[t2.micro] and my own computer is much faster than it- I tried to deposit a large number of polyhedra in a box with an small dt). I was not lucky in installing form source code. At the first step I am not able to install packages required and as you know without this packages there won't be a chance for installing from source code. When I try to install packages using

sudo apt-get install cmake git freeglut3-dev libloki-dev \
libboost-all-dev fakeroot dpkg-dev build-essential g++ \
python-dev ipython python-matplotlib libsqlite3-dev python-numpy python-tk gnuplot \
libgts-dev python-pygraphviz libvtk6-dev python-numpy libeigen3-dev \
python-xlib python-pyqt5 pyqt5-dev-tools python-pyqt5.qtwebkit gtk2-engines-pixbuf python-argparse python-pyqt5.qtsvg \
libqglviewer-dev python-imaging libjs-jquery python-sphinx python-git python-bibtex \
libxmu-dev libxi-dev libcgal-dev help2man libbz2-dev zlib1g-dev python-minieigen

As what I do for my own computer. The error issued is: E: Unable to locate package xxx
Is there any advise for installing required packages on Ubuntu server 16.04 LTS AMI in aws???
I plan to transfer required folders (I mean trunk,install and bin) to the remote computer (server) using FileZila and try to install from source code like we do on local computers after installing packages.

Thanks so much

Nima

Hi， I installed yade from source

Hi JIPEIQI,

Thanks for the reply. I need your help for installing from source.
Do you by chance have the steps for installation?? I tried to to
install the packages but as I explained for Bruno, it was not successful.
I also need to know which instance do you use. I currently
use t2.micro (free one) but this is even slower than my
own computer

Thanks so much for your help

Hi Nima, I'm not using AWS. Which OS did you use in the AWS? In my opinion, if you can choose the OS in AWS, ubuntu may be better as yade can be easily installed on it.

I also want to konw if you root premissions. Cause if you don't, things will be a little difficult.

>>Do you by chance have the steps for installation??
I have to say [1] is the best instruction. You have to install nearly all of them first. I encountered plenty of problems but many of them are relevent to cmake commands. Learn sth about cmake will denefintely help you. And if your OS happens to be centos6, I can give you my versions of these prerequisites, cause their versions matter.

>>I currently use t2.micro (free one) but this is even slower than my own computer
That may depend on the CPUs?

[1]https://yade-dem.org/doc/installation.html#prerequisites

I am not sure how I missed this thread...my apologies.

Anyways, as Bruno says, you can treat AWS terminal as your own terminal...so go ahead and compile yade the same way as shown on the install page. Here was my script for sources on an Ubuntu 16.04 EC2 instance:

sudo add-apt-repository ppa:yade-users/external
sudo apt-get update

sudo apt-get -y install cmake git freeglut3-dev libloki-dev \
libboost-all-dev fakeroot dpkg-dev build-essential g++ \
python-dev ipython python-matplotlib libsqlite3-dev python-numpy python-tk gnuplot \
libgts-dev python-pygraphviz libvtk6-dev python-numpy libeigen3-dev \
python-xlib python-pyqt5 pyqt5-dev-tools python-pyqt5.qtwebkit gtk2-engines-pixbuf python-argparse \
libqglviewer-dev python-imaging libjs-jquery python-sphinx python-git python-bibtex \
libxmu-dev libxi-dev libcgal-dev help2man libbz2-dev zlib1g-dev python-minieigen \
libopenblas-dev libsuitesparse-dev libmetis-dev

sudo mkdir /usr/local/lib/myYade
cd /usr/local/lib/myYade/
sudo mkdir install build
sudo git clone https://github.com/yade/trunk.git
sudo apt-get update

cd build
sudo cmake -DCMAKE_INSTALL_PREFIX=../install ../trunk -DNOSUFFIX=ON
sudo make -jX install

# add an alias to .bashrc
sudo bash -c 'echo "alias yadeSrc='/usr/local/lib/myYade/install/bin/yade'" >> /home/ubuntu/.bashrc'
sudo bash -c 'echo "alias yadeSrc-batch='/usr/local/lib/myYade/install/bin/yade-batch'" >> /home/ubuntu/.bashrc'
source ~/.bashrc

# set the gnuplot terminal to 'dumb'
sudo bash -c 'echo "set terminal dumb" >> /usr/share/gnuplot5/gnuplot/5.0/gnuplotrc'