Member Site › Forums › Rosetta 3 › Rosetta 3 – Build/Install › Is there a setup script to automate the process of installing and testing rosetta on a cloud server ?
- This topic has 5 replies, 3 voices, and was last updated 5 years, 1 month ago by
Anonymous.
-
AuthorPosts
-
-
April 4, 2018 at 6:51 pm #2885
Anonymous
Also – is Ubuntu 16 LTS the best choice for running rosetta in the cloud ?
-
April 6, 2018 at 1:45 pm #14174
If you are interacting with your cloud server as a VM, then it behaves the same as any other machine, so setting up Rosetta is basically the same as doing it locally.
If you are interacting with your cloud server via a local gcloud command line tool (or whatever the AWS equivalent is, or whatever cloud you are using) – Commons does not have official support for it.
There have been a few half-completed attempts to create Rosetta docker containers for cloud use, but as RosettaCommons runs almost entirely on academic server resources and Rosetta@HOME, neither of which are “cloud” nor use containers, there’s not been much interest. (Based on your location perhaps you already know this?)
From experience, Ubuntu 16 is a perfectly reasonable choice for the purpose. centos will work well too.
-
April 7, 2018 at 6:22 am #14175
Cool – thanks for the input. I was curious about docker containers and you’re answer makes sense. I ended up writing a bash script – here is my draft ( any feedback would be apreciated)
Yes – using gcloud
#!/bin/bash
# Update system and fetch basic build tools
sudo apt-get update
sudo apt-get --assume-yes upgrade
sudo apt-get --assume-yes install build-essential
sudo apt-get --assume-yes install lib32z1-dev
#sudo apt-get --assume-yes install openmpi openmpi-dev
# better choice
sudo apt-get --assume-yes install libopenmpi-dev
sudo apt-get --assume-yes install zlib1g-dev
#sudo apt-get --assume-yes install openmpi-bin libop
#sudo apt-get --assume-yes install libsqlite3-dev
#sudo apt-get --assume-yes install zlib1g-dev libncurses5-dev
sudo apt-get --assume-yes install htop
# SSH for transfer of files to local mac
sudo apt-get install ssh
# From Linux to Mac (run from the Linux machine):
# scp filename.txt user@remote_server:/Users/YOURNAME/
# From Linux to Mac (run from the Mac):
# scp user@remote_server:/Users/YOURNAME/filename.txt .
# Download and extract latest rosetta version (3.9 released 4/2/18)
curl -o a.tar.gz -u Academic_User:****** https://www.rosettacommons.org/downloads/academic/3.9/rosetta_src_3.9_bundle.tgz
tar -xvzf a.tar.gz
cd rosetta_src_2018.09.60072_bundle/main/source
./scons.py -j 96 mode=release bin
#./scons.py -j 96 mode=release cat=test
# Run rosetta unit tests
# Need to pass options to tell rosetta which mode
## --mode=MODE [ 'mode' (eg. debug, release) to pass to scons to identify the platform path.]
##python test/run.py -j 96 --mode=release
# to do
# note bechmarks for compilation times and testing time
-
April 7, 2018 at 1:58 pm #14176
That is definitely a good script for “install Rosetta on a local machine”, which will work for a cloud machine you have logged into. We never had it as a script per se; we kept the package list on a lab wiki.
sudo apt-get –assume-yes install lib32z1-dev
That’s unlikely to be necessary.
I guess python was already installed if scons worked. I guess SSH was already there if you logged in. You should probably install a text editor of your choice.
-
-
October 25, 2019 at 10:24 am #15027
I have just spent nearly an hour trying to do exactly this…
The command `curl -o a.tar.gz -u Academic_User:**** https://www.rosettacommons.org/downloads/academic/3.11/rosetta_bin_linux_3.11_bundle.tgz` features the same path as the site that gives the Basic auth login page, but is different from that found on the site in the downloads, which is `https://www.rosettacommons.org/download.php?token=xxxxx&file=rosetta_bin_linux_3.11_bundle.tgz ` the latter does not do Basic auth like the /downloads route does but requires its cookies (the token is common to all sessions), but did not like my cookies with wget and Python requests was not doing well with streamed tar.gzip files .
I only found this thread because I Googled “Academic_User Rosetta” (the common username is not secret?). Therefore, I am commenting here to say a few keywords so hopefully searches work better:
“How to /tutorial / guide / instructions on downloading and installing rosetta on a remote cloud cluster / supercomputer / docker container with SSH by means of headless authentication without a browser using licence / license credentials using the command line / bash / terminal”
-
October 25, 2019 at 10:27 am #15028
I have just spent nearly an hour trying to do exactly this…
The command `curl -o a.tar.gz -u Academic_User:**** https://www.rosettacommons.org/downloads/academic/3.11/rosetta_bin_linux_3.11_bundle.tgz` features the same path as the site that gives the Basic auth login page, but is different from that found on the site in the downloads, which is `https://www.rosettacommons.org/download.php?token=xxxxx&file=rosetta_bin_linux_3.11_bundle.tgz ` the latter does not do Basic auth like the /downloads route does but requires its cookies (the token is common to all sessions), but did not like my cookies with wget and Python requests was not doing well with streamed tar.gzip files .
I only found this thread because I Googled “Academic_User Rosetta” (the common username is not secret?). Therefore, I am commenting here to say a few keywords so hopefully searches work better:
“How to /tutorial / guide / instructions on downloading and installing rosetta on a remote cloud cluster / supercomputer / docker container with SSH by means of headless authentication without a browser using licence / license credentials using the command line / bash / terminal”
-
-
AuthorPosts
- You must be logged in to reply to this topic.