E4S-Project.github.io

Container installation recipes

Docker

To use the Docker image, please install docker and download the ecp.xz (or .tgz) file from the download page:

# wget http://tau.uoregon.edu/ecp.xz
# unxz -c ecp.xz | docker load

OR

# wget http://tau.uoregon.edu/ecp.tgz
# gunzip -c ecp.tgz | docker load
# docker images
# docker run -i -t exascaleproject/sdk:AHM19 /bin/bash
Inside the Docker container:
# which spack
# cd /usr/local/packages/ecp/apps/demo; cat README
# cd demo/trilinos/Zoltan; ./compile.sh; ls -l Zoltan
# ./run.sh

Singularity

# which singularity
# wget http://tau.uoregon.edu/ecp.simg
# singularity exec /home/livetau/ecp.simg /bin/bash --rcfile /etc/bashrc
# which spack

Replacing MPI On Theta at ALCF: Allocate two nodes:

% qsub -A  -t 30 -n 2  -q debug-cache-quad  -I
% /projects/ECP_SDK/tutorial/run_job.sh
% cat /projects/ECP_SDK/tutorial/run_job.sh
module swap PrgEnv-intel PrgEnv-gnu
module swap cray-mpich cray-mpich-abi
export SINGULARITYENV_LIBWLM_DETECT=/opt/cray/wlm_detect/1.3.2-6.0.6.0_3.8__g388ccd5.ari/lib64
aprun -n 16 -N 8 singularity exec -H $HOME    -B /projects/ECP_SDK:/projects/ECP_SDK:ro -B /opt:/opt:ro -B /var/opt:/var/opt:ro /projects/ECP_SDK/containers/singularity/ecp.simg bash -c 'unset CRAYPE_VERSION; source /usr/local/packages/ecp/misc/bashrc; spack load   trilinos hypre parmetis hdf5 metis openblas superlu zlib netcdf matio boost@1.66.0 scalapack suite-sparse tau ;spack unload openmpi mpich ;  export LD_LIBRARY_PATH=$LIBWLM_DETECT:$CRAY_LD_LIBRARY_PATH:$CRAYPAT_LD_LIBRARY_PATH:$LD_LIBRARY_PATH   ; /projects/ECP_SDK/tutorial/demo/trilinos/Zoltan/Zoltan; '

Shifter

Replacing MPI with system MPI on Cori at NERSC:

# shifterimg -v pull docker:exascaleproject/sdk:SC18
# shifter -E --image=exascaleproject/sdk:SC18 -- /bin/bash --rcfile /etc/bashrc
# which spack

# shifterimg images | grep exascaleproject

# salloc -N 2 -q interactive -t 00:30:00 --image=exascaleproject/sdk:AHM19 -C haswell -L SCRATCH
# srun -n 32 shifter  -- /bin/bash  -c 'unset CRAYPE_VERSION;  . /etc/bashrc ; spack load   trilinos hypre parmetis hdf5 metis openblas superlu zlib netcdf matio boost@1.66.0 scalapack suite-sparse tau; spack unload openmpi mpich; ./Zoltan'

Charliecloud

# wget http://tau.uoregon.edu/ecp-cc.tgz
# tar xf ecp-cc.tgz
# ch-run --bind=$HOME:$HOME ./ecp-cc -- /bin/bash --rcfile /etc/bashrc
# which spack
# cat /usr/local/packages/ecp/Acknowledgment.txt

If you wish to use the OVA file, please contact below for login information. The OVA file has Docker, Singularity, Shifter, and Charliecloud preinstalled.

Please contact Sameer Shende at sameer [at] cs.uoregon.edu if you have any questions.