HTML |
---|
<div style="background-color: yellow; border: 2px solid red; margin: 4px; padding: 2px; font-weight: bold; text-align: center;">
The HAL documentation has moved to <a href="https://docs.ncsa.illinois.edu/systems/hal/">https://docs.ncsa.illinois.edu/systems/hal/</a>. Please update any bookmarks you may have.
<br>
Click the link above if you are not automatically redirected in 7 seconds.
</br>
</div>
<meta http-equiv="refresh" content="7; URL='https://docs.ncsa.illinois.edu/systems/hal/en/latest/user-guide/containers.html'" />
|
Apptainer (Previously known as Singularity)
Background
Apptainer is a container solution created by necessity for scientific and application-driven workloads. The Apptainer containers can be used to package entire scientific workflows, software and libraries, and even data. This means that you don’t have to ask your cluster admin to install anything for you - you can put it in a Apptainer container and run.
(see webpage https://www.sylabs.io and/or https://apptainer.org/docs/user/latest/ for details)
Build a Apptainer Container
Info |
---|
title | Admin assistance required |
---|
|
Apptainer now requires fakeroot privilege for non-root users to create container images. Please contact an admin to set up your account with fakeroot. |
Build a container from a
...
Code Block |
---|
|
wget https://wiki.ncsa.illinois.edu/download/attachments/82518873/ubuntu1604-cuda92-ompi400.def
apptainer build ubuntu1604-cuda92-ompi400.sif ubuntu1604-cuda92-ompi400.def |
Pull a container from Apptainer
...
Hub or Docker Hub
Code Block |
---|
|
singularityapptainer pull docker://nvidia/cuda-ppc64le:9.2-cudnn7-devel-ubuntu16.04 |
Run a Apptainer Container
Warning |
---|
title | Mounted home filesystem |
---|
|
Unlike docker (which provides an isolated filesystem), Singluarity mounts your home directory into the container. Be aware of this so you don't accidentally delete things in your home directory. |
Run a container with "exec" command
Code Block |
---|
|
mpirun -n 4 apptainer exec --nv /opt/apps/samples-image/ubuntu1604-cuda92-ompi400.sif hostname |
Run a container with shell
Code Block |
---|
|
apptainer shell --nv /opt/apps/samples-image/ubuntu1604-cuda92-ompi400.sif |
Build a writable Apptainer container
By default, the Apptainer container filesystem is read-only. There are 2 options to build a writable Apptainer container.
The "--sandbox
" option allows users to create a container within a writable directory (called a sandbox). It’s possible to create a sandbox without root privileges, but to ensure proper file permissions it is recommended to do so as root.
Code Block |
---|
|
apptainer build --sandbox cuda-ppc64le/ docker://nvidia/cuda-ppc64le:9.2-cudnn7-devel-ubuntu16.0
apptainer shell --writable cuda-ppc64le/ |
The "--writable" option allows users to create a writable ext3 image. Root privileges are required to create writable containers.
Code Block |
---|
|
apptainer build --writable cuda-ppc64le.sif docker://nvidia/cuda-ppc64le:9.2-cudnn7-devel-ubuntu16.04
apptainer shell --writable cuda-ppc64le.sif |
Build a writable Apptainer container based on an existing read-only image
Convert it to a writable directory (a sandbox):
Code Block |
---|
|
apptainer build --sandbox cuda-ppc64le-mod/ cuda-ppc64le.sif
apptainer shell --writable cuda-ppc64le-mod/ |
Use an existing container as a target to build a new container
Code Block |
---|
|
apptainer build --writable cuda-ppc64le-mod.sif cuda-ppc64le.sif
apptainer shell --writable cuda-ppc64le-mod.sif |
Frequently Asked Questions
- Can I run a Apptainer container with x86 architecture image on an IBM ppc64le system?
A: Apptainer cannot directly run x86 binaries on an IBM Power system because the bytes of machine code are different. Users need to make sure their own images are built for "ppc64le" rather than "x86". - What is the option "--nv" means?
A: The "--nv" allows the Apptainer container to leverage the NVIDIA GPU on the host system. Use this option if the container asks for nvidia-docker support.