Confluence was recently upgraded. Report any issues to help+service@ncsa.illinois.edu.
Page tree
Skip to end of metadata
Go to start of metadata

Here, we bring together information regarding how to control your computing resources on the C3 AI Suite.

Jupyter

Access Through Static Console

The Jupyter service is controlled through the 'Jupyter' type. To start the Juptyer service with the default container profile, execute Jupyter.inst().start() within the static console. To stop the Jupyter service execute Jupyter.inst().stop().

To launch Jupyter service with a specific config, use Jupyter.startWithConfig(). This accepts an argument of type JupyterServiceConfig. The JupyterServiceConfig can represent multiple types of services one of which is the 'resourceProfile'. This can represent pre-designated resource profiles of type ResourceProfile. To list the available resource profiles do c3Grid(ResourceProfile.fetch())

By default, two ResourceProfiles exist, 'Basic', and 'BasicGpu'. For example, to launch the Jupyter service using the 'BasicGpu' profile, you would execute

Jupyter.startWithConfig({'resourceProfile': 'BasicGpu'})


Creating new Resource Profile

As a default, tags come with "Basic" and "BasicGpu" profiles. In case these do not fit your needs, it is possible to create a new profile from your static console using:

var rp = ResourceProfile.upsert({'id': 'YourProfileName', 'name': 'YourProfileName', 'cpuCount': <cpus>, 'memoryMb': <cpu_memory>, 'diskGb': <disk_memory>, 'gpuCount': <gpus>, 'gpuMemoryMb': <gpu_memory>});

If you want to make this your default profile whenever launching a Jupyter service, you can do so with:

Jupyter.setDefaultResourceProfile('YourProfileName')

Keep in mind that, currently, the maximum number of GPUs that can be used on the training cluster is one. If you request more than one, your static console is going to be unresponsive for some time, and you won't be able to start your Jupyter service. The same thing will happen if you request resources that surpass the limits of the current underlying hardware infrastructure. These are summarized in the table below:

ResourceMax CountMax Memory (MB)
vCPUs, no GPU1548*1024
vCPUs, with GPU540*1024
GPU112*1024


Access Through IDS

Through IDS, clear controls regarding Jupyter are exposed under the 'ML Studio' section for Application. When you've selected a project, you need to start the Jupyter service to access notebooks on that project. In the creation process, you're able to select the container profile to use for your Jupyter service. By default, the 'BasicGpu' profile offers a single K80 GPU.

You can create new container profiles. Select the 'App Settings' Menu, and there's a tab called 'Container Profiles'. You can create new profiles which have different resources like more GPUs, and more vCPUs, and more RAM. Create a new container profile, then when creating the Jupyter service select the new profile to gain access to those resources.

  • No labels