Versions Compared

Old Version 13

changes.mady.by.user Unknown User (dmu)

Saved on

compared with

New Version 143

changes.mady.by.user Unknown User (dmu)

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

"My name is HAL. I became operational on March 25 2019 at the Innovative Systems Lab in Urbana, Illinois. My creators are putting me to the fullest possible use, which is all I think that any conscious entity can ever hope to do." (paraphrased from https://en.wikipedia.org/wiki/HAL_9000)

In publications and presentations that use results obtained on this system, please include the following acknowledgement: “This work utilizes resources supported by the National Science Foundation’s Major Research Instrumentation program, grant #1725729, as well as the University of Illinois at Urbana-Champaign”.

Also, please include the following reference in your publications: “V. Kindratenko, D. Mu, Y. Zhan, J. Maloney, S. Hashemi, B. Rabe, K. Xu, R. Campbell, J. Peng, and W. Gropp. HAL: Computer System for Scalable Deep Learning. In Practice and Experience in Advanced Research Computing (PEARC ’20), July 26–30, 2020, Portland, OR, USA. ACM, New York, NY, USA, 15 pages. https://doi.org/10.1145/3311790.3396649”.

Hardware-Accelerated Learning (HAL) cluster


Info

Effective May 19, 2020, two-factor authentication via NCSA Duo is now required for SSH logins on HAL. See https://go.ncsa.illinois.edu/2fa for instructions to sign up.

≈
System Description


Host name: hal.ncsa.illinois.edu

Hardware

GTG
    • GTH AC922 server
      • 2x 20-core IBM POWER9 CPU @ 2.
00GHz
GB
Software
  • RHEL 7.6

    • Software

    CUDA 10.1.105cuDNN 7.5.0
    4
      • 8.
    2
  • IBM XLC 16.1.1
  • IBM XLFORTRAN 16.1.1
  • Advance toolchain for Linux on Power 12.0

    • Documentation

    Science on HAL

    Software for HAL

    PowerAI 1.6.0


    To request access: fill out this form

    . Usage notes:

    . Make sure to follow the link in the confirmation email to request actual system account.

    Frequently Asked Questions

    To report problems: email us

    For our new users: New User Guide for HAL System

    User group Slack space: https://join.slack.com/t/halillinoisncsa

    Real-time system status: https://hal-monitor

    to connect to the cluster, ssh username@hal

    .ncsa.illinois.edu

    to submit job

    :3000

     Image Removed

    HAL User Guide

  • Techical Summary

  • System Software Environment

  • System Access

  • Request access to HAL

    • Logging in to HAL

    HAL OnDemand portal: https://hal-ondemand.ncsa.illinois.edu/

    Globus Endpoint: ncsa#hal

    Quick start guide: (for complete details see Documentation section on the left)

    To connect to the cluster:

    Code Block
    ssh <username>@hal-login2

    To log in to HAL from the command line, use the hostname:

    ssh [your_username]@hal
    .ncsa.illinois.edu

    • Modules

    Essential Modules Commands

    CommandDescriptionmodule listList the modules that are currently loadedmodule availList the modules that are availablemodule load [module_name]Load [module_name] into the environmentmodule unload[module_name]Remove [module_name] from the environmentmodule display [module_name]Display the environment variables of [module_name]

    • Managing Accounts

    • Run Jobs on Compute Nodes

    • Submit Interactive Jobs using "srun"

    • Submit Jobs using "sbatch"

    • Job Monitoring and Management

    To submit interactive job:

    Code Block
    languagebash
    swrun -p gpux1

    To submit a batch job:

    Code Block
    swbatch run_script.swb

    Job Queue time limits:

    • "debug" queue: 4 hours
    • "gpux<n>" and "cpun<n>" queues:  24 hours

    To load IBM Watson Machine Learning Community Edition (former IBM PowerAI) module:

    Code Block
    module load wmlce

    To see CLI scheduler status:

    Code Block
    swqueue



    Main -> Systems -> NanoHAL

    Contact us

    Request access to ISL resourcesthis system: Application

    Contact ISL staff: Email Address

    Visit: NCSA, room 3050E


    Image Added