...
| Framework | Version | Description | |||
|---|---|---|---|---|---|
| Caffe | 1.0 | Caffe is a deep learning framework made with expression, speed, and modularity in mind. It is developed by Berkeley AI Research and by community contributors. | |||
| Caffe2 | n/a | Caffe2 is a companion to PyTorch. PyTorch is great for experimentation and rapid development, while Caffe2 is aimed at production environments | TensorFlow | 1.13.1 | TensorFlow is an end-to-end open source platform for machine learning. It is developed by Google and by community contributors. |
| Pytorch | 1.0.1 | Pytorch is an open source deep learning platform that provides a seamless path from research prototyping to production deployment. It is developed by Facebook and by community contributors. | |||
| TensorFlow | 1.13.1 | TensorFlow is an end-to-end open source platform for machine learning. It is developed by Google and by community contributors. |
For complete PowerAI documentation, see https://www.ibm.com/support/knowledgecenter/SS5SF7_1.6.0/navigation/pai_getstarted.htm. Here we only show simple examples with system-specific instructions.
...
The same can be accomplished in batch mode using the following caffe_sample.sb script:
| Code Block |
|---|
sbatch caffe_sample.sb
squeue |
Simple Example for Caffe2
Interactive mode
Get node for interactive use:
| Code Block |
|---|
srun --partition=debug --pty --nodes=1 --ntasks-per-node=8 --gres=gpu:v100:1 -t 01:30:00 --wait=0 --export=ALL /bin/bash |
Once on the compute node, load PowerAI module using one of these:
| Code Block |
|---|
module load ibm/powerai/1.6.0.py2 # for python2 environment
module load ibm/powerai/1.6.0.py3 # for python3 environment
module load ibm/powerai # python3 environment by default |
Install samples for Caffe2:
| Code Block |
|---|
caffe2-install-samples ~/caffe2-samples
cd ~/caffe2-sample |
Download data with LMDB:
| Code Block |
|---|
python ./examples/lmdb_create_example.py --output_file lmdb |
Train ResNet50 with Caffe2:
| Code Block |
|---|
python ./examples/resnet50_trainer.py --train_data ./lmdb |
Batch mode
The same can be accomplished in batch mode using the following caffe2_sample.sb script:
| Code Block |
|---|
sbatch caffe2_sample.sb
squeue |
Simple Example for TensorFlow
Interactive mode
Get node for interactive use:
...
| Code Block |
|---|
python ./mnist-demo.py |
Batch mode
The same can be accomplished in batch mode using the following tf_sample.sb script:
...
Simple Example for Pytorch
Interactive mode
Get node for interactive use:
...
| Code Block |
|---|
python ./examples/mnist/main.py |
Batch mode
The same can be accomplished in batch mode using the following pytorch_sample.sb script:
...