Skip to content

asnaylor/nersc_cluster_deploy

Repository files navigation

Overview

tests

Deploy Ray clusters on NERSC supercomputers.

  • Free software: GNU Lesser General Public License v3 (LGPLv3)

Deploy Ray Easily

from nersc_cluster_deploy import deploy_ray_cluster

#Create Ray Cluster with dashboard
rayCluster = deploy_ray_cluster(
    slurm_options = '-q regular -A elvis -t 01:00:00 -N 3'
    job_setup = 'module load pytorch',
)
>>> Ray cluster running at x.x.x.x:6379
>>> Dashboard avaliable at https://jupyter.nersc.gov/user/elivs/proxy/localhost:8265/ with metrics

#Connect to cluster
import ray
ray.init(address='auto')

Installation

You can install the latest version with:

pip install git+https://github.com/asnaylor/[email protected]

Documentation

Visit the documentation README for more information.

Tutorials

For examples see the tutorial repo.

About

Deploy workflow clusters on NERSC supercomputers

Resources

License

Stars

Watchers

Forks

Packages

No packages published