You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In the Zyda2 tutorial, several scripts like the process_dclm.py attempt to start a Dask LocalCluster. These scripts take an environment variable CPU_WORKERS = os.environ.get("CPU_WORKERS") to setup the cluster with equivalent workers using the following code cluster = LocalCluster(n_workers=CPU_WORKERS, processes=True, memory_limit="48GB"). A TypeError is raised because n_workers is expected to be an integer.
Describe the bug
In the Zyda2 tutorial, several scripts like the process_dclm.py attempt to start a Dask LocalCluster. These scripts take an environment variable
CPU_WORKERS = os.environ.get("CPU_WORKERS")
to setup the cluster with equivalent workers using the following codecluster = LocalCluster(n_workers=CPU_WORKERS, processes=True, memory_limit="48GB")
. A TypeError is raised because n_workers is expected to be an integer.Steps/Code to reproduce bug
python3 0_processing/process_dclm.py
Expected behavior
Dask cluster is created and data is processed, script completes successfully
Environment overview (please complete the following information)
The text was updated successfully, but these errors were encountered: