Skip to content

Commit

Permalink
Add command to download log files from ray cluster
Browse files Browse the repository at this point in the history
  • Loading branch information
Raunak Bhagat committed Nov 23, 2024
1 parent cba7c54 commit fcf94fc
Showing 1 changed file with 13 additions and 1 deletion.
14 changes: 13 additions & 1 deletion .github/workflows/run-cluster.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -78,9 +78,21 @@ jobs:
echo 'Invalid command submitted; command cannot be empty'
exit 1
fi
ray job submit --working-dir ${{ inputs.working_dir }} --address http://localhost:8265 -- ${{ inputs.command }}
ray job submit \
--working-dir ${{ inputs.working_dir }} \
--address http://localhost:8265 \
--runtime-env-json '{"DAFT_ENABLE_RAY_TRACING": "1"}' \
-- ${{ inputs.command }}
- name: Download log files from ray cluster
run: |
source .venv/bin/activate
ray rsync-down .github/assets/benchmarking_ray_config.yaml /tmp/ray/session_*/logs/daft ray-daft-logs
- name: Spin down ray cluster
if: always()
run: |
source .venv/bin/activate
ray down .github/assets/benchmarking_ray_config.yaml -y
- uses: actions/upload-artifact@v4
with:
name: ray-daft-logs
path: ray-daft-logs

0 comments on commit fcf94fc

Please sign in to comment.