Skip to content

[BUG] clean up ray scheduler threads after computing partial results #2775

[BUG] clean up ray scheduler threads after computing partial results

[BUG] clean up ray scheduler threads after computing partial results #2775

Triggered via pull request November 13, 2023 19:00
Status Success
Total duration 28s
Artifacts

release-drafter.yml

on: pull_request
update_release_draft
6s
update_release_draft
Fit to window
Zoom out
Zoom in

Annotations

2 errors
update_release_draft
Validation Failed: {"resource":"Release","code":"invalid","field":"target_commitish"} { name: 'HttpError', id: '6854482434', status: 422, response: { url: 'https://api.github.com/repos/Eventual-Inc/Daft/releases/128248697', status: 422, headers: { 'access-control-allow-origin': '*', 'access-control-expose-headers': 'ETag, Link, Location, Retry-After, X-GitHub-OTP, X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Used, X-RateLimit-Resource, X-RateLimit-Reset, X-OAuth-Scopes, X-Accepted-OAuth-Scopes, X-Poll-Interval, X-GitHub-Media-Type, X-GitHub-SSO, X-GitHub-Request-Id, Deprecation, Sunset', connection: 'close', 'content-length': '195', 'content-security-policy': "default-src 'none'", 'content-type': 'application/json; charset=utf-8', date: 'Mon, 13 Nov 2023 19:00:25 GMT', 'referrer-policy': 'origin-when-cross-origin, strict-origin-when-cross-origin', server: 'GitHub.com', 'strict-transport-security': 'max-age=31536000; includeSubdomains; preload', vary: 'Accept-Encoding, Accept, X-Requested-With', 'x-accepted-github-permissions': 'contents=write', 'x-content-type-options': 'nosniff', 'x-frame-options': 'deny', 'x-github-api-version-selected': '2022-11-28', 'x-github-media-type': 'github.v3; format=json', 'x-github-request-id': '8407:286C:664E8E:696EAC:65527248', 'x-ratelimit-limit': '1000', 'x-ratelimit-remaining': '959', 'x-ratelimit-reset': '1699903520', 'x-ratelimit-resource': 'core', 'x-ratelimit-used': '41', 'x-xss-protection': '0' }, data: { message: 'Validation Failed', errors: [ { resource: 'Release', code: 'invalid', field: 'target_commitish' } ], documentation_url: 'https://docs.github.com/rest/releases/releases#update-a-release' } }, request: { method: 'PATCH', url: 'https://api.github.com/repos/Eventual-Inc/Daft/releases/128248697', headers: { accept: 'application/vnd.github.v3+json', 'user-agent': 'probot/12.2.5 octokit-core.js/3.5.1 Node.js/16.20.2 (linux; x64)', authorization: 'token [REDACTED]', 'content-type': 'application/json; charset=utf-8' }, body: '{"body":"## Changes\\n\\n## ✨ New Features\\n\\n- [FEAT] Add translation of IOConfig to PyArrow filesystem arguments @jaychia (#1592)\\n- [FEAT] [Scan Operator] Refactor planning and execution code to use shared `Pushdowns` struct. @clarkzinzow (#1595)\\n- [FEAT] [Scan Operator] Add `ChunkSpec` for specifying format-specific per-file row subset selection for `ScanTask`s. @clarkzinzow (#1590)\\n- [FEAT] [Scan Operator] Integrate `size_bytes` with `ScanOperator`s @clarkzinzow (#1586)\\n- [FEAT] [Scan Operator] Add Python I/O support (+ JSON) to `MicroPartition` reads @clarkzinzow (#1578)\\n- [FEAT][ScanOperator 1/3] Add MVP e2e `ScanOperator` integration. @clarkzinzow (#1559)\\n\\n## 👾 Bug Fixes\\n\\n- [BUG] Update requirements for typing\\\\_extensions @jaychia (#1593)\\n- [BUG] Fix Deadlock with ScanOperators in `to_physical_plan_scheduler` and show iostats for glob and from\\\\_scan\\\\_task @samster25 (#1581)\\n- [BUG] add allow threads for io pool operations @samster25 (#1580)\\n\\n## 🧰 Maintenance\\n\\n- [CHORE] Use DAFT\\\\_MICROPARTITIONS as shared feature flag for data catalog support @jaychia (#1579)\\n- [CHORE] Convert GlobScanOperator to perform streaming into result and take a list of glob paths @jaychia (#1577)\\n","draft":true,"prerelease":false,"make_latest":"true","name":"v0.2.2","tag_name":"v0.2.2","target_commitish":"refs/pull/1597/merge"}', request: {} }, event: { id: '6854482434', name: 'pull_request', payload: { action: 'edited', changes: { body: { from: '* adds `stop_plan` method on the Ray Scheduler when is called when the `RayRunner.run_iter` goes out of scope.\r\n' + '* This fixes the issues where we have a hanging thread at the end of execution' } }, number: 1
update_release_draft
HttpError: Validation Failed: {"resource":"Release","code":"invalid","field":"target_commitish"} at /home/runner/work/_actions/release-drafter/release-drafter/v5/dist/index.js:8462:21 at processTicksAndRejections (node:internal/process/task_queues:96:5) at async Job.doExecute (/home/runner/work/_actions/release-drafter/release-drafter/v5/dist/index.js:30793:18) { name: 'AggregateError', event: { id: '6854482434', name: 'pull_request', payload: { action: 'edited', changes: { body: { from: '* adds `stop_plan` method on the Ray Scheduler when is called when the `RayRunner.run_iter` goes out of scope.\r\n' + '* This fixes the issues where we have a hanging thread at the end of execution' } }, number: 1597, organization: { avatar_url: 'https://avatars.githubusercontent.com/u/98941975?v=4', description: 'Eventual Computing', events_url: 'https://api.github.com/orgs/Eventual-Inc/events', hooks_url: 'https://api.github.com/orgs/Eventual-Inc/hooks', id: 98941975, issues_url: 'https://api.github.com/orgs/Eventual-Inc/issues', login: 'Eventual-Inc', members_url: 'https://api.github.com/orgs/Eventual-Inc/members{/member}', node_id: 'O_kgDOBeW8Fw', public_members_url: 'https://api.github.com/orgs/Eventual-Inc/public_members{/member}', repos_url: 'https://api.github.com/orgs/Eventual-Inc/repos', url: 'https://api.github.com/orgs/Eventual-Inc' }, pull_request: { _links: { comments: { href: 'https://api.github.com/repos/Eventual-Inc/Daft/issues/1597/comments' }, commits: { href: 'https://api.github.com/repos/Eventual-Inc/Daft/pulls/1597/commits' }, html: { href: 'https://github.com/Eventual-Inc/Daft/pull/1597' }, issue: { href: 'https://api.github.com/repos/Eventual-Inc/Daft/issues/1597' }, review_comment: { href: 'https://api.github.com/repos/Eventual-Inc/Daft/pulls/comments{/number}' }, review_comments: { href: 'https://api.github.com/repos/Eventual-Inc/Daft/pulls/1597/comments' }, self: { href: 'https://api.github.com/repos/Eventual-Inc/Daft/pulls/1597' }, statuses: { href: 'https://api.github.com/repos/Eventual-Inc/Daft/statuses/d70c3dd78303396d512755180fe95ebbaacad57e' } }, active_lock_reason: null, additions: 96, assignee: null, assignees: [], author_association: 'MEMBER', auto_merge: null, base: { label: 'Eventual-Inc:main', ref: 'main', repo: { allow_auto_merge: true, allow_forking: true, allow_merge_commit: false, allow_rebase_merge: false, allow_squash_merge: true, allow_update_branch: false, archive_url: 'https://api.github.com/repos/Eventual-Inc/Daft/{archive_format}{/ref}', archived: false, assignees_url: 'https://api.github.com/repos/Eventual-Inc/Daft/assignees{/user}', blobs_url: 'https://api.github.com/repos/Eventual-Inc/Daft/git/blobs{/sha}', branches_url: 'https://api.github.com/repos/Eventual-Inc/Daft/branches{/branch}', clone_url: 'https://github.com/Eventual-Inc/Daft.git', collaborators_url: 'https://api.github.com/repos/Eventual-Inc/Daft/collaborators{/collaborator}', comments_url: 'https://api.github.com/repos/Eventual-Inc/Daft/comments{/number}', commits_url: 'https://api.github.com/repos/Eventual-Inc/Daft/commits{/sha}', compare_url: 'https://api.github.com/repos/Eventual-Inc/Daft/compare/{base}...{head}', contents_url: 'https://api.github.com/repos/Eventual-Inc/Daft/contents/{+path}', contributors_url: 'https://api.github.com/repos/Eventual-Inc/Daft/contribu