[FEAT] IOStats for Native Reader #2258
samster25
This run and associated checks have been archived and are scheduled for deletion.
Learn more about checks retention
release-drafter.yml
on: pull_request
update_release_draft
6s
label
4s
Annotations
2 errors
|
update_release_draft
Validation Failed: {"resource":"Release","code":"invalid","field":"target_commitish"}
{
name: 'HttpError',
id: '6529175014',
status: 422,
response: {
url: 'https://api.github.com/repos/Eventual-Inc/Daft/releases/124512520',
status: 422,
headers: {
'access-control-allow-origin': '*',
'access-control-expose-headers': 'ETag, Link, Location, Retry-After, X-GitHub-OTP, X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Used, X-RateLimit-Resource, X-RateLimit-Reset, X-OAuth-Scopes, X-Accepted-OAuth-Scopes, X-Poll-Interval, X-GitHub-Media-Type, X-GitHub-SSO, X-GitHub-Request-Id, Deprecation, Sunset',
connection: 'close',
'content-length': '195',
'content-security-policy': "default-src 'none'",
'content-type': 'application/json; charset=utf-8',
date: 'Mon, 16 Oct 2023 04:56:55 GMT',
'referrer-policy': 'origin-when-cross-origin, strict-origin-when-cross-origin',
server: 'GitHub.com',
'strict-transport-security': 'max-age=31536000; includeSubdomains; preload',
vary: 'Accept-Encoding, Accept, X-Requested-With',
'x-accepted-github-permissions': 'contents=write',
'x-content-type-options': 'nosniff',
'x-frame-options': 'deny',
'x-github-api-version-selected': '2022-11-28',
'x-github-media-type': 'github.v3; format=json',
'x-github-request-id': '6447:787B:25934E9:4D6C7EF:652CC297',
'x-ratelimit-limit': '1000',
'x-ratelimit-remaining': '994',
'x-ratelimit-reset': '1697435812',
'x-ratelimit-resource': 'core',
'x-ratelimit-used': '6',
'x-xss-protection': '0'
},
data: {
message: 'Validation Failed',
errors: [
{
resource: 'Release',
code: 'invalid',
field: 'target_commitish'
}
],
documentation_url: 'https://docs.github.com/rest/releases/releases#update-a-release'
}
},
request: {
method: 'PATCH',
url: 'https://api.github.com/repos/Eventual-Inc/Daft/releases/124512520',
headers: {
accept: 'application/vnd.github.v3+json',
'user-agent': 'probot/12.2.5 octokit-core.js/3.5.1 Node.js/16.20.2 (linux; x64)',
authorization: 'token [REDACTED]',
'content-type': 'application/json; charset=utf-8'
},
body: '{"body":"## Changes\\n\\n## 🚀 Performance Improvements\\n\\n- [PERF] Use pyarrow table for pickling rather than ChunkedArray @samster25 (#1488)\\n- [PERF] Use region from system and leverage cached credentials when making new clients @samster25 (#1490)\\n- [PERF] Update default max\\\\_connections 64->8 because it is now per-io-thread @jaychia (#1485)\\n- [PERF] Pass-through multithreaded\\\\_io flag in read\\\\_parquet @jaychia (#1484)\\n\\n## 👾 Bug Fixes\\n\\n- [BUG] Fix local globbing of current directory @jaychia (#1494)\\n- [BUG] fix script to upload file 1 at a time @samster25 (#1492)\\n- [CHORE] Add tests and fixes for Azure globbing @jaychia (#1482)\\n\\n## 🧰 Maintenance\\n\\n- [CHORE] Add Workflow to build artifacts and upload to S3 @samster25 (#1491)\\n- [CHORE] Update default num\\\\_tries on S3Config to 25 @jaychia (#1487)\\n- [CHORE] Add tests and fixes for Azure globbing @jaychia (#1482)\\n","draft":true,"prerelease":false,"name":"v0.1.21","tag_name":"v0.1.21","target_commitish":"refs/pull/1493/merge"}',
request: {}
},
event: {
id: '6529175014',
name: 'pull_request',
payload: {
action: 'edited',
changes: {
body: {
from: '* Implements IOStats via atomics that will track the number of:\r\n' +
'* GetRequests\r\n' +
'* HeadRequests\r\n' +
'* ListRequests\r\n' +
'* BytesRead\r\n' +
'\r\n' +
'\r\n' +
'When the `IOStatsContext` goes out of scope it will debug log its output:\r\n' +
'For a parquet read:\r\n' +
'```\r\n' +
'IOStatsContext: read_parquet: for uri s3://eventual-dev-benchmarking-fixtures/parquet-benchmarking/tpch/200MB-2RG/daft_200MB_lineitem_chunk.RG-2.parquet, Gets: 17, Heads:
|
|
update_release_draft
HttpError: Validation Failed: {"resource":"Release","code":"invalid","field":"target_commitish"}
at /home/runner/work/_actions/release-drafter/release-drafter/v5/dist/index.js:8462:21
at processTicksAndRejections (node:internal/process/task_queues:96:5)
at async Job.doExecute (/home/runner/work/_actions/release-drafter/release-drafter/v5/dist/index.js:30793:18)
{
name: 'AggregateError',
event: {
id: '6529175014',
name: 'pull_request',
payload: {
action: 'edited',
changes: {
body: {
from: '* Implements IOStats via atomics that will track the number of:\r\n' +
'* GetRequests\r\n' +
'* HeadRequests\r\n' +
'* ListRequests\r\n' +
'* BytesRead\r\n' +
'\r\n' +
'\r\n' +
'When the `IOStatsContext` goes out of scope it will debug log its output:\r\n' +
'For a parquet read:\r\n' +
'```\r\n' +
'IOStatsContext: read_parquet: for uri s3://eventual-dev-benchmarking-fixtures/parquet-benchmarking/tpch/200MB-2RG/daft_200MB_lineitem_chunk.RG-2.parquet, Gets: 17, Heads: 1, Lists: 0, BytesRead: 213627535, AvgGetSize: 12566325\r\n' +
'```\r\n' +
'For our io_glob:\r\n' +
'```\r\n' +
'IOStatsContext: io_glob for s3://daft-segment-data/segment-logs/**, Gets: 0, Heads: 0, Lists: 237, BytesRead: 0, AvgGetSize: 0\r\n' +
'```\r\n' +
'\r\n' +
'Currently the context is threaded through our python Apis for `io_glob`, `read_parquet`, and `read_csv`\r\n' +
'\r\n' +
'IOStats is currently implemented for:\r\n' +
'* S3\r\n' +
'* GCS\r\n' +
'* HTTP\r\n' +
'* Azure\r\n' +
'\r\n'
},
title: { from: '[Feat] IOStats for Native Reader' }
},
number: 1493,
organization: {
avatar_url: 'https://avatars.githubusercontent.com/u/98941975?v=4',
description: 'Eventual Computing',
events_url: 'https://api.github.com/orgs/Eventual-Inc/events',
hooks_url: 'https://api.github.com/orgs/Eventual-Inc/hooks',
id: 98941975,
issues_url: 'https://api.github.com/orgs/Eventual-Inc/issues',
login: 'Eventual-Inc',
members_url: 'https://api.github.com/orgs/Eventual-Inc/members{/member}',
node_id: 'O_kgDOBeW8Fw',
public_members_url: 'https://api.github.com/orgs/Eventual-Inc/public_members{/member}',
repos_url: 'https://api.github.com/orgs/Eventual-Inc/repos',
url: 'https://api.github.com/orgs/Eventual-Inc'
},
pull_request: {
_links: {
comments: {
href: 'https://api.github.com/repos/Eventual-Inc/Daft/issues/1493/comments'
},
commits: {
href: 'https://api.github.com/repos/Eventual-Inc/Daft/pulls/1493/commits'
},
html: { href: 'https://github.com/Eventual-Inc/Daft/pull/1493' },
issue: {
href: 'https://api.github.com/repos/Eventual-Inc/Daft/issues/1493'
},
review_comment: {
href: 'https://api.github.com/repos/Eventual-Inc/Daft/pulls/comments{/number}'
},
review_comments: {
href: 'https://api.github.com/repos/Eventual-Inc/Daft/pulls/1493/comments'
},
self: {
href: 'https://api.github.com/repos/Eventual-Inc/Daft/pulls/1493'
},
statuses: {
href: 'https://api.github.com/repos/Eventual-Inc/Daft/statuses/8f765b57799ebbee38c2b3c734e79386510f03b9'
}
},
active_lock_reason: null,
additions: 586,
assignee: null,
assignees: [],
author_association: 'CONTRIBUTOR',
auto_merge: null,
base: {
label: 'Eventual-Inc:main',
ref: 'main',
repo: {
allow_auto_merge: true,
allow_forking: true,
allow_merge_commit: false,
allow_rebase_merge: false,
|