[FEAT][1/2] Support Iceberg renaming of columns #4055
release-drafter.yml
on: pull_request
update_release_draft
5s
label
5s
Annotations
2 errors and 1 warning
update_release_draft
Validation Failed: {"resource":"Release","code":"invalid","field":"target_commitish"}
{
name: 'HttpError',
id: '8029089821',
status: 422,
response: {
url: 'https://api.github.com/repos/Eventual-Inc/Daft/releases/142827731',
status: 422,
headers: {
'access-control-allow-origin': '*',
'access-control-expose-headers': 'ETag, Link, Location, Retry-After, X-GitHub-OTP, X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Used, X-RateLimit-Resource, X-RateLimit-Reset, X-OAuth-Scopes, X-Accepted-OAuth-Scopes, X-Poll-Interval, X-GitHub-Media-Type, X-GitHub-SSO, X-GitHub-Request-Id, Deprecation, Sunset',
connection: 'close',
'content-length': '195',
'content-security-policy': "default-src 'none'",
'content-type': 'application/json; charset=utf-8',
date: 'Sat, 24 Feb 2024 07:29:37 GMT',
'referrer-policy': 'origin-when-cross-origin, strict-origin-when-cross-origin',
server: 'GitHub.com',
'strict-transport-security': 'max-age=31536000; includeSubdomains; preload',
vary: 'Accept-Encoding, Accept, X-Requested-With',
'x-accepted-github-permissions': 'contents=write',
'x-content-type-options': 'nosniff',
'x-frame-options': 'deny',
'x-github-api-version-selected': '2022-11-28',
'x-github-media-type': 'github.v3; format=json',
'x-github-request-id': '8CA7:142F97:DE6770:1C010D8:65D99AE0',
'x-ratelimit-limit': '1000',
'x-ratelimit-remaining': '982',
'x-ratelimit-reset': '1708762826',
'x-ratelimit-resource': 'core',
'x-ratelimit-used': '18',
'x-xss-protection': '0'
},
data: {
message: 'Validation Failed',
errors: [
{
resource: 'Release',
code: 'invalid',
field: 'target_commitish'
}
],
documentation_url: 'https://docs.github.com/rest/releases/releases#update-a-release'
}
},
request: {
method: 'PATCH',
url: 'https://api.github.com/repos/Eventual-Inc/Daft/releases/142827731',
headers: {
accept: 'application/vnd.github.v3+json',
'user-agent': 'probot/12.2.5 octokit-core.js/3.5.1 Node.js/16.20.2 (linux; x64)',
authorization: 'token [REDACTED]',
'content-type': 'application/json; charset=utf-8'
},
body: '{"body":"## Changes\\n\\n- [FEAT] Add str.lower() function @nsalerni (#1938)\\n\\n## ✨ New Features\\n\\n- [FEAT] Time Array @colin-ho (#1892)\\n- [FEAT] Add str.lstrip() and str.rstrip() functions @nsalerni (#1944)\\n- [FEAT] Add str.upper() function @nsalerni (#1942)\\n\\n## 📖 Documentation\\n\\n- [DOCS] Add documentation for using and developing Daft on Ray @kevinzwang (#1896)\\n- [DOCS] Update schema hints documentation @jaychia (#1935)\\n\\n## 🧰 Maintenance\\n\\n- [CHORE] Remove non-`MicroPartition` and non-`ScanOperator` paths @clarkzinzow (#1946)\\n- [CHORE] Populate previews only when show() or \\\\_\\\\_repr\\\\_\\\\_() is called @colin-ho (#1889)\\n- [CHORE] Update segment endpoint @jaychia (#1902)\\n","draft":true,"prerelease":false,"make_latest":"true","name":"v0.2.17","tag_name":"v0.2.17","target_commitish":"refs/pull/1937/merge"}',
request: {}
},
event: {
id: '8029089821',
name: 'pull_request',
payload: {
action: 'edited',
changes: {
body: {
from: '# Summary\r\n' +
'\r\n' +
'Support field_id renaming of Parquet files along the codepath:\r\n' +
'\r\n' +
'1. `IcebergScanOperator`\r\n' +
'2. Generates `ScanTasks`, each containing the `field_id_mapping: Arc<{i32: Field}>`\r\n' +
'3. Propagated to workers through the `ScanWithTask` instruction object\r\n' +
'4. Micropartitions are created with `MicroPartition::from_scan_task`\r\n' +
'5. This then calls into `read_parquet_into_micropartition`, and the resulting MicroPartition that is a raw read from Parquet is casted to the schema provided by the ScanTask/IcebergScanOperator\r\n' +
' a. If statistics are available, it will create an unloaded Micr
|
update_release_draft
HttpError: Validation Failed: {"resource":"Release","code":"invalid","field":"target_commitish"}
at /home/runner/work/_actions/release-drafter/release-drafter/v5/dist/index.js:8462:21
at processTicksAndRejections (node:internal/process/task_queues:96:5)
at async Job.doExecute (/home/runner/work/_actions/release-drafter/release-drafter/v5/dist/index.js:30793:18)
{
name: 'AggregateError',
event: {
id: '8029089821',
name: 'pull_request',
payload: {
action: 'edited',
changes: {
body: {
from: '# Summary\r\n' +
'\r\n' +
'Support field_id renaming of Parquet files along the codepath:\r\n' +
'\r\n' +
'1. `IcebergScanOperator`\r\n' +
'2. Generates `ScanTasks`, each containing the `field_id_mapping: Arc<{i32: Field}>`\r\n' +
'3. Propagated to workers through the `ScanWithTask` instruction object\r\n' +
'4. Micropartitions are created with `MicroPartition::from_scan_task`\r\n' +
'5. This then calls into `read_parquet_into_micropartition`, and the resulting MicroPartition that is a raw read from Parquet is casted to the schema provided by the ScanTask/IcebergScanOperator\r\n' +
' a. If statistics are available, it will create an unloaded MicroPartition by creating a new ScanTask (hydrated with statistics) and then calling `MicroPartition::new_unloaded(new_scan_task)`. \r\n' +
' b. Otherwise, it falls back into `read_parquet_bulk`, which has been modified to correctly handle `field_id_mapping`\r\n' +
'\r\n' +
'## Drive-By\r\n' +
'\r\n' +
"1. Refactored `MicroPartition::new_unloaded`: it no longer requires passing in a schema, and instead just uses the ScanTask's `.materialized_schema()`.\r\n" +
'2. Refactored `read_parquet_into_micropartition` to reduce code deduplication\r\n' +
'\r\n' +
'## Remaining todos:\r\n' +
'\r\n' +
'- [x] Fix logic with column pruning (need to apply column pruning after applying the field ID mappings)\r\n' +
'- [ ] Perform recursive renaming for Series and for Schema\r\n' +
'- [x] Perform correct renaming for statistics parsing from Parquet metadata'
}
},
number: 1937,
organization: {
avatar_url: 'https://avatars.githubusercontent.com/u/98941975?v=4',
description: 'Eventual Computing',
events_url: 'https://api.github.com/orgs/Eventual-Inc/events',
hooks_url: 'https://api.github.com/orgs/Eventual-Inc/hooks',
id: 98941975,
issues_url: 'https://api.github.com/orgs/Eventual-Inc/issues',
login: 'Eventual-Inc',
members_url: 'https://api.github.com/orgs/Eventual-Inc/members{/member}',
node_id: 'O_kgDOBeW8Fw',
public_members_url: 'https://api.github.com/orgs/Eventual-Inc/public_members{/member}',
repos_url: 'https://api.github.com/orgs/Eventual-Inc/repos',
url: 'https://api.github.com/orgs/Eventual-Inc'
},
pull_request: {
_links: {
comments: {
href: 'https://api.github.com/repos/Eventual-Inc/Daft/issues/1937/comments'
},
commits: {
href: 'https://api.github.com/repos/Eventual-Inc/Daft/pulls/1937/commits'
},
html: { href: 'https://github.com/Eventual-Inc/Daft/pull/1937' },
issue: {
href: 'https://api.github.com/repos/Eventual-Inc/Daft/issues/1937'
},
review_comment: {
href: 'https://api.github.com/repos/Eventual-Inc/Daft/pulls/comments{/number}'
},
review_comments: {
href: 'https://api.github.com/repos/Eventual-Inc/Daft/pulls/1937/comments'
},
self: {
href: 'https://api.github.com/repos/Eventual-Inc/Daft/pulls/1937'
},
statuses: {
href: 'https://api.github.com/repos/Eventual-Inc/Daft/statuses/54bf7925fd1bb670e69cb1c63124f771736be876'
|
update_release_draft
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: release-drafter/release-drafter@v5. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|