[v1] Add v1 ast -> plan conversion; hook up w/ existing code

[alancai98]

Relevant Issues

• [v1] Replace sprout-generated AST with hand-written AST #1610

Description

• Adds v1 AST -> plan conversion and hooks up w/ existing planner and eval code

Other Information

• Updated Unreleased Section in CHANGELOG: [NO]

  • No, on v1

• Any backward-incompatible changes? [YES]

  • Yes, but on v1

• Any new external dependencies? [NO]

• Do your changes comply with the Contributing Guidelines
  and Code Style Guidelines? [YES]

License Information

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[github-actions]

CROSS-ENGINE-REPORT ❌

	BASE (LEGACY-V0.14.8)	TARGET (EVAL-4327469)	+/-
% Passing	89.67%	94.39%	4.72% ✅
Passing	5287	5565	278 ✅
Failing	609	50	-559 ✅
Ignored	0	281	281 🔶
Total Tests	5896	5896	0 ✅

Testing Details

• Base Commit: v0.14.8
• Base Engine: LEGACY
• Target Commit: 4327469
• Target Engine: EVAL

Result Details

• ❌ REGRESSION DETECTED. See Now Failing/Ignored Tests. ❌
• Passing in both: 2643
• Failing in both: 17
• Ignored in both: 0
• PASSING in BASE but now FAILING in TARGET: 3
• PASSING in BASE but now IGNORED in TARGET: 108
• FAILING in BASE but now PASSING in TARGET: 180
• IGNORED in BASE but now PASSING in TARGET: 0

Now FAILING Tests ❌

The following 3 test(s) were previously PASSING in BASE but are now FAILING in TARGET:

Click here to see

1. undefinedUnqualifiedVariableWithUndefinedVariableBehaviorMissing, compileOption: PERMISSIVE
2. undefinedUnqualifiedVariableIsNullExprWithUndefinedVariableBehaviorMissing, compileOption: PERMISSIVE
3. undefinedUnqualifiedVariableIsMissingExprWithUndefinedVariableBehaviorMissing, compileOption: PERMISSIVE

Now IGNORED Tests ❌

The complete list can be found in GitHub CI summary, either from Step Summary or in the Artifact.

Now Passing Tests

180 test(s) were previously failing in BASE (LEGACY-V0.14.8) but now pass in TARGET (EVAL-4327469). Before merging, confirm they are intended to pass.

The complete list can be found in GitHub CI summary, either from Step Summary or in the Artifact.

CROSS-COMMIT-REPORT ✅

	BASE (EVAL-47DE56F)	TARGET (EVAL-4327469)	+/-
% Passing	94.39%	94.39%	0.00% ✅
Passing	5565	5565	0 ✅
Failing	50	50	0 ✅
Ignored	281	281	0 ✅
Total Tests	5896	5896	0 ✅

Testing Details

• Base Commit: 47de56f
• Base Engine: EVAL
• Target Commit: 4327469
• Target Engine: EVAL

Result Details

• Passing in both: 5565
• Failing in both: 50
• Ignored in both: 281
• PASSING in BASE but now FAILING in TARGET: 0
• PASSING in BASE but now IGNORED in TARGET: 0
• FAILING in BASE but now PASSING in TARGET: 0
• IGNORED in BASE but now PASSING in TARGET: 0

[johnedquinn]

Something I didn't catch from before. ExprIsType should be distinct from ExprIsNull and ExprIsMissing and ExprIsUnknown. DataType shouldn't contain the NULL and MISSING variants.
That way, you don't need those checks in the visitExprCast. Since this modelling is not the main topic of this PR, this can be a follow-up if you'd like.

[alancai98]

Yeah, @RCHowell gave me some context. The previous sprout AST modeling for IS and type were not correct, hence why the current v1 AST modeling is not correct. The correct modeling of IS in the ast and plan will need some additional spec work so will be addressed in a future PR before v1 is released. I've added some TODOs in data type and ExprIsType for now.