Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update spark-job tests with Hermes #2168

Open
miroslavpojer opened this issue Jan 24, 2023 · 0 comments
Open

Update spark-job tests with Hermes #2168

miroslavpojer opened this issue Jan 24, 2023 · 0 comments
Labels
feature New feature priority: undecided Undecided priority to be assigned after discussion tests QA/test-specific under discussion Requires consideration before a decision is made whether/how to implement

Comments

@miroslavpojer
Copy link
Collaborator

miroslavpojer commented Jan 24, 2023 •
edited
Loading

Background

Spark-jobs test - Hermes tooling are not up to date.

Feature

Spark-job tests are up to date to current existing logic and rules.

Proposed Solution

Solution Ideas:

  1. Improve test data - remove duplicity (Aa >> ab, ac, …)
  2. Update reference data to be compatible with Spark 3
  3. Add missing rules
  4. Add missing ignores to get tests passing
  5. Add std & conf scenarios
  6. Try to change usage of property "enceladus-job-jar" to use current version instead of defined one.
@miroslavpojer miroslavpojer added feature New feature under discussion Requires consideration before a decision is made whether/how to implement priority: undecided Undecided priority to be assigned after discussion labels Jan 24, 2023
@benedeki benedeki added the tests QA/test-specific label Jan 30, 2023
@miroslavpojer miroslavpojer mentioned this issue Feb 22, 2023
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature New feature priority: undecided Undecided priority to be assigned after discussion tests QA/test-specific under discussion Requires consideration before a decision is made whether/how to implement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@benedeki @miroslavpojer