Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add smoke tests v2 generator implementation #3577

Closed
wants to merge 208 commits into from

Conversation

AlexDaines
Copy link

Description

Implements the generator for smoke tests v2 format based on the new smoke-2.json schema. Key features:

  • Supports all configuration options from the smoke-2.json schema
  • Handles complex input types including arrays and nested objects
  • Generates both success and failure test cases
  • Includes proper test categorization
  • Manages special cases for Tags and Includes objects

Questions for review:

  1. Special case handling for Tags/Includes - should this be more generic?
  2. Configuration defaults - should we explicitly set schema defaults?
  3. Error handling - any additional checks needed beyond ErrorCode?
  4. Input validation - should we validate against operation parameters?
  5. Test categorization - any additional AWS-specific categories needed?

Motivation and Context

This implementation supports the new smoke tests format (smoke-2.json) which provides more configuration options and better structure for test cases. The generator creates test files that:

  • Allow per-test configuration
  • Support all endpoint configuration options
  • Handle complex input structures
  • Provide proper error handling and validation

Testing

  • Verified generation with ACM service model
  • Tested various scenarios including:
    • Success and failure cases
    • Complex input structures (arrays, nested objects)
    • Special cases (Tags, Includes)
    • Edge cases (null values, empty strings)
    • All configuration options
  • Generated tests compile successfully

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist

  • My code follows the code style of this project
  • My change requires a change to the documentation
  • I have updated the documentation accordingly
  • I have read the README document
  • I have added tests to cover my changes
  • All new and existing tests passed

License

  • I confirm that this pull request can be released under the Apache 2 license

…CloudFormation Hooks invocation results for hooks invoked during a create change set operation or Cloud Control API operation
…e Event Filters as part of Amazon Connect Customer Profiles service.
…ICK, to support third-party monitors to trigger an automatic rollback during a deployment.
…ate and view the versions of a contact flow.
…Connect, along with APIs to create, read, search, update, and delete MessageTemplate resources.
…S CreateService/UpdateService APIs. The configuration allows for associating VPC Lattice target groups with ECS Services.
… It includes: 1) InvokeAssistant API - Invoke the Assistant to get alarm summaries and ask questions. 2) Dataset APIs - Manage knowledge base configuration for the Assistant. 3) Portal APIs enhancement - Manage AI-aware dashboards.
…roller (ARC) zonal shift and zonal autoshift to help you quickly recover an impaired application from failures in an Availability Zone (AZ).
…r workloads requiring fewer resources than mw1.small. This class supports a single instance of each Airflow component: Scheduler, Worker, and Webserver.
…che Iceberg tables that can be accessed only from a specific Amazon Virtual Private Cloud (VPC) environment.
…pdate for some existing Tax Registration APIs
…e control which blocks resources in VPCs and subnets that you own in a Region from reaching or being reached from the internet through internet gateways and egress-only internet gateways.
…cy feature for individual containers defined within a task definition. The configuration allows to specify whether ECS should resolve the container image tag specified in the container definition to an image digest.
…ly computed results from a set of completed tasks in a new workflow run.
…TCUs), a new feature that allows provisioning dedicated compute resources for your queries, providing predictable and cost-effective query performance.
…, and Bill Estimate resources. Updated documentation links.
… Notifications enabled an alert could be sent to customers about new messages even when they aren't actively using the mobile application.
…s recording mode and interval for both Individual Participant Recording (IPR) and Server-Side Compositions (SSC).
…support for listing migration task updates and associating, disassociating and listing source resources
…bject part of the Control Catalog GetControl API
@AlexDaines AlexDaines mentioned this pull request Dec 12, 2024
10 tasks
@AlexDaines AlexDaines closed this Dec 12, 2024
@AlexDaines
Copy link
Author

Closed in favor of #3578

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants