diff --git a/.cache/plugin/social/assets/images/social/sponsor-blah.png b/.cache/plugin/social/assets/images/social/sponsor-blah.png new file mode 100644 index 00000000..eab6f01d Binary files /dev/null and b/.cache/plugin/social/assets/images/social/sponsor-blah.png differ diff --git a/.cache/plugin/social/assets/images/social/sponsor.png b/.cache/plugin/social/assets/images/social/sponsor.png index 843a97ff..dcb42c02 100644 Binary files a/.cache/plugin/social/assets/images/social/sponsor.png and b/.cache/plugin/social/assets/images/social/sponsor.png differ diff --git a/.cache/plugin/social/manifest.json b/.cache/plugin/social/manifest.json index a57d03f9..648e424f 100644 --- a/.cache/plugin/social/manifest.json +++ b/.cache/plugin/social/manifest.json @@ -1,6 +1,6 @@ { "assets/images/social/use-case.png": "af616615b03287b308aef251bbb1df0e733673f8", - "assets/images/social/sponsor.png": "3f0a3fa0fe4a8b402dc466897a7cdb292a6cae39", + "assets/images/social/sponsor.png": "da859d64c8b4b221c85e862023259830e4ed9b61", "assets/images/social/legal/terms-of-service.png": "6ec7f830230d9b2634fe4f1df28515b9634e66e2", "assets/images/social/about.png": "f06fb9fd297df6846154fcab074af00618acbd8c", "assets/images/social/get-started/docker.png": "50000ec64d76abb9d1c111969573d4db9f738f60", @@ -41,5 +41,6 @@ "assets/images/social/use-case/roadmap.png": "5347d2fca134ae9b74f47d4264a8d0eeba8e3b5c", "assets/images/social/use-case/blog/shift-left-data-quality.png": "79e3df16ecb96943ab3fdb233d315595366209ca", "assets/images/social/setup/delete-data.png": "4699fa68ff1573f1bb847fc6926f7eeb7e942524", - "assets/images/social/demo.png": "48db7ee2f51ea5a7bfaf696061dc7cdd8398ca39" + "assets/images/social/demo.png": "48db7ee2f51ea5a7bfaf696061dc7cdd8398ca39", + "assets/images/social/sponsor-blah.png": "f369f1d660b471ef373daf40722a62d4b756f78f" } \ No newline at end of file diff --git a/docs/diagrams/index/data_connections.gif b/docs/diagrams/index/data_connections.gif new file mode 100644 index 00000000..884148fc Binary files /dev/null and b/docs/diagrams/index/data_connections.gif differ diff --git a/docs/diagrams/index/data_relationship.gif b/docs/diagrams/index/data_relationship.gif new file mode 100644 index 00000000..92d813f7 Binary files /dev/null and b/docs/diagrams/index/data_relationship.gif differ diff --git a/docs/diagrams/index/data_validations.gif b/docs/diagrams/index/data_validations.gif new file mode 100644 index 00000000..219f8421 Binary files /dev/null and b/docs/diagrams/index/data_validations.gif differ diff --git a/docs/diagrams/index/delete_data.gif b/docs/diagrams/index/delete_data.gif new file mode 100644 index 00000000..8b7a6248 Binary files /dev/null and b/docs/diagrams/index/delete_data.gif differ diff --git a/docs/index.md b/docs/index.md index 66928387..688f37e1 100644 --- a/docs/index.md +++ b/docs/index.md @@ -1,108 +1,93 @@ --- title: "Automated data generation and validation tool" -description: "A synthetic data generation and testing tool that can automatically discover, generate and validate for files, databases, HTTP APIs and messaging systems." +description: "A synthetic data generation and testing tool that can automatically discover, generate and validate for +files, databases, HTTP APIs and messaging systems." image: "https://data.catering/diagrams/logo/data_catering_logo.svg" --- -

Data Caterer is a metadata-driven data generation and -validation tool that aids in creating production-like data across both batch and event data systems. Run data validations -to ensure your systems have ingested it as expected, then clean up the data afterwards.

+

Never manually generate or validate data again.

+

Create simple managed flows for data generation, validation and cleanup.

- + + + + + + + + + + + + + + + + + +
-

Simplify your data testing

+

๐Ÿ”Œ Data Connections


Connect to databases, messaging systems, HTTP APIs, file systems, data catalogs and +metadata sources to automatically generate and validate data. -

Take away the pain and complexity of your data landscape and let Data Caterer handle it

+		 - -[Try now](get-started/docker.md){ .md-button .md-button--primary .button-spaced } -[Demo](sample/ui/index.html){ .md-button .md-button--primary .button-spaced } - + -

Data testing is difficult and fragmented

+
-- Data being sent via messages, HTTP requests or files and getting stored in databases, file systems, etc. -- Maintaining and updating tests with the latest schemas and business definitions -- Different testing tools for services, jobs or data sources -- Complex relationships between datasets and fields -- Different scenarios, permutations, combinations and edge cases to cover + -

Current solutions only cover half the story

+		 -- Specific testing frameworks that support one or limited number of data sources or transport protocols -- Under utilizing metadata from data catalogs or metadata discovery services -- Testing teams having difficulties understanding when failures occur -- Integration tests relying on external teams/services -- Manually generating data, or worse, copying/masking production data into lower environments -- Observability pushes towards being reactive rather than proactive +

๐Ÿš€ Relationships


Generate data with relationships between any data source. Batch or real-time. - -[Try now](get-started/docker.md){ .md-button .md-button--primary .button-spaced } -[Demo](sample/ui/index.html){ .md-button .md-button--primary .button-spaced } - +
-

What you need is a reliable tool that can handle changes to your data landscape

+

๐Ÿ‘€ Complex Data Validations


Don't just fire and forget. Validate your data with powerful validations +that can be powered by the data generated. -
- ![High level overview of Data Caterer](diagrams/high_level_flow-high-level.svg#only-light) - ![High level overview of Data Caterer](diagrams/high_level_flow-high-level-dark.svg#only-dark) -
+		 -With Data Caterer, you get: + -- Ability to connect to any type of data source: files, SQL or no-SQL databases, messaging systems, HTTP APIs -- Discover metadata from your existing infrastructure and services -- Gain confidence that bugs do not propagate to production -- Synthetic data generation that is production-like without ever connecting to production -- Be proactive in ensuring changes do not affect other data producers or consumers -- Configurability to run the way you want +
- -[Try now](get-started/docker.md){ .md-button .md-button--primary .button-spaced } -[Demo](sample/ui/index.html){ .md-button .md-button--primary .button-spaced } - + -## Tech Summary + -Use the Java, Scala API, or YAML files to help with setup or customisation that are all run via a Docker image. Want to -get into details? [Checkout the setup pages here](setup/index.md) to get code examples and guides that will take you -through scenarios and data sources. +

๐Ÿงน Data Cleanup


Delete the generated data or even delete the data generated by your consumers. Keep your environments nice and tidy ๐Ÿ˜Š. -Main features include: +
-- :material-card-search: Metadata discovery -- :material-file: Batch and :material-circle-multiple: event data generation -- :material-vector-difference-ba: Maintain referential integrity across any dataset -- :material-projector-screen-variant-outline: Create custom data generation scenarios -- :material-delete-sweep: Clean up generated data -- :material-check: Validate data -- :material-test-tube: Suggest data validations - -[Check other run configurations here.](setup/index.md#high-level-run-configurations) + +[Try now](get-started/docker.md){ .md-button .md-button--primary .button-spaced } +[Demo](sample/ui/index.html){ .md-button .md-button--primary .button-spaced } + ## What is it
-- :material-tools: __Data generation and testing tool__ +- :material-tools: __Test data management tool__ --- - Generate synthetic production-like data to be consumed and validated. + Generate synthetic production-like data to be consumed and validated. Clean up the data after using to keep your + environments clean. - :material-connection: __Designed for any data source__ --- - We aim to support pushing data to any data source, in any format. + We aim to support pushing data to any data source, in any format, batch or real-time. - :material-code-tags-check: __Low/no code solution__ --- - Can use the tool via either Scala, Java or YAML. Connect to data or metadata sources to generate data and validate. + Use the tool via either UI, Scala, Java or YAML. - :material-run-fast: __Developer productivity tool__ @@ -143,15 +128,3 @@ Main features include: [Try now](get-started/docker.md){ .md-button .md-button--primary .button-spaced } [Demo](sample/ui/index.html){ .md-button .md-button--primary .button-spaced } - -

Data Catering vs Other tools vs In-house

- - - -| | Data Catering | Other tools | In-house | -|------------------------|--------------------------------------------------------------------------------|-------------------------------------------|---------------------------------------------| -| Data flow | Batch and events generation with validation | Batch generation only or validation only | Depends on architecture and design | -| Time to results | 1 day | 1+ month to integrate, deploy and onboard | 1+ month to build and deploy | -| Solution | Connect with your existing data ecosystem, automatic generation and validation | Manual UI data entry or via SDK | Depends on engineer(s) building it | - - diff --git a/docs/javascripts/extra.js b/docs/javascripts/extra.js deleted file mode 100644 index e69de29b..00000000 diff --git a/docs/sponsor.md b/docs/sponsor.md index a8def414..d0c98c17 100644 --- a/docs/sponsor.md +++ b/docs/sponsor.md @@ -1,4 +1,4 @@ -# Sponsor +# Pricing To have access to all the features of Data Caterer, you can subscribe according to your situation. You will not be charged by usage. As you continue to subscribe, you will have access to the latest version of Data Caterer as new @@ -17,23 +17,21 @@ This is inspired by the [mkdocs-material project](https://github.com/squidfunk/m ## Features -- :material-card-search: Metadata discovery -- :material-connection: All data sources (see [here for all data sources](setup/connection.md)) +- :material-connection: Connect to all data sources (see [here for all data sources](setup/connection.md)) - :material-file: Batch and :material-circle-multiple: Event generation - :material-auto-fix: [Auto generation from data connections or metadata sources](setup/guide/scenario/auto-generate-connection.md) - :material-test-tube: Suggest data validations - :material-delete-sweep: [Clean up generated data](setup/guide/scenario/delete-generated-data.md) - :material-animation-play-outline: Run as many times as you want, not charged by usage +- :material-card-search: Metadata discovery - [Plus more to come](use-case/roadmap.md) ## Tiers - -
- - -
+ + + ## Manage Subscription diff --git a/mkdocs.yml b/mkdocs.yml index 3cfc4f6a..6ff81345 100644 --- a/mkdocs.yml +++ b/mkdocs.yml @@ -110,7 +110,7 @@ nav: - Shift Left Data Quality: 'use-case/blog/shift-left-data-quality.md' - About: - 'about.md' - - Sponsor: 'sponsor.md' + - Pricing: 'sponsor.md' - Terms of service: 'legal/terms-of-service.md' - Privacy policy: 'legal/privacy-policy.md' - Demo: 'demo.md' diff --git a/site/404.html b/site/404.html index f4c7fdc9..d8f95d92 100644 --- a/site/404.html +++ b/site/404.html @@ -2003,7 +2003,7 @@ - Sponsor + Pricing diff --git a/site/about/index.html b/site/about/index.html index cea43851..7a31890e 100644 --- a/site/about/index.html +++ b/site/about/index.html @@ -2086,7 +2086,7 @@ - Sponsor + Pricing @@ -2312,13 +2312,13 @@

Contact

- +
Next
- Sponsor + Pricing
diff --git a/site/assets/images/social/sponsor.png b/site/assets/images/social/sponsor.png index 843a97ff..dcb42c02 100644 Binary files a/site/assets/images/social/sponsor.png and b/site/assets/images/social/sponsor.png differ diff --git a/site/demo/index.html b/site/demo/index.html index eff73e8e..a92bd621 100644 --- a/site/demo/index.html +++ b/site/demo/index.html @@ -2029,7 +2029,7 @@ - Sponsor + Pricing diff --git a/site/diagrams/index/data_connections.gif b/site/diagrams/index/data_connections.gif new file mode 100644 index 00000000..884148fc Binary files /dev/null and b/site/diagrams/index/data_connections.gif differ diff --git a/site/diagrams/index/data_relationship.gif b/site/diagrams/index/data_relationship.gif new file mode 100644 index 00000000..92d813f7 Binary files /dev/null and b/site/diagrams/index/data_relationship.gif differ diff --git a/site/diagrams/index/data_validations.gif b/site/diagrams/index/data_validations.gif new file mode 100644 index 00000000..219f8421 Binary files /dev/null and b/site/diagrams/index/data_validations.gif differ diff --git a/site/diagrams/index/delete_data.gif b/site/diagrams/index/delete_data.gif new file mode 100644 index 00000000..8b7a6248 Binary files /dev/null and b/site/diagrams/index/delete_data.gif differ diff --git a/site/get-started/docker/index.html b/site/get-started/docker/index.html index c9b011c6..abdaece5 100644 --- a/site/get-started/docker/index.html +++ b/site/get-started/docker/index.html @@ -2138,7 +2138,7 @@ - Sponsor + Pricing diff --git a/site/index.html b/site/index.html index c67f58f3..3a678540 100644 --- a/site/index.html +++ b/site/index.html @@ -101,7 +101,7 @@
- + Skip to content @@ -458,17 +458,6 @@
    -
  • - - - - Tech Summary - - - - -
    • -
  • @@ -2104,7 +2093,7 @@ - Sponsor + Pricing @@ -2229,96 +2218,84 @@ -

    Data Caterer is a metadata-driven data generation and -validation tool that aids in creating production-like data across both batch and event data systems. Run data validations -to ensure your systems have ingested it as expected, then clean up the data afterwards.

    +

    Never manually generate or validate data again.

    +

    Create simple managed flows for data generation, validation and cleanup.

    - + + + + + + + + + + + + + + + + + +
    -

    Simplify your data testing

    +

    ๐Ÿ”Œ Data Connections


    Connect to databases, messaging systems, HTTP APIs, file systems, data catalogs and +metadata sources to automatically generate and validate data. -

    Take away the pain and complexity of your data landscape and let Data Caterer handle it

    +    		 -

    -Try now -Demo -

    -

    Data testing is difficult and fragmented

    + -
      -
    • Data being sent via messages, HTTP requests or files and getting stored in databases, file systems, etc.
      • -
    • Maintaining and updating tests with the latest schemas and business definitions
      • -
    • Different testing tools for services, jobs or data sources
      • -
    • Complex relationships between datasets and fields
      • -
    • Different scenarios, permutations, combinations and edge cases to cover
      • -
    -

    Current solutions only cover half the story

    +
    -
      -
    • Specific testing frameworks that support one or limited number of data sources or transport protocols
      • -
    • Under utilizing metadata from data catalogs or metadata discovery services
      • -
    • Testing teams having difficulties understanding when failures occur
      • -
    • Integration tests relying on external teams/services
      • -
    • Manually generating data, or worse, copying/masking production data into lower environments
      • -
    • Observability pushes towards being reactive rather than proactive
      • -
    -

    -Try now -Demo -

    -

    What you need is a reliable tool that can handle changes to your data landscape

    + + +    		 + +

    ๐Ÿš€ Relationships


    Generate data with relationships between any data source. Batch or real-time. + +
    + +

    ๐Ÿ‘€ Complex Data Validations


    Don't just fire and forget. Validate your data with powerful validations +that can be powered by the data generated. + +    		 + + + +
    + + + + + +

    ๐Ÿงน Data Cleanup


    Delete the generated data or even delete the data generated by your consumers. Keep your environments nice and tidy ๐Ÿ˜Š. + +
    -
    -

    High level overview of Data Caterer - High level overview of Data Caterer

    -
    -

    With Data Caterer, you get:

    -
      -
    • Ability to connect to any type of data source: files, SQL or no-SQL databases, messaging systems, HTTP APIs
      • -
    • Discover metadata from your existing infrastructure and services
      • -
    • Gain confidence that bugs do not propagate to production
      • -
    • Synthetic data generation that is production-like without ever connecting to production
      • -
    • Be proactive in ensuring changes do not affect other data producers or consumers
      • -
    • Configurability to run the way you want
      • -

    Try now Demo

    -

    Tech Summary

    -

    Use the Java, Scala API, or YAML files to help with setup or customisation that are all run via a Docker image. Want to -get into details? Checkout the setup pages here to get code examples and guides that will take you -through scenarios and data sources.

    -

    Main features include:

    -
      -
    • Metadata discovery
      • -
    • Batch and event data generation
      • -
    • Maintain referential integrity across any dataset
      • -
    • Create custom data generation scenarios
      • -
    • Clean up generated data
      • -
    • Validate data
      • -
    • Suggest data validations
      • -
    -

    Check other run configurations here.

    What is it

    • -

      Data generation and testing tool

      +

      Test data management tool

      -

      Generate synthetic production-like data to be consumed and validated.

      +

      Generate synthetic production-like data to be consumed and validated. Clean up the data after using to keep your +environments clean.

    • Designed for any data source

      -

      We aim to support pushing data to any data source, in any format.

      +

      We aim to support pushing data to any data source, in any format, batch or real-time.

    • Low/no code solution

      -

      Can use the tool via either Scala, Java or YAML. Connect to data or metadata sources to generate data and validate.

      +

      Use the tool via either UI, Scala, Java or YAML.

    • Developer productivity tool

      @@ -2354,40 +2331,6 @@

      What it is not

      Try now Demo

      -

      Data Catering vs Other tools vs In-house

      - -

      - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
      Data CateringOther toolsIn-house
      Data flowBatch and events generation with validationBatch generation only or validation onlyDepends on architecture and design
      Time to results1 day1+ month to integrate, deploy and onboard1+ month to build and deploy
      SolutionConnect with your existing data ecosystem, automatic generation and validationManual UI data entry or via SDKDepends on engineer(s) building it
      -

      diff --git a/site/javascripts/extra.js b/site/javascripts/extra.js deleted file mode 100644 index e69de29b..00000000 diff --git a/site/legal/privacy-policy/index.html b/site/legal/privacy-policy/index.html index 73f5910b..50963580 100644 --- a/site/legal/privacy-policy/index.html +++ b/site/legal/privacy-policy/index.html @@ -2029,7 +2029,7 @@ - Sponsor + Pricing diff --git a/site/legal/terms-of-service/index.html b/site/legal/terms-of-service/index.html index bf6e8567..48281201 100644 --- a/site/legal/terms-of-service/index.html +++ b/site/legal/terms-of-service/index.html @@ -2029,7 +2029,7 @@ - Sponsor + Pricing @@ -2357,7 +2357,7 @@

      Contact Us