Skip to content

Commit

Permalink
Remove multi-warehouse dependence from the docs (#1549)
Browse files Browse the repository at this point in the history
* Remove multi-warehouse dependence from the docs

* Remove a br
  • Loading branch information
Ekrekr authored Oct 9, 2023
1 parent b24ff18 commit 2ce51b4
Show file tree
Hide file tree
Showing 18 changed files with 11 additions and 322 deletions.
44 changes: 11 additions & 33 deletions readme.md
Original file line number Diff line number Diff line change
@@ -1,56 +1,34 @@
<p align="center">
<img src="https://github.com/dataform-co/dataform/blob/main/static/images/github_bg.png">
</p>
# Dataform Core

# Intro

Dataform core is an open source meta-language to create SQL tables and workflows. Dataform core extends SQL by providing a dependency management system, automated data quality testing, and data documentation.
Dataform core is an open source meta-language to create SQL tables and workflows in BigQuery. Dataform core extends SQL by providing a dependency management system, automated data quality testing, and data documentation.

Using Dataform core, data teams can build scalable SQL data transformation pipelines following software engineering best practices, like version control and testing.

<br/>
<br/>

<p align="center">
<img src="https://assets.dataform.co/github-readme/single-source-of-truth%20(1).png">
</p>

### Supported warehouses
![Data collections and integrations feed into Dataform, which exports this data to BI and analytics tools.](static/images/single-source-of-truth.png?raw=true)

- BigQuery
- Snowflake
- Redshift
- Postgres
- Azure SQL data warehouse

# Data modeling with Dataform
## Data modeling with Dataform

- [Quickstart](https://cloud.google.com/dataform/docs/quickstart)
- [Create tables and views](https://cloud.google.com/dataform/docs/tables)
- [Configure dependencies](https://cloud.google.com/dataform/docs/define-table#define_table_structure_and_dependencies)
- Write [data quality checks](https://cloud.google.com/dataform/docs/assertions)
- Enable [scripting](https://cloud.google.com/dataform/docs/develop-workflows-js) and code re-use with a JavaScript API

<div align="center">
<img src="https://assets.dataform.co/docs/introduction/simple_dag.png" alt="Dependency tree in a Dataform project">
<i>Dependency tree in a Dataform project</i>
</div>
![A simple Dataform DAG illustrating table dependency](static/images/simple-dag.png?raw=true)

_Note: we have recently undergone a documentation transition from [docs.dataform.co](https://docs.dataform.co/) to [cloud.google.com/dataform/docs](https://cloud.google.com/dataform/docs). Content hosted on the old document site is published from the [`main_v1` branch](https://github.com/dataform-co/dataform/tree/main_v1)._

# Get started
## Get started

## With the CLI
### With the CLI

You can install the Dataform CLI tool using the following command line. Follow the [docs](https://cloud.google.com/dataform/docs/use-dataform-cli) to get started.

```
npm i -g @dataform/cli
```

<br/>

## In Google Cloud Platform
### In Google Cloud Platform

Dataform in Google Cloud Platform provides a fully managed experience to build scalable data transformations pipelines in **BigQuery** using SQL. It includes:

Expand All @@ -59,15 +37,15 @@ Dataform in Google Cloud Platform provides a fully managed experience to build s

You can learn more on [cloud.google.com/dataform](https://cloud.google.com/dataform)

## How it works
### How it works

- Read the [docs here](https://cloud.google.com/dataform/docs/overview).

# Want to report a bug or request a feature?
## Want to report a bug or request a feature?

- For Dataform core / open source requests, you can open an [issue](https://github.com/dataform-co/dataform/issues) in GitHub.
- For Dataform in Google Cloud Platform, you can file a bug [here](https://issuetracker.google.com/issues/new?component=1193995&template=1698201), and file feature requests [here](https://issuetracker.google.com/issues/new?component=1193995&template=1713836).

# Want to contribute?
## Want to contribute?

Check out our [contributors guide](https://github.com/dataform-co/dataform/blob/main/contributing.md) to get started with setting up the repo.
4 changes: 0 additions & 4 deletions static/images/dataform_logo.svg

This file was deleted.

110 changes: 0 additions & 110 deletions static/images/datastack.svg

This file was deleted.

Binary file removed static/images/favicon.ico
Binary file not shown.
3 changes: 0 additions & 3 deletions static/images/footer_background.svg

This file was deleted.

Loading

0 comments on commit 2ce51b4

Please sign in to comment.