Skip to content

Commit

Permalink
fix: remove ownership for query
Browse files Browse the repository at this point in the history
  • Loading branch information
sagar-salvi-apptware committed Nov 29, 2024
1 parent 902d2ed commit 855bfbe
Show file tree
Hide file tree
Showing 2 changed files with 8 additions and 11 deletions.
14 changes: 7 additions & 7 deletions metadata-ingestion/docs/sources/dremio/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,10 @@

Here's a table for **Concept Mapping** between Dremio and DataHub to provide a clear overview of how entities and concepts in Dremio are mapped to corresponding entities in DataHub:

| Source Concept | DataHub Concept | Notes |
| -------------------------- | --------------- | ---------------------------------------------------------- |
| **Physical Dataset/Table** | `Dataset` | Subtype: `Table` |
| **Virtual Dataset/Views** | `Dataset` | Subtype: `View` |
| **Spaces** | `Container` | Mapped to DataHub’s `Container` aspect. Subtype: `Space` |
| **Folders** | `Container` | Mapped as a `Container` in DataHub. Subtype: `Folder` |
| **Sources** | `Container` | Represented as a `Container` in DataHub. Subtype: `Source` |
| Source Concept | DataHub Concept | Notes |
| -------------------------- | --------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| **Physical Dataset/Table** | `Dataset` | Subtype: `Table` Note: `Ownership` information will only be available for the Cloud and Enterprise editions, it will not be available for the Community edition. |
| **Virtual Dataset/Views** | `Dataset` | Subtype: Note: `Ownership` information will only be available for the Cloud and Enterprise editions, it will not be available for the Community edition.`View` |
| **Spaces** | `Container` | Mapped to DataHub’s `Container` aspect. Subtype: `Space` |
| **Folders** | `Container` | Mapped as a `Container` in DataHub. Subtype: `Folder` |
| **Sources** | `Container` | Represented as a `Container` in DataHub. Subtype: `Source` |
Original file line number Diff line number Diff line change
Expand Up @@ -570,14 +570,11 @@ def process_query(self, query: DremioQuery) -> None:
)

# Add observed query

self.sql_parsing_aggregator.add_observed_query(
ObservedQuery(
query=query.query,
timestamp=query.submitted_ts,
user=CorpUserUrn(username=query.username)
if self.config.ingest_owner
else None,
user=CorpUserUrn(username=query.username),
default_db=self.default_db,
)
)
Expand Down

0 comments on commit 855bfbe

Please sign in to comment.