Import dbt meta tags into Metaphor
N
Noa David
import the meta dictionary from dbt models into metaphor. ideally display those meta tags as custom metadata on the materialized dataset
sample meta tag :
config:
meta:
{
"owner": "owner name",
"email": "owner email",
"Last Author": "author name",
"Owning Team": "BI",
"Business owner": "business owner name",
"Domain": "HR",
"Sub domain": "Employee managememt",
"Data freshness": "Daily", --Live, Hourly, every X min,custom
"Aggregation level": "<field_name> , <field_name>",
"Tags":"ab_test, multiproducts"
}
Kirit Basu
Noa David Couple of questions :
- how is this generally generated? is it a part of your ci/cd process thats automatically generating these entries or is it done manually.
- Are those tags supposed to be dbt tags, or are they specifically Metaphor tags? (technically if there are tags associated with a model we automatically bring them into metaphor)
- Since you already use MonteCarlo is there a particular reason you are needing to define the Data freshness again in this manner?
N
Noa David
Kirit Basu: Hey
These tags are generated as part of the ci/cd. this is the policy for every new model created by the developers and created in dbt.
We use it since we get a lot of questions for analysts on the aggregation level of a table and when it is refreshed (not only if, but when during the day)