dbt Questions

1

Solved

is there a way to make these warnings in DBT errors? [WARNING]: Did not find matching node for patch with name 'my_model' in the 'models' section of file 'models/path/to/model.yml' We check errors...
Glauce asked 9/8, 2022 at 13:10

1

I am relatively new to DBT and I have been reading about env_var and I want to use this in a couple of situations and I am having difficultly and looking for some support. firstly I am trying to us...
Palmieri asked 12/7, 2022 at 17:16

1

Solved

I want to run a DBT Snapshot and am following a near-identical template to the one outlined in the documentation. However, I get the error when I run dbt snpashot Compilation Error in model test_sn...
Lovelace asked 26/6, 2022 at 2:31

1

Solved

Using the star macro, is there a way to also get the column data type (boolean, numerical, etc), in addition to the column name? For example, this query uses the star macro to collect the column na...
Stimson asked 23/6, 2022 at 13:17

1

I have currently dockerized my DBT solution and I launch it in AWS Fargate (triggered from Airflow). However, Fargate requires about 1 minute to start running (image pull + resource provisioning + ...
Elysium asked 24/2, 2022 at 16:29

3

Solved

I want to iterate over all the columns using dbt.
Clingfish asked 4/10, 2021 at 17:51

4

hope you are doing well. I wanted to check if anyone has get up and running with dbt in aws mwaa airflow. I have tried without success this one and this python packages but fails for some reason or...
Townsley asked 4/6, 2021 at 13:56

2

I am trying to build a DBT model from SQL which has delete statements based on where clause. Can any one please suggest me how to convert the below SQL delete statement into DBT model? ''' delete t...
Morality asked 7/10, 2020 at 12:17

1

Having trouble running dbt today... encountered this error message and cannot debug the issue. I did not have this issue yesterday and have not changed anything since. Installed dbt with Homebrew R...
dbt
Kt asked 30/9, 2020 at 19:28

1

Solved

I need some wisdom for a new DBT use case that I am trying to solve. I am pretty new to DBT and not sure what is the most efficient DBT way. We are using snowflake as our DWH. Problem We have a lot...
Penetrant asked 18/12, 2021 at 12:46

1

Solved

When running dbt jobs in Meltano, dbt run jobs may collide with each other if run out of a triggered context - for instance, when an on-demand job collides with a scheduled job or a CI-based job. I...
Illuminism asked 16/12, 2021 at 17:20

1

Solved

I have been reading dbt's How we configure Snowflake guide which explains the rationale behind having a raw database and an analytics database. Raw data is loaded into your warehouse into raw (e.g....
dbt
Fugleman asked 16/12, 2021 at 17:10

2

Solved

I've been working with dbt for a couple of months now, so still fairly new to it. When running a test model, I have no problems when using the view materialization: {{ config(materialized='view') }...
Instancy asked 7/10, 2021 at 15:28

3

Solved

We use airflow to orchestrate our workflows, and dbt with bigquery for our daily transformations in BigQuery. We have two separate git repos, one for our dbt project and a separate one for airflow....
Pettifogging asked 18/11, 2020 at 9:18

2

Solved

I would like to be able to run an ad-hoc python script that would access and run analytics on the model calculated by a dbt run, are there any best practices around this?
Manipur asked 10/11, 2021 at 18:59

3

Solved

We are considering using dbt to manage models in our PostgreSQL data warehouse. Since dbt models are SQL select statements, there doesn't seem to be an obvious, or documented, way to specify that a...
Concierge asked 5/2, 2021 at 10:44

1

Solved

I'm a new user of dbt, trying to write a relationship test: - name: PROTOCOL_ID tests: - relationships: to: ref('Animal_Protocols') field: id I am getting this error: Compilation Error Invalid...
dbt
Lithology asked 25/10, 2021 at 18:32

2

Solved

I'm just onboarding dbt and having gone through the tutorial docs I'm wondering if there's a difference between materializing my transformations as views or tables? I'm using Snowflake as the data ...
Decrepit asked 22/10, 2020 at 20:5

1

Solved

We have a large schema.yml file in our DBT folders. It is not the cleanest or easiest to find what we need in it. I am curious if anyone knows of a way to split up this file. I am not trying to ove...
Neptune asked 13/10, 2021 at 18:37

1

Solved

I'm new to the dbt and I'm planning to use dbt cli. One question is how to setup the dbt ui and have such a data lineage graph? I didn't find how to do it here with cli https://docs.getdbt.com/tuto...
dbt
Lower asked 13/10, 2021 at 5:43

2

I am curious if I can pass macros into another macro like this: {% macro my_macro(a, b, another_macro) %} ... {{ another_macro(a,b) }} ... {% endmacro %} BONUS: If dbt's framework can allow it ...
Hiccup asked 6/9, 2021 at 18:54

1

Solved

Thank you in advance for helping me in my journey! I am a dbt newb, doing the dbt fundamentals course. I am following the directions exactly. Sequence of the issue: I created .sql files in my mode...
Salim asked 19/7, 2021 at 11:38

2

I'm trying to build a model in DBT that flattens out a struct with name properties that contains about a hundred structs inside it (e.g. property1, property2, etc.), each with 5 different columns o...
Lavena asked 14/6, 2021 at 16:30

4

It seems dbt only works for a single database. If my data is in a different database, will that still work? For example, if my datalake is using delta, but I want to run dbt using Redshift, would d...
dbt
Keepsake asked 20/7, 2020 at 19:0

1

can anyone share how to organise multiple projects in dbt , given the best practices. My present abstract architecture hierarchy is as follows Analytics --.dbt/ -----profiles.yml --projects/ -----...
Utta asked 8/4, 2021 at 9:8

© 2022 - 2024 — McMap. All rights reserved.