How to direct DLT target table to a Unity Catalog Metastore
Asked Answered
H

1

6

This question is pretty straightforward. Seems like in DLT, you can define the output table name like below:

@dlt.table(name="my_table_name")
def my_pipeline():
  ...

This writes to the hive_metastore catalog, but how do I customize it for a different catalog?

Hamamelidaceous answered 12/8, 2022 at 20:58 Comment(0)
R
4

As of right now (august 2022), DLT doesn't support Unity Catalog yet. It should be available in the near future.

Update June 2023rd: DLT started to support Unity Catalog since April 2023rd.

P.S. You can join Databricks quarterly roadmap webinar if you want to get latest updates about newer features

Regeniaregensburg answered 13/8, 2022 at 8:0 Comment(4)
Is this still the case or do we have now UNITY catalog available with DLT?Arrowood
If it’s not announced then not yetRegeniaregensburg
@AlexOtt are you aware if it's on the roadmap and what the ETA is? Feels weird that these core Databricks features don't work with each other. I love UC and DLT, but by adopting UC it makes DLT useless, forcing users into other workflow frameworksRizika
I can’t give exact ETA, but I think that it was covered by the quarterly roadmap webinar…Regeniaregensburg

© 2022 - 2024 — McMap. All rights reserved.