Currently we are using Avro data format in production. Out of several good points using Avro, we know that it is good in schema evolution. Now we are evaluating Parquet format because of its effic...

What is the exact difference between fact-less fact and fact table ? I have perused couple of articles but they weren't cogent

I am creating data warehouse model on numerous OLTP tables. a) I can either utilize a Star schema or b) Flat table model table. Many people think dimensional star schema model table is not require...

I am analyzing Azure SQL DW and I came across the term DWU (Data warehouse units). The link on Azure site only mentions a crude definition of DWU. I want to understand how DWU is calculated and how...

I'm new to dimensional data modeling and wondering how I can apply it to something that doesn't look like a sales report. Let's say I have a web messenger. It tracks user's device, browser type an...

Also, is there anything wrong with doing transforms/joins directly within BigQuery? I'd like to minimize the number of components and steps involved for a data warehouse I'm setting up (simple tran...

I get the exception "The formal parameter "@param1" was not declared as an OUTPUT parameter, but the actual parameter passed in requested output" I'm pretty sure I got everything in the corre...

Need your help I have successfully installed VS2017 on my computer . But when I tried to install SQL server data tools 15.6.0 or 15.5.1 it gives me error as below : Setup failed The configurati...

I am trying to create dimensional model on a flat OLTP tables (not in 3NF). There are people who are thinking dimensional model table is not required because most of the data for the report prese...

We are looking at Amazon Redshift to implement our Data Warehouse and I would like some suggestions on how to properly design Schemas in Redshift, please. I am completely new to Redshift. In the p...

I'm trying to design a Data Warehouse for a single store of commonly required data ranging from finance systems, project scheduling systems and a myriad of scientific systems. I.e. many different d...

I've been googling all over the place and haven't found this. The retail client I'm working for using the NRFretail calendar. NRF site Calendars I'm wondering if anyone has ever created a lookup/di...

In layman terms, what would be the key differences between WITH clause & temporary table? In which scenario it is better to use one over the other?

From what I've read: Table or Views data access mode commits each row at a time as a transaction. Thus, making a package transferring 5 million rows take long (30+ minutes). Fast-load data access...

I have a DimPlace dimension that has the name of the place (manually entered by the user) and the latitude and longitude of the place (automatically captured). Since the Places are entered manually...

I have click stream data such as referring URL, top landing pages, top exit pages and metrics such as page views, number of visits, bounces all in Google Analytics. There is no database yet where a...

So Azure SQL Data Warehouse doesn't support identity columns, and therefore it's tricky to deal with surrogate keys.. anyone got any bold solutions on this one? This is best i have found, and it's...

I am from SQL Datawarehouse world where from a flat feed I generate dimension and fact tables. In general data warehouse projects we divide feed into fact and dimension. Ex: I am completely new...

I am designing a new hadoop-based data warehouse using hive and I was wondering whether the classic star/snowflake schemas were still a "standard" in this context. Big Data systems embrace redunda...

I want to understand how surrogate keys are leveraged in real-time DWH environments. I get that they add the benefit of not being dependent on source-generated data to store each dimension key and ...

I was wondering about why and when we need a data warehouse, I mean the main goal of data warehouse is to provide a reporting from multidimentional view, but in some case there is a way to build a ...

I am familiar with Kimball data warehouses, but I have never seen an Inmon data warehouse. With all my research, I'm looking for a real example. I understand that Inmon data warehouses are normaliz...

I've been tasked with coming up with a recommendation of how to proceed with a EDW and am looking for clarification on what I'm seeing. Everything that I am learning about states that Kimball's app...

I'm trying to model my data warehouse using a star schema but I have a problem to avoid joins between fact tables. To give a trivial idea of my problem, I want to collect all the events who occur o...

According to The Data Warehouse Toolkit by Kimball "The grain must be declared before choosing dimensions or facts because every candidate dimension or fact must be consistent with the grain." ...