I am currently employed as a Junior Data Developer and recently saw a post saying that Azure Synapse can now create SQL tables from Delta tables. I tried creating an SQL table from a Delta table wh...

I'm trying to connect from a Databricks notebook to an Azure SQL Datawarehouse using the pyodbc python library. When I execute the code I get this error: Error: ('01000', "[01000] [unixODBC][Drive...

I have created 3 different notebook using pyspark code in Azure synapse Analytics. Notebook is running using spark pool. There is only one spark pool for all 3 notebook. when these 3 notebook run i...

I have the following partition strategy in an ADLS Gen2 store dir_parquet = "abfss://blah.windows.net/container_name/project=cars/make=*/model=*/*.parquet" And this would load in the alr...

I will give some context regarding our inconvenience in Azure Synapse: We created a Stored Procedure (it creates a VIEW which reads all the parquet files in a certain folder) on a Develop script, ...

I am trying to run an Stored Proc in SQL Server (Synapse) using pyodbc.This SP merely performs INSERT operation into a table. sql =""" EXEC my_sp (?,?,?)""" values = (...

I have installed: Ubuntu (18.04) Python (3.6.8) msodbcsql17 (Microsoft ODBC Driver 17 for SQL Server) SQLAlchemy (1.3.5) Pandas (0.24.2) and I want to create just a proof of concept using SQLAl...

I am new in Azure Synapse Analytics. I have created database in workspace but when I am trying to create a new table it is showing below error. Failed to execute query. Error: CREATE TABLE <tab...

I'm trying to execute an Azure Synapse Notebook using Notebook Activity in Synapse Pipelines and it keeps coming up with errors while debuging the Pipelines, the Notebook is using TokenLibrary.getS...

I created a Synapse workspace in my Azure Portal and tried opening the Synapse studio and I received the following error: Failed to load one or more resources due to No access, error code 403. cr...

I'm building some reusable libraries to use in Azure synapse. And these libraries need mssparkutils, built-in synapse library. Is it possible to install this library/module on local python environm...

I have Installed Microsoft Integration Runtime configuration Manager When I have Migrated Data from On-Premise SQL Server to Azure Data Lake and when I'm trying to use for another Azure Data Factor...

Just would like to know what's the problem of the following merge . thanks

Following example from Azure team is using Apache Spark connector for SQL Server to write data to a table. Question: How can we execute a Stored Procedure in an Azure Databricks when using Apache S...

Following example from Azure team on Using Apache Spark connector for SQL Server is using hard-coded user name and password. But I am storing password in Azure key Vault for security requirements. ...

I'm little bit new on Azure and I'm wondering when is recommendable to use ADF, Synapse, or DataBricks. What are their use cases for best practices and performance? Could you help me with this theo...

When I try to drop a database in my builtin synapse pool, I'm getting the following error: Cannot drop database "database name" because it is currently in use. I've tried in both SSMS an...

I am new to Synapse (Azure SQL DW). Currently, the DW has lots of views and I need to modify a handful of them. The issue is that I do not know how the views were created. Is there a query to check...

I know I can accomplish my objective with this process: Create new column Update new from old Drop old I am looking for a way to do this with one command. I know that remane object works at the...

I used the SQL Server management studio to generate script against Azure Data Warehouse. I selected Edition Azure Data Warehouse, it generates below the script to drop table if it exists and create...

I have an OPENJSON command that takes the parsed JSON and LEFT joins it onto an existing table. When I add the LEFT JOIN I get the error: collation conflict between "Latin1_General_BIN2"...

I am connecting to a RESTful api using Azure Synapse Analytics notebook and write the json file to Azure Data Lake Storage Gen 2. pyspark code: import requests response = requests.get('https://api....

Can someone explain what is the difference between Azure Analysis Services and Azure Synapse Analytics? Why would one use Analysis Services over Synapse Analytics? Thanks,

I tried to run the following commands in SQL DW: RENAME OBJECT dbo.test TO test2 RENAME OBJECT test TO test2 Both failed with the following error: No item by the name of '[DemoDB].[dbo].[test]' c...

I am looking for databricks equivalent properties in Synapse spark. Please let me know if there are any or workaround for the same. Using MERGE command to Insert/update the data. However, it does ...