amazon-redshift Questions
3
Solved
As Redshift is based on PostgreSQL, does it have an option to overwrite or append data in table while copying from S3 to redshift?
Only thing I got is use of triggers but they don't accept any arg...
Displode asked 19/7, 2016 at 10:47
5
I have created a Glue job that copies data from S3 (csv file) to Redshift. It works and populates the desired table.
However, I need to purge the table during this process as I am left with duplic...
Bloodyminded asked 29/12, 2017 at 17:21
3
Solved
I have a problem that I'm not quite sure how to solve: I have a web application (packaged as a war) and clients can configure which database they wish to point to. We support both PostgreSQL and Re...
Confectioner asked 11/8, 2015 at 20:39
0
I am having issues loading a json file (date fields) in my S3 bucket into Redshift via the copy command. The three columns that are problematic look like this...
{
...
"date":20201209,
...
Achievement asked 10/12, 2020 at 5:38
4
Is it possible to use Sequelize with Redshift? If not, what are the alternatives? I need an ORM for Node.js with built-in support for transactions, hence Sails.js is not an option. I've also looked...
Geometrize asked 16/8, 2015 at 16:25
6
Solved
I have series of ~10 queries to be executed every hour automatically in Redshift (maybe report success/failure).
Most queries are aggregation on my tables.
I have tried using AWS Lambda with Clou...
Askance asked 2/3, 2017 at 20:4
6
We have a few collections in mongodb that we wish to transfer to redshift (on an automatic incremental daily basis).
How can we do it? Should we export the mongo to csv?
Freezing asked 28/1, 2014 at 13:7
5
Solved
I am inserting a record into a Amazon Redshift table from Python 2.7 using psycopg2 library and I would like to get back the auto generate primary id for the inserted row.
I have tried the usual w...
Pendergrass asked 5/4, 2017 at 19:27
3
Solved
I am writing psql through Amazon Redshift and now I am trying to save the output as CSV through PSQL query, on SQL Workbench
The reason I am planning to do this through query instead of using selec...
Colman asked 22/5, 2017 at 20:18
1
Solved
I want to get the column names in redshift using python boto3
Creaed Redshift Cluster
Insert Data into it
Configured Secrets Manager
Configure SageMaker Notebook
Open the Jupyter Notebook wrote t...
Villainous asked 21/10, 2020 at 1:49
4
Solved
I am reading an SQL query in Redshift and can't understand the last part:
...
LEFT JOIN (SELECT MIN(modified) AS first_modified FROM user) ue
ON 1=1
What does ON 1=1 mean here?
Dissolute asked 13/2, 2016 at 1:8
3
I'm pulling data from Amazon S3 into a table in Amazon Redshift. The table contains various columns, where some column data might contain special characters.
The copy command has an option called ...
Do asked 10/3, 2017 at 14:9
3
Solved
I am trying to copy some data from S3 bucket to redshift table by using the COPY command. The format of the file is PARQUET. When I run the execute the COPY command query, I get InternalError_: Spe...
Manger asked 29/3, 2020 at 21:33
2
Solved
I am using default DBeaver settings in Mac OS but when I connect to Redshift, the pg_catalog schema & system tables within are missing in DBeaver Project browser. I tried looking into DBeaver d...
Volumed asked 7/11, 2019 at 22:53
4
I'm using the latest version of IntelliJ and I've just created a cluster in Amazon Redshift. How do I connect IntelliJ to Redshift so that I can query it from my favorite IDE?
Metacenter asked 31/8, 2015 at 20:2
3
Solved
AWS Redshift has recently released their own new encoding format AZ64, for which they say:
Compared to ZSTD encoding, AZ64 consumed 5–10% less storage, and was 70% faster
When I use an ANALYZE...
Scharaga asked 21/11, 2019 at 15:12
2
Solved
I understand that the COPY command imports lots of data very efficiently. But copying data from one table to another with the INSERT command is slow. Is there a more efficient way to copy data from...
Footrace asked 9/2, 2015 at 15:22
3
Solved
Logged in as the superuser, how can I grant user access to a specific table under a specific schema.
I tried this
GRANT SELECT on TABLE this_schema.my_table TO my_user
But when I login as my_use...
Taneka asked 28/2, 2019 at 16:39
1
Solved
I have two Redshift tables which get joined on an id and a date in a specific date range.
When I try to full-outer-join the tables (both alternative SQL statements further down below), I get the fo...
Fireboat asked 3/7, 2020 at 9:2
0
I have a Redshift cluster and use psycopg2 library with Lambda to call stored procedures in Redshift.
I have two stored procedures and use
cur = conn.cursor()
cur.execute("call stored_procedur...
Borecole asked 1/7, 2020 at 1:36
1
Solved
Can't select the default VPC. Error: VPC associated with db subnet group does not exist
Error image 1 -> https://i.sstatic.net/8dp4Y.png
Error Image 2 -> https://i.sstatic.net/ulytq.png
VPC Dash...
Nernst asked 11/6, 2020 at 6:28
3
Solved
I am using the data found on this page to practice the copy command.
But i am getting an exception
org.postgresql.util.PSQLException: ERROR: S3ServiceException:The bucket you are attempting to ...
Jannet asked 21/7, 2014 at 8:16
3
I am trying out AWS Glue service to ETL some data from redshift to S3. Crawler runs successfully and creates the meta table in data catalog, however when I run the ETL job ( generated by AWS ) it f...
Phenolphthalein asked 22/8, 2017 at 8:50
2
Solved
I'm new to Redshift and having some clarification on how Redshift operates:
Does Amazon Redshift has their own backend storage platform or it depends on S3 to store the data as objects and Redshif...
Elata asked 7/5, 2020 at 12:27
1
Solved
I am trying to write a dataframe from pandas to redshift.
here is the code
df = pd.DataFrame({'num_legs': [2, 4, 8, 0],
'num_wings': [2, 0, 0, 0],
'num_specimen_seen': [10, 2, 1, 8]},
index=[...
Dawndawna asked 22/11, 2019 at 11:14
© 2022 - 2024 — McMap. All rights reserved.