hive-partitions Questions

5

Solved

Hive version 1.1 I have a hive external table as below: CREATE EXTERNAL TABLE `schedule_events`( `schedule_id` string COMMENT 'from deserializer', `service_key` string COMMENT 'from deserializer...
Meuser asked 19/9, 2017 at 18:41

4

Solved

I'm planning to truncate the hive external table which has one partition. So, I have used the following command to truncate the table : hive> truncate table abc; But, it is throwing me an e...
Cassiani asked 12/11, 2018 at 6:52

2

I am new to pySpark. I am trying get the latest partition (date partition) of a hive table using PySpark-dataframes and done like below. But I am sure there is a better way to do it using datafr...
Gallinule asked 7/3, 2019 at 21:40

1

Solved

Suppose I want to INSERT INTO a static hive partition, can I do that with Presto? The PARTITION keyword is only for hive. INSERT INTO TABLE Employee PARTITION (department='HR') Caused by: co...
Boscage asked 20/5, 2020 at 22:39

4

alter table abc add columns (stats1 map<string,string>, stats2 map<string,string>) i have altered my table with above query. But after while checking the data i got NULL's for the bot...
Hutchens asked 14/11, 2016 at 5:29

1

Solved

I am trying to use Spark Structured Streaming - writeStream API to write to an External Partitioned Hive table. CREATE EXTERNAL TABLE `XX`( `a` string, `b` string, `b` string, `happened` timestamp...

2

I have external hive table stored as Parquet, partitioned on a column say as_of_dt and data gets inserted via spark streaming. Now Every day new partition get added. I am doing msck repair table s...
Turnbull asked 6/8, 2018 at 17:40

1

Solved

While inserting data into table hive threw the error "Dynamic partition cannot be the parent of a static partition '3'" using below query INSERT INTO TABLE student_partition PARTITION(course , y...
Aluminous asked 7/5, 2018 at 17:30

1

I have a HiveQL script that can do some operations based on a hive table. But before doing these operations, I will check whether the partition needed exists, and if not, I will terminate the scrip...
Dou asked 4/5, 2018 at 10:6

1

I'm creating a new table in Hive using: CREATE TABLE new_table AS select * from old_table; My problem is that after the table is created, It generates multiple files for each partition - while I...

2

Solved

An external table in HIVE is partitioned on year, month and day. So does the following query delete data from external table for the specific partitioned referenced in this query?:- ALTER TABLE M...
Loux asked 12/7, 2016 at 1:11
1

© 2022 - 2024 — McMap. All rights reserved.