apache-tez Questions
2
Solved
Problem -
I am running 1 query in AWS EMR. It is failing by throwing exception -
java.io.FileNotFoundException: File s3://xxx/yyy/internal_test_automation/2016/09/17/17156/data/feed/commerce_feed...
Wolter asked 17/9, 2016 at 12:47
4
I've been running some hive scripts on an aws emr 4.8 cluster with hive 1.0 and tez 0.8.
My configurations look like this:
SET hive.exec.compress.output=true;
SET mapred.output.compression.type=...
Paulin asked 26/10, 2016 at 1:45
1
Solved
Current Setup
we have our 10 node discovery cluster.
Each node of this cluster has 24 cores and 264 GB ram Keeping some memory and CPU aside for background processes, we are planning to use 240 G...
Chantalchantalle asked 20/3, 2019 at 7:28
3
Solved
After reading What is hive, Is it a database?, a colleague yesterday mentioned that he was able to filter a 15B table, join it with another table after doing a "group by", which resulted in 6B reco...
Subscribe asked 9/9, 2016 at 16:30
2
Hive version: 1.2.1
Configuration:
set hive.execution.engine=tez;
set hive.merge.mapredfiles=true;
set hive.merge.smallfiles.avgsize=256000000;
set hive.merge.tezfiles=true;
HQL:
ALTER TABLE `...
Handley asked 16/10, 2015 at 9:1
1
In the Tez paper from Saha et al., the following modular architecture of Hadoop 2 with Tez is shown:
Why would someone run Spark/Flink on Tez?
What are the advantages? Better utilization of YAR...
Tablet asked 9/9, 2016 at 12:42
2
Solved
Are there any performance benchmark(genuine ones) that compare Stinger vs Impala vs Drill? Also, which is preferred - my use case will be mainly towards ad-hoc interactive queries on top of Hive. T...
Metopic asked 22/8, 2015 at 6:44
1
I want to get the interpretation of Map-Reduce logs after running a query on Hive-Tez ? What the lines after INFO: conveys ?
Here I have attached a sample
INFO : Session is already open
INFO : D...
Beall asked 24/8, 2016 at 6:17
1
Solved
I don't know how to fix this error:
Vertex failed, vertexName=initialmap, vertexId=vertex_1449805139484_0001_1_00, diagnostics=[Task failed, taskId=task_1449805139484_0001_1_00_000003, diagnostics...
Brandonbrandt asked 12/12, 2015 at 22:20
1
Solved
As the github page of tez says, tez is very simple and at its heart has just two components:
The data-processing pipeline engine, and
A master for the data-processing application, where-by one ca...
Leavenworth asked 17/7, 2015 at 0:48
0
Getting error while running query on hive over tez. As per logs, hive is failing while copying tez jars to a hdfs location on start of tez session.Below is the complete log obtained from hive log f...
Jylland asked 18/6, 2015 at 22:20
1
© 2022 - 2024 — McMap. All rights reserved.