I'm trying to setup Hadoop3-alpha3 with a Single Node Cluster (Psuedo-distributed) and using the apache guide to do so. I've tried running the example MapReduce job but every time the connection is...

Contents of mapred-site.xml : <configuration> <property> <name>mapreduce.framework.name</name> <value>yarn</value> </property> <property> <na...

I am trying to install Hadoop(3.1.2) on Windows-10, but data node and node manager shuts down. I have tried downloading and placing the winutils.exe and hadoop.dll files under bin directory. I hav...

I have a vagrant box on debian/stretch64 I try to install Hadoop3 with documentation http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.htm When I run start-dfs...

I'm working on a Hadoop cluster (HDP) with Hadoop 3. Spark and Hive are also installed. Since Spark and Hive catalogs are separated, it's a bit confusing sometimes, to know how and where to save d...

I am new to hadoop. I'm trying to install hadoop in my laptop in Pseudo-Distributed mode. I am running it with root user, but I'm getting the error below. root@debdutta-Lenovo-G50-80:~# $HADOOP_PR...

I am running word count program from my windows machine on hadoop cluster which is setup on remote linux machine. Program is running successfully and I am getting output but I am getting following ...

I'm trying to build an Oozie workflow to execute everyday a python script which needs specific libraries to run. At the moment I created a python virtual environment (using venv) on a node of my c...

I want to use Spark version 2.2 and Hadoop latest version 3.1. Can I integrate Spark and Hadoop manually? I have already installed Spark 2.2 with Hadoop 2.6 or later but I want to update Hadoop. ...

I have updated the /conf/slaves file on the Hadoop master node with the hostnames of my slave nodes, but I'm not able to start the slaves from the master. I have to individually start the slaves, a...