webhdfs Questions

3

Solved

The documentation describing how to connect to a kerberos secured endpoint shows the following: curl -i --negotiate -u : "http://<HOST>:<PORT>/webhdfs/v1/<PATH>?op=..." The -u ...
Dinahdinan asked 21/7, 2016 at 16:39

2

I am trying to connect to HDFS protected with Kerberos authentication. I have following details but dont know how to proceed. User Password Realm HttpFs Url I tried below code but getting Authe...
Banana asked 15/7, 2019 at 4:52

1

Solved

I have a Spring application that reads a file from HDFS using WebHDFS. When I test it in IDEA, it works. But after I build the project and deploy the Docker image on a virtual machine locally or on...
Kanchenjunga asked 30/8, 2017 at 11:57

4

I'm loading 28 GB file in hadoop hdfs using webhdfs and it takes ~25 mins to load. I tried loading same file using hdfs put and It took ~6 mins. Why there is so much difference in performance? W...
Unattended asked 23/7, 2015 at 7:29

2

Solved

Can anyone please tell me that If I am using java application to request some file upload/download operations to HDFS with Namenode HA setup, Where this request go first? I mean how would the clien...
Eijkman asked 10/3, 2016 at 8:29

1

Solved

Is it possible to check to contents of a directory in HDFS using webhdfs? This would work as hdfs dfs -ls normally would, but instead using webhdfs. How do I list a webhdfs directory using Python...
Masha asked 23/6, 2016 at 10:51

2

Solved

I have a working application for managing HDFS using WebHDFS. I need to be able to do this on a Kerberos secured cluster. The problem is, that there is no library or extension to negotiate the tic...
Academicism asked 26/5, 2016 at 11:5

0

I am trying to browse my HDFS system from internet explorer but for some reason it is always using NTLM instead of Kerberos, so I receive the message GSSException: Defective token detected (Mec...
Asperse asked 22/4, 2016 at 12:42

0

I am using curl command to access hadoop(webhdfs) and for http response parsing i am using python. But after firing curl command ,multiple responses are being returned. curl -i "http://host:5007...
Mandatory asked 14/1, 2016 at 10:14

1

I need to transfer big files (at least 14MB) from the Cosmos instance of the FIWARE Lab to my backend. I used the Spring RestTemplate as a client interface for the Hadoop WebHDFS REST API describe...
Hadfield asked 28/11, 2015 at 18:17

1

Solved

Are the “resource manager” and the “hdfs namenode” always installed on the same host? 1) When I want to send an http request (YARN REST API) to get new application id I am using this web uri: htt...
Hwahwan asked 30/3, 2015 at 12:19

1

Solved

What is the difference between the WebHDFS REST API and HttpFS? If I understand correctly: HttpFS is an independent service that exposes a REST API on top of HDFS WebHDFS is a REST API built-int...
Maggiemaggio asked 30/7, 2014 at 9:49

2

I have a nodejs application and I want to write data into hadoop HDFS file system. I have seen two main nodejs libraries that can do it: node-hdfs and node-webhdfs. Someone have tried it? Any hints...
Monster asked 5/1, 2014 at 1:34

1

Solved

Is there any way by which I can download a file from HDFS using WebHDFS REST API?The closest I have reached is to use the open operation to read the file and save the content. curl -i -L "h...
Haller asked 31/5, 2013 at 20:9
1

© 2022 - 2024 — McMap. All rights reserved.