webhdfs Questions
3
Solved
The documentation describing how to connect to a kerberos secured endpoint shows the following:
curl -i --negotiate -u : "http://<HOST>:<PORT>/webhdfs/v1/<PATH>?op=..."
The -u ...
2
I am trying to connect to HDFS protected with Kerberos authentication. I have following details but dont know how to proceed.
User
Password
Realm
HttpFs Url
I tried below code but getting Authe...
Banana asked 15/7, 2019 at 4:52
1
Solved
I have a Spring application that reads a file from HDFS using WebHDFS. When I test it in IDEA, it works. But after I build the project and deploy the Docker image on a virtual machine locally or on...
4
I'm loading 28 GB file in hadoop hdfs using webhdfs and it takes ~25 mins to load.
I tried loading same file using hdfs put and It took ~6 mins. Why there is so much difference in performance?
W...
2
Solved
Can anyone please tell me that If I am using java application to request some file upload/download operations to HDFS with Namenode HA setup, Where this request go first? I mean how would the clien...
1
Solved
Is it possible to check to contents of a directory in HDFS using webhdfs?
This would work as hdfs dfs -ls normally would, but instead using webhdfs.
How do I list a webhdfs directory using Python...
2
Solved
I have a working application for managing HDFS using WebHDFS.
I need to be able to do this on a Kerberos secured cluster.
The problem is, that there is no library or extension to negotiate the tic...
0
I am trying to browse my HDFS system from internet explorer but for some reason it is always using NTLM instead of Kerberos, so I receive the message
GSSException: Defective token detected (Mec...
Asperse asked 22/4, 2016 at 12:42
0
1
I need to transfer big files (at least 14MB) from the Cosmos instance of the FIWARE Lab to my backend.
I used the Spring RestTemplate as a client interface for the Hadoop WebHDFS REST API describe...
Hadfield asked 28/11, 2015 at 18:17
1
Solved
Are the “resource manager” and the “hdfs namenode” always installed on the same host?
1) When I want to send an http request (YARN REST API) to get new application id I am using this web uri:
htt...
Hwahwan asked 30/3, 2015 at 12:19
1
Solved
What is the difference between the WebHDFS REST API and HttpFS?
If I understand correctly:
HttpFS is an independent service that exposes a REST API on top of HDFS
WebHDFS is a REST API built-int...
2
I have a nodejs application and I want to write data into hadoop HDFS file system. I have seen two main nodejs libraries that can do it: node-hdfs and node-webhdfs. Someone have tried it? Any hints...
1
Solved
Is there any way by which I can download a file from HDFS using WebHDFS REST API?The closest I have reached is to use the open operation to read the file and save the content.
curl -i -L "h...
1
© 2022 - 2024 — McMap. All rights reserved.