We have a Kafka cluster consists of 6 nodes. Five of the 6 nodes have zookeeper. A spark streaming job is reading from a streaming server, do some processing, and send the result to Kafka. From ...

I recently setup Kafka on a single node CDH 5 setup with the aim of playing with it on a single node before moving to a real cluster. Initially, I just started the zookeeper server, with the kafka ...

So today we run into a disturbing solr issue. After a restart of the whole cluster one of the shard stop being able to index/store documents. We had no hint about the issue until we started indexin...

I am using following code to extract Kafka broker list from zookeeper: private static String getBrokerList() { try { ZooKeeper zookeeper = new ZooKeeper(zookeeperConnect, 15000, null); List<...

On studying the material in multiple no of websites and videos, I am confused with the functionalities and differences in the purposes of the 3 hadoop components ZooKeeper, Journal Node and the Quo...

For particular reasons I need to use both - ConsumerGroup (a.k.a. high-level consumer) and SimpleConsumer (a.k.a. low-level consumer) to read from Kafka. For ConsumerGroup I use ZooKeeper-based con...

I need to debug the data being exchanged between my kafka consumer and zookeeper using tcpdump. I went through the zookeeper documentation but could not find any write up about the zookeeper commun...

This question is in reference to https://zookeeper.apache.org/doc/trunk/zookeeperObservers.html Observers are non-voting members of an ensemble which only hear the results of votes, not the agr...

Here is the output of zookeeper monitoring zk_version 3.4.6-1569965, built on 02/20/2014 09:09 GMT zk_avg_latency 0 zk_max_latency 0 zk_min_latency 0 zk_packets_received 3 zk_packets_sent 2 ...

I am using zookeeper to get data from kafka. And here I always get data from last offset point. Is there any way to specify the time of offset to get old data? There is one option autooffset.reset...

I have a zookeeper cluster consisting of N nodes (which knows about each other). What if I pass only M < N of the nodes' addresses in zk client connection string? What will be the cluster's beha...

when i use kafka0.8.x，i can get all group list with zookeeper by path /consumers/group_id, because offsets will commit to zookeeper in 0.8.x. But in version of 0.10.x, offsets commited to kafka br...

Are there any well documented use cases of Apache ZooKeeper being used to distribute configuration of Java applications, and in particular Spring services? Like many users of cloud services I have...

I have setup a multi node setup for kafka, everything seems to work well and show no error logs unless i try to push message to one producer. I get a message: Bootstrap broker host2:2181 disconnec...

Regarding Apache-Kafka messaging queue. I have downloaded Apache Kafka from the Kafka download page. I've extracted it to /opt/apache/installed/kafka-0.7.0-incubating-src. The quickstart page say...

I am trying to start zookeeper on a remote virtual machine. I use this for my project regularly and I do not have any problems while starting the zookeeper. But lately when I am trying to start the...

I started a Solrcloud by running the included example bin/solr -e cloud, and in that case, I managed to start up a three nodes Solr cloud and created a gettingstarted collection: http://localhost...

There are a few topics and articles on Solr authentication & authorization, but I cannot get it to work (the way I like). I followed these tutorials / information sources: https://cwiki.apac...

We use Spring to run scheduled tasks which works fine with single node. We want to run these scheduled tasks in cluster of N nodes such that the tasks are executed atmost by one node at a point of ...

Is there any facility in the Apache Curator lock recipes (or lower-level ZooKeeper) for auto-releasing locks that have exceeded some TTL? If not, is there a best practice for dealing with that? I s...

I am trying to deploy Hbase in standalone mode following this article: http://hbase.apache.org/book.html#quickstart. The version is 0.92.1-cdh4.1.2 But I am getting these errors when try to create...

I have been trying to test a kafka installation and using the guide created a producer and consumer. When trying to retrieve a message I get the following error: WARN Session 0x0 for server null,...

Is there an embedded zookeeper so that we could use it in unit testing? It can be shipped with the test and run out of the box. Maybe we could mock some service and register to the embedded zookeep...

I'm trying to tweak our system status check to see the state of the Solr nodes in our SolrCloud. I'm facing the following problems: We send a query to each of the Solr nodes separately. If we get ...

Say I have two distributed process running the following code that uses zookeeper and curator for a shared lock: public static void main(String[] args) throws Exception { CuratorFramework client ...