We are choosing the best option for implementing a leader election for our service (written in Java) comprised of multiple (e.g., 3) instances for high availability. Our goal is to have only a sing...

We use docker swarm with service discovery for Backend REST application. The services in swarm are configured with endpoint_mode: vip and are running in global mode. Nginx is proxy passed with serv...

Suppose I want to have highly available Kafka on production on small deployment. I have to use following configs min.insync.replicas=2 // Don't want to lose messages in case of 1 broker crash def...

I have an Kubernetes environment running multipe applications (services). Now i'm a little bit confused how to setup the MySQL database instance(s). According to different sources each microservi...

I used the following logic to restart the uncompleted jobs on single-node Spring Batch application: public void restartUncompletedJobs() { try { jobRegistry.register(new ReferenceJobFactory(doc...

At work we're currently building a webapp that supports SSE. We're all relatively new to SSE, so we're dealing with lot's of (newbie) questions: Disconnected connections When a client closes his...

We have two servers (SQL-ATL01, SQL-ATL02) that make up a Failover Cluster, each running as part of a SQL Server High Availability Group (HAG). Each server has two network cards. One is a 10Gbit ca...

I am trying to connect HBase cluster via Phoenix. First, I have copied Phoenix client and query server jars files to HMaster and HRegion lib folder and restarted HBase services. Server - Started t...

I am trying to understand the logic for message deletion in RabbitMQ. My goal is to make messages persist even if there is not a client connected to read them, so that when clients reconnect the m...

The first section of the official Kubernetes tutorial states that, A Kubernetes cluster that handles production traffic should have a minimum of three nodes. but gives no rationale for w...

I am learning Kubernetes and currently deep diving into high availability and while I understand that I can set up a highly available control plane (API-server, controllers, scheduler) with local (...

first of all I'm using this setup postgres-docker-cluster, everything works fine during the fail-over, i stop the master and the slave1 take its place, but if i turn the master back on im not sure ...

I am trying to build the very lightweight solution for zero downtime deployment for Java apps. For the sake of simplicity lets think that we have two servers. My solution is to use: On the "front...

Hadoop is Consistent and partition tolerant, i.e. It falls under the CP category of the CAP theoram. Hadoop is not available because all the nodes are dependent on the name node. If the name node ...

With HDFS or HFTP URI scheme (e.g. hdfs://namenode/path/to/file) I can access HDFS clusters without requiring their XML configuration files. It is very handy when running shell commands like hdfs d...

Using Spark(1.6.1) standalone master, I need to run multiple applications on same spark master. All application submitted after first one, keep on holding 'WAIT' state always. I also observed, the...

We have a multi-container application, which uses a microservices architecture, running in Docker Compose. When I make code changes to the web app, for example, I need to rebuild the image with n...

I'm trying to come up with a solution for achieving Geo-Redundancy (2+ datacentres) while using Service Fabric reliable Actors/Services to manage state. It insinuates here that geo replication is p...

I'm trying to setup a cluster of RabbitMQ servers, to get highly available queues using an active/passive server architecture. I'm following this guides: http://www.rabbitmq.com/clustering.html ...

I have two servers listening on a TCP port behind a load balancer. The load balancer can detect if a TCP connection attempt from a client was unsuccessful and retry it to the second server without ...

This is actually a standby HA namenode. It was configured with the same settings as the primary and hdfs namenode -bootstrapStandby was successfully run. It begins coming up on the standard HTTP po...

We are planning to implement a little Jenkins server farm which will continuously build our binaries as code is getting checked in. Plan to have around 500-600 odd VMs in this farm A few quest...

I have 2 Kafka topics streaming the exact same content from different sources so I can have high availability in case one of the sources fails. I'm attempting to merge the 2 topics into 1 output t...

I have an application that uses Redis Tomcat Session Manager in order to connect to the Redis Server in order to externalize the sessions. Since we are targeting high availability, we wanted to run...

We are exposing a stateless Owin WebAPI hosted on all nodes in our service fabric cluster (instance count -1) on Azure. The WebAPI is meant for public consumption and should be highly available eve...