I came up with the following implementation for the Greedy Set Cover after much discussion regarding my original question here. From the help I received, I encoded the problem into a "Greedy Set Co...

Assume there is a worker service that receives messages from a queue, reads the product with the specified Id from a document database, applies some manipulation logic based on the message, and fin...

I have read the following text in a technical blog discussing the advantages and disadvantages of NoSQL: "For years, in order to improve performance on database servers, database administrato...

When is it a good idea to use something like CRDT instead of paxos or raft?

Many Linux/Unix programming books and tutorials speak about the "Thundering Herd Problem" which happens when multiple threads or forks are blocked on a select() call waiting for readabili...

We have created a website using Drupal , but the problem ( good problem ) is that we are getting WAAAAYY too many hits on the server to the point where the traffic is brining the server down to its...

I have been reading a bit about tries, and how they are a good structure for typeahead designs. Aside from the trie, you usually also have a key/value pair for nodes and pre-computed top-n suggesti...

I'm looking for an elegant way to execute a Contains() statement in a scalable way. Please allow me to give some background before I come to the actual question. The IN statement In Entity Framewor...

Should parallel programming be used in the development of microservices in case the microservices are scalable and, for instance, deployed as ECS on AWS? If yes, what are the benefits of consuming...

I've been introduced recently to AWS and I really loved it. However, I'm asking myself some questions (that may be stupid) about architecturing for multi-regions. Let's say an application is used ...

I have read that copying the data directory will work. But, that is a combination of logs and snapshots. How do folks backup a zookeeper infrastructure ? Export ? Dump ? Custom script ? What are th...

I'm new to Azure architecture and am trying to understand why Azure Resource Groups, which are logical deployment buckets for applications built on Azure, are associated with a region when they are...

I've heard many people using both terms interchangeably. However, in my opinion there is difference between them: SCALABILITY - ability of a software system to process higher amount of workload on...

I am using redis for pub/sub as well as for server side cache. I mean my app server has redis server running as one process (functioning as a cache as well) . I have several thin clients (running r...

I am building an app using firestore at the moment. Google is always promoting firestore for its scalability, but I don't think a 10 000 writes/second limit fits that promise. If you store user lik...

I have a DynamoDB Stream that triggers a Lambda function. I'm noticing that bursts of a thousand of writes to the DynamoDB table can take many minutes (longest I have seen is 30 minutes) to all be ...

After some googling I have found: Note from mysql docs: MySQL Cluster automatically shards (partitions) tables across nodes, enabling databases to scale horizontally on low cost, commodity ha...

I understand that when upgrading to a Multi-AZ rds from a Single-AZ, there occurs a "breef i/o freeze". What exactly does that mean? When an upgrade is made to a Multi-AZ deployment, say from smal...

I have a lambda function that reads from DynamoDB and creates a large file (~500M) in /tmp that finally uploaded to s3. Once uploaded the lambda clears the file from /tmp (since there is a high pro...

I've been reading up on this topic a lot but could not find a good answer that I was looking for. So my understanding of the pros and cons of JWT vs Session is JWT pro more scalable since no...

I have a website in PHP, Lighttpd. It uses also MySQL on Centos 5. I've tested my PHP with code below with Apache Bench (ab). It resulted in some errors (Failed Requests) indicating other length th...

I tried to test RabbitMQ, but I found that rabbitmq has some problems: if I created a cluster of 3 nodes, I can't publish/delivered more than 6000/s. in other hand, if I worked with one single node...

For my webapp I'm going to need to have many timeouts running at once at any given point, possibly around 10,000-100,000. What I'm wondering is how well this function scales. I don't need it to be...

There's a cots (commercial off-the-shelf) application that I work on customizing, where a couple of pages take an extremely long time to load for certain distributions of data. (I'm talking approxi...

Problem I want to understand how I need to design the message passing for microservices to be still elastic and scalable. Goal Microservices allow an elastic number of instances which are scaled u...