I'm making use of the (frankly great) BlockingCollection<T> type for a heavily multithreaded, high-performance app. There's a lot of throughput through the collection and on the micro-level i...

I am using Live Data to publish states from View Model to Fragments, this might result in states getting published frequently. But the Mutable Live Data is skipping the initial values and taking th...

I am using the excellent Papa Parse library in nodejs mode, to stream a large (500 MB) CSV file of over 1 million rows, into a slow persistence API, that can only take one request at a time. The pe...

In RxJava 2 Flowable there are different backpressure strategies, among them the most interesting are: LATEST BUFFER DROP which are respected throughout whole Rx chain. In Kotlin there is Flow...

I am a beginner of RxJava and I am curious about the meaning of "backpressure". Does it mean that the producer puts pressure behind the consumer's back? Or does it mean that consumers are putting...

I'm analyzing the backpressure feature on Spark Structured Streaming. Does anyone know the details? Is it possible to tune process incoming records by code? Thanks

I started learning NodeJS, and streams seems to be something that people use a lot. In most of the documentation that I had read there are mentions of the "back-pressure problem" that occ...

I'm a starter in Spring Web-Flux. I wrote a controller as follows: @RestController public class FirstController { @GetMapping("/first") public Mono<String> getAllTweets() { return Mon...

I am writing a module, which is a writeable stream. I want to implement pipe interface for my users. If some error happens, i need to pause readable stream and emit error event. Then, user will de...

I have a CustomReceiver which receives a single event(String).The received single event is used during spark application's run time to read data from nosql and to apply transformations.When the pro...

I have a situation in Kafka where the producer publishes the messages at a very higher rate than the consumer consumption rate. I have to implement the back pressure implementation in kafka for fur...

I am new to the world of reactive programming and I am trying to create a simple backpressure aware message processing using rxjava 2. Following is the workflow I am trying to achieve: Flowable ...

In akka-http, you can: Set akka.http.server.max-connections, which will prevent more than that number of connections. Exceeding this limit means clients will get connection timeouts. Set akka.htt...

Consider using the zip operator to zip together two infinite Observables, one of which emits items twice as frequently as the other. The current implementation is loss-less, i.e. if I keep these Ob...

recently I realized that I don't understand how RxJava2 backpressure works. I made small test and I expect that it should fail with MissingBackpressureException exception: @Test public void testB...

We have a Spark Streaming application, it reads data from a Kafka queue in receiver and does some transformation and output to HDFS. The batch interval is 1min, we have already tuned the backpressu...

I wrote some core.async code in Clojure and when I ran it it consumed all available memory and failed with an error. It appears that using mapcat in a core.async pipeline breaks back pressure. (Whi...

I want to observer the mousewheel event using RxJS-DOM so that when the first event fires, I forward that on and then drop any and all values until the delay between subsequent values passes a prev...

I have a service that consumes messages off of a queue at a rate that I control. I do some processing and then attempt to write to a Cassandra cluster via the Datastax Java client. I have setup my ...

I have an rx.Observable which emits the progress of a task to onNext(). The onNext() emissions can sometimes occur so quickly that the Observer cannot keep up, resulting in backpressure. I would li...

As I understand it, one of the consequences of Node's evented IO model is the inability to tell a Node process that is (for example) receiving data over a TCP socket, to block, once you've hooked u...