tpl-dataflow Questions

2

Solved

The company I work for runs a few hundred very dynamic web sites. It has decided to build a search engine and I was tasked with writing the scraper. Some of the sites run on old hardware and are no...
Morphogenesis asked 6/3, 2014 at 17:26

2

Solved

Teaser: guys, this question is not about how to implement retry policy. It's about correct completion of a TPL Dataflow block. This question is mostly a continuation of my previous question Retry ...
Ibbison asked 5/7, 2013 at 11:49

1

Solved

I have been using TPL dataflow for an image processing pipeline using the producer/consumer pattern. I'm trying to work out the best approach to allow for algorithms that require either the previo...
Grefe asked 12/8, 2014 at 8:28

1

Solved

I need to have some kind of object that acts like a BroadcastBlock, but with guaranteed delivery. So i used an answer from this question. But i don't really clearly understand the execution flow he...

1

Solved

I would like to know. How can I remove the link between the blocks? In other words. I want to get opposite of LinkTo. I want to write a logger based on tlp dataflow. I wrote this interface and wa...
Keewatin asked 8/7, 2014 at 12:22

1

Solved

MSDN documentation shows that there is a NameFormat attribute on the DataflowBlockOptions class, described as: Gets or sets the format string to use when a block is queried for its name. So .....
Bagger asked 28/6, 2014 at 17:51

3

I am trying to asynchronously log some information to SQL Server inside of an MVC 4 controller action targeting .NET 4.0 using the AsyncTargetingPack. I would jump straight to .NET 4.5 but my app l...
Egeria asked 19/10, 2012 at 7:6

2

I have several files (nearly 1GB each) with data. Data is a string line. I need to process each of these files with several hundreds of consumers. Each of these consumers does some processi...
Cecilacecile asked 30/5, 2014 at 15:14

1

Solved

Below I have replicated a real life scenario as a LINQPad script for the sake of simplicity: var total = 1 * 1000 * 1000; var cts = new CancellationTokenSource(); var threads = Environment.Process...
Eustis asked 28/5, 2014 at 18:4

1

Solved

TPL Dataflow block has .InputCount and .OutputCount properties. But it can perform execution over item right now, and there is no property like .Busy [Boolean]. So is there a way to know if block i...
Bounty asked 1/5, 2014 at 11:44

1

Solved

I expected the following to produce output from both publishers, but it only produces output from the first one: var broadcastBlock = new BroadcastBlock<int>(null); var transformBlock = new ...
Trypanosomiasis asked 25/4, 2014 at 10:51

2

Solved

I want to set up a TransformBlock that processes its item in parallel. Thus, I'm setting ExecutionDataflowBlockOptions.MaxDegreeOfParallelism to > 1. I don't care about the order of the messages bu...
Madea asked 6/4, 2014 at 12:16

3

Solved

I would like to run a bunch of async tasks, with a limit on how many tasks may be pending completion at any given time. Say you have 1000 URLs, and you only want to have 50 requests open at a time...
Vitovitoria asked 18/3, 2014 at 22:28

1

Solved

In the C# TPL Dataflow library, SingleProducerConstrained is an optimisation option for ActionBlocks you can use when only a single thread is feeding the action block: If a block is only ever go...
Crazed asked 18/3, 2014 at 8:38

2

Solved

I try to create well-designed TPL dataflow pipeline with optimal using of system resources. My project is a HTML parser that adds parsed values into SQL Server DB. I already have all methods of my ...
Sialoid asked 10/3, 2014 at 10:15

3

Solved

I have never worked with TPL before so I was wondering whether this can be done with it: My application creates a gif image animation file from a lot of frames. I start with a list of Bitmap which ...

2

I understand that a BlockingCollection is best suited for a consumer/producer pattern. However, when do I use a ActionBlock from the TPL DataFlow library? My initial understanding is for IO operat...

2

Solved

I'm working on a system that involves accepting commands over a TCP network connection, then sending responses upon execution of those commands. Fairly basic stuff, but I'm looking to support a few...
Maestro asked 31/1, 2014 at 16:32

1

Solved

I have a constant flow of certain items that I need to process in parallel so I'm using TPL Dataflow. The catch is that the items that share the same key (similar to a Dictionary) should be process...
Mauretania asked 9/1, 2014 at 1:25

1

Solved

Let's assume i have a simple ActionBlock<int> var actionBlock = new ActionBlock<int>(_ => Console.WriteLine(_)); I can specify a bounded capacity to enable buffering: var actionB...
Hallow asked 2/1, 2014 at 16:52

2

Solved

I'm making a port of the AKKA framework for .NET (don't take this too serious now, it is a weekend hack of the Actor part of it right now) I'm having some problems with the "Future" support in it....
Vest asked 1/1, 2014 at 11:28

1

Solved

I'm trying to get my head around controlling dataflow in TPL Dataflow. I have a very fast producer, and a very slow consumer. (My real code is more complex, but none the less, this is a pretty good...
Velma asked 21/12, 2013 at 5:28

3

Solved

I have a piece of C# 5.0 code that generates a ton of network and disk I/O. I need to run multiple copies of this code in parallel. Which of the following technologies is likely to give me the best...

2

Solved

I have producer/consumer dataflow block set-up using BufferBlock and ActionBlock and it is working fine inside Console application; After adding all items into BurfferBlock and Linking BufferBloc...
Cushy asked 2/12, 2013 at 19:0

1

Solved

After playing around with dataflow I encountered a new problem. I would like to limit the inputqueue of all blocks. My producingblock (ActionBlock) is creating 5000 elements really fast and posts t...
Inheritor asked 17/9, 2013 at 9:54

© 2022 - 2024 — McMap. All rights reserved.