tpl-dataflow Questions
2
Solved
As Stephen Toub explained in this post, when you submit a message to an ActionBlock, you can ExecutionContext.Capture before calling ActionBlock.Post, pass a DTO holding both message and ExecutionC...
Gytle asked 14/8, 2019 at 19:58
5
Solved
Using Dataflow CTP (in the TPL)
Is there a way to call BatchBlock.TriggerBatch automatically if the number of currently queued or postponed items is less than the BatchSize, after a timeout?
And be...
Windtight asked 23/2, 2012 at 19:1
2
I have read through quite a number technical documents either by some of the Microsoft team, or other authors detailing functionality of the new TPL Dataflow library, async/await concurrency framew...
Ladysmith asked 27/11, 2012 at 6:25
3
Solved
I'm submitting a series of select statements (queries - thousands of them) to a single database synchronously and getting back one DataTable per query (Note: This program is such that it has knowle...
Complacent asked 20/3, 2018 at 16:18
2
Using TPL.DataFlow blocks, is it possible to link two or more sources to a single ITargetBlock(e.g. ActionBlock) and prioritize the sources?
e.g.
BufferBlock<string> b1 = new ...
BufferBloc...
Auricular asked 7/1, 2014 at 14:30
2
Solved
I need to construct TPL dataflow pipeline which will process a lot of messages. Because there are many messages I can not simply Post them into infinite queue of the BufferBlock or I will face memo...
Madonnamadora asked 6/2, 2014 at 12:47
4
Solved
In this scenerio, I have to Poll AWS SQS messages from a queue, each async request can fetch upto 10 sqs items/messages. Once I Poll the items, Then I have to process those items on a kubernetes po...
Spitter asked 28/8, 2021 at 2:53
2
Solved
The title of my question says it all.
I am looking for a TPL dataflow block that doesn't need an input.
Right now I am using a transform block but it's input is unused.
Wills asked 5/7, 2016 at 8:42
3
Solved
I need to do this kind of work:
Get Page object from database
For each page get all images and process them (IO bound, for example, upload to CDN)
If all images proceeded successfully then mark P...
Dune asked 25/10, 2014 at 7:53
2
Solved
I have a stream of data that I process in several different ways... so I would like to send a copy of each message I get to multiple targets so that these targets may execute in parallel... however...
Cislunar asked 2/3, 2014 at 12:41
3
Solved
I have the following function that returns the standard output data, as an async stream, that results from running a System.Diagnostics.Process. Everything currently in the method works as intended...
Proteus asked 4/11, 2020 at 6:12
3
Solved
I'm trying to wrap my head around "completion" in TPL Dataflow blocks. In particular, the TransformBlock doesn't seem to ever complete. Why?
Sample program
My code calculates the square of all in...
Sukey asked 28/11, 2014 at 10:47
2
Solved
I would be glad for some input on the following implementation of a BroadcastCopyBlock in TPL Dataflow, which copies a received message to all consumers, that registered to the BroadcastCopyBlock a...
Voss asked 15/11, 2016 at 8:38
1
Solved
I have a TPL Datalow pipeline with two sources and two targets linked in a many-to-many fashion. The target blocks appear to complete successfully, however, it usually drops one or more inputs. I'v...
Grandsire asked 4/9, 2020 at 22:46
2
How could I use DataflowBlockOptions.CancellationToken?
If I create instance of BufferBlock like this:
var queue = new BufferBlock<int>(new DataflowBlockOptions { BoundedCapacity = 5, Cance...
Firebox asked 20/4, 2015 at 12:38
2
I'm working with TPL Dataflow now and I need to implement my own action block.
This action block should accept messages from two different input blocks, put these messages into single queue and th...
Loaves asked 20/9, 2016 at 11:9
4
I have a chain of TPL Dataflow blocks and would like to observe progress somewhere inside the system.
I am aware that I could just jam a TransformBlock into the mesh where I want to observe, get i...
Dynamiter asked 16/6, 2017 at 1:43
2
I am develop a Dataflow pipeline which reads a collection of files and, for each line in each file, performs a series of Dataflow blocks.
After all steps have completed for each line in a file, I ...
Silvio asked 9/8, 2017 at 4:30
3
Solved
I have a TransformManyBlock with the following design:
Input: Path to a file
Output: IEnumerable of the file's contents, one line at a time
I am running this block on a huge file (61GB), which ...
Gladdie asked 23/6, 2015 at 5:31
1
Solved
Is it possible to get TransformManyBlocks to send intermediate results as they are created to the next step instead if waiting for the entire IEnumerable<T> to be filled?
All testing I've d...
Hinckley asked 12/6, 2020 at 0:56
2
Solved
I have a requirement to make a scalable process. The process has mainly I/O operations with some minor CPU operations (mainly deserializing strings). The process query the database for a list of ur...
Harmonize asked 31/7, 2018 at 14:41
4
Solved
I wonder whether the following code can be optimized to execute faster. I currently seem to max out at around 1.4 million simple messages per second on a pretty simple data flow structure. I am awa...
Smilax asked 22/6, 2012 at 11:12
2
I was reading Dataflow (Task Parallel Library), and there is a portion which says:
When you specify a maximum degree of parallelism that is larger than 1, multiple messages are processed simulta...
Observer asked 26/8, 2016 at 18:23
5
Solved
Given the following setup in TPL dataflow.
var directory = new DirectoryInfo(@"C:\dev\kortforsyningen_dsm\tiles");
var dirBroadcast=new BroadcastBlock<DirectoryInfo>(dir=>dir);
var dirf...
Galenical asked 30/9, 2014 at 21:10
2
Solved
I'm experimenting with TPL Dataflow before porting it into my production code.
The production code is a classical producer/consumer system - producer(s) produce messages (related to financial domai...
Heliogabalus asked 31/10, 2016 at 10:21
1 Next >
© 2022 - 2024 — McMap. All rights reserved.