akka.stream with TCP as input

In recent post You are evicted! I was planning to use akka.net streams solution to solve memory pressure problem. Today I have a solution that I will be testing. 

Mainly I used an example from akka.net manual pages. As I was stuck on the flow (it is a bidirectional flow, where every byte received can have a response to the sender) I asked on the akka.net discord server for help as I was stuck in one of the stages, and my code was not compiling. 

The TCP flow is very specific as it needs to start with ByteStream and finish with same, as what ever is on the end of the flow is sent directly to the other connected side.

The flow has stages listed below:

  1. Framing - that splits incoming stuff in chunks by delimiter (new line in our case, but can be a series of bytes as well)
  2. Then we are converting it to string
  3. Grouping (this is a key for the solution as sending one line over http is a killer)
  4. Final stage is the place where it will be send over http, but for illustrative purposes in gist there is only a loop writing to console received elements.
To test it on your local machine - one need to create a .net console project and add one nuget:
dotnet add package Akka.Streams --version 1.4.49


Let's run it for a quick test, network bind is to localhost port 8888 and if you have telnet enabled in your windows then just type: telnet localhost 8888 (linux geeks can use whatever they have)


It is hard to see on a static image, but our input was buffered and then printed, all 10 entries as per grouping stage parameter.
Important: if the client disconnects after let's say 3 lines, they will be processed so the data will be flushed.

Next test was done using a very simple code snippet that is pushing a lot of data over the wire, so the expectation is that the consumer will slow down the producer (using a backpressure mechanism).


In above snippet, the message payload need to be large or we need to add more than 5 seconds sleep time in the processor, to see the test results easily.

Below a screenshot when we can see that the process was blocked for around 5 seconds, so the slow consumer was able to do it's job.









Comments

Post a Comment

Popular posts from this blog

when a new guy joins a team...

Image
Not so long ago, I was browsing merged pull requests to check quality of the work that was done. I don't know why, but in 202X C# is rather a modern language and some language syntax shall be adjusted to newer standards. When I was starting my developer journey - I was told to always add a code that looks similar to the one that already is there, unless it is total crap and adding new stuff needs more effort today, to not to die tomorrow. But in this case, we have a project that is created in in 202X and there is a lot of good looking and working lines of code around, so anyone can follow it. First time, when I was a student and helped my colleague, I was in shock that the teacher recognized my help, I turned all red and asked him "how you were able to recognize that?". He said that most of us have a kind of style that identifies us as developers, so this is spacing, the way how we organize braces (even when autoformated), how we write and solve problems,  and finally var
Read more

FizzBuzz - my first interview task on whiteboard

Image
 I think we all know the FizzBuzz task, when we a function shall print fizz if the number is divided by 3, buzz if by 5 and fizzbuzz when by both. Yesterday I did a small research about how many different implementations we can have using C# and there were many. Ones looks very common with "if"   statement tree, some of them were using LINQ and looking hard to understand what is going on in a first instance. StackOverflow has this one question with a bunch of examples  Writing FizzBuzz , that I will use to check how those solutions work from a performance perspective, code complexity and human understanding. listing 1 fizzbuzz question As we can see, OP introduced a tuple to solve the problem, which in my opinion gives a lot of opportunists for extensions with a little code changes.  The metric looks good, but if we move the list declaration outside the function (so it is not recreated every time the function is called we shall be good) To do benchmark I will convert
Read more

are YOU a garbage collector?

Image
 If I will ask you: "Are you a garbage collector" - I bet I will hear: " NO ", so I ask you: show me your code.... It is unbelievable that so many developers are pushing changes with commented out code, because  there could be a chance to re-use that piece. In fact that time never comes to me and the lines stays there forever. Clean code means no rubbish commented code - we have git to remember that for us. Now, when you need to comment a few lines in a row... there are better solutions, but if someone is lazy and slumsy then we can see diffs on code review like that: Now this is a mystery for me, when I am able to see that this is going to the main branch as the guys who is called code reviewer is there only to click Approve -  I am truly believing that it is not you my reader. I need to admit that, when I was a kid, together with grandma we were collecting garbage as a way to get some $$ for a life and then every piece we found had a material value and were able t
Read more