Architectural Roundelay With Kafka: System Analyst as Consumer and Producer Coordinator

Today, Kafka is one of the most common technologies used in projects with a lot of cross-system integration to support intensive data flows. However, despite its widespread use, Kafka contains a fair amount of technical nuances and pitfalls in the mechanics of its operation. So to ensure that using Kafka doesn't become an unpleasant surprise with unexpected data loss, you need to know about the specifics of setting up a Kafka Broker, Consumer and Producer.

As part of the presentation, I will dive into the world of infrastructure configuration around Kafka. I will provide best practices for configuring Kafka elements and architectural patterns depending on the goals/objectives of different projects. I will also focus on defining the role of a systems analyst in setting requirements for Kafka-related elements.