Four Different Ways of Working with Kafka on Azure

 
English Intermediate DevOps

Life doesn't happen in batch mode, which is why for several years now, we see a very strong tendency towards stream processing throughout various industries. Companies need, or least partially have to rethink their existing data architectures in order to enable near real-time business cases. Besides traditional database systems and batch-driven tooling, many companies put Apache Kafka® - the de facto standard for robust and scalable event streaming - to good use. This talk explores the following four different ways to run Kafka on Azure: * Kafka on HDInsight (open-source core Kafka) * EventHubs (Microsoft's very own "Kafka look-alike") * Confluent Cloud (a vendor-backed Kafka distribution) * Kafka in Azure Kubernetes Service You will walk away with a better understanding about the most important benefits, drawbacks and implications for each of the discussed alternatives.

Speaker

Hans-Peter Grahsl

SW Engineer, Technical Trainer, Consultant & Associate Lecturer

Hans-Peter is a technical trainer for Java backend development and is responsible for the internal education department at NETCONOMY Software & Consulting GmbH in Graz, Austria. As an independent engineer and consultant he is supporting customers during the conception and implementation of either cloud-based or on-premises data architectures using modern technology stacks and NoSQL data stores. He is also an associate lecturer for Software Engineering at CAMPUS 02 University of Applied Sciences and is speaking at tech-related and developer conferences. For his code contributions, conference talks and blog post writing at the intersection of the Apache Kafka and MongoDB ecosystems, Hans-Peter received the Confluent Community Catalyst award twice (2019-2020 & 2020-2021) and became one of the founding members of the MongoDB Champions Program in late 2020.

Code of Conduct

We seek to provide a respectful, friendly, professional experience for everyone, regardless of gender, sexual orientation, physical appearance, disability, age, race or religion. We do not tolerate any behavior that is harassing or degrading to any individual, in any form. The Code of Conduct will be enforced.

Who does this Code of Conduct apply to?

All live stream organizers using the Global Azure brand and Global Azure speakers are responsible for knowing and abiding by these standards. Each speaker who wishes to submit through our Call for Presentations needs to read and accept the Code of Conduct. We encourage every organizer and attendee to assist in creating a welcoming and safe environment. Live stream organizers are required to inform and enforce the Code of Conduct if they accept community content to their stream.

Where can I get help?

If you are being harassed, notice that someone else is being harassed, or have any other concerns, report it. Please report any concerns, suspicious or disruptive activity or behavior directly to any of the live stream organizers, or directly to the Global Azure admins at team@globalazure.net. All reports to the Global admin team will remain confidential.

Code of Conduct for local live streams

We expect local organizers to set up and enforce a Code of Conduct for all Global Azure live stream.

A good template can be found at https://confcodeofconduct.com/, including internationalized versions at https://github.com/confcodeofconduct/confcodeofconduct.com. An excellent version of a Code of Conduct, not a template, is built by the DDD Europe conference at https://dddeurope.com/2020/coc/.