Selecting the right message broker for your application demands a deep understanding of available options & messaging patterns.
Critical factors include: traffic, auto-scaling, poison pill tolerance, batch processing, and ordering.
Read the #InfoQ article by Nehme Bilal and get it right: https://bit.ly/4iv41IW
Happy #piday !!!
Estimating Pi with Kafka Streams
https://fredrikmeyer.net/2024/05/06/estimating-pi-kafka.html
Our Client needed a robust solution to process vast amounts of data in real-time. We chose Apache Kafka for this project 
See how it helped overcome all the challenges: https://softwaremill.com/case-study/data-streaming-using-kafka-for-a-retail-company/
Kafka: The Great Database Debate – Can a Streaming Platform Replace Traditional Databases?
As the tech industry grapples with the evolving role of data management, the debate over whether Apache Kafka can serve as a full-fledged database heats up. Advocates argue for the potential of stream...
KafkIO v.1.1.6 released: http://kafkio.com. New: produce millions of messages with token substitution support for dates, UUIDs, strings, ints, doubles, counters. Re-publish messages. Quickly copy all messages or topic summaries to clipboard. #apachekafka #kafka #datascience
Cut Kafka cloud costs by 30%! Discover how Wix Engineering optimized high-traffic topics with a push-based consumer proxy.
Behind Netflix's Impressions: The Data-Driven Engine Powering Personalization
Netflix's new blog series dives deep into the technology behind its impression tracking system, revealing how the streaming giant processes billions of data points daily to enhance user experience. Wi...
Atlassian introduced Lithium - an in-house #ETL platform designed to meet the requirements of dynamic data movement.
Lithium simplifies cloud migrations, scheduled backups, and in-flight data validations with ephemeral pipelines and tenant-level isolation - ensuring efficiency, scalability & cost savings.
InfoQ spoke with Niraj Mishra, Principal Engineer at Atlassian, about Lithium’s implementation and future.
Read more here: https://bit.ly/415RPYZ
#DataPipelines #KafkaStreams #ApacheKafka #ApacheFlink #SoftwareArchitecture
We know data layers will survive the AI revolution. Will Kafka?
#apachekafka meetup ahead of #FlinkForward Jakarta tomorrow!
Join the Apache Kafka x Apache Pinot meetup hosted by VirtusLab and featuring @adamwarski
The event will take place on November 26th from 6:00 p.m. to 8:00 p.m. in Kraków. Register here: https://www.meetup.com/krakow-kafka/events/304395169/?eventOrigin=group_events_list
This role will let me build on my recent work, dive into new tech, and support the next wave of #openSource innovation. While I may be shifting gears, I’m looking forward to continued collaboration with the wonderful #apacheKafka 
and #apacheFlink 
communities.
The October issue of #CheckpointChronicle is now out 
It covers Ververica's Fluss, #ApacheFlink 2.0, Iggy.rs, Strimzi's support for #ApacheKafka 4.0, tons of OTF material from @vanlightly, Christian Hollinger's write up of ngrok's data platform, nice detail of how SmartNews use #ApacheIceberg with Flink and #ApacheSpark, a good writeup from Sudhendu Pandey on #ApachePolaris, notes from Kir Titievsky on Kafka's Avro serialisers, and much more!
I'm very proud that Aiven keeps working to make life-with-databases-in-the-cloud easier, and that we address this from multiple different angles. For instance, #ApacheKafka tiered storage is now a thing (courtesy in large part to some of my colleagues) and we were part of #valkey getting off the ground.
Today, partnering with Google Cloud, we've launched Aiven for AlloyDB Omni - use our platform to run (PG compatible) AlloyDB Omni on Google Cloud, AWS and Azure. See https://cloud.google.com/blog/products/databases/announcing-aiven-for-alloydb-omni-on-google-cloud-aws-and-azure/
Kafka Streams In Action - Baue deine erste Streaming-App
In seinem Vortrag auf der #BaselOne24 zeigt Thomas Müller, wie man mit der hashtag#Kafka-Streaming-API eine leistungsfähige Streaming-Anwendung erstellen kann – und das auf einfache Weise! 
https://lnkd.in/ggjmzerN
Wir freuen uns auf dich! 
Part two of the journey to #current24, getting off the plane...
I'll see most of you all tomorrow, though some will be at the meet up this evening.
Ping me to chat nonsense about
#apacheflink, #apachePaimon and #apachekafka
This is really cool: a hands-on guide to the #ApacheKafka protocol: https://ivanyu.me/blog/2024/09/08/kafka-protocol-practical-guide/
(It's by Ivan Yurchenko, who also works at Aiven)
I am only an infrequent visitor to LinkedIn, but today I discovered a valuable tip from @gunnarmorling about the new Kafka Native Docker image. Thank you!
Wednesday September 18, 2024 at 9am PDT | 12noon EDT | 6pm CEST
Come learn **#ApacheKafka** with @celeste ! In this 2 hour workshop you’ll learn the basic components of Kafka and how to get started with data streaming using Python. We'll also give a brief introduction to transforming your data using **#ApacheFlink**.
Read more and register 
https://aiven.io/workshop/movie-recommender-with-tensorflow-pgvector?utm_source=mastodon&utm_medium=organic&utm_campaign=workshop-movie-recommender
#Uber introduces a new tiered storage feature in #ApacheKafka!
Added in version 3.6.0 (and currently in early access), this feature aims to solve the scalability and efficiency challenges faced by organizations running large Kafka clusters.
Details on #InfoQ 
https://bit.ly/4dssQ5P
