25 Jan, 2023 | Community

The Stream — January 2023 edition

How can you send time-series data to Apache Kafka using Python and Pandas? Plus Apache Flink news, memes, and meetups

Words by
Mike Rosam, CEO & Co-Founder
The Stream January 2023
Tabular time series data Kafka Python 13d4d186d7ff09a3656a59136feb24d7

How to send tabular time series data to Apache Kafka with Python and Pandas

We put together a tutorial for software engineers to send data to Kafka with Python. This just uses OSS elements and should take 30 minutes or so. By the end of the tutorial, you'll understand:

  • Why startups and online businesses use Apache Kafka
  • The unique qualities of time series data and how it works with Kafka
  • How to install and run Kafka on your local machine
  • How to send time series data to Kafka in batches using Python and the Pandas library
Dig into the tutorial

What Confluent's acquisition of Immerok means for the future of real-time

Confluent has acquired Immerok, a start-up serving Apache Flink customers. Confluent's CEO Jay Kreps said, "Stream processing enables organizations to clean and enrich data streams to derive actionable insights from their data in real-time. Our planned acquisition of Immerok will accelerate our ability to bring one of the most popular and powerful stream processing engines directly into Confluent"

There are some interesting hot takes on Twitter including this thread by Matthias J Sax, the technical lead of Kafka Streams, as well as this blog from Yaroslav Tkachenko. Exciting times for those building streaming applications!

Read Confluent's blog post

More news and insights

  • How Uber adopted the Kappa Architecture to improve developer productivity - Read more
  • Problems We Face for Sending Events to the Secure Kafka in Python - Read more

  • Upcoming Stream Processing meetups in Berlin (31/1) and Munich (7/2)

Meme of the Month

Image 2

Try Quix for yourself for free (no credit card, no time limit).

Start for free
words by
Mike Rosam, CEO & Co-Founder

Mike Rosam is Co-Founder and CEO at Quix, where he works at the intersection of business and technology to pioneer the world's first streaming data development platform. He was previously Head of Innovation at McLaren Applied, where he led the data analytics product line. Mike has a degree in Mechanical Engineering and an MBA from Imperial College London.

Previous Post Next Post

Related content

View all
The Stream March 2023
Community | 31 Mar, 2023
The Stream — March 2023 edition
A monthly round-up of the most interesting news coming out of the stream processing ecosystem
words by
Mike Rosam, CEO & Co-Founder
Quix streams blog feature image
Community | 2 Mar, 2023
Introducing Quix Streams, an open source library for telemetry data streaming
Lightweight, powerful, no JVM and no need for separate clusters of orchestrators. Here’s a look at our next-gen streaming library for C# and Python developers including feature summaries, code samples, and a sneak peek into our roadmap.
Tomas Neubauer
words by
Tomáš Neubauer, CTO & Co-Founder
The Stream February 2023
Community | 28 Feb, 2023
The Stream — February 2023 edition
Build a simple event-driven system to get ML predictions with Python and Apache Kafka
words by
Mike Rosam, CEO & Co-Founder

The Stream

Updates to your inbox

Get the data stream processing community's newsletter. It's for sharing insights, events and community-driven projects.

Background image