The Quix blog
![Featured image for the "How to fix common issues when using Spark Structured Streaming with PySpark and Kafka" article published on the Quix blog](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/6690104d4bc595087975e938_Feature%20image%20-%20Spark%20structured%20streaming%20issues.jpg)
Ecosystem
July 9, 2024
How to fix common issues when using Spark Structured Streaming with PySpark and Kafka
A look at five common issues you might face when working with Structured Streaming, PySpark, and Kafka, along with practical steps to help you overcome them.
![Featured image for the "Quix Streams, a reliable Faust alternative for Python stream processing " article published on the Quix blog](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/6661557b60bb598fc98a58e7_blog_feature_image.png)
Ecosystem
June 6, 2024
Quix Streams—a reliable Faust alternative for Python stream processing
A detailed comparison between Faust and Quix Streams covering criteria like performance, coding experience, features, integrations, and product maturity.
![Pipeline diagram for data enrichment pipeline](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/6654b5fac048686a6502d9c1_coverimage_enrich.png)
Tutorials
June 3, 2024
How to enrich a stream of data in real time with Quix and Redis
Learn how to enrich real-time sensor data streams by looking up device coordinates in Redis and appending them to the data stream using Quix.
![The logos of Flink and Python](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/6657732f7d3989ba684e79bf_663254ba41186db9772e1ad9_Feature%20image%20-%20PyFlink%20deep%20dive-p2.jpg.png)
Ecosystem
May 23, 2024
Debugging PyFlink import issues
Solutions to a common issue that Python developers face when setting up PyFlink to handle real-time data.
![Featured image for the "Choosing a Python Kafka client: A comparative analysis" article published on the Quix.io blog](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/6643514d4291a87ad41e77ad_Feature%20image%20-%20Python%20Kafka%20clients.jpg)
Ecosystem
May 16, 2024
Choosing a Python Kafka client: A comparative analysis
Assessing Python clients for Kafka: kafka-python, Confluent, and Quix Streams. Learn how they compare in terms of DevEx, broker compatibility, and performance.
![Featured image for the "PyFlink — A deep dive into Flink’s Python API" article published on the Quix blog](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/663254ba41186db9772e1ad9_Feature%20image%20-%20PyFlink%20deep%20dive.jpg)
Ecosystem
May 1, 2024
PyFlink — A deep dive into Flink’s Python API
Learn how to use PyFlink for data processing workloads, read about its architecture, and discover its strengths and limitations.
![A data streaming pipeline for creating a heat map. There is an Angular logo next to both frontend applications](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/6630e10ae7f044e7deac9b50_Feature%20image%20-%20Clickstream%20heatmap%20template.jpg)
Tutorials
April 30, 2024
Clickstream analytics: creating a user interaction heat map for an e-commerce website
See Quix Streams in action by vizualizing mouse movement patterns in real-time using hopping windows. A Python data streaming tutorial for web analytics.
![Graphic showing Quix Streams windowing code](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/66151260a3d4c27b121afa92_Feature%20image%20-%20SDF%20launch.jpg)
Announcements
April 9, 2024
Introducing Streaming DataFrames
Learn how Streaming DataFrames can simplify real-time data processing in Python with a familiar DataFrame approach.
![Featured image for the "Navigating stateful stream processing" post published on the Quix blog](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/65fd50c741815cccae531a94_Feature%20image%20-%20Stateful%20stream%20processing.jpg)
Industry insights
March 26, 2024
Navigating stateful stream processing
Discover what sets stateful stream processing apart from stateless processing and read about its related concepts, challenges and use cases.
![windowing in stream processing](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/65f81143fca0d4e0763b242d_Feature%20image%20-%20Windowing%20in%20stream%20processing.jpg)
Industry insights
March 14, 2024
A guide to windowing in stream processing
Explore streaming windows (including tumbling, sliding and hopping windows) and learn about windowing benefits, use cases and technologies.
![real time feature engineering architecture diagram](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/65f32064af29f7b0627259be_Feature%20image%20-%20What%20is%20real%20time%20feature%20engineering%20(1).jpg)
Industry insights
March 14, 2024
What is real-time feature engineering?
Pre-computing features for real-time machine learning reduces the precision of the insights you can draw from data streams. In this guide, we'll look at what real-time feature engineering is and show you a simple example of how you can do it yourself.
![Banner image for the article "Understanding Kafka’s auto offset reset configuration: Use cases and pitfalls" published on the Quix blog](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/65e5e610f88da99a3ddd169e_Feature%20image%20-%20Kafka%20auto%20offset%20reset.jpg)
Ecosystem
February 28, 2024
Understanding Kafka’s auto offset reset configuration: Use cases and pitfalls
The auto.offset.reset configuration defines how Kafka consumers should behave when no initial committed offsets are available for the partitions assigned to them. Learn how to work with this configuration and discover its related challenges.
![kafka vs spark logos](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/65d3643c85a9c120abf20336_Feature%20image%20-%20Kafka%20vs%20Spark.jpg)
Ecosystem
February 19, 2024
Kafka vs Spark - a comparison of stream processing tools
This comparison specifically focuses on Kafka and Spark's streaming extensions — Kafka Streams and Spark Structured Streaming. Kafka Streams excels in per-record processing with a focus on low latency, while Spark Structured Streaming stands out with its built-in support for complex data processing tasks, including advanced analytics, machine learning and graph processing.
![Banner image for the blog article "Get started in minutes with the Hello Quix template"](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/65cb6198ec6b7ff5b3ad316d_Feature%20image%20-%20Updating%20vector%20store.jpg)
Tutorials
February 12, 2024
Continuously ingest documents into a vector store using Quix, Qdrant, and Apache Kafka
Learn how to set up a decoupled, event-driven pipeline to embed and ingest new content into a vector store as soon as it's published.
![Banner image for the blog article "Get started in minutes with the Hello Quix template"](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/65cb6409403b0777dd236e3c_Feature%20image%20-%20Hello%20Quix%20template.jpg)
Tutorials
February 9, 2024
Get started in minutes with the Hello Quix template
Learn how to get started quickly with Hello Quix base template and use it as a foundation for your projects.
![Banner image for the article "Streaming ETL 101" published on the Quix blog](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/65c0d3b124690a81a068db9d_Feature%20image%20-%20Streaming%20ETL%20101.jpg)
Industry insights
February 6, 2024
Streaming ETL 101
Read about the fundamentals of streaming ETL: what it is, how it works and how it compares to batch ETL. Discover streaming ETL technologies, architectures and use cases.
![Banner image for the blog article "AI Bots as difficult customers—generating synthetic customer conversations using Llama-2, Kafka and LangChain"](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/65ae2618e5bcfeef92e2348e_Feature%20image%20-%20AI%20Bots%20as%20difficult%20customers.jpg)
Tutorials
January 25, 2024
AI Bots as difficult customers—generating synthetic customer conversations using Llama-2, Kafka and LangChain
Learn the basics for running your own AI-powered support bots and understand the challenges involved in using AI for customer support.
![Banner image for the blog article "Analyze clickstream data in real time and trigger special offers based on user behavior"](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/65a647126a22911ef5efc49c_Feature%20image%20-%20Create%20project%20from%20template.jpg)
Tutorials
January 22, 2024
How to create a project from a template in Quix
Learn how to get started quickly with Quix project templates and use them as a reference to build your own event-driven, stream-processing application.
![LLMOps: large language models in production with Quix](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/6585385798a61272e38740f8_Feature%20image%20-%20LLMOps.jpg)
Industry insights
December 22, 2023
LLMOps: running large language models in production
LLMOps is a considered, well structured response to the hurdles that come with building, managing and scaling apps reliant on large language models. From data preparation, through model fine tuning, to finding ways to improve model performance, here is an overview of the LLM lifecycle and LLMOps best practices.
![What is stream processing](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/6582c5957e731f1de4e5603a_OG%20image%20-%20What%20is%20stream%20processing.jpg)
Industry insights
December 21, 2023
What is stream processing?
An overview of stream processing: core concepts, use cases enabled, what challenges stream processing presents, and what the future looks like as AI starts playing a bigger role in how we process and analyze streaming data
![Banner image for the blog article Predict 3D printer failures in real-time using sensor data](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/6572d5ccf3e6089c6d3487f6_blog_cover_pred_%20mockup2.png)
Tutorials
December 8, 2023
Predict 3D printer failures in real-time using sensor data
Deploy a reference application that shows you how to do real-time predictive analytics on sensor data from a simulated fleet of 3D printers.
![Banner image for the blog article "Analyze clickstream data in real time and trigger special offers based on user behavior"](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/6567784dee565192dc46a67f_Clickstream%20mockup.jpg)
Tutorials
November 30, 2023
Analyze clickstream data in real time and trigger special offers based on user behavior
Learn how to analyze clickstream data in real time using Python. Trigger frontend events and show aggregations in a real-time dashboard—using Quix, Streamlit and Redis Cloud.
![image with aws fargate and lambda logos](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/654e1e4bc55d66b2e9ebf8ec_Feature%20image%20-%20Fargate%20vs%20Lambda.jpg)
Ecosystem
November 13, 2023
Fargate vs Lambda: a comparison of serverless technologies
The main difference between these two serverless compute platforms is that AWS Fargate takes care of the underlying VMs, networking, and other resources you need to run containers using ECS or EKS, whereas AWS Lambda lets you run standalone, stateless functions without having to consider any of the infrastructure whatsoever.
![Graphic featuring Amazon ECS, EKS and Fargate logos](https://cdn.prod.website-files.com/64a7eed956ba9b9a3c62401d/6548e4750c2eff76450f1856_Feature%20image%20-%20ECS%20vs%20EKS%20vs%20Fargate.jpg)
Ecosystem
November 6, 2023
Amazon ECS vs. EKS. vs. Fargate: a comparison of container management services
The main difference between them? ECS and EKS are container orchestration services for Docker and Kubernetes that simplify the deployment, management, and scaling of containerized apps. Meanwhile, Fargate is a serverless compute engine that works with both ECS and EKS, removing the need to manage underlying server infrastructure.