Create a topic
Typically, when you deploy a configured service, topics will be created automatically for you, with default settings. However, you can create topics manually and configure the topic settings.
To create a topic:
- On the left-hand main menu, click
Topics. -
In the top right of the screen click
+ New topic. TheNew topicdialog is displayed:
-
Give your topic a suitable name.
- If you want to set some specific parameters for the topic, click
Advanced settingsto display the panel with configurable parameters for your broker. - Once you've configured your topic, click
Create.
The system will then create the topic, which might take a few moments.
Advanced settings
The parameters in the Advanced settings panel are as follows:
| Parameter | Description |
|---|---|
| Partitions | The basic unit of paralellism in a Kafka topic. The more partitions the more messages can be processed concurrently. You can think of partitions in Kafka topics as lanes on a motorway. Each partition acts as an independent lane where messages (like vehicles) flow in an ordered sequence. Just like lanes on a motorway, partitions enable parallel processing of messages within a Kafka topic. Multiple consumers (or subscribers) can each read from their own partition concurrently, enabling efficient and scalable message processing. Additionally, partitions provide fault tolerance similar to lanes providing redundancy on a motorway. If one lane (partition) becomes congested or experiences issues, the others can continue operating independently without affecting the overall flow of traffic (messages) on the motorway (topic). Note, you can't reduce the number of partitions, but you can increase them using the edit topic menu in Quix Cloud. If you need to reduce the number of partitions, you'd have to delete the topic and create it again, with the required number of partitions. Default = 1 |
| Retention time (hours) | Messages are retained in the topic for this amount of time, regardless of whether they have been consumed or not. After the specified time period elapses, Kafka will automatically delete messages older than the retention period. Default = 24 |
| Retention size (MB) | Messages are retained in the topic until the topic reaches this size. Once the topic size exceeds this threshold, Kafka starts deleting the oldest messages to make space for new ones. Default = 50 |
To change the advanced settings
In the Topics view, hover over the topic you want to edit until the kebab menu (vertical dots) is displayed. Click the kebab menu, and then select Edit topic. Change your configuration as required. Click Save and your changes are applied to the topic.