Skip to content

Commit ef24e54

Browse files
authored
in_kafka: Add buffer_max_size description (#1257)
* in_kafka: Add buffer_chunk_size description Signed-off-by: Hiroshi Hatake <hatake@calyptia.com> * in_kafka: Add buffer_max_size parameter instead of chunk_size We need to halt the greedy consuming loop before reaching the exceeded limitation of chunk size. Without this parameter, in_kafka always consuming greedy from subscribing topics. Signed-off-by: Hiroshi Hatake <hatake@calyptia.com> --------- Signed-off-by: Hiroshi Hatake <hatake@calyptia.com>
1 parent ef1554c commit ef24e54

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

pipeline/inputs/kafka.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,8 @@ This plugin uses the official [librdkafka C library](https://github.com/edenhill
1212
| client\_id | Client id passed to librdkafka. | |
1313
| group\_id | Group id passed to librdkafka. | fluent-bit |
1414
| poll\_ms | Kafka brokers polling interval in milliseconds. | 500 |
15+
| Buffer\_Max\_Size | Specify the maximum size of buffer per cycle to poll kafka messages from subscribed topics. To increase throughput, specify larger size. | 4M |
16+
| poll\_ms | Kafka brokers polling interval in milliseconds. | 500 |
1517
| rdkafka.{property} | `{property}` can be any [librdkafka properties](https://github.com/edenhill/librdkafka/blob/master/CONFIGURATION.md) | |
1618

1719
## Getting Started

0 commit comments

Comments
 (0)