| queue.type |
TB_QUEUE_TYPE |
kafka |
kafka (Apache Kafka) |
| queue.prefix |
TB_QUEUE_PREFIX |
|
Global queue prefix. If specified, prefix is added before default topic name: 'prefix.default_topic_name'. Prefix is applied to all topics (and consumer groups for kafka). |
| queue.kafka.bootstrap.servers |
TB_KAFKA_SERVERS |
localhost:9092 |
Kafka Bootstrap nodes in "host:port" format |
| queue.kafka.ssl.enabled |
TB_KAFKA_SSL_ENABLED |
false |
Enable/Disable SSL Kafka communication |
| queue.kafka.ssl.truststore.location |
TB_KAFKA_SSL_TRUSTSTORE_LOCATION |
|
The location of the trust store file |
| queue.kafka.ssl.truststore.password |
TB_KAFKA_SSL_TRUSTSTORE_PASSWORD |
|
The password of trust store file if specified |
| queue.kafka.ssl.keystore.location |
TB_KAFKA_SSL_KEYSTORE_LOCATION |
|
The location of the key store file. This is optional for the client and can be used for two-way authentication for the client |
| queue.kafka.ssl.keystore.password |
TB_KAFKA_SSL_KEYSTORE_PASSWORD |
|
The store password for the key store file. This is optional for the client and only needed if ‘ssl.keystore.location’ is configured. Key store password is not supported for PEM format |
| queue.kafka.ssl.key.password |
TB_KAFKA_SSL_KEY_PASSWORD |
|
The password of the private key in the key store file or the PEM key specified in ‘keystore.key’ |
| queue.kafka.acks |
TB_KAFKA_ACKS |
all |
The number of acknowledgments the producer requires the leader to have received before considering a request complete. This controls the durability of records that are sent. The following settings are allowed:0, 1 and all |
| queue.kafka.retries |
TB_KAFKA_RETRIES |
1 |
Number of retries. Resend any record whose send fails with a potentially transient error |
| queue.kafka.compression.type |
TB_KAFKA_COMPRESSION_TYPE |
none |
none or gzip |
| queue.kafka.batch.size |
TB_KAFKA_BATCH_SIZE |
16384 |
Default batch size. This setting gives the upper bound of the batch size to be sent |
| queue.kafka.linger.ms |
TB_KAFKA_LINGER_MS |
1 |
This variable creates a small amount of artificial delay—that is, rather than immediately sending out a record |
| queue.kafka.max.request.size |
TB_KAFKA_MAX_REQUEST_SIZE |
1048576 |
The maximum size of a request in bytes. This setting will limit the number of record batches the producer will send in a single request to avoid sending huge requests |
| queue.kafka.max.in.flight.requests.per.connection |
TB_KAFKA_MAX_IN_FLIGHT_REQUESTS_PER_CONNECTION |
5 |
The maximum number of unacknowledged requests the client will send on a single connection before blocking |
| queue.kafka.buffer.memory |
TB_BUFFER_MEMORY |
33554432 |
The total bytes of memory the producer can use to buffer records waiting to be sent to the server |
| queue.kafka.replication_factor |
TB_QUEUE_KAFKA_REPLICATION_FACTOR |
1 |
The multiple copies of data over the multiple brokers of Kafka |
| queue.kafka.max_poll_interval_ms |
TB_QUEUE_KAFKA_MAX_POLL_INTERVAL_MS |
300000 |
The maximum delay between invocations of poll() method when using consumer group management. This places an upper bound on the amount of time that the consumer can be idle before fetching more records |
| queue.kafka.max_poll_records |
TB_QUEUE_KAFKA_MAX_POLL_RECORDS |
8192 |
The maximum number of records returned in a single call of poll() method |
| queue.kafka.max_partition_fetch_bytes |
TB_QUEUE_KAFKA_MAX_PARTITION_FETCH_BYTES |
16777216 |
The maximum amount of data per-partition the server will return. Records are fetched in batches by the consumer |
| queue.kafka.fetch_max_bytes |
TB_QUEUE_KAFKA_FETCH_MAX_BYTES |
134217728 |
The maximum amount of data the server will return. Records are fetched in batches by the consumer |
| queue.kafka.request.timeout.ms |
TB_QUEUE_KAFKA_REQUEST_TIMEOUT_MS |
30000 |
(30 seconds) |
| queue.kafka.session.timeout.ms |
TB_QUEUE_KAFKA_SESSION_TIMEOUT_MS |
10000 |
(10 seconds) |
| queue.kafka.auto_offset_reset |
TB_QUEUE_KAFKA_AUTO_OFFSET_RESET |
earliest |
earliest, latest or none |
| queue.kafka.use_confluent_cloud |
TB_QUEUE_KAFKA_USE_CONFLUENT_CLOUD |
false |
Enable/Disable using of Confluent Cloud |
| queue.kafka.confluent.ssl.algorithm |
TB_QUEUE_KAFKA_CONFLUENT_SSL_ALGORITHM |
https |
The endpoint identification algorithm used by clients to validate server hostname. The default value is https |
| queue.kafka.confluent.sasl.mechanism |
TB_QUEUE_KAFKA_CONFLUENT_SASL_MECHANISM |
PLAIN |
The mechanism used to authenticate Schema Registry requests. SASL/PLAIN should only be used with TLS/SSL as a transport layer to ensure that clear passwords are not transmitted on the wire without encryption |
| queue.kafka.confluent.sasl.config |
TB_QUEUE_KAFKA_CONFLUENT_SASL_JAAS_CONFIG |
org.apache.kafka.common.security.plain.PlainLoginModule required username=\"CLUSTER_API_KEY\" password=\"CLUSTER_API_SECRET\"; |
Using JAAS Configuration for specifying multiple SASL mechanisms on a broker |
| queue.kafka.confluent.security.protocol |
TB_QUEUE_KAFKA_CONFLUENT_SECURITY_PROTOCOL |
SASL_SSL |
Protocol used to communicate with brokers. Valid values are: PLAINTEXT, SSL, SASL_PLAINTEXT, SASL_SSL |
| queue.kafka.consumer-properties-per-topic.tasks.key |
|
max.poll.records |
Key-value properties for Kafka consumer for tasks topics |
| queue.kafka.consumer-properties-per-topic.tasks.key.value |
TB_QUEUE_KAFKA_TASKS_MAX_POLL_RECORDS |
1 |
Max poll records for tasks topics |
| queue.kafka.other-inline |
TB_QUEUE_KAFKA_OTHER_PROPERTIES |
|
In this section you can specify custom parameters (semicolon separated) for Kafka consumer/producer/admin |
| queue.kafka.topic-properties.tasks |
TB_QUEUE_KAFKA_TASKS_TOPIC_PROPERTIES |
retention.ms:604800000;segment.bytes:52428800;retention.bytes:104857600;partitions:1;min.insync.replicas:1 |
Kafka properties for tasks topics |
| queue.kafka.consumer-stats.enabled |
TB_QUEUE_KAFKA_CONSUMER_STATS_ENABLED |
true |
Prints lag between consumer group offset and last messages offset in Kafka topics |
| queue.kafka.consumer-stats.print-interval-ms |
TB_QUEUE_KAFKA_CONSUMER_STATS_MIN_PRINT_INTERVAL_MS |
60000 |
Statistics printing interval for Kafka's consumer-groups stats |
| queue.kafka.consumer-stats.kafka-response-timeout-ms |
TB_QUEUE_KAFKA_CONSUMER_STATS_RESPONSE_TIMEOUT_MS |
1000 |
Time to wait for the stats-loading requests to Kafka to finish |
| queue.tasks.poll_interval |
TB_QUEUE_TASKS_POLL_INTERVAL_MS |
500 |
Poll interval in milliseconds for tasks topics |
| queue.tasks.partitions |
TB_QUEUE_TASKS_PARTITIONS |
12 |
Partitions count for tasks queues |
| queue.tasks.partitions_per_type |
TB_QUEUE_TASKS_PARTITIONS_PER_TYPE |
|
Custom partitions count for tasks queues per type. Format: 'TYPE1:24;TYPE2:36', e.g. 'CF_REPROCESSING:24;TENANT_EXPORT:6' |
| queue.tasks.partitioning_strategy |
TB_QUEUE_TASKS_PARTITIONING_STRATEGY |
tenant |
Tasks partitioning strategy: 'tenant' or 'entity'. By default, using 'tenant' - tasks of a specific tenant are processed in the same partition.
In a single-tenant environment, use 'entity' strategy to distribute the tasks among multiple partitions. |
| queue.report.notifications_topic |
TB_QUEUE_REPORT_NOTIFICATIONS_TOPIC |
tb_report.notifications |
TB Report notifications topic name |
| queue.report.poll_interval |
TB_QUEUE_REPORT_POLL_INTERVAL_MS |
125 |
Poll interval in milliseconds for TB Report queues |
| queue.partitions.hash_function_name |
TB_QUEUE_PARTITIONS_HASH_FUNCTION_NAME |
murmur3_128 |
murmur3_32, murmur3_128 or sha256 |
