queue.type |
TB_QUEUE_TYPE |
in-memory |
in-memory or kafka (Apache Kafka) |
queue.cloud-event.topic |
TB_QUEUE_CLOUD_EVENT_TOPIC |
tb_cloud_event |
Kafka topic for cloud events (entity, attribute, and alarm changes to send to the server) |
queue.cloud-event.poll-interval |
TB_QUEUE_CLOUD_EVENT_POLL_INTERVAL_MS |
25 |
Poll interval in milliseconds for the cloud event topic |
queue.cloud-event-ts.topic |
TB_QUEUE_CLOUD_EVENT_TS_TOPIC |
tb_cloud_event_ts |
Kafka topic for time-series cloud events |
queue.cloud-event-ts.poll-interval |
TB_QUEUE_CLOUD_EVENT_TS_POLL_INTERVAL_MS |
25 |
Poll interval in milliseconds for the time-series cloud event topic |
queue.kafka.topic-properties.cloud_event |
TB_QUEUE_KAFKA_CLOUD_EVENT_TOPIC_PROPERTIES |
retention.ms:2678400000;segment.bytes:52428800;retention.bytes:1048576000;partitions:1;min.insync.replicas:1 |
Kafka properties for the cloud event topic |
queue.kafka.topic-properties.cloud_event_ts |
TB_QUEUE_KAFKA_CLOUD_EVENT_TS_TOPIC_PROPERTIES |
retention.ms:2678400000;segment.bytes:52428800;retention.bytes:10485760000;partitions:1;min.insync.replicas:1 |
Kafka properties for the time-series cloud event topic |
queue.prefix |
TB_QUEUE_PREFIX |
_(empty)_ |
Global queue prefix. If specified, prefix is added before default topic name: ‘prefix.default_topic_name’. Prefix is applied to all topics (and consumer groups for kafka). |
queue.in_memory.stats.print-interval-ms |
TB_QUEUE_IN_MEMORY_STATS_PRINT_INTERVAL_MS |
60000 |
For debug level |
queue.kafka.bootstrap.servers |
TB_KAFKA_SERVERS |
localhost:9092 |
Kafka Bootstrap nodes in “host:port” format |
queue.kafka.ssl.enabled |
TB_KAFKA_SSL_ENABLED |
false |
Enable/Disable SSL Kafka communication |
queue.kafka.ssl.truststore.location |
TB_KAFKA_SSL_TRUSTSTORE_LOCATION |
_(empty)_ |
The location of the trust store file |
queue.kafka.ssl.truststore.password |
TB_KAFKA_SSL_TRUSTSTORE_PASSWORD |
_(empty)_ |
The password of trust store file if specified |
queue.kafka.ssl.keystore.location |
TB_KAFKA_SSL_KEYSTORE_LOCATION |
_(empty)_ |
The location of the key store file. This is optional for the client and can be used for two-way authentication for the client |
queue.kafka.ssl.keystore.password |
TB_KAFKA_SSL_KEYSTORE_PASSWORD |
_(empty)_ |
The store password for the key store file. This is optional for the client and only needed if ‘ssl.keystore.location’ is configured. Key store password is not supported for PEM format |
queue.kafka.ssl.key.password |
TB_KAFKA_SSL_KEY_PASSWORD |
_(empty)_ |
The password of the private key in the key store file or the PEM key specified in ‘keystore.key’ |
queue.kafka.acks |
TB_KAFKA_ACKS |
all |
The number of acknowledgments the producer requires the leader to have received before considering a request complete. This controls the durability of records that are sent. The following settings are allowed:0, 1 and all |
queue.kafka.retries |
TB_KAFKA_RETRIES |
1 |
Number of retries. Resend any record whose send fails with a potentially transient error |
queue.kafka.compression.type |
TB_KAFKA_COMPRESSION_TYPE |
none |
none or gzip |
queue.kafka.batch.size |
TB_KAFKA_BATCH_SIZE |
16384 |
Default batch size. This setting gives the upper bound of the batch size to be sent |
queue.kafka.linger.ms |
TB_KAFKA_LINGER_MS |
1 |
This variable creates a small amount of artificial delay—that is, rather than immediately sending out a record |
queue.kafka.max.request.size |
TB_KAFKA_MAX_REQUEST_SIZE |
1048576 |
The maximum size of a request in bytes. This setting will limit the number of record batches the producer will send in a single request to avoid sending huge requests |
queue.kafka.max.in.flight.requests.per.connection |
TB_KAFKA_MAX_IN_FLIGHT_REQUESTS_PER_CONNECTION |
5 |
The maximum number of unacknowledged requests the client will send on a single connection before blocking |
queue.kafka.buffer.memory |
TB_BUFFER_MEMORY |
33554432 |
The total bytes of memory the producer can use to buffer records waiting to be sent to the server |
queue.kafka.replication_factor |
TB_QUEUE_KAFKA_REPLICATION_FACTOR |
1 |
The multiple copies of data over the multiple brokers of Kafka |
queue.kafka.max_poll_interval_ms |
TB_QUEUE_KAFKA_MAX_POLL_INTERVAL_MS |
300000 |
The maximum delay between invocations of poll() method when using consumer group management. This places an upper bound on the amount of time that the consumer can be idle before fetching more records |
queue.kafka.max_poll_records |
TB_QUEUE_KAFKA_MAX_POLL_RECORDS |
8192 |
The maximum number of records returned in a single call of poll() method |
queue.kafka.max_partition_fetch_bytes |
TB_QUEUE_KAFKA_MAX_PARTITION_FETCH_BYTES |
16777216 |
The maximum amount of data per-partition the server will return. Records are fetched in batches by the consumer |
queue.kafka.fetch_max_bytes |
TB_QUEUE_KAFKA_FETCH_MAX_BYTES |
134217728 |
The maximum amount of data the server will return. Records are fetched in batches by the consumer |
queue.kafka.request.timeout.ms |
TB_QUEUE_KAFKA_REQUEST_TIMEOUT_MS |
30000 |
(30 seconds) |
queue.kafka.session.timeout.ms |
TB_QUEUE_KAFKA_SESSION_TIMEOUT_MS |
10000 |
(10 seconds) |
queue.kafka.auto_offset_reset |
TB_QUEUE_KAFKA_AUTO_OFFSET_RESET |
earliest |
earliest, latest or none |
queue.kafka.use_confluent_cloud |
TB_QUEUE_KAFKA_USE_CONFLUENT_CLOUD |
false |
Enable/Disable using of Confluent Cloud |
queue.kafka.confluent.ssl.algorithm |
TB_QUEUE_KAFKA_CONFLUENT_SSL_ALGORITHM |
https |
The endpoint identification algorithm used by clients to validate server hostname. The default value is https |
queue.kafka.confluent.sasl.mechanism |
TB_QUEUE_KAFKA_CONFLUENT_SASL_MECHANISM |
PLAIN |
The mechanism used to authenticate Schema Registry requests. SASL/PLAIN should only be used with TLS/SSL as a transport layer to ensure that clear passwords are not transmitted on the wire without encryption |
queue.kafka.confluent.sasl.config |
TB_QUEUE_KAFKA_CONFLUENT_SASL_JAAS_CONFIG |
org.apache.kafka.common.security.plain.PlainLoginModule required username=\"CLUSTER_API_KEY\" password=\"CLUSTER_API_SECRET\"; |
Using JAAS Configuration for specifying multiple SASL mechanisms on a broker |
queue.kafka.confluent.security.protocol |
TB_QUEUE_KAFKA_CONFLUENT_SECURITY_PROTOCOL |
SASL_SSL |
Protocol used to communicate with brokers. Valid values are: PLAINTEXT, SSL, SASL_PLAINTEXT, SASL_SSL |
queue.kafka.consumer-properties-per-topic.tb_ota_package.key |
_(none)_ |
max.poll.records |
Key-value properties for Kafka consumer per specific topic, e.g. tb_ota_package is a topic name for ota, tb_rule_engine.sq is a topic name for default SequentialByOriginator queue. Check TB_QUEUE_CORE_OTA_TOPIC and TB_QUEUE_RE_SQ_TOPIC params |
queue.kafka.consumer-properties-per-topic.tb_ota_package.value |
TB_QUEUE_KAFKA_OTA_MAX_POLL_RECORDS |
10 |
Example of specific consumer properties value per topic |
queue.kafka.consumer-properties-per-topic.tb_version_control.key |
_(none)_ |
max.poll.interval.ms |
Example of specific consumer properties value per topic for VC |
queue.kafka.consumer-properties-per-topic.tb_version_control.value |
TB_QUEUE_KAFKA_VC_MAX_POLL_INTERVAL_MS |
600000 |
Example of specific consumer properties value per topic for VC |
queue.kafka.consumer-properties-per-topic.tb_housekeeper.key |
_(none)_ |
max.poll.records |
Consumer properties for Housekeeper tasks topic |
queue.kafka.consumer-properties-per-topic.tb_housekeeper.value |
TB_QUEUE_KAFKA_HOUSEKEEPER_MAX_POLL_RECORDS |
1 |
Amount of records to be returned in a single poll. For Housekeeper tasks topic, we should consume messages (tasks) one by one |
queue.kafka.consumer-properties-per-topic.tb_housekeeper.reprocessing.key |
_(none)_ |
max.poll.records |
Consumer properties for Housekeeper reprocessing topic |
queue.kafka.consumer-properties-per-topic.tb_housekeeper.reprocessing.value |
TB_QUEUE_KAFKA_HOUSEKEEPER_REPROCESSING_MAX_POLL_RECORDS |
1 |
Amount of records to be returned in a single poll. For Housekeeper reprocessing topic, we should consume messages (tasks) one by one |
queue.kafka.other-inline |
TB_QUEUE_KAFKA_OTHER_PROPERTIES |
_(empty)_ |
In this section you can specify custom parameters (semicolon separated) for Kafka consumer/producer/admin |
queue.kafka.topic-properties.rule-engine |
TB_QUEUE_KAFKA_RE_TOPIC_PROPERTIES |
retention.ms:604800000;segment.bytes:52428800;retention.bytes:1048576000;partitions:1;min.insync.replicas:1 |
Kafka properties for Rule Engine |
queue.kafka.topic-properties.core |
TB_QUEUE_KAFKA_CORE_TOPIC_PROPERTIES |
retention.ms:604800000;segment.bytes:52428800;retention.bytes:1048576000;partitions:1;min.insync.replicas:1 |
Kafka properties for Core topics |
queue.kafka.topic-properties.transport-api |
TB_QUEUE_KAFKA_TA_TOPIC_PROPERTIES |
retention.ms:604800000;segment.bytes:52428800;retention.bytes:1048576000;partitions:10;min.insync.replicas:1 |
Kafka properties for Transport Api topics |
queue.kafka.topic-properties.notifications |
TB_QUEUE_KAFKA_NOTIFICATIONS_TOPIC_PROPERTIES |
retention.ms:604800000;segment.bytes:52428800;retention.bytes:1048576000;partitions:1;min.insync.replicas:1 |
Kafka properties for Notifications topics |
queue.kafka.topic-properties.js-executor |
TB_QUEUE_KAFKA_JE_TOPIC_PROPERTIES |
retention.ms:86400000;segment.bytes:52428800;retention.bytes:104857600;partitions:30;min.insync.replicas:1 |
Kafka properties for JS Executor topics |
queue.kafka.topic-properties.ota-updates |
TB_QUEUE_KAFKA_OTA_TOPIC_PROPERTIES |
retention.ms:604800000;segment.bytes:52428800;retention.bytes:1048576000;partitions:10;min.insync.replicas:1 |
Kafka properties for OTA updates topic |
queue.kafka.topic-properties.version-control |
TB_QUEUE_KAFKA_VC_TOPIC_PROPERTIES |
retention.ms:604800000;segment.bytes:52428800;retention.bytes:1048576000;partitions:1;min.insync.replicas:1 |
Kafka properties for Version Control topic |
queue.kafka.topic-properties.housekeeper |
TB_QUEUE_KAFKA_HOUSEKEEPER_TOPIC_PROPERTIES |
retention.ms:604800000;segment.bytes:52428800;retention.bytes:1048576000;partitions:10;min.insync.replicas:1 |
Kafka properties for Housekeeper tasks topic |
queue.kafka.topic-properties.housekeeper-reprocessing |
TB_QUEUE_KAFKA_HOUSEKEEPER_REPROCESSING_TOPIC_PROPERTIES |
retention.ms:7776000000;segment.bytes:52428800;retention.bytes:1048576000;partitions:1;min.insync.replicas:1 |
Kafka properties for Housekeeper reprocessing topic; retention.ms is set to 90 days; partitions is set to 1 since only one reprocessing service is running at a time |
queue.kafka.topic-properties.edge |
TB_QUEUE_KAFKA_EDGE_TOPIC_PROPERTIES |
retention.ms:604800000;segment.bytes:52428800;retention.bytes:1048576000;partitions:1;min.insync.replicas:1 |
Kafka properties for Edge topic |
queue.kafka.consumer-stats.enabled |
TB_QUEUE_KAFKA_CONSUMER_STATS_ENABLED |
true |
Prints lag between consumer group offset and last messages offset in Kafka topics |
queue.kafka.consumer-stats.print-interval-ms |
TB_QUEUE_KAFKA_CONSUMER_STATS_MIN_PRINT_INTERVAL_MS |
60000 |
Statistics printing interval for Kafka’s consumer-groups stats |
queue.kafka.consumer-stats.kafka-response-timeout-ms |
TB_QUEUE_KAFKA_CONSUMER_STATS_RESPONSE_TIMEOUT_MS |
1000 |
Time to wait for the stats-loading requests to Kafka to finish |
queue.partitions.hash_function_name |
TB_QUEUE_PARTITIONS_HASH_FUNCTION_NAME |
murmur3_128 |
murmur3_32, murmur3_128 or sha256 |
queue.transport_api.requests_topic |
TB_QUEUE_TRANSPORT_API_REQUEST_TOPIC |
tb_transport.api.requests |
Topic used to consume api requests from transport microservices |
queue.transport_api.responses_topic |
TB_QUEUE_TRANSPORT_API_RESPONSE_TOPIC |
tb_transport.api.responses |
Topic used to produce api responses to transport microservices |
queue.transport_api.max_pending_requests |
TB_QUEUE_TRANSPORT_MAX_PENDING_REQUESTS |
10000 |
Maximum pending api requests from transport microservices to be handled by server |
queue.transport_api.max_requests_timeout |
TB_QUEUE_TRANSPORT_MAX_REQUEST_TIMEOUT |
10000 |
Maximum timeout in milliseconds to handle api request from transport microservice by server |
queue.transport_api.max_callback_threads |
TB_QUEUE_TRANSPORT_MAX_CALLBACK_THREADS |
100 |
Amount of threads used to invoke callbacks |
queue.transport_api.max_core_handler_threads |
TB_QUEUE_TRANSPORT_MAX_CORE_HANDLER_THREADS |
16 |
Amount of threads used for transport API requests |
queue.transport_api.request_poll_interval |
TB_QUEUE_TRANSPORT_REQUEST_POLL_INTERVAL_MS |
25 |
Interval in milliseconds to poll api requests from transport microservices |
queue.transport_api.response_poll_interval |
TB_QUEUE_TRANSPORT_RESPONSE_POLL_INTERVAL_MS |
25 |
Interval in milliseconds to poll api response from transport microservices |
queue.core.topic |
TB_QUEUE_CORE_TOPIC |
tb_core |
Default topic name of Kafka, RabbitMQ, etc. queue |
queue.core.poll-interval |
TB_QUEUE_CORE_POLL_INTERVAL_MS |
25 |
Interval in milliseconds to poll messages by Core microservices |
queue.core.partitions |
TB_QUEUE_CORE_PARTITIONS |
10 |
Amount of partitions used by Core microservices |
queue.core.pack-processing-timeout |
TB_QUEUE_CORE_PACK_PROCESSING_TIMEOUT_MS |
2000 |
Timeout for processing a message pack by Core microservices |
queue.core.consumer-per-partition |
TB_QUEUE_CORE_CONSUMER_PER_PARTITION |
true |
Enable/disable a separate consumer per partition for Core queue |
queue.core.ota.topic |
TB_QUEUE_CORE_OTA_TOPIC |
tb_ota_package |
Default topic name for OTA updates |
queue.core.ota.pack-interval-ms |
TB_QUEUE_CORE_OTA_PACK_INTERVAL_MS |
60000 |
The interval of processing the OTA updates for devices. Used to avoid any harm to the network due to many parallel OTA updates |
queue.core.ota.pack-size |
TB_QUEUE_CORE_OTA_PACK_SIZE |
100 |
The size of OTA updates notifications fetched from the queue. The queue stores pairs of firmware and device ids |
queue.core.usage-stats-topic |
TB_QUEUE_US_TOPIC |
tb_usage_stats |
Stats topic name for queue Kafka, RabbitMQ, etc. |
queue.core.stats.enabled |
TB_QUEUE_CORE_STATS_ENABLED |
true |
Enable/disable statistics for Core microservices |
queue.core.stats.print-interval-ms |
TB_QUEUE_CORE_STATS_PRINT_INTERVAL_MS |
60000 |
Statistics printing interval for Core microservices |
queue.core.housekeeper.topic |
TB_HOUSEKEEPER_TOPIC |
tb_housekeeper |
Topic name for Housekeeper tasks |
queue.core.housekeeper.reprocessing-topic |
TB_HOUSEKEEPER_REPROCESSING_TOPIC |
tb_housekeeper.reprocessing |
Topic name for Housekeeper tasks to be reprocessed |
queue.core.housekeeper.poll-interval-ms |
TB_HOUSEKEEPER_POLL_INTERVAL_MS |
500 |
Poll interval for topics related to Housekeeper |
queue.core.housekeeper.task-processing-timeout-ms |
TB_HOUSEKEEPER_TASK_PROCESSING_TIMEOUT_MS |
120000 |
Timeout in milliseconds for task processing. Tasks that fail to finish on time will be submitted for reprocessing |
queue.core.housekeeper.disabled-task-types |
TB_HOUSEKEEPER_DISABLED_TASK_TYPES |
_(empty)_ |
Comma-separated list of task types that shouldn’t be processed. Available task types: DELETE_ATTRIBUTES, DELETE_TELEMETRY (both DELETE_LATEST_TS and DELETE_TS_HISTORY will be disabled), DELETE_LATEST_TS, DELETE_TS_HISTORY, DELETE_EVENTS, DELETE_ALARMS, UNASSIGN_ALARMS |
queue.core.housekeeper.task-reprocessing-delay-ms |
TB_HOUSEKEEPER_TASK_REPROCESSING_DELAY_MS |
3000 |
Delay in milliseconds between tasks reprocessing |
queue.core.housekeeper.max-reprocessing-attempts |
TB_HOUSEKEEPER_MAX_REPROCESSING_ATTEMPTS |
10 |
Maximum amount of task reprocessing attempts. After exceeding, the task will be dropped |
queue.core.housekeeper.stats.enabled |
TB_HOUSEKEEPER_STATS_ENABLED |
true |
Enable/disable statistics for Housekeeper |
queue.core.housekeeper.stats.print-interval-ms |
TB_HOUSEKEEPER_STATS_PRINT_INTERVAL_MS |
60000 |
Statistics printing interval for Housekeeper |
queue.vc.topic |
TB_QUEUE_VC_TOPIC |
tb_version_control |
Default topic name for Kafka, RabbitMQ, etc. |
queue.vc.partitions |
TB_QUEUE_VC_PARTITIONS |
10 |
Number of partitions to associate with this queue. Used for scaling the number of messages that can be processed in parallel |
queue.vc.poll-interval |
TB_QUEUE_VC_INTERVAL_MS |
25 |
Interval in milliseconds between polling of the messages if no new messages arrive |
queue.vc.pack-processing-timeout |
TB_QUEUE_VC_PACK_PROCESSING_TIMEOUT_MS |
180000 |
Timeout before retrying all failed and timed-out messages from the processing pack |
queue.vc.request-timeout |
TB_QUEUE_VC_REQUEST_TIMEOUT |
180000 |
Timeout for a request to VC-executor (for a request for the version of the entity, for a commit charge, etc.) |
queue.vc.msg-chunk-size |
TB_QUEUE_VC_MSG_CHUNK_SIZE |
250000 |
Queue settings for Kafka, RabbitMQ, etc. Limit for single message size |
queue.js.request_topic |
REMOTE_JS_EVAL_REQUEST_TOPIC |
js_eval.requests |
JS Eval request topic |
queue.js.response_topic_prefix |
REMOTE_JS_EVAL_RESPONSE_TOPIC |
js_eval.responses |
JS Eval responses topic prefix that is combined with node id |
queue.js.max_pending_requests |
REMOTE_JS_MAX_PENDING_REQUESTS |
10000 |
JS Eval max pending requests |
queue.js.max_eval_requests_timeout |
REMOTE_JS_MAX_EVAL_REQUEST_TIMEOUT |
60000 |
JS Eval max request timeout |
queue.js.max_requests_timeout |
REMOTE_JS_MAX_REQUEST_TIMEOUT |
10000 |
JS max request timeout |
queue.js.max_exec_requests_timeout |
REMOTE_JS_MAX_EXEC_REQUEST_TIMEOUT |
2000 |
JS execution max request timeout |
queue.js.response_poll_interval |
REMOTE_JS_RESPONSE_POLL_INTERVAL_MS |
25 |
JS response poll interval |
queue.rule-engine.topic |
TB_QUEUE_RULE_ENGINE_TOPIC |
tb_rule_engine |
Deprecated. It will be removed in the nearest releases |
queue.rule-engine.poll-interval |
TB_QUEUE_RULE_ENGINE_POLL_INTERVAL_MS |
25 |
Interval in milliseconds to poll messages by Rule Engine |
queue.rule-engine.pack-processing-timeout |
TB_QUEUE_RULE_ENGINE_PACK_PROCESSING_TIMEOUT_MS |
2000 |
Timeout for processing a message pack of Rule Engine |
queue.rule-engine.stats.enabled |
TB_QUEUE_RULE_ENGINE_STATS_ENABLED |
true |
Enable/disable statistics for Rule Engine |
queue.rule-engine.stats.print-interval-ms |
TB_QUEUE_RULE_ENGINE_STATS_PRINT_INTERVAL_MS |
60000 |
Statistics printing interval for Rule Engine |
queue.rule-engine.stats.max-error-message-length |
TB_QUEUE_RULE_ENGINE_MAX_ERROR_MESSAGE_LENGTH |
4096 |
Max length of the error message that is printed by statistics |
queue.rule-engine.topic-deletion-delay |
TB_QUEUE_RULE_ENGINE_TOPIC_DELETION_DELAY_SEC |
15 |
After a queue is deleted (or the profile’s isolation option was disabled), Rule Engine will continue reading related topics during this period before deleting the actual topics |
queue.rule-engine.management-thread-pool-size |
TB_QUEUE_RULE_ENGINE_MGMT_THREAD_POOL_SIZE |
12 |
Size of the thread pool that handles such operations as partition changes, config updates, queue deletion |
queue.transport.notifications_topic |
TB_QUEUE_TRANSPORT_NOTIFICATIONS_TOPIC |
tb_transport.notifications |
For high-priority notifications that require minimum latency and processing time |
queue.transport.poll_interval |
TB_QUEUE_TRANSPORT_NOTIFICATIONS_POLL_INTERVAL_MS |
25 |
Interval in milliseconds to poll messages |
queue.edge.topic |
TB_QUEUE_EDGE_TOPIC |
tb_edge |
Default topic name for Kafka, RabbitMQ, etc. |
queue.edge.partitions |
TB_QUEUE_EDGE_PARTITIONS |
10 |
Amount of partitions used by Edge services |
queue.edge.poll-interval |
TB_QUEUE_EDGE_POLL_INTERVAL_MS |
25 |
Poll interval for topics related to Edge services |
queue.edge.pack-processing-timeout |
TB_QUEUE_EDGE_PACK_PROCESSING_TIMEOUT_MS |
10000 |
Timeout for processing a message pack by Edge services |
queue.edge.pack-processing-retries |
TB_QUEUE_EDGE_MESSAGE_PROCESSING_RETRIES |
3 |
Retries for processing a failure message pack by Edge services |
queue.edge.consumer-per-partition |
TB_QUEUE_EDGE_CONSUMER_PER_PARTITION |
false |
Enable/disable a separate consumer per partition for Edge queue |
queue.edge.stats.enabled |
TB_QUEUE_EDGE_STATS_ENABLED |
true |
Enable/disable statistics for Edge services |
queue.edge.stats.print-interval-ms |
TB_QUEUE_EDGE_STATS_PRINT_INTERVAL_MS |
60000 |
Statistics printing interval for Edge services |