02.12.2021 17:25:00,004 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59271ms delay out of 60000ms. Remaining 729ms. Executor queue at 0
02.12.2021 17:25:00,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 10 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,016 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:00,016 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 32107ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:00,016 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Flushing record collector
02.12.2021 17:25:00,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Prepared RUNNING task for committing
02.12.2021 17:25:00,017 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry1-0=OffsetAndMetadata{offset=1142284, leaderEpoch=null, metadata='AQAAAX179bfd'}} to coordinator kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:00,017 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1061) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition_index=0,committed_offset=1142284,committed_leader_epoch=-1,committed_metadata=AQAAAX179bfd}]}]}
02.12.2021 17:25:00,017 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1060): org.apache.kafka.common.requests.HeartbeatResponse@14bd5cc5
02.12.2021 17:25:00,017 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:00,018 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:00,034 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received OFFSET_COMMIT response from node 2147483644 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1061): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry1', partitions=[OffsetCommitResponsePartition(partitionIndex=0, errorCode=0)])])
02.12.2021 17:25:00,035 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Committed offset 1142284 for partition redacted.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:00,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 295
02.12.2021 17:25:00,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry1-0=1142283}
02.12.2021 17:25:00,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:00,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Committed all active tasks [0_0] and standby tasks [] in 0ms
02.12.2021 17:25:00,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:00,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:00,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:00,041 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142284, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:00,047 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142294, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:00,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 12 ms and fetched 10 records
02.12.2021 17:25:00,058 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:00,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,058 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:00,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:00,059 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59170ms for 60000ms of delay, sleeping for 840ms
02.12.2021 17:25:00,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 292
02.12.2021 17:25:00,094 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:00,122 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:00,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:00,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:00,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,158 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 190
02.12.2021 17:25:00,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:00,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 178
02.12.2021 17:25:00,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,244 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 73
02.12.2021 17:25:00,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:00,310 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:00,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:00,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,330 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 257
02.12.2021 17:25:00,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:00,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:00,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:00,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:00,338 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016308, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:00,338 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016318, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:00,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:00,339 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:00,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,339 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:00,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:00,339 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119393ms for 120000ms of delay, sleeping for 617ms
02.12.2021 17:25:00,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 77
02.12.2021 17:25:00,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:00,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,359 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 229
02.12.2021 17:25:00,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,394 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,417 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,431 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 156
02.12.2021 17:25:00,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 129
02.12.2021 17:25:00,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:00,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 56
02.12.2021 17:25:00,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 28
02.12.2021 17:25:00,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,589 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,589 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,589 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=685) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null}
02.12.2021 17:25:00,588 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,589 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,590 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=685): org.apache.kafka.common.requests.HeartbeatResponse@1fa6463c
02.12.2021 17:25:00,590 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:00,590 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 185 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:00,590 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:00,590 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:00,590 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 85, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,590 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=686) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:00,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 240
02.12.2021 17:25:00,590 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=685) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null}
02.12.2021 17:25:00,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 271
02.12.2021 17:25:00,596 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=685): org.apache.kafka.common.requests.HeartbeatResponse@1b3a187f
02.12.2021 17:25:00,596 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:00,596 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 185 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:00,596 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:00,596 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:00,596 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 85, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,596 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=686) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:00,596 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 263
02.12.2021 17:25:00,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:00,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:00,625 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,626 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,626 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1122) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null}
02.12.2021 17:25:00,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,660 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,689 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:00,692 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:00,697 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:00,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:00,726 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1122): org.apache.kafka.common.requests.HeartbeatResponse@6c215b03
02.12.2021 17:25:00,726 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:00,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,751 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,752 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:00,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:00,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:00,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:00,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,834 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:00,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,861 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:00,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,895 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,901 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59768ms for 60000ms of delay, sleeping for 242ms
02.12.2021 17:25:00,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,929 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,970 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119785ms for 120000ms of delay, sleeping for 225ms
02.12.2021 17:25:00,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,997 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239988ms delay out of 240000ms. Remaining 12ms. Executor queue at 0
02.12.2021 17:25:01,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 60 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:01,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 179865ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:01,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:01,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 61 iterations.
02.12.2021 17:25:01,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 61 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:01,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 179865ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:01,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:01,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:01,005 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970208, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:01,005 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970218, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:01,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:01,005 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:01,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,005 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:01,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 61 iterations.
02.12.2021 17:25:01,006 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239855ms for 240000ms of delay, sleeping for 155ms
02.12.2021 17:25:01,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:01,097 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:01,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 286
02.12.2021 17:25:01,157 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59900ms for 60000ms of delay, sleeping for 110ms
02.12.2021 17:25:01,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,162 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,165 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239981ms for 240000ms of delay, sleeping for 29ms
02.12.2021 17:25:01,196 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239608ms for 240000ms of delay, sleeping for 402ms
02.12.2021 17:25:01,196 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119336ms for 120000ms of delay, sleeping for 674ms
02.12.2021 17:25:01,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:01,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:01,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,253 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,253 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 175
02.12.2021 17:25:01,268 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59255ms for 60000ms of delay, sleeping for 755ms
02.12.2021 17:25:01,305 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:01,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,335 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 74
02.12.2021 17:25:01,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,362 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,396 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,396 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,431 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:01,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:01,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:01,601 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239441ms for 240000ms of delay, sleeping for 569ms
02.12.2021 17:25:01,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:01,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,666 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,667 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:01,698 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:01,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:01,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,755 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,798 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:01,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:01,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,837 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,838 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,863 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,866 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,875 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119692ms for 120000ms of delay, sleeping for 318ms
02.12.2021 17:25:01,897 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,897 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,899 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,954 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,954 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:02,002 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:02,039 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59948ms for 60000ms of delay, sleeping for 62ms
02.12.2021 17:25:02,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:02,106 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59124ms for 60000ms of delay, sleeping for 886ms
02.12.2021 17:25:02,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 282
02.12.2021 17:25:02,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:02,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,166 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,206 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119874ms for 120000ms of delay, sleeping for 136ms
02.12.2021 17:25:02,215 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239865ms for 240000ms of delay, sleeping for 145ms
02.12.2021 17:25:02,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 167
02.12.2021 17:25:02,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,256 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:02,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 67
02.12.2021 17:25:02,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:02,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,348 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,349 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119570ms for 120000ms of delay, sleeping for 440ms
02.12.2021 17:25:02,362 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239487ms for 240000ms of delay, sleeping for 523ms
02.12.2021 17:25:02,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:02,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,367 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,368 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,401 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 118
02.12.2021 17:25:02,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,456 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 57
02.12.2021 17:25:02,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 18
02.12.2021 17:25:02,513 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:02,513 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:02,514 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=728) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:02,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 443
02.12.2021 17:25:02,514 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=728): org.apache.kafka.common.requests.HeartbeatResponse@74afd13d
02.12.2021 17:25:02,514 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:02,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 442
02.12.2021 17:25:02,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 442
02.12.2021 17:25:02,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,521 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:02,522 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:02,522 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=671) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:02,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 380
02.12.2021 17:25:02,522 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=671): org.apache.kafka.common.requests.HeartbeatResponse@3b364862
02.12.2021 17:25:02,522 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:02,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 379
02.12.2021 17:25:02,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 379
02.12.2021 17:25:02,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 341
02.12.2021 17:25:02,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 278
02.12.2021 17:25:02,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,667 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 236
02.12.2021 17:25:02,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 177
02.12.2021 17:25:02,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,758 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,794 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118975ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:02,823 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 133
02.12.2021 17:25:02,825 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 76
02.12.2021 17:25:02,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,852 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,868 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,887 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239953ms for 240000ms of delay, sleeping for 57ms
02.12.2021 17:25:02,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,904 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:02,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 32
02.12.2021 17:25:02,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 61 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:02,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 181807ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:02,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:02,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 62 iterations.
02.12.2021 17:25:02,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 62 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:02,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 181807ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:02,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:02,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:02,946 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970218, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:02,946 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970228, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:02,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:02,947 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:02,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,947 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:02,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 62 iterations.
02.12.2021 17:25:02,948 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239048ms for 240000ms of delay, sleeping for 962ms
02.12.2021 17:25:02,951 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:02,952 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:02,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,956 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:02,952 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1062) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:02,995 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59979ms for 60000ms of delay, sleeping for 31ms
02.12.2021 17:25:03,012 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 393
02.12.2021 17:25:03,030 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59772ms for 60000ms of delay, sleeping for 238ms
02.12.2021 17:25:03,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:03,061 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1062): org.apache.kafka.common.requests.HeartbeatResponse@41efad77
02.12.2021 17:25:03,065 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:03,112 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:03,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:03,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,168 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,212 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:03,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:03,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,259 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,270 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59418ms for 60000ms of delay, sleeping for 592ms
02.12.2021 17:25:03,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:03,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:03,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:03,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,366 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,369 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,405 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,458 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,458 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:03,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:03,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:03,652 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:03,652 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:03,653 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1123) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null}
02.12.2021 17:25:03,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:03,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,670 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:03,753 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1123): org.apache.kafka.common.requests.HeartbeatResponse@1c63ef7d
02.12.2021 17:25:03,753 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:03,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,760 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:03,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,764 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,795 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119976ms delay out of 120000ms. Remaining 24ms. Executor queue at 0
02.12.2021 17:25:03,804 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119635ms for 120000ms of delay, sleeping for 375ms
02.12.2021 17:25:03,807 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:03,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:03,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,880 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,881 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 9 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:03,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:03,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,864 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:03,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,910 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,911 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,911 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59811ms for 60000ms of delay, sleeping for 199ms
02.12.2021 17:25:03,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:03,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,926 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239882ms for 240000ms of delay, sleeping for 128ms
02.12.2021 17:25:03,922 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,953 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 520 ms and fetched 0 records
02.12.2021 17:25:03,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,978 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,055 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239214ms for 240000ms of delay, sleeping for 796ms
02.12.2021 17:25:04,053 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:04,114 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=676): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', members=[])
02.12.2021 17:25:04,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 1 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:04,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:04,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:04,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:04,132 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142294, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:04,132 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142304, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:04,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:04,132 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:04,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,132 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:04,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:04,116 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=676): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', members=[])
02.12.2021 17:25:04,134 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', members=[])
02.12.2021 17:25:04,134 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:04,134 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}
02.12.2021 17:25:04,134 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:04,134 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=677) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null,assignments=[]}
02.12.2021 17:25:04,116 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', members=[])
02.12.2021 17:25:04,134 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:04,134 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}
02.12.2021 17:25:04,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 36
02.12.2021 17:25:04,135 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:04,139 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=677) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:04,133 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59479ms for 60000ms of delay, sleeping for 531ms
02.12.2021 17:25:04,139 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 125
02.12.2021 17:25:04,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:04,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,175 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:04,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:04,189 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=677): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:04,190 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119143ms for 120000ms of delay, sleeping for 867ms
02.12.2021 17:25:04,190 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=677): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:04,189 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:04,192 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=55, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}
02.12.2021 17:25:04,191 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:04,194 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=55, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}
02.12.2021 17:25:04,195 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 55 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e
02.12.2021 17:25:04,196 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:04,196 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:04,193 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 55 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025
02.12.2021 17:25:04,197 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:04,197 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:04,197 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:04,198 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:04,197 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:04,199 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:04,198 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:04,202 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from RUNNING to REBALANCING
02.12.2021 17:25:04,213 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:04,213 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 487
02.12.2021 17:25:04,202 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:04,215 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:04,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 73
02.12.2021 17:25:04,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 170
02.12.2021 17:25:04,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 525 ms and fetched 0 records
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:04,289 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,313 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 363
02.12.2021 17:25:04,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,384 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,385 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 69
02.12.2021 17:25:04,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:04,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:04,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,411 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 262
02.12.2021 17:25:04,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 513 ms and fetched 0 records
02.12.2021 17:25:04,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,455 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,455 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 513 ms and fetched 0 records
02.12.2021 17:25:04,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,499 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 287
02.12.2021 17:25:04,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 162
02.12.2021 17:25:04,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:04,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:04,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 186
02.12.2021 17:25:04,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 62
02.12.2021 17:25:04,657 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:04,673 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59706ms for 60000ms of delay, sleeping for 304ms
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:04,677 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:04,677 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from REBALANCING to RUNNING
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,700 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:04,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 86
02.12.2021 17:25:04,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:04,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:04,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,790 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,794 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,802 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:04,853 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239727ms for 240000ms of delay, sleeping for 283ms
02.12.2021 17:25:04,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:04,880 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:04,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,886 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:04,903 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:04,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,913 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,956 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,980 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59106ms for 60000ms of delay, sleeping for 904ms
02.12.2021 17:25:04,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:04,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:05,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,000 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:05,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:05,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:05,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 30632ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:05,066 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Flushing record collector
02.12.2021 17:25:05,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Prepared RUNNING task for committing
02.12.2021 17:25:05,066 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry2-5=OffsetAndMetadata{offset=1016318, leaderEpoch=null, metadata='AQAAAX179N5X'}} to coordinator kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:05,066 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1124) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry2,partitions=[{partition_index=5,committed_offset=1016318,committed_leader_epoch=-1,committed_metadata=AQAAAX179N5X}]}]}
02.12.2021 17:25:05,081 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:05,082 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received OFFSET_COMMIT response from node 2147483645 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1124): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry2', partitions=[OffsetCommitResponsePartition(partitionIndex=5, errorCode=0)])])
02.12.2021 17:25:05,087 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Committed offset 1016318 for partition redacted.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:05,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry2-5=1016317}
02.12.2021 17:25:05,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:05,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committed all active tasks [0_5] and standby tasks [] in 0ms
02.12.2021 17:25:05,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:05,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:05,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:05,098 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 185 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd
02.12.2021 17:25:05,097 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:05,098 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:05,099 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:05,100 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 85, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 5])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:05,100 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1125) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:05,100 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016318, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:05,100 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016328, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:05,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 8 ms and fetched 10 records
02.12.2021 17:25:05,100 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:05,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:05,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:05,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:05,102 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119963ms for 120000ms of delay, sleeping for 47ms
02.12.2021 17:25:05,138 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239804ms for 240000ms of delay, sleeping for 206ms
02.12.2021 17:25:05,151 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118942ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:05,161 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:05,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:05,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,179 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,179 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,199 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:05,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:05,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:05,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:05,287 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=686): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:05,287 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:05,287 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:05,287 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:05,287 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:05,287 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=687) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:05,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 100
02.12.2021 17:25:05,287 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=686): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:05,287 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:05,288 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:05,288 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:05,288 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:05,288 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=687) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,assignments=[]}
02.12.2021 17:25:05,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 127
02.12.2021 17:25:05,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,294 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,302 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:05,335 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=687): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,335 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=687): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,335 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,336 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,336 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=186, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:05,336 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=186, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:05,336 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 186 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:05,336 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 186 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:05,336 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:05,336 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:05,336 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:05,337 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:05,337 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:05,337 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:05,337 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:05,337 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:05,337 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from RUNNING to REBALANCING
02.12.2021 17:25:05,337 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:05,337 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:05,337 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 80
02.12.2021 17:25:05,337 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:05,337 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:05,338 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 51
02.12.2021 17:25:05,346 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239186ms for 240000ms of delay, sleeping for 824ms
02.12.2021 17:25:05,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:05,380 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:05,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:05,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:05,389 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:05,389 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:05,389 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:05,389 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:05,389 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:05,389 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:05,389 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:05,389 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:05,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:05,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,389 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:05,402 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:05,418 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:05,418 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from REBALANCING to RUNNING
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:05,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,458 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,458 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 63
02.12.2021 17:25:05,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:05,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:05,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:05,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,502 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 10
02.12.2021 17:25:05,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:05,513 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:05,514 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:05,514 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=729) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:05,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 489
02.12.2021 17:25:05,514 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=729): org.apache.kafka.common.requests.HeartbeatResponse@4c4590c2
02.12.2021 17:25:05,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:05,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 488
02.12.2021 17:25:05,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 488
02.12.2021 17:25:05,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:05,522 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:05,522 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:05,522 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=672) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:05,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 436
02.12.2021 17:25:05,522 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=672): org.apache.kafka.common.requests.HeartbeatResponse@6d151ffa
02.12.2021 17:25:05,522 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:05,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 436
02.12.2021 17:25:05,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 436
02.12.2021 17:25:05,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:05,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:05,596 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:05,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 388
02.12.2021 17:25:05,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:05,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 335
02.12.2021 17:25:05,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,684 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:05,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:05,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 287
02.12.2021 17:25:05,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:05,723 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 235
02.12.2021 17:25:05,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:05,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,795 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,803 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 87
02.12.2021 17:25:05,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:05,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:05,838 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 120
02.12.2021 17:25:05,888 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59919ms for 60000ms of delay, sleeping for 91ms
02.12.2021 17:25:05,892 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 295
02.12.2021 17:25:05,897 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:05,897 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,897 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:05,921 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:05,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:05,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,922 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,941 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 17
02.12.2021 17:25:05,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:05,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,969 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,971 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:05,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:05,972 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:05,974 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1063) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:05,981 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59916ms for 60000ms of delay, sleeping for 94ms
02.12.2021 17:25:05,992 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:05,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:06,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:06,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,005 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,006 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:05,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,030 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,073 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:06,075 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1063): org.apache.kafka.common.requests.HeartbeatResponse@7893c0b2
02.12.2021 17:25:06,078 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:06,082 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59115ms for 60000ms of delay, sleeping for 895ms
02.12.2021 17:25:06,096 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:06,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:06,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 285
02.12.2021 17:25:06,108 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:06,136 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 293
02.12.2021 17:25:06,151 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119942ms delay out of 120000ms. Remaining 58ms. Executor queue at 0
02.12.2021 17:25:06,167 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119058ms for 120000ms of delay, sleeping for 952ms
02.12.2021 17:25:06,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:06,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:06,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,193 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:06,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:06,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 180
02.12.2021 17:25:06,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 62 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 185080ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:06,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:06,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 63 iterations.
02.12.2021 17:25:06,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 63 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 185080ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:06,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:06,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:06,220 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1375): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', members=[])
02.12.2021 17:25:06,220 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', members=[])
02.12.2021 17:25:06,220 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:06,220 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}
02.12.2021 17:25:06,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 285
02.12.2021 17:25:06,220 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:06,232 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970228, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:06,233 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970238, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:06,233 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1376) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null,assignments=[]}
02.12.2021 17:25:06,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 14 ms and fetched 10 records
02.12.2021 17:25:06,280 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:06,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 178
02.12.2021 17:25:06,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:06,297 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:06,297 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,298 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:06,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 63 iterations.
02.12.2021 17:25:06,297 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:06,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 185
02.12.2021 17:25:06,319 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 80
02.12.2021 17:25:06,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:06,334 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1376): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:06,334 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=55, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}
02.12.2021 17:25:06,351 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239498ms for 240000ms of delay, sleeping for 512ms
02.12.2021 17:25:06,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 48
02.12.2021 17:25:06,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:06,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 293
02.12.2021 17:25:06,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 513 ms and fetched 0 records
02.12.2021 17:25:06,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,411 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,430 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:06,430 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,430 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,430 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,430 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,430 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,430 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,430 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,431 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 75
02.12.2021 17:25:06,430 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:06,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:06,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,471 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:06,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:06,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,508 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:06,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:06,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:06,601 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:06,610 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:06,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:06,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:06,645 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 285
02.12.2021 17:25:06,672 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:06,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:06,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,697 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,697 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 437
02.12.2021 17:25:06,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:06,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:06,741 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:06,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 185
02.12.2021 17:25:06,774 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:06,798 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 336
02.12.2021 17:25:06,812 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:06,813 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:06,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 532 ms and fetched 0 records
02.12.2021 17:25:06,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,831 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 303
02.12.2021 17:25:06,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 84
02.12.2021 17:25:06,865 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239570ms for 240000ms of delay, sleeping for 440ms
02.12.2021 17:25:06,875 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:06,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 236
02.12.2021 17:25:06,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,911 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,911 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,912 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:06,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,931 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30281ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:06,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 203
02.12.2021 17:25:06,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:06,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,975 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,982 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59155ms for 60000ms of delay, sleeping for 855ms
02.12.2021 17:25:06,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 135
02.12.2021 17:25:07,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,010 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:07,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:07,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 101
02.12.2021 17:25:07,077 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:07,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 35
02.12.2021 17:25:07,112 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:07,110 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:07,122 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118978ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:07,139 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:07,141 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:07,134 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:07,141 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:07,141 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=678) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null}
02.12.2021 17:25:07,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:07,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 56
02.12.2021 17:25:07,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:07,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 55
02.12.2021 17:25:07,142 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=678): org.apache.kafka.common.requests.HeartbeatResponse@551320fa
02.12.2021 17:25:07,142 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:07,142 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 55 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025
02.12.2021 17:25:07,142 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:07,142 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:07,142 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 99, -7, 73, -122, 97, 3, 73, 127, -105, 10, 111, -53, -15, -100, 50, -91, 0, 0, 0, 0, 0, 0, 0, 0, 36, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:07,143 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=679) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:07,143 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 54
02.12.2021 17:25:07,141 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=678) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null}
02.12.2021 17:25:07,143 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:07,143 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=678): org.apache.kafka.common.requests.HeartbeatResponse@64e58f57
02.12.2021 17:25:07,144 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:07,144 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 55 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e
02.12.2021 17:25:07,144 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:07,144 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:07,144 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 99, -7, 73, -122, 97, 3, 73, 127, -105, 10, 111, -53, -15, -100, 50, -91, 0, 0, 0, 0, 0, 0, 0, 0, 36, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:07,144 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=679) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:07,144 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 187
02.12.2021 17:25:07,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 287
02.12.2021 17:25:07,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,204 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,219 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:07,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 192
02.12.2021 17:25:07,241 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:07,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 189
02.12.2021 17:25:07,243 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:07,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:07,307 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239355ms for 240000ms of delay, sleeping for 655ms
02.12.2021 17:25:07,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:07,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:07,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:07,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,334 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 89
02.12.2021 17:25:07,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:07,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,411 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:07,421 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:07,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,432 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:07,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,485 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,511 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:07,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:07,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:07,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:07,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:07,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:07,692 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:07,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,705 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:07,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:07,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:07,792 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:07,813 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:07,815 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:07,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:07,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:07,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,836 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,840 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 10 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,840 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:07,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:07,844 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142304, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:07,845 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142314, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:07,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:07,846 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:07,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,846 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:07,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:07,847 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59692ms for 60000ms of delay, sleeping for 318ms
02.12.2021 17:25:07,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:07,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,912 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,913 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 374
02.12.2021 17:25:07,914 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:07,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,936 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 352
02.12.2021 17:25:07,965 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239720ms for 240000ms of delay, sleeping for 290ms
02.12.2021 17:25:07,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:07,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,996 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:08,014 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 273
02.12.2021 17:25:08,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 515 ms and fetched 0 records
02.12.2021 17:25:08,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,026 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 486
02.12.2021 17:25:08,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 251
02.12.2021 17:25:08,140 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119996ms delay out of 120000ms. Remaining 4ms. Executor queue at 0
02.12.2021 17:25:08,153 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119068ms for 120000ms of delay, sleeping for 942ms
02.12.2021 17:25:08,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 382
02.12.2021 17:25:08,117 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 170
02.12.2021 17:25:08,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:08,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 136
02.12.2021 17:25:08,200 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59824ms for 60000ms of delay, sleeping for 186ms
02.12.2021 17:25:08,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,206 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,253 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 34
02.12.2021 17:25:08,253 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 260
02.12.2021 17:25:08,256 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 236347ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:08,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 245
02.12.2021 17:25:08,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 28
02.12.2021 17:25:08,287 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,287 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 186 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,287 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=688) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null}
02.12.2021 17:25:08,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 125
02.12.2021 17:25:08,288 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=688): org.apache.kafka.common.requests.HeartbeatResponse@44bddfa5
02.12.2021 17:25:08,288 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:08,288 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 186 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:08,288 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:08,288 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:08,289 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,290 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 186 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,290 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=688) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null}
02.12.2021 17:25:08,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,288 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 86, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 146
02.12.2021 17:25:08,290 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=688): org.apache.kafka.common.requests.HeartbeatResponse@6ab4bd24
02.12.2021 17:25:08,290 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=689) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:08,290 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:08,291 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 186 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:08,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 123
02.12.2021 17:25:08,291 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:08,291 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:08,292 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 86, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,292 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=689) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:08,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 144
02.12.2021 17:25:08,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:08,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,339 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 160
02.12.2021 17:25:08,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 138
02.12.2021 17:25:08,387 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59550ms for 60000ms of delay, sleeping for 460ms
02.12.2021 17:25:08,388 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:08,390 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:08,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,414 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,437 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,454 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 59
02.12.2021 17:25:08,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 38
02.12.2021 17:25:08,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:08,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,500 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 21
02.12.2021 17:25:08,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,520 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,520 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:08,520 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=730) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:08,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 7
02.12.2021 17:25:08,521 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=730): org.apache.kafka.common.requests.HeartbeatResponse@3ba5fc99
02.12.2021 17:25:08,522 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,522 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:08,522 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=673) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:08,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 479
02.12.2021 17:25:08,522 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:08,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 5
02.12.2021 17:25:08,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 5
02.12.2021 17:25:08,523 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=673): org.apache.kafka.common.requests.HeartbeatResponse@39257f7e
02.12.2021 17:25:08,523 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:08,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 478
02.12.2021 17:25:08,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 478
02.12.2021 17:25:08,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:08,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,530 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:08,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 378
02.12.2021 17:25:08,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:08,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,707 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,723 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 278
02.12.2021 17:25:08,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:08,824 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 177
02.12.2021 17:25:08,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:08,840 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,840 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,840 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,840 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,840 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,840 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,841 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,849 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59970ms for 60000ms of delay, sleeping for 40ms
02.12.2021 17:25:08,900 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59133ms for 60000ms of delay, sleeping for 877ms
02.12.2021 17:25:08,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,915 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 76
02.12.2021 17:25:08,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,938 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:08,984 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,984 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:08,984 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1064) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:09,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,002 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,002 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:09,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,044 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,044 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,084 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1064): org.apache.kafka.common.requests.HeartbeatResponse@209e7b12
02.12.2021 17:25:09,085 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:09,111 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119474ms for 120000ms of delay, sleeping for 536ms
02.12.2021 17:25:09,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:09,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:09,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,208 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,212 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:09,244 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:09,244 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:09,245 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1377) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null}
02.12.2021 17:25:09,246 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:09,257 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 237348ms delay out of 240000ms. Remaining 2652ms. Executor queue at 0
02.12.2021 17:25:09,258 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 237348ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:09,313 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:09,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,345 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1377): org.apache.kafka.common.requests.HeartbeatResponse@3b390ca4
02.12.2021 17:25:09,345 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:09,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:09,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:09,416 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,416 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,417 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,446 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:09,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,474 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,502 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 528 ms and fetched 0 records
02.12.2021 17:25:09,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,572 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:09,662 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119534ms for 120000ms of delay, sleeping for 476ms
02.12.2021 17:25:09,673 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:09,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:09,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,709 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:09,778 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58701ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:09,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:09,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,843 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:09,874 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:09,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:09,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,918 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,918 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,974 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,975 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:09,975 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,004 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,004 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,076 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,077 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,148 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119796ms for 120000ms of delay, sleeping for 214ms
02.12.2021 17:25:10,181 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:10,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:10,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,210 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,258 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 238348ms delay out of 240000ms. Remaining 1652ms. Executor queue at 1
02.12.2021 17:25:10,262 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238350ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:10,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:10,306 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:10,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,345 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 9 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:10,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:10,364 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118609ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:10,385 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:10,406 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:10,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,419 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,419 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,476 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,476 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:10,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,505 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,579 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,581 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:10,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:10,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,716 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,778 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59701ms delay out of 60000ms. Remaining 299ms. Executor queue at 2
02.12.2021 17:25:10,781 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59592ms for 60000ms of delay, sleeping for 418ms
02.12.2021 17:25:10,789 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:10,807 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:10,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,851 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,851 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:10,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:10,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,920 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,977 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,977 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,051 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 471
02.12.2021 17:25:10,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:11,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 558 ms and fetched 0 records
02.12.2021 17:25:11,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,140 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 379
02.12.2021 17:25:11,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 371
02.12.2021 17:25:11,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 10 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:11,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:11,209 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142314, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:11,209 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142324, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:11,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:11,210 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:11,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,210 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:11,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:11,210 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59154ms for 60000ms of delay, sleeping for 856ms
02.12.2021 17:25:11,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,217 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 279
02.12.2021 17:25:11,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 270
02.12.2021 17:25:11,262 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239350ms delay out of 240000ms. Remaining 650ms. Executor queue at 2
02.12.2021 17:25:11,263 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239342ms for 240000ms of delay, sleeping for 668ms
02.12.2021 17:25:11,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 178
02.12.2021 17:25:11,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,352 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 170
02.12.2021 17:25:11,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,364 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119609ms delay out of 120000ms. Remaining 391ms. Executor queue at 3
02.12.2021 17:25:11,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 1 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:11,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:11,365 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1125): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', members=[])
02.12.2021 17:25:11,365 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', members=[])
02.12.2021 17:25:11,365 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:11,365 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}
02.12.2021 17:25:11,365 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:11,365 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1126) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:11,365 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016328, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:11,365 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016338, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:11,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:11,366 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:11,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,366 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:11,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:11,366 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119291ms for 120000ms of delay, sleeping for 719ms
02.12.2021 17:25:11,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,421 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,422 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,442 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 78
02.12.2021 17:25:11,454 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 68
02.12.2021 17:25:11,466 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1126): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:11,466 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=186, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}
02.12.2021 17:25:11,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,478 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,522 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:11,522 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:11,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,522 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=674) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:11,523 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:11,523 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:11,523 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=731) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:11,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 29
02.12.2021 17:25:11,523 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=674): org.apache.kafka.common.requests.HeartbeatResponse@2e604c1b
02.12.2021 17:25:11,523 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:11,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 28
02.12.2021 17:25:11,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 28
02.12.2021 17:25:11,524 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=731): org.apache.kafka.common.requests.HeartbeatResponse@2420c07c
02.12.2021 17:25:11,532 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:11,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 109
02.12.2021 17:25:11,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 108
02.12.2021 17:25:11,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,553 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:11,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 8
02.12.2021 17:25:11,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,641 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,641 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:11,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:11,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,718 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,742 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:11,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:11,843 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:11,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,854 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,855 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,856 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:11,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,935 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30180ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 63 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 190800ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 64 iterations.
02.12.2021 17:25:11,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 64 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 190802ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:11,942 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:11,942 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:11,942 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:11,942 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 99, -7, 73, -122, 97, 3, 73, 127, -105, 10, 111, -53, -15, -100, 50, -91, 0, 0, 0, 0, 0, 0, 0, 0, 36, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 7])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:11,942 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1378) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:11,942 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970238, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:11,942 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970248, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:11,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:11,943 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:11,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,943 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:11,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:11,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 64 iterations.
02.12.2021 17:25:11,953 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:11,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:11,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,983 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,983 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,995 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:11,997 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:11,997 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1065) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:12,008 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239081ms for 240000ms of delay, sleeping for 929ms
02.12.2021 17:25:12,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:12,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:12,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,078 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,093 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59318ms for 60000ms of delay, sleeping for 692ms
02.12.2021 17:25:12,087 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119983ms for 120000ms of delay, sleeping for 27ms
02.12.2021 17:25:12,098 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1065): org.apache.kafka.common.requests.HeartbeatResponse@5ca1cbbc
02.12.2021 17:25:12,098 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:12,123 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119935ms for 120000ms of delay, sleeping for 75ms
02.12.2021 17:25:12,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:12,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,154 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,179 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:12,211 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119993ms for 120000ms of delay, sleeping for 17ms
02.12.2021 17:25:12,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:12,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,230 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,235 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119838ms for 120000ms of delay, sleeping for 172ms
02.12.2021 17:25:12,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:12,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:12,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:12,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,357 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:12,383 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:12,420 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119357ms for 120000ms of delay, sleeping for 653ms
02.12.2021 17:25:12,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:12,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,444 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30689ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:12,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:12,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,444 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,469 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:12,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:12,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,485 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 60
02.12.2021 17:25:12,579 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:12,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,569 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:12,615 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,622 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 551 ms and fetched 0 records
02.12.2021 17:25:12,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,705 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,726 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:12,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:12,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,736 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:12,786 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59678ms for 60000ms of delay, sleeping for 332ms
02.12.2021 17:25:12,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:12,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:12,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,858 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,859 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:12,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:12,938 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239907ms for 240000ms of delay, sleeping for 103ms
02.12.2021 17:25:12,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,945 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31190ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:12,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:12,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,946 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,986 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,986 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:13,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:13,051 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239862ms for 240000ms of delay, sleeping for 148ms
02.12.2021 17:25:13,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:13,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,127 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,128 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:13,130 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59677ms for 60000ms of delay, sleeping for 333ms
02.12.2021 17:25:13,155 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118065ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:13,209 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239955ms for 240000ms of delay, sleeping for 55ms
02.12.2021 17:25:13,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 523 ms and fetched 0 records
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,238 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,268 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239952ms for 240000ms of delay, sleeping for 58ms
02.12.2021 17:25:13,328 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239189ms for 240000ms of delay, sleeping for 821ms
02.12.2021 17:25:13,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:13,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:13,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:13,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,362 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,428 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:13,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:13,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 544 ms and fetched 0 records
02.12.2021 17:25:13,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,493 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,493 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,494 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59781ms for 60000ms of delay, sleeping for 229ms
02.12.2021 17:25:13,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31738ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:13,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:13,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,629 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:13,726 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59842ms for 60000ms of delay, sleeping for 168ms
02.12.2021 17:25:13,730 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:13,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:13,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,732 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,739 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,740 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,832 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:13,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:13,863 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,864 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,867 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,895 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59828ms for 60000ms of delay, sleeping for 182ms
02.12.2021 17:25:13,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:13,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:13,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,001 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32247ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:14,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,002 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:14,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:14,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 10 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:14,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:14,102 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142324, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:14,108 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142334, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:14,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 17 ms and fetched 10 records
02.12.2021 17:25:14,126 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:14,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,126 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:14,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:14,128 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59417ms for 60000ms of delay, sleeping for 593ms
02.12.2021 17:25:14,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:14,146 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 517 ms and fetched 0 records
02.12.2021 17:25:14,146 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,147 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 64 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,150 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 372
02.12.2021 17:25:14,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 193011ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,155 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119065ms delay out of 120000ms. Remaining 935ms. Executor queue at 0
02.12.2021 17:25:14,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:14,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:14,156 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:14,156 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:14,156 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:14,157 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 86, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 5])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:14,157 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1127) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:14,157 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016338, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:14,157 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016348, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:14,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:14,158 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:14,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,158 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:14,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:14,158 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119052ms for 120000ms of delay, sleeping for 958ms
02.12.2021 17:25:14,159 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=689): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:14,159 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:14,159 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:14,159 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:14,159 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,159 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=690) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 349
02.12.2021 17:25:14,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:14,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 65 iterations.
02.12.2021 17:25:14,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 65 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,158 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=689): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:14,161 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:14,161 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:14,161 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:14,161 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,161 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=690) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 340
02.12.2021 17:25:14,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 193022ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:14,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:14,175 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970248, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:14,177 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970258, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:14,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 9 ms and fetched 10 records
02.12.2021 17:25:14,183 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:14,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,184 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:14,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 65 iterations.
02.12.2021 17:25:14,184 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239965ms for 240000ms of delay, sleeping for 45ms
02.12.2021 17:25:14,218 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:14,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:14,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,238 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 285
02.12.2021 17:25:14,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,247 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 271
02.12.2021 17:25:14,288 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239120ms for 240000ms of delay, sleeping for 890ms
02.12.2021 17:25:14,290 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=690): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,290 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=690): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,299 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,299 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=187, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:14,299 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 187 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:14,300 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:14,300 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,300 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,300 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:14,300 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,300 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from RUNNING to REBALANCING
02.12.2021 17:25:14,300 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:14,300 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 203
02.12.2021 17:25:14,299 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,301 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=187, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:14,318 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 187 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:14,330 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:14,336 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,336 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,336 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:14,336 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,336 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:14,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 209
02.12.2021 17:25:14,336 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=679): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', members=[])
02.12.2021 17:25:14,337 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', members=[])
02.12.2021 17:25:14,336 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=679): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', members=[])
02.12.2021 17:25:14,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 185
02.12.2021 17:25:14,338 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:14,339 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}
02.12.2021 17:25:14,339 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,339 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', members=[])
02.12.2021 17:25:14,342 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=680) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,344 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:14,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 402
02.12.2021 17:25:14,345 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}
02.12.2021 17:25:14,347 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 171
02.12.2021 17:25:14,350 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=680) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 13
02.12.2021 17:25:14,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:14,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,370 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,379 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=680): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,379 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=680): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,379 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,379 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=56, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}
02.12.2021 17:25:14,379 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,379 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 56 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e
02.12.2021 17:25:14,380 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:14,380 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,380 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,380 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:14,380 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,380 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from RUNNING to REBALANCING
02.12.2021 17:25:14,380 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:14,380 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 492
02.12.2021 17:25:14,380 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=56, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}
02.12.2021 17:25:14,381 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 56 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025
02.12.2021 17:25:14,381 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:14,381 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,381 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,382 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:14,382 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,382 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:14,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 368
02.12.2021 17:25:14,400 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 102
02.12.2021 17:25:14,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 71
02.12.2021 17:25:14,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:14,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 70
02.12.2021 17:25:14,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 391
02.12.2021 17:25:14,482 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 265
02.12.2021 17:25:14,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 2
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,503 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32748ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,508 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:14,508 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,509 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,509 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:14,509 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:14,509 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,509 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,509 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,509 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from REBALANCING to RUNNING
02.12.2021 17:25:14,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:14,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,509 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,524 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:14,524 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:14,524 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=732) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:14,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 213
02.12.2021 17:25:14,522 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:14,525 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:14,525 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=675) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:14,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,525 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=732): org.apache.kafka.common.requests.HeartbeatResponse@2e8cdbfc
02.12.2021 17:25:14,528 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:14,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 125
02.12.2021 17:25:14,528 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 210
02.12.2021 17:25:14,539 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=675): org.apache.kafka.common.requests.HeartbeatResponse@279c64ed
02.12.2021 17:25:14,544 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:14,546 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:14,548 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 104
02.12.2021 17:25:14,551 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:14,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 290
02.12.2021 17:25:14,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 165
02.12.2021 17:25:14,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:14,610 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:14,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:14,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:14,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,656 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:14,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 190
02.12.2021 17:25:14,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 64
02.12.2021 17:25:14,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 514 ms and fetched 0 records
02.12.2021 17:25:14,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,763 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:14,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:14,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:14,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,764 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:14,708 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:14,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,765 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59726ms for 60000ms of delay, sleeping for 284ms
02.12.2021 17:25:14,764 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,765 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,765 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:14,765 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:14,765 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,765 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,765 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:14,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,765 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:14,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 89
02.12.2021 17:25:14,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 139
02.12.2021 17:25:14,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 144
02.12.2021 17:25:14,864 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:14,869 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 395
02.12.2021 17:25:14,870 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 396
02.12.2021 17:25:14,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:14,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,874 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:14,874 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,874 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,874 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:14,874 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:14,875 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,875 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,875 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,875 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from REBALANCING to RUNNING
02.12.2021 17:25:14,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:14,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,875 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,876 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:14,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 44
02.12.2021 17:25:14,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 39
02.12.2021 17:25:14,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:14,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:14,977 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:15,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,005 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,005 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,010 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,025 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:15,025 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:15,025 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1066) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:15,052 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59969ms for 60000ms of delay, sleeping for 41ms
02.12.2021 17:25:15,066 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:15,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:15,071 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:15,077 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:15,098 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58973ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:15,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:15,110 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:15,122 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118990ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:15,125 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1066): org.apache.kafka.common.requests.HeartbeatResponse@6019514a
02.12.2021 17:25:15,127 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:15,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:15,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,163 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:15,175 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:15,180 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239064ms for 240000ms of delay, sleeping for 946ms
02.12.2021 17:25:15,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:15,207 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:15,211 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:15,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:15,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,265 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,267 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:15,308 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:15,311 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:15,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:15,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:15,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:15,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,377 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,408 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:15,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:15,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:15,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:15,468 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:15,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:15,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,506 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:15,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,513 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,566 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:15,566 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:15,568 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:15,579 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:15,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:15,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:15,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,663 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,665 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:15,669 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:15,679 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:15,708 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:15,714 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:15,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:15,774 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:15,780 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:15,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,774 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,780 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,799 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:15,816 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:15,885 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:15,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,885 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,876 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:15,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:15,912 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:15,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 89
02.12.2021 17:25:15,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 177
02.12.2021 17:25:15,986 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:15,989 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:16,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:16,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:16,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,008 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,009 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,009 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,009 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:16,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,013 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,015 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:16,093 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 72
02.12.2021 17:25:16,094 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 292
02.12.2021 17:25:16,099 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59974ms delay out of 60000ms. Remaining 26ms. Executor queue at 0
02.12.2021 17:25:16,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 184
02.12.2021 17:25:16,101 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59384ms for 60000ms of delay, sleeping for 626ms
02.12.2021 17:25:16,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:16,109 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:16,124 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119992ms delay out of 120000ms. Remaining 8ms. Executor queue at 1
02.12.2021 17:25:16,126 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119991ms for 120000ms of delay, sleeping for 19ms
02.12.2021 17:25:16,122 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 393
02.12.2021 17:25:16,145 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239641ms for 240000ms of delay, sleeping for 369ms
02.12.2021 17:25:16,154 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119996ms for 120000ms of delay, sleeping for 14ms
02.12.2021 17:25:16,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,170 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,174 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,174 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119969ms for 120000ms of delay, sleeping for 41ms
02.12.2021 17:25:16,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 191
02.12.2021 17:25:16,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:16,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:16,209 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:16,217 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119312ms for 120000ms of delay, sleeping for 698ms
02.12.2021 17:25:16,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 287
02.12.2021 17:25:16,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:16,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,285 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30460ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:16,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:16,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:16,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,300 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,300 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,310 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 200
02.12.2021 17:25:16,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 186
02.12.2021 17:25:16,375 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:16,386 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:16,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,386 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,387 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,400 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:16,410 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:16,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 86
02.12.2021 17:25:16,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:16,486 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:16,487 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:16,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:16,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,510 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:16,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:16,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,516 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:16,518 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239619ms for 240000ms of delay, sleeping for 391ms
02.12.2021 17:25:16,576 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:16,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:16,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:16,601 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:16,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:16,616 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:16,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:16,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,675 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30415ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:16,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,676 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 200
02.12.2021 17:25:16,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:16,702 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:16,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:16,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:16,728 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59855ms for 60000ms of delay, sleeping for 155ms
02.12.2021 17:25:16,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:16,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,786 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,786 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,788 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:16,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,800 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,800 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,811 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:16,818 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:16,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:16,884 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59677ms for 60000ms of delay, sleeping for 333ms
02.12.2021 17:25:16,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:16,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,887 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 458
02.12.2021 17:25:16,901 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:16,912 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:16,916 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119999ms for 120000ms of delay, sleeping for 11ms
02.12.2021 17:25:16,918 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:16,929 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239946ms for 240000ms of delay, sleeping for 64ms
02.12.2021 17:25:16,931 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119939ms for 120000ms of delay, sleeping for 71ms
02.12.2021 17:25:16,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:16,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:16,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 357
02.12.2021 17:25:16,995 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239778ms for 240000ms of delay, sleeping for 232ms
02.12.2021 17:25:17,002 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:17,006 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 117999ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:17,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,010 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 151
02.12.2021 17:25:17,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,017 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,018 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 141
02.12.2021 17:25:17,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:17,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:17,090 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 255
02.12.2021 17:25:17,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 194
02.12.2021 17:25:17,111 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 50
02.12.2021 17:25:17,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 41
02.12.2021 17:25:17,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:17,160 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,160 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,160 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=691) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null}
02.12.2021 17:25:17,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 358
02.12.2021 17:25:17,161 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,161 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,161 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=691) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null}
02.12.2021 17:25:17,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 349
02.12.2021 17:25:17,162 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=691): org.apache.kafka.common.requests.HeartbeatResponse@7f0b19a7
02.12.2021 17:25:17,162 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,162 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 187 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:17,162 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:17,162 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:17,162 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 87, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,162 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=692) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 348
02.12.2021 17:25:17,162 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=691): org.apache.kafka.common.requests.HeartbeatResponse@31550adf
02.12.2021 17:25:17,163 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,163 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 187 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:17,163 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:17,163 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:17,163 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 87, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,164 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=692) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,164 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 354
02.12.2021 17:25:17,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:17,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,181 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,181 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 341
02.12.2021 17:25:17,191 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:17,191 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 154
02.12.2021 17:25:17,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:17,219 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59158ms for 60000ms of delay, sleeping for 852ms
02.12.2021 17:25:17,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 65 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:17,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 196091ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:17,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:17,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 66 iterations.
02.12.2021 17:25:17,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 66 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:17,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 196091ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:17,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:17,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:17,231 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1378): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', members=[])
02.12.2021 17:25:17,231 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', members=[])
02.12.2021 17:25:17,231 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:17,231 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}
02.12.2021 17:25:17,231 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:17,232 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970258, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:17,232 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1379) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null,assignments=[]}
02.12.2021 17:25:17,232 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970268, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:17,232 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1379): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:17,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:17,233 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:17,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,233 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:17,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 66 iterations.
02.12.2021 17:25:17,234 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239368ms for 240000ms of delay, sleeping for 642ms
02.12.2021 17:25:17,260 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:17,261 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:17,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 240
02.12.2021 17:25:17,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,286 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 238
02.12.2021 17:25:17,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 53
02.12.2021 17:25:17,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,300 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 38
02.12.2021 17:25:17,332 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=56, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}
02.12.2021 17:25:17,339 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,339 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 56 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,339 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=681) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null}
02.12.2021 17:25:17,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 462
02.12.2021 17:25:17,340 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=681): org.apache.kafka.common.requests.HeartbeatResponse@6ade8852
02.12.2021 17:25:17,340 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,340 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 56 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025
02.12.2021 17:25:17,340 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:17,340 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:17,340 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 99, -7, 73, -122, 97, 3, 73, 127, -105, 10, 111, -53, -15, -100, 50, -91, 0, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,340 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=682) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 461
02.12.2021 17:25:17,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,346 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,346 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 56 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,346 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=681) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null}
02.12.2021 17:25:17,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 41
02.12.2021 17:25:17,347 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=681): org.apache.kafka.common.requests.HeartbeatResponse@624d20e1
02.12.2021 17:25:17,347 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,347 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 56 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e
02.12.2021 17:25:17,347 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:17,347 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:17,347 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 99, -7, 73, -122, 97, 3, 73, 127, -105, 10, 111, -53, -15, -100, 50, -91, 0, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,347 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=682) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 40
02.12.2021 17:25:17,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 140
02.12.2021 17:25:17,387 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 137
02.12.2021 17:25:17,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,388 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,388 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,439 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:17,446 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:17,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 19
02.12.2021 17:25:17,487 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 37
02.12.2021 17:25:17,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,511 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:17,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,520 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,523 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,525 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:17,525 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=676) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:17,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:17,525 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=676): org.apache.kafka.common.requests.HeartbeatResponse@62b3552b
02.12.2021 17:25:17,526 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:17,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 155
02.12.2021 17:25:17,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 151
02.12.2021 17:25:17,543 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:17,543 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,543 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:17,543 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=733) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:17,543 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 243
02.12.2021 17:25:17,544 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=733): org.apache.kafka.common.requests.HeartbeatResponse@4e2f8d6f
02.12.2021 17:25:17,544 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:17,544 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 242
02.12.2021 17:25:17,544 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 242
02.12.2021 17:25:17,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 51
02.12.2021 17:25:17,645 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 141
02.12.2021 17:25:17,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:17,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,685 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,686 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:17,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 37
02.12.2021 17:25:17,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:17,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,787 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:17,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,802 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,802 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,877 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239696ms for 240000ms of delay, sleeping for 314ms
02.12.2021 17:25:17,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:17,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,889 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,889 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 391
02.12.2021 17:25:17,987 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:18,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 287
02.12.2021 17:25:18,006 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 118999ms delay out of 120000ms. Remaining 1001ms. Executor queue at 0
02.12.2021 17:25:18,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:18,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:18,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:18,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:18,011 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1127): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', members=[])
02.12.2021 17:25:18,011 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', members=[])
02.12.2021 17:25:18,011 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:18,011 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}
02.12.2021 17:25:18,011 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:18,011 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1128) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:18,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:18,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,015 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,015 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,011 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016348, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:18,036 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:18,036 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:18,036 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1067) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:18,034 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016358, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:18,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 513 ms and fetched 0 records
02.12.2021 17:25:18,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,039 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,039 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1128): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:18,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 45 ms and fetched 10 records
02.12.2021 17:25:18,057 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:18,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,057 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:18,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:18,062 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118994ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:18,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:18,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:18,112 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=187, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}
02.12.2021 17:25:18,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 10 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:18,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:18,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:18,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:18,122 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142334, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:18,123 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142344, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:18,123 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1067): org.apache.kafka.common.requests.HeartbeatResponse@18bdb1c3
02.12.2021 17:25:18,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 7 ms and fetched 10 records
02.12.2021 17:25:18,128 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:18,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,128 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:18,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:18,134 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59331ms for 60000ms of delay, sleeping for 679ms
02.12.2021 17:25:18,136 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:18,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:18,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,197 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,211 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239277ms for 240000ms of delay, sleeping for 733ms
02.12.2021 17:25:18,214 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 73
02.12.2021 17:25:18,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:18,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,295 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,295 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,297 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,303 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,303 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:18,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,392 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,398 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:18,498 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:18,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:18,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,516 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,540 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,551 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:18,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:18,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,700 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,700 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,708 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:18,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,796 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,796 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,801 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:18,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,804 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,805 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,814 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59919ms for 60000ms of delay, sleeping for 91ms
02.12.2021 17:25:18,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,894 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,901 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:18,906 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59748ms for 60000ms of delay, sleeping for 262ms
02.12.2021 17:25:18,945 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239624ms for 240000ms of delay, sleeping for 386ms
02.12.2021 17:25:18,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:19,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:19,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,017 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:19,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,054 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,062 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119994ms delay out of 120000ms. Remaining 6ms. Executor queue at 0
02.12.2021 17:25:19,072 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119969ms for 120000ms of delay, sleeping for 41ms
02.12.2021 17:25:19,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:19,112 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:19,130 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119917ms for 120000ms of delay, sleeping for 93ms
02.12.2021 17:25:19,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:19,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,211 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,211 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,210 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:19,219 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59034ms for 60000ms of delay, sleeping for 976ms
02.12.2021 17:25:19,250 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119369ms for 120000ms of delay, sleeping for 641ms
02.12.2021 17:25:19,297 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,297 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,297 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,297 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,297 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,297 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,297 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,297 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,297 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,306 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,306 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,311 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:19,333 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239189ms for 240000ms of delay, sleeping for 821ms
02.12.2021 17:25:19,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:19,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,397 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:19,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:19,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:19,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:19,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,518 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,579 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,582 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:19,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:19,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:19,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,711 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,798 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,798 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,798 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,798 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,800 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,807 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,807 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,813 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:19,896 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119948ms for 120000ms of delay, sleeping for 62ms
02.12.2021 17:25:19,901 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:19,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:19,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,901 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,903 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,918 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:19,963 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118883ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:20,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:20,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:20,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,025 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:20,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 518 ms and fetched 0 records
02.12.2021 17:25:20,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,104 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,124 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:20,157 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239014ms for 240000ms of delay, sleeping for 996ms
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:20,241 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 56 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:20,241 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1380) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null}
02.12.2021 17:25:20,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 63
02.12.2021 17:25:20,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 520 ms and fetched 0 records
02.12.2021 17:25:20,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,257 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 266
02.12.2021 17:25:20,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,310 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,310 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,320 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59602ms for 60000ms of delay, sleeping for 408ms
02.12.2021 17:25:20,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 519 ms and fetched 0 records
02.12.2021 17:25:20,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,322 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,322 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 221
02.12.2021 17:25:20,341 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1380): org.apache.kafka.common.requests.HeartbeatResponse@47dcf19e
02.12.2021 17:25:20,350 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:20,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 166
02.12.2021 17:25:20,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:20,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,405 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,422 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 121
02.12.2021 17:25:20,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 64
02.12.2021 17:25:20,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 21
02.12.2021 17:25:20,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,524 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:20,524 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:20,524 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=677) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:20,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 233
02.12.2021 17:25:20,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,526 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,525 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=677): org.apache.kafka.common.requests.HeartbeatResponse@707f088c
02.12.2021 17:25:20,526 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:20,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 231
02.12.2021 17:25:20,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 227
02.12.2021 17:25:20,544 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:20,544 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:20,544 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=734) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:20,543 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,549 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=734): org.apache.kafka.common.requests.HeartbeatResponse@5a7ae107
02.12.2021 17:25:20,549 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:20,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 273
02.12.2021 17:25:20,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 265
02.12.2021 17:25:20,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,605 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 127
02.12.2021 17:25:20,657 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 165
02.12.2021 17:25:20,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 26
02.12.2021 17:25:20,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 10 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:20,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:20,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:20,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:20,734 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142344, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:20,735 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142354, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:20,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:20,737 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:20,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,737 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:20,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:20,742 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59172ms for 60000ms of delay, sleeping for 838ms
02.12.2021 17:25:20,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,758 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:20,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 64
02.12.2021 17:25:20,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,811 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,812 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:20,823 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,828 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,828 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:20,858 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:20,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,906 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:20,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:20,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:20,963 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119883ms delay out of 120000ms. Remaining 117ms. Executor queue at 0
02.12.2021 17:25:20,964 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119847ms for 120000ms of delay, sleeping for 163ms
02.12.2021 17:25:21,029 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:21,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,032 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,053 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:21,055 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:21,055 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1129) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null}
02.12.2021 17:25:21,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:21,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,106 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,114 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:21,114 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:21,114 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1068) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:21,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:21,147 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119494ms for 120000ms of delay, sleeping for 516ms
02.12.2021 17:25:21,156 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1129): org.apache.kafka.common.requests.HeartbeatResponse@2bd60571
02.12.2021 17:25:21,157 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:21,160 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238556ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:21,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:21,215 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1068): org.apache.kafka.common.requests.HeartbeatResponse@6699bab
02.12.2021 17:25:21,215 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:21,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:21,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,260 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,311 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,312 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,329 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,360 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:21,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,407 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,431 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:21,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:21,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:21,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,539 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,542 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:21,582 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59529ms for 60000ms of delay, sleeping for 481ms
02.12.2021 17:25:21,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,610 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,610 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:21,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:21,666 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118863ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:21,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:21,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,761 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,813 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,813 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,831 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:21,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,910 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,910 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:21,964 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:22,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:22,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,062 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,062 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:22,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:22,078 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59943ms for 60000ms of delay, sleeping for 67ms
02.12.2021 17:25:22,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:22,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,117 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,161 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239557ms delay out of 240000ms. Remaining 443ms. Executor queue at 0
02.12.2021 17:25:22,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 66 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:22,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 201043ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:22,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:22,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 67 iterations.
02.12.2021 17:25:22,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 67 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:22,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 201043ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:22,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:22,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:22,182 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:22,182 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:22,182 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:22,182 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 99, -7, 73, -122, 97, 3, 73, 127, -105, 10, 111, -53, -15, -100, 50, -91, 0, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 7])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:22,182 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1381) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:22,183 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970268, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:22,183 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970278, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:22,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:22,183 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:22,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,183 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:22,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 67 iterations.
02.12.2021 17:25:22,184 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239258ms for 240000ms of delay, sleeping for 752ms
02.12.2021 17:25:22,184 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=682): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', members=[])
02.12.2021 17:25:22,184 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', members=[])
02.12.2021 17:25:22,184 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:22,184 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}
02.12.2021 17:25:22,184 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,184 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=683) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 226
02.12.2021 17:25:22,183 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=682): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', members=[])
02.12.2021 17:25:22,212 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', members=[])
02.12.2021 17:25:22,212 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:22,212 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}
02.12.2021 17:25:22,174 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:22,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 166
02.12.2021 17:25:22,212 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,223 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=683) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,223 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:22,222 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59638ms for 60000ms of delay, sleeping for 372ms
02.12.2021 17:25:22,277 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:22,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 541 ms and fetched 0 records
02.12.2021 17:25:22,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,303 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,303 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,314 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,314 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,315 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,316 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,317 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=683): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,317 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=683): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,317 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,317 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,317 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=57, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}
02.12.2021 17:25:22,318 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 57 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e
02.12.2021 17:25:22,318 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:22,318 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,318 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,318 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:22,318 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,318 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from RUNNING to REBALANCING
02.12.2021 17:25:22,318 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:22,318 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:22,318 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 13
02.12.2021 17:25:22,317 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=57, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}
02.12.2021 17:25:22,319 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 57 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025
02.12.2021 17:25:22,319 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:22,319 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,320 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,324 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:22,324 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,324 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:22,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:22,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,333 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:22,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:22,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,412 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:22,412 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,412 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,412 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:22,412 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:22,412 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,413 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 392
02.12.2021 17:25:22,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:22,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:22,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:22,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 292
02.12.2021 17:25:22,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:22,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,563 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,599 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59513ms for 60000ms of delay, sleeping for 497ms
02.12.2021 17:25:22,604 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:22,652 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 534 ms and fetched 0 records
02.12.2021 17:25:22,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,653 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:22,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 191
02.12.2021 17:25:22,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:22,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,673 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119870ms delay out of 120000ms. Remaining 130ms. Executor queue at 0
02.12.2021 17:25:22,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:22,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:22,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:22,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:22,674 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:22,674 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:22,674 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:22,674 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 87, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 5])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:22,674 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1130) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:22,674 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016358, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:22,675 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016368, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:22,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:22,675 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:22,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,675 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:22,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:22,675 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119747ms for 120000ms of delay, sleeping for 263ms
02.12.2021 17:25:22,676 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=692): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:22,676 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:22,676 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:22,676 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:22,676 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,677 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=693) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,677 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=692): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:22,677 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:22,677 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:22,677 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:22,677 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,677 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=693) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 486
02.12.2021 17:25:22,679 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 384
02.12.2021 17:25:22,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:22,715 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=693): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,715 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,715 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=188, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:22,715 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 188 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:22,715 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:22,715 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,713 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=693): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,715 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,716 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,717 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:22,721 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=188, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:22,722 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,723 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 188 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:22,729 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:22,729 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,727 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from RUNNING to REBALANCING
02.12.2021 17:25:22,730 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,734 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:22,733 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:22,734 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,748 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 448
02.12.2021 17:25:22,753 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:22,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 347
02.12.2021 17:25:22,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 79
02.12.2021 17:25:22,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 61
02.12.2021 17:25:22,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 158
02.12.2021 17:25:22,764 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:22,803 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,803 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,803 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,816 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:22,816 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,816 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,816 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:22,816 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:22,816 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,816 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,816 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,817 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from REBALANCING to RUNNING
02.12.2021 17:25:22,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:22,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,817 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,834 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 309
02.12.2021 17:25:22,855 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 208
02.12.2021 17:25:22,856 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 57
02.12.2021 17:25:22,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:22,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,916 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:22,935 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:22,938 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239767ms for 240000ms of delay, sleeping for 243ms
02.12.2021 17:25:22,939 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119307ms for 120000ms of delay, sleeping for 703ms
02.12.2021 17:25:22,956 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 107
02.12.2021 17:25:22,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 209
02.12.2021 17:25:23,009 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:23,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,018 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:23,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:23,056 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 7
02.12.2021 17:25:23,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 105
02.12.2021 17:25:23,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:23,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:23,065 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:23,065 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:23,065 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:23,065 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:23,065 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:23,065 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:23,065 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:23,065 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:23,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:23,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,067 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,107 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59962ms for 60000ms of delay, sleeping for 48ms
02.12.2021 17:25:23,109 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:23,117 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:23,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:23,139 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:23,157 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59340ms for 60000ms of delay, sleeping for 670ms
02.12.2021 17:25:23,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:23,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:23,164 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:23,164 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from REBALANCING to RUNNING
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,164 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,182 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239592ms for 240000ms of delay, sleeping for 418ms
02.12.2021 17:25:23,210 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:23,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:23,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:23,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:23,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:23,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,305 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,305 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 219
02.12.2021 17:25:23,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:23,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,318 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,318 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,335 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 209
02.12.2021 17:25:23,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:23,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:23,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 119
02.12.2021 17:25:23,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,417 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 109
02.12.2021 17:25:23,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:23,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:23,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 18
02.12.2021 17:25:23,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:23,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:23,524 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:23,524 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:23,524 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=678) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:23,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,525 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=678): org.apache.kafka.common.requests.HeartbeatResponse@5c53920c
02.12.2021 17:25:23,525 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:23,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 280
02.12.2021 17:25:23,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 279
02.12.2021 17:25:23,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 9
02.12.2021 17:25:23,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,545 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:23,546 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:23,546 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=735) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:23,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 289
02.12.2021 17:25:23,547 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=735): org.apache.kafka.common.requests.HeartbeatResponse@787bf914
02.12.2021 17:25:23,547 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:23,547 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 288
02.12.2021 17:25:23,547 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 288
02.12.2021 17:25:23,566 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:23,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,570 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,570 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,602 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239351ms for 240000ms of delay, sleeping for 659ms
02.12.2021 17:25:23,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:23,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:23,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 175
02.12.2021 17:25:23,645 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119840ms for 120000ms of delay, sleeping for 170ms
02.12.2021 17:25:23,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 188
02.12.2021 17:25:23,665 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,665 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,665 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,665 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,665 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,665 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,665 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,665 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,665 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:23,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:23,730 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 75
02.12.2021 17:25:23,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:23,770 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:23,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:23,840 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:23,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,841 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:23,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,842 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,842 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,843 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119944ms for 120000ms of delay, sleeping for 66ms
02.12.2021 17:25:23,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,850 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,850 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:23,841 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:23,858 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59588ms for 60000ms of delay, sleeping for 422ms
02.12.2021 17:25:23,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:23,873 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 292
02.12.2021 17:25:23,933 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119771ms for 120000ms of delay, sleeping for 239ms
02.12.2021 17:25:23,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 523 ms and fetched 0 records
02.12.2021 17:25:23,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:23,940 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,946 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,950 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:23,951 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 390
02.12.2021 17:25:23,973 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:23,974 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:24,043 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:24,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:24,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:24,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 287
02.12.2021 17:25:24,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,077 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,075 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:24,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,083 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,144 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:24,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:24,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:24,157 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:24,158 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:24,158 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1069) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:24,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 176
02.12.2021 17:25:24,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:24,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,178 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,178 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,182 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119361ms for 120000ms of delay, sleeping for 649ms
02.12.2021 17:25:24,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:24,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:24,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:24,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:24,258 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1069): org.apache.kafka.common.requests.HeartbeatResponse@55fc269f
02.12.2021 17:25:24,258 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:24,262 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239128ms for 240000ms of delay, sleeping for 882ms
02.12.2021 17:25:24,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 76
02.12.2021 17:25:24,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 10 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:24,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:24,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:24,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:24,282 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142354, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:24,282 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142364, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:24,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:24,283 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:24,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,283 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:24,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:24,284 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59318ms for 60000ms of delay, sleeping for 692ms
02.12.2021 17:25:24,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:24,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,344 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:24,344 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,349 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:24,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,350 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:24,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:24,446 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:24,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:24,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,449 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:24,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:24,479 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:24,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:24,547 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:24,547 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:24,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:24,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:24,579 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:24,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:24,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,583 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:24,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:24,652 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:24,655 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:24,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:24,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,681 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:24,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:24,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:24,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:24,781 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,786 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:24,834 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119658ms for 120000ms of delay, sleeping for 352ms
02.12.2021 17:25:24,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:24,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,847 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 365
02.12.2021 17:25:24,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,848 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,848 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:24,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,853 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,853 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,853 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:24,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:24,889 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:24,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 265
02.12.2021 17:25:24,948 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:24,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,950 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,950 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 234
02.12.2021 17:25:24,954 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:24,977 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59914ms for 60000ms of delay, sleeping for 96ms
02.12.2021 17:25:24,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:24,989 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:25,050 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 134
02.12.2021 17:25:25,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:25,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 165
02.12.2021 17:25:25,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:25,077 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59007ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:25,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,084 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,084 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:25,083 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:25,146 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239994ms for 240000ms of delay, sleeping for 16ms
02.12.2021 17:25:25,153 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:25,154 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 30
02.12.2021 17:25:25,154 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 58
02.12.2021 17:25:25,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:25,164 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238979ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,185 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,185 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,185 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 57 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,185 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=684) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null}
02.12.2021 17:25:25,185 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:25,185 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 265
02.12.2021 17:25:25,185 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=684): org.apache.kafka.common.requests.HeartbeatResponse@624173a7
02.12.2021 17:25:25,186 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,186 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 57 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e
02.12.2021 17:25:25,186 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:25,186 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:25,186 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 99, -7, 73, -122, 97, 3, 73, 127, -105, 10, 111, -53, -15, -100, 50, -91, 0, 0, 0, 0, 0, 0, 0, 0, 38, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,186 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=685) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:25,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,187 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 490
02.12.2021 17:25:25,188 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119766ms for 120000ms of delay, sleeping for 244ms
02.12.2021 17:25:25,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 264
02.12.2021 17:25:25,214 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,214 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 57 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,214 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,215 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=684) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null}
02.12.2021 17:25:25,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 132
02.12.2021 17:25:25,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 132
02.12.2021 17:25:25,215 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=684): org.apache.kafka.common.requests.HeartbeatResponse@1f26f92f
02.12.2021 17:25:25,215 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,215 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 57 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025
02.12.2021 17:25:25,215 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:25,215 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:25,216 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 99, -7, 73, -122, 97, 3, 73, 127, -105, 10, 111, -53, -15, -100, 50, -91, 0, 0, 0, 0, 0, 0, 0, 0, 38, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,216 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=685) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 131
02.12.2021 17:25:25,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:25,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:25,285 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:25,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:25,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 390
02.12.2021 17:25:25,315 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:25,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,347 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,348 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,353 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,386 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:25,387 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 290
02.12.2021 17:25:25,433 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119518ms for 120000ms of delay, sleeping for 492ms
02.12.2021 17:25:25,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:25,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:25,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,452 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,454 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:25,486 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:25,488 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 189
02.12.2021 17:25:25,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:25,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:25,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,585 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:25,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 89
02.12.2021 17:25:25,650 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:25,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:25,676 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,676 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,676 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=694) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null}
02.12.2021 17:25:25,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 409
02.12.2021 17:25:25,678 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,678 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,678 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=694) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null}
02.12.2021 17:25:25,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,677 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=694): org.apache.kafka.common.requests.HeartbeatResponse@204f67a8
02.12.2021 17:25:25,678 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=694): org.apache.kafka.common.requests.HeartbeatResponse@15478c9d
02.12.2021 17:25:25,679 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,679 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 188 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:25,679 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:25,679 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:25,679 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 88, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,679 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=695) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 7
02.12.2021 17:25:25,679 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,680 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 188 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:25,680 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:25,680 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:25,680 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 88, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,680 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=695) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 405
02.12.2021 17:25:25,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,687 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:25,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:25,757 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:25,777 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:25,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:25,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,859 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,859 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,854 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,853 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,863 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30424ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:25,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:25,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,869 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,927 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118928ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:25,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:25,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 391
02.12.2021 17:25:25,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30283ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,065 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:26,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:26,083 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59909ms for 60000ms of delay, sleeping for 101ms
02.12.2021 17:25:26,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,086 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,090 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,164 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239979ms delay out of 240000ms. Remaining 21ms. Executor queue at 0
02.12.2021 17:25:26,165 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239960ms for 240000ms of delay, sleeping for 50ms
02.12.2021 17:25:26,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:26,172 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:26,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,198 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,213 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59333ms for 60000ms of delay, sleeping for 677ms
02.12.2021 17:25:26,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 67 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 205083ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 68 iterations.
02.12.2021 17:25:26,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 68 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 205085ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:26,226 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1381): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', members=[])
02.12.2021 17:25:26,226 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', members=[])
02.12.2021 17:25:26,226 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:26,226 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}
02.12.2021 17:25:26,226 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:26,226 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970278, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:26,226 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970288, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:26,226 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1382) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null,assignments=[]}
02.12.2021 17:25:26,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:26,228 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:26,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,228 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:26,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 68 iterations.
02.12.2021 17:25:26,230 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239209ms for 240000ms of delay, sleeping for 801ms
02.12.2021 17:25:26,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:26,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:26,328 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1382): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:26,328 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=57, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}
02.12.2021 17:25:26,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,360 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,360 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 164
02.12.2021 17:25:26,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:26,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,363 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 182
02.12.2021 17:25:26,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,369 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30930ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 63
02.12.2021 17:25:26,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 81
02.12.2021 17:25:26,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:26,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,473 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30784ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,525 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:26,531 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:26,532 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=679) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:26,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 334
02.12.2021 17:25:26,534 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=679): org.apache.kafka.common.requests.HeartbeatResponse@18ac2e67
02.12.2021 17:25:26,534 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:26,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 326
02.12.2021 17:25:26,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 326
02.12.2021 17:25:26,545 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:26,546 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:26,546 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=736) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:26,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,546 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=736): org.apache.kafka.common.requests.HeartbeatResponse@30e08edc
02.12.2021 17:25:26,546 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:26,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 317
02.12.2021 17:25:26,547 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 316
02.12.2021 17:25:26,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:26,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,590 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 226
02.12.2021 17:25:26,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 210
02.12.2021 17:25:26,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,699 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,700 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:26,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 125
02.12.2021 17:25:26,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 109
02.12.2021 17:25:26,836 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 25
02.12.2021 17:25:26,857 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 7
02.12.2021 17:25:26,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,865 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:26,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:26,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,867 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:26,870 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,871 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31432ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,896 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59846ms for 60000ms of delay, sleeping for 164ms
02.12.2021 17:25:26,929 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119930ms delay out of 120000ms. Remaining 70ms. Executor queue at 0
02.12.2021 17:25:26,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:26,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:26,931 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1130): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', members=[])
02.12.2021 17:25:26,931 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', members=[])
02.12.2021 17:25:26,931 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:26,931 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}
02.12.2021 17:25:26,932 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:26,932 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016368, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:26,932 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016378, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:26,932 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1131) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:26,932 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:26,932 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:26,932 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,932 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:26,932 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,932 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:26,933 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119864ms for 120000ms of delay, sleeping for 146ms
02.12.2021 17:25:26,932 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1131): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:26,933 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=188, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}
02.12.2021 17:25:26,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:26,968 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:26,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,974 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31285ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,975 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:27,050 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239796ms for 240000ms of delay, sleeping for 214ms
02.12.2021 17:25:27,066 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:27,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:27,080 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119947ms for 120000ms of delay, sleeping for 63ms
02.12.2021 17:25:27,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 10 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:27,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:27,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:27,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:27,086 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142364, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:27,090 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142374, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:27,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 5 ms and fetched 10 records
02.12.2021 17:25:27,092 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:27,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,093 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,093 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,092 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:27,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:27,096 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58243ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:27,145 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119464ms for 120000ms of delay, sleeping for 546ms
02.12.2021 17:25:27,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:27,167 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:27,167 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:27,167 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1070) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:27,170 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:27,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,199 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:27,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:27,267 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1070): org.apache.kafka.common.requests.HeartbeatResponse@752fbb7
02.12.2021 17:25:27,267 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:27,268 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239326ms for 240000ms of delay, sleeping for 684ms
02.12.2021 17:25:27,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:27,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:27,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,368 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,368 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,368 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,372 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31933ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,469 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,469 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,474 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31785ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,569 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:27,569 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:27,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,593 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:27,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:27,693 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119498ms for 120000ms of delay, sleeping for 512ms
02.12.2021 17:25:27,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,705 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:27,771 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:27,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,881 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32443ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 525 ms and fetched 0 records
02.12.2021 17:25:27,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,898 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 529 ms and fetched 0 records
02.12.2021 17:25:27,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,901 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,909 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,953 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239607ms for 240000ms of delay, sleeping for 403ms
02.12.2021 17:25:27,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,976 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32287ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:28,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:28,096 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59243ms delay out of 60000ms. Remaining 757ms. Executor queue at 0
02.12.2021 17:25:28,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:28,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,099 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,110 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58079ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:28,111 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:28,201 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:28,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,209 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,213 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,214 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119835ms for 120000ms of delay, sleeping for 175ms
02.12.2021 17:25:28,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:28,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:28,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:28,368 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239791ms for 240000ms of delay, sleeping for 219ms
02.12.2021 17:25:28,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 513 ms and fetched 0 records
02.12.2021 17:25:28,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:28,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 519 ms and fetched 0 records
02.12.2021 17:25:28,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,426 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32987ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,426 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,426 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,429 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,430 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,430 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119361ms for 120000ms of delay, sleeping for 649ms
02.12.2021 17:25:28,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,477 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32789ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:28,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:28,589 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239401ms for 240000ms of delay, sleeping for 609ms
02.12.2021 17:25:28,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,600 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:28,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:28,713 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,713 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,713 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,713 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,714 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:28,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:28,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:28,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:28,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:28,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:28,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,933 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Committing all active tasks [] and standby tasks [] since 33495ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,930 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,936 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,979 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Committing all active tasks [] and standby tasks [] since 33292ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:29,038 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:29,094 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119985ms for 120000ms of delay, sleeping for 25ms
02.12.2021 17:25:29,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,112 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:29,110 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59079ms delay out of 60000ms. Remaining 921ms. Executor queue at 0
02.12.2021 17:25:29,115 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58316ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:29,121 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119922ms for 120000ms of delay, sleeping for 88ms
02.12.2021 17:25:29,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:29,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:29,199 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239259ms for 240000ms of delay, sleeping for 751ms
02.12.2021 17:25:29,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:29,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:29,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:29,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:29,211 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:29,211 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:29,211 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:29,211 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 88, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 5])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:29,211 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1132) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:29,212 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016378, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:29,212 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016388, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:29,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:29,212 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:29,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,212 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:29,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:29,213 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119121ms for 120000ms of delay, sleeping for 889ms
02.12.2021 17:25:29,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,214 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:29,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:29,243 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:29,244 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 57 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:29,244 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1383) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null}
02.12.2021 17:25:29,245 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:29,394 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1383): org.apache.kafka.common.requests.HeartbeatResponse@22ce8dc2
02.12.2021 17:25:29,341 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:29,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:29,394 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:29,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,435 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Committing all active tasks [] and standby tasks [] since 33996ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 554 ms and fetched 0 records
02.12.2021 17:25:29,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,490 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 35
02.12.2021 17:25:29,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:29,494 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,494 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,494 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,494 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,494 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,494 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,494 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Committing all active tasks [] and standby tasks [] since 33805ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,494 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,494 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 558 ms and fetched 0 records
02.12.2021 17:25:29,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,495 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 50
02.12.2021 17:25:29,526 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:29,528 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:29,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,528 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=680) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:29,529 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=680): org.apache.kafka.common.requests.HeartbeatResponse@604e3a54
02.12.2021 17:25:29,531 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:29,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 459
02.12.2021 17:25:29,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 459
02.12.2021 17:25:29,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,545 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:29,545 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:29,545 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=737) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:29,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 450
02.12.2021 17:25:29,546 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=737): org.apache.kafka.common.requests.HeartbeatResponse@216395a
02.12.2021 17:25:29,546 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:29,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 449
02.12.2021 17:25:29,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 449
02.12.2021 17:25:29,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,613 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 358
02.12.2021 17:25:29,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 348
02.12.2021 17:25:29,706 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=695): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:29,706 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:29,706 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:29,707 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=695): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:29,708 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:29,708 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:29,708 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:29,708 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=696) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:29,708 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 406
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=696) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,assignments=[]}
02.12.2021 17:25:29,714 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 1
02.12.2021 17:25:29,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:29,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,718 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 258
02.12.2021 17:25:29,747 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 248
02.12.2021 17:25:29,767 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=696): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,767 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,767 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=696): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,767 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,767 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=189, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:29,767 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 189 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:29,767 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:29,768 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:29,768 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:29,768 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:29,768 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=189, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:29,768 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 189 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:29,768 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:29,769 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from RUNNING to REBALANCING
02.12.2021 17:25:29,769 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:29,768 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:29,770 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 451
02.12.2021 17:25:29,771 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:29,771 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:29,772 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:29,772 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:29,772 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:29,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 347
02.12.2021 17:25:29,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 157
02.12.2021 17:25:29,848 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 148
02.12.2021 17:25:29,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 347
02.12.2021 17:25:29,872 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 242
02.12.2021 17:25:29,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 57
02.12.2021 17:25:29,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:29,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,944 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Committing all active tasks [] and standby tasks [] since 34505ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,944 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,952 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 43
02.12.2021 17:25:29,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 68 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:29,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 208817ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 69 iterations.
02.12.2021 17:25:29,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 69 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:29,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 208818ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:29,957 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:29,958 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:29,958 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:29,958 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 99, -7, 73, -122, 97, 3, 73, 127, -105, 10, 111, -53, -15, -100, 50, -91, 0, 0, 0, 0, 0, 0, 0, 0, 38, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 7])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:29,958 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1384) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:29,958 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970288, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:29,959 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970298, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:29,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:29,959 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:29,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,959 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:29,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 69 iterations.
02.12.2021 17:25:29,960 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239754ms for 240000ms of delay, sleeping for 256ms
02.12.2021 17:25:29,973 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 245
02.12.2021 17:25:29,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 137
02.12.2021 17:25:29,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,991 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:29,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,996 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:29,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,996 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,998 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:29,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Committing all active tasks [] and standby tasks [] since 34307ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:30,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,002 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,123 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,124 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,124 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 374
02.12.2021 17:25:30,115 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59316ms delay out of 60000ms. Remaining 684ms. Executor queue at 0
02.12.2021 17:25:30,132 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119902ms for 120000ms of delay, sleeping for 108ms
02.12.2021 17:25:30,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:30,073 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 145
02.12.2021 17:25:30,150 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59424ms for 60000ms of delay, sleeping for 586ms
02.12.2021 17:25:30,178 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:30,181 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:30,182 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1071) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:30,223 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239972ms for 240000ms of delay, sleeping for 38ms
02.12.2021 17:25:30,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 271
02.12.2021 17:25:30,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:30,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 259
02.12.2021 17:25:30,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 515 ms and fetched 0 records
02.12.2021 17:25:30,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,236 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:30,236 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,239 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,239 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:30,239 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:30,239 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,250 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,250 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,250 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from REBALANCING to RUNNING
02.12.2021 17:25:30,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:30,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,262 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239121ms for 240000ms of delay, sleeping for 889ms
02.12.2021 17:25:30,259 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119875ms for 120000ms of delay, sleeping for 135ms
02.12.2021 17:25:30,256 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,322 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1071): org.apache.kafka.common.requests.HeartbeatResponse@2d6b6916
02.12.2021 17:25:30,328 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:30,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:30,325 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 171
02.12.2021 17:25:30,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 152
02.12.2021 17:25:30,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:30,402 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119318ms for 120000ms of delay, sleeping for 692ms
02.12.2021 17:25:30,408 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=685): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', members=[])
02.12.2021 17:25:30,408 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=685): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', members=[])
02.12.2021 17:25:30,408 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', members=[])
02.12.2021 17:25:30,408 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:30,408 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}
02.12.2021 17:25:30,408 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', members=[])
02.12.2021 17:25:30,408 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:30,408 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}
02.12.2021 17:25:30,408 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:30,408 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:30,409 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=686) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null,assignments=[]}
02.12.2021 17:25:30,409 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=686) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:30,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 35
02.12.2021 17:25:30,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:30,443 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 181
02.12.2021 17:25:30,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 53
02.12.2021 17:25:30,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:30,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,445 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Committing all active tasks [] and standby tasks [] since 35007ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:30,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,447 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=686): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,447 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,447 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=686): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,447 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,447 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=58, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}
02.12.2021 17:25:30,447 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=58, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}
02.12.2021 17:25:30,448 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 58 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e
02.12.2021 17:25:30,448 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:30,448 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:30,447 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 58 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025
02.12.2021 17:25:30,448 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:30,448 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:30,448 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:30,448 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:30,448 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:30,448 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:30,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 42
02.12.2021 17:25:30,449 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from RUNNING to REBALANCING
02.12.2021 17:25:30,449 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:30,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 55
02.12.2021 17:25:30,449 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:30,450 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:30,450 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:30,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 497
02.12.2021 17:25:30,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:30,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,491 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:30,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,498 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,505 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Committing all active tasks [] and standby tasks [] since 34816ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,544 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 80
02.12.2021 17:25:30,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 395
02.12.2021 17:25:30,570 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:30,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:30,599 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:30,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:30,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,624 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 294
02.12.2021 17:25:30,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:30,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:30,700 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:30,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:30,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:30,738 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59653ms for 60000ms of delay, sleeping for 357ms
02.12.2021 17:25:30,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:30,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:30,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,769 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,769 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,796 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:30,801 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:30,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:30,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:30,855 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:30,870 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:30,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:30,901 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:30,909 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:30,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:31,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 696 ms and fetched 0 records
02.12.2021 17:25:31,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:31,154 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:31,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 127
02.12.2021 17:25:31,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:31,009 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,154 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:31,164 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:31,166 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239845ms for 240000ms of delay, sleeping for 165ms
02.12.2021 17:25:31,164 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:31,176 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:31,176 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:31,176 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:31,176 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:31,176 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from REBALANCING to RUNNING
02.12.2021 17:25:31,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:31,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:31,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:31,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:31,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:31,189 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,201 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59128ms for 60000ms of delay, sleeping for 882ms
02.12.2021 17:25:31,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Committing all active tasks [] and standby tasks [] since 35761ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:31,200 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1132): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', members=[])
02.12.2021 17:25:31,202 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', members=[])
02.12.2021 17:25:31,202 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:31,202 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}
02.12.2021 17:25:31,202 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:31,202 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016388, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:31,202 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016398, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:31,202 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1133) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:31,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 27 ms and fetched 10 records
02.12.2021 17:25:31,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,235 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:31,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,235 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:31,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:31,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 14
02.12.2021 17:25:31,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:31,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 627 ms and fetched 0 records
02.12.2021 17:25:31,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,262 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,270 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:31,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:31,270 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,277 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,263 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119567ms for 120000ms of delay, sleeping for 443ms
02.12.2021 17:25:31,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:31,318 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1133): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:31,321 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=189, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}
02.12.2021 17:25:31,333 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239147ms for 240000ms of delay, sleeping for 863ms
02.12.2021 17:25:31,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:31,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:31,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 289
02.12.2021 17:25:31,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 288
02.12.2021 17:25:31,378 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:31,421 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:31,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:31,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:31,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:31,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 188
02.12.2021 17:25:31,479 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:31,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:31,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:31,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:31,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 88
02.12.2021 17:25:31,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:31,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:31,621 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:31,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:31,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,663 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:31,685 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:31,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 517 ms and fetched 0 records
02.12.2021 17:25:31,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,719 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,719 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,722 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119936ms for 120000ms of delay, sleeping for 74ms
02.12.2021 17:25:31,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:31,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:31,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:31,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,765 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,781 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,810 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119910ms for 120000ms of delay, sleeping for 100ms
02.12.2021 17:25:31,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:31,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:31,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:31,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:31,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:31,883 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:31,911 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119730ms for 120000ms of delay, sleeping for 280ms
02.12.2021 17:25:31,921 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:31,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:31,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:31,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:31,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 286
02.12.2021 17:25:31,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:32,021 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:32,067 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:32,067 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:32,067 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:32,084 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:32,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 10 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:32,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 32050ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:32,087 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Flushing record collector
02.12.2021 17:25:32,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Prepared RUNNING task for committing
02.12.2021 17:25:32,081 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 184
02.12.2021 17:25:32,087 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry1-0=OffsetAndMetadata{offset=1142374, leaderEpoch=null, metadata='AQAAAX179jJK'}} to coordinator kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:32,091 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1072) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition_index=0,committed_offset=1142374,committed_leader_epoch=-1,committed_metadata=AQAAAX179jJK}]}]}
02.12.2021 17:25:32,110 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received OFFSET_COMMIT response from node 2147483644 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1072): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry1', partitions=[OffsetCommitResponsePartition(partitionIndex=0, errorCode=0)])])
02.12.2021 17:25:32,110 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Committed offset 1142374 for partition redacted.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:32,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry1-0=1142373}
02.12.2021 17:25:32,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:32,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Committed all active tasks [0_0] and standby tasks [] in 0ms
02.12.2021 17:25:32,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:32,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:32,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:32,119 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142374, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:32,122 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:32,121 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142384, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:32,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 6 ms and fetched 10 records
02.12.2021 17:25:32,135 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:32,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,135 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:32,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:32,161 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59974ms for 60000ms of delay, sleeping for 36ms
02.12.2021 17:25:32,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:32,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,165 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:32,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:32,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,167 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,166 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,167 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 379
02.12.2021 17:25:32,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 358
02.12.2021 17:25:32,185 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:32,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 77
02.12.2021 17:25:32,194 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119506ms for 120000ms of delay, sleeping for 504ms
02.12.2021 17:25:32,201 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238262ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:32,202 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59896ms for 60000ms of delay, sleeping for 114ms
02.12.2021 17:25:32,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,220 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,266 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 441
02.12.2021 17:25:32,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:32,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 276
02.12.2021 17:25:32,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 256
02.12.2021 17:25:32,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,282 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 425
02.12.2021 17:25:32,318 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59344ms for 60000ms of delay, sleeping for 666ms
02.12.2021 17:25:32,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:32,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 341
02.12.2021 17:25:32,368 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:32,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 176
02.12.2021 17:25:32,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 155
02.12.2021 17:25:32,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 325
02.12.2021 17:25:32,421 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:32,467 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 241
02.12.2021 17:25:32,468 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:32,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 75
02.12.2021 17:25:32,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 55
02.12.2021 17:25:32,486 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 221
02.12.2021 17:25:32,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:32,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,526 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,527 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:32,528 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=681) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:32,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 141
02.12.2021 17:25:32,529 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=681): org.apache.kafka.common.requests.HeartbeatResponse@68fd75b9
02.12.2021 17:25:32,535 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:32,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 133
02.12.2021 17:25:32,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 131
02.12.2021 17:25:32,545 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,545 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:32,545 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=738) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:32,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,554 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=738): org.apache.kafka.common.requests.HeartbeatResponse@f6982c6
02.12.2021 17:25:32,554 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:32,555 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 112
02.12.2021 17:25:32,555 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 111
02.12.2021 17:25:32,568 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 140
02.12.2021 17:25:32,569 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:32,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 120
02.12.2021 17:25:32,622 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:32,642 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 26
02.12.2021 17:25:32,655 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 11
02.12.2021 17:25:32,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,667 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,667 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:32,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,668 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 40
02.12.2021 17:25:32,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,668 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,669 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:32,688 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 19
02.12.2021 17:25:32,705 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119676ms for 120000ms of delay, sleeping for 334ms
02.12.2021 17:25:32,709 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,709 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 189 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,710 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=697) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null}
02.12.2021 17:25:32,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,710 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 57
02.12.2021 17:25:32,707 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,710 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 189 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,710 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=697) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null}
02.12.2021 17:25:32,710 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=697): org.apache.kafka.common.requests.HeartbeatResponse@6b7d6a3e
02.12.2021 17:25:32,714 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:32,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 69
02.12.2021 17:25:32,714 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=697): org.apache.kafka.common.requests.HeartbeatResponse@387dbfaf
02.12.2021 17:25:32,714 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 189 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:32,716 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:32,716 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 189 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:32,716 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:32,720 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:32,719 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:32,720 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:32,720 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 89, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,720 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=698) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:32,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 47
02.12.2021 17:25:32,720 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 89, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,722 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=698) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:32,722 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 60
02.12.2021 17:25:32,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,722 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,724 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,769 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:32,768 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:32,767 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:32,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,791 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,791 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:32,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,791 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,791 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:32,810 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:32,814 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:32,825 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:32,890 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 279
02.12.2021 17:25:32,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 277
02.12.2021 17:25:32,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 276
02.12.2021 17:25:32,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:32,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 176
02.12.2021 17:25:32,994 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59990ms for 60000ms of delay, sleeping for 20ms
02.12.2021 17:25:32,994 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 174
02.12.2021 17:25:32,994 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 173
02.12.2021 17:25:33,016 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59977ms for 60000ms of delay, sleeping for 33ms
02.12.2021 17:25:33,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:33,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 9 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:33,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:33,055 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119613ms for 120000ms of delay, sleeping for 397ms
02.12.2021 17:25:33,056 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59994ms for 60000ms of delay, sleeping for 16ms
02.12.2021 17:25:33,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 1 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:33,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:33,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:33,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:33,081 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142384, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:33,082 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142394, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:33,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:33,087 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:33,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,087 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:33,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:33,089 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59196ms for 60000ms of delay, sleeping for 814ms
02.12.2021 17:25:33,095 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 72
02.12.2021 17:25:33,094 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 74
02.12.2021 17:25:33,093 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 76
02.12.2021 17:25:33,126 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:33,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:33,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,170 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:33,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,174 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,175 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 233
02.12.2021 17:25:33,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:33,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,175 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,175 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,201 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239262ms delay out of 240000ms. Remaining 738ms. Executor queue at 0
02.12.2021 17:25:33,205 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238970ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:33,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:33,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,227 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 181
02.12.2021 17:25:33,248 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,249 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:33,249 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1073) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:33,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:33,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 133
02.12.2021 17:25:33,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:33,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,292 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,292 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,327 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 81
02.12.2021 17:25:33,349 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1073): org.apache.kafka.common.requests.HeartbeatResponse@67150bd3
02.12.2021 17:25:33,349 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:33,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:33,375 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 33
02.12.2021 17:25:33,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:33,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,409 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,409 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 58 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,409 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=687) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null}
02.12.2021 17:25:33,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 318
02.12.2021 17:25:33,409 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=687): org.apache.kafka.common.requests.HeartbeatResponse@15ae8df0
02.12.2021 17:25:33,409 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:33,410 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 58 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025
02.12.2021 17:25:33,410 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:33,410 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:33,410 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 99, -7, 73, -122, 97, 3, 73, 127, -105, 10, 111, -53, -15, -100, 50, -91, 0, 0, 0, 0, 0, 0, 0, 0, 39, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,410 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=688) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:33,410 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 317
02.12.2021 17:25:33,409 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,410 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 58 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,410 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=687) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null}
02.12.2021 17:25:33,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 266
02.12.2021 17:25:33,411 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=687): org.apache.kafka.common.requests.HeartbeatResponse@6f96ffcb
02.12.2021 17:25:33,411 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:33,411 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 58 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e
02.12.2021 17:25:33,411 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:33,411 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:33,411 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 99, -7, 73, -122, 97, 3, 73, 127, -105, 10, 111, -53, -15, -100, 50, -91, 0, 0, 0, 0, 0, 0, 0, 0, 39, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,411 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=688) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:33,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 263
02.12.2021 17:25:33,456 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119843ms for 120000ms of delay, sleeping for 167ms
02.12.2021 17:25:33,472 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:33,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:33,510 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:33,511 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:33,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:33,578 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:33,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:33,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:33,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:33,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:33,624 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:33,625 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:33,625 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:33,625 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 89, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 5])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:33,625 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1134) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:33,625 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016398, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:33,625 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016408, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:33,625 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:33,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:33,626 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:33,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,626 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:33,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:33,627 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119991ms for 120000ms of delay, sleeping for 19ms
02.12.2021 17:25:33,648 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119667ms for 120000ms of delay, sleeping for 343ms
02.12.2021 17:25:33,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:33,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,672 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,672 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,675 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,676 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,729 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:33,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,873 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:33,881 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:33,912 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59751ms for 60000ms of delay, sleeping for 259ms
02.12.2021 17:25:33,974 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:33,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:34,060 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119673ms for 120000ms of delay, sleeping for 337ms
02.12.2021 17:25:34,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:34,083 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:34,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:34,173 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59931ms for 60000ms of delay, sleeping for 79ms
02.12.2021 17:25:34,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,178 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,181 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,208 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239973ms delay out of 240000ms. Remaining 27ms. Executor queue at 0
02.12.2021 17:25:34,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 69 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:34,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,242 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 213087ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:34,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:34,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 70 iterations.
02.12.2021 17:25:34,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 70 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:34,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 213107ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:34,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:34,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:34,258 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59242ms for 60000ms of delay, sleeping for 768ms
02.12.2021 17:25:34,256 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1384): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', members=[])
02.12.2021 17:25:34,259 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', members=[])
02.12.2021 17:25:34,261 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:34,270 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}
02.12.2021 17:25:34,274 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:34,274 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1385) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null,assignments=[]}
02.12.2021 17:25:34,274 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970298, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:34,278 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970308, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:34,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 22 ms and fetched 10 records
02.12.2021 17:25:34,280 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:34,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,280 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:34,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 70 iterations.
02.12.2021 17:25:34,281 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239939ms for 240000ms of delay, sleeping for 71ms
02.12.2021 17:25:34,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 383
02.12.2021 17:25:34,354 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239165ms for 240000ms of delay, sleeping for 845ms
02.12.2021 17:25:34,378 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1385): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:34,378 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=58, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}
02.12.2021 17:25:34,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:34,398 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119189ms for 120000ms of delay, sleeping for 821ms
02.12.2021 17:25:34,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 283
02.12.2021 17:25:34,482 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:34,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 183
02.12.2021 17:25:34,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:34,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 82
02.12.2021 17:25:34,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:34,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,681 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:34,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,684 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:34,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,687 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:34,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,746 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:34,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:34,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,795 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,796 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,883 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:34,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:34,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:34,995 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:35,043 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58966ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:35,084 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:35,096 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:35,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:35,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,183 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 362
02.12.2021 17:25:35,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:35,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,192 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:35,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,193 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 332
02.12.2021 17:25:35,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,201 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239996ms for 240000ms of delay, sleeping for 14ms
02.12.2021 17:25:35,217 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239106ms for 240000ms of delay, sleeping for 904ms
02.12.2021 17:25:35,221 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118941ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:35,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,247 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 261
02.12.2021 17:25:35,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 232
02.12.2021 17:25:35,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,296 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,298 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,298 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 161
02.12.2021 17:25:35,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 132
02.12.2021 17:25:35,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 60
02.12.2021 17:25:35,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 31
02.12.2021 17:25:35,528 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:35,530 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:35,530 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=682) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:35,528 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,531 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=682): org.apache.kafka.common.requests.HeartbeatResponse@28fe4958
02.12.2021 17:25:35,533 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:35,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 161
02.12.2021 17:25:35,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 159
02.12.2021 17:25:35,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,545 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:35,545 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:35,546 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=739) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:35,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 138
02.12.2021 17:25:35,546 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=739): org.apache.kafka.common.requests.HeartbeatResponse@28fd7966
02.12.2021 17:25:35,546 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:35,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 137
02.12.2021 17:25:35,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 137
02.12.2021 17:25:35,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 59
02.12.2021 17:25:35,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 37
02.12.2021 17:25:35,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,684 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:35,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,695 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,695 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:35,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:35,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,696 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,755 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:35,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:35,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,797 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,798 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,802 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,803 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:35,798 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:35,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:35,986 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:36,002 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:36,050 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59973ms delay out of 60000ms. Remaining 27ms. Executor queue at 0
02.12.2021 17:25:36,056 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59965ms for 60000ms of delay, sleeping for 45ms
02.12.2021 17:25:36,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:36,109 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:36,109 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=698): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:36,113 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:36,113 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:36,109 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=698): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:36,113 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:36,113 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:36,113 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:36,113 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:36,114 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=699) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,assignments=[]}
02.12.2021 17:25:36,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 188
02.12.2021 17:25:36,113 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:36,115 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:36,138 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=699) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:36,114 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59404ms for 60000ms of delay, sleeping for 606ms
02.12.2021 17:25:36,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 160
02.12.2021 17:25:36,150 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239051ms for 240000ms of delay, sleeping for 959ms
02.12.2021 17:25:36,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:36,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,195 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,196 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,202 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,210 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=699): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,212 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,210 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=699): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,214 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,215 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=190, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:36,215 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 190 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:36,215 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:36,215 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:36,215 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:36,218 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:36,218 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:36,218 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from RUNNING to REBALANCING
02.12.2021 17:25:36,218 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:36,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:36,215 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=190, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:36,221 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119941ms delay out of 120000ms. Remaining 59ms. Executor queue at 0
02.12.2021 17:25:36,218 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 190 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:36,226 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119526ms for 120000ms of delay, sleeping for 484ms
02.12.2021 17:25:36,225 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:36,228 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:36,228 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:36,228 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:36,228 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:36,231 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:36,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 84
02.12.2021 17:25:36,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,256 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,258 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:36,258 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:36,258 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1074) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:36,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:36,302 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:36,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:36,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:36,308 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:36,308 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:36,308 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:36,308 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:36,308 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:36,309 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:36,309 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:36,309 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:36,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:36,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,309 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,309 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 519 ms and fetched 0 records
02.12.2021 17:25:36,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:36,316 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:36,316 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:36,316 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:36,316 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:36,316 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:36,316 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:36,316 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:36,316 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:36,317 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from REBALANCING to RUNNING
02.12.2021 17:25:36,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:36,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,317 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,359 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1074): org.apache.kafka.common.requests.HeartbeatResponse@53691170
02.12.2021 17:25:36,359 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:36,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:36,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:36,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:36,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:36,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:36,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:36,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:36,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:36,604 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:36,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:36,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:36,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:36,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,697 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,698 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:36,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,698 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,711 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,713 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,713 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,714 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119941ms for 120000ms of delay, sleeping for 69ms
02.12.2021 17:25:36,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:36,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:36,747 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59746ms for 60000ms of delay, sleeping for 264ms
02.12.2021 17:25:36,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,757 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,757 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,785 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119998ms for 120000ms of delay, sleeping for 12ms
02.12.2021 17:25:36,799 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:36,799 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119677ms for 120000ms of delay, sleeping for 333ms
02.12.2021 17:25:36,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,816 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:36,815 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:36,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,821 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,825 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:36,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:36,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:36,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:37,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:37,012 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59196ms for 60000ms of delay, sleeping for 814ms
02.12.2021 17:25:37,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:37,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:37,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:37,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:37,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:37,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:37,123 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239902ms for 240000ms of delay, sleeping for 108ms
02.12.2021 17:25:37,128 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:37,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 32042ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:37,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:37,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 19 iterations.
02.12.2021 17:25:37,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 19 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 32043ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:37,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:37,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:37,134 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1134): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', members=[])
02.12.2021 17:25:37,135 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', members=[])
02.12.2021 17:25:37,135 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:37,136 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}
02.12.2021 17:25:37,136 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:37,136 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016408, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:37,136 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016418, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:37,136 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1135) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:37,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:37,139 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:37,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,139 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:37,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 19 iterations.
02.12.2021 17:25:37,139 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119771ms for 120000ms of delay, sleeping for 239ms
02.12.2021 17:25:37,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,199 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,199 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,200 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:37,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,217 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:37,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:37,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 70 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 216097ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:37,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:37,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 71 iterations.
02.12.2021 17:25:37,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 71 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 216097ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:37,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:37,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:37,236 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:37,236 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:37,236 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:37,237 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 99, -7, 73, -122, 97, 3, 73, 127, -105, 10, 111, -53, -15, -100, 50, -91, 0, 0, 0, 0, 0, 0, 0, 0, 39, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 7])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:37,237 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1386) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:37,237 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970308, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:37,237 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970318, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:37,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:37,238 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1135): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:37,238 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:37,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,238 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:37,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 71 iterations.
02.12.2021 17:25:37,238 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=190, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}
02.12.2021 17:25:37,239 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239512ms for 240000ms of delay, sleeping for 498ms
02.12.2021 17:25:37,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,258 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,298 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:37,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:37,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:37,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,320 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30389ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:37,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:37,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,327 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,380 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119469ms for 120000ms of delay, sleeping for 541ms
02.12.2021 17:25:37,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:37,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:37,420 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,428 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:37,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:37,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:37,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:37,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:37,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:37,621 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:37,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:37,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,700 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,701 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,702 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,718 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:37,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:37,738 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239759ms for 240000ms of delay, sleeping for 251ms
02.12.2021 17:25:37,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:37,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,761 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,762 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,770 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=688): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', members=[])
02.12.2021 17:25:37,770 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=688): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', members=[])
02.12.2021 17:25:37,771 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', members=[])
02.12.2021 17:25:37,774 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:37,774 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}
02.12.2021 17:25:37,774 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:37,774 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=689) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null,assignments=[]}
02.12.2021 17:25:37,774 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 488
02.12.2021 17:25:37,771 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', members=[])
02.12.2021 17:25:37,775 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:37,775 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}
02.12.2021 17:25:37,775 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:37,776 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=689) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:37,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 424
02.12.2021 17:25:37,803 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:37,818 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:37,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,821 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 10 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:37,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,829 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,829 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:37,830 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142394, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:37,830 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142404, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:37,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:37,831 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:37,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,831 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:37,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:37,832 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59872ms for 60000ms of delay, sleeping for 138ms
02.12.2021 17:25:37,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:37,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:37,922 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119784ms for 120000ms of delay, sleeping for 226ms
02.12.2021 17:25:37,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,973 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59145ms for 60000ms of delay, sleeping for 865ms
02.12.2021 17:25:37,994 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239577ms for 240000ms of delay, sleeping for 433ms
02.12.2021 17:25:38,004 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:38,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:38,030 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:38,023 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:38,110 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:38,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:38,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 192
02.12.2021 17:25:38,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:38,150 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119096ms for 120000ms of delay, sleeping for 914ms
02.12.2021 17:25:38,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:38,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,211 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,211 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:38,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,214 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 330
02.12.2021 17:25:38,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,220 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 307
02.12.2021 17:25:38,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:38,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 87
02.12.2021 17:25:38,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,264 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 230
02.12.2021 17:25:38,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 207
02.12.2021 17:25:38,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:38,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,326 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:38,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:38,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,333 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:38,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 130
02.12.2021 17:25:38,422 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 107
02.12.2021 17:25:38,426 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:38,430 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239287ms for 240000ms of delay, sleeping for 723ms
02.12.2021 17:25:38,433 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:38,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 29
02.12.2021 17:25:38,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 6
02.12.2021 17:25:38,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:38,528 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,528 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:38,529 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=683) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:38,528 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,530 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=683): org.apache.kafka.common.requests.HeartbeatResponse@51589536
02.12.2021 17:25:38,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:38,531 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:38,539 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:38,539 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 182
02.12.2021 17:25:38,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,545 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,546 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:38,546 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=740) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:38,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 170
02.12.2021 17:25:38,546 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=740): org.apache.kafka.common.requests.HeartbeatResponse@1c5f94cb
02.12.2021 17:25:38,546 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:38,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 169
02.12.2021 17:25:38,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 169
02.12.2021 17:25:38,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:38,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:38,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 82
02.12.2021 17:25:38,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 68
02.12.2021 17:25:38,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,712 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,727 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:38,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,728 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,729 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:38,729 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:38,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:38,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,766 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,827 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,828 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 285
02.12.2021 17:25:38,828 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:38,829 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:38,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,834 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 279
02.12.2021 17:25:38,840 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59913ms for 60000ms of delay, sleeping for 97ms
02.12.2021 17:25:38,928 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 185
02.12.2021 17:25:38,928 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:38,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:38,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 179
02.12.2021 17:25:38,938 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58787ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:39,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:39,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 85
02.12.2021 17:25:39,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:39,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 78
02.12.2021 17:25:39,073 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119937ms for 120000ms of delay, sleeping for 73ms
02.12.2021 17:25:39,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,115 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:39,115 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 190 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:39,115 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=700) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null}
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,115 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 220
02.12.2021 17:25:39,114 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:39,115 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 190 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:39,115 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=700): org.apache.kafka.common.requests.HeartbeatResponse@4197d003
02.12.2021 17:25:39,115 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=700) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null}
02.12.2021 17:25:39,115 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:39,115 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 213
02.12.2021 17:25:39,115 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 190 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:39,115 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:39,116 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:39,116 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=700): org.apache.kafka.common.requests.HeartbeatResponse@77ef6819
02.12.2021 17:25:39,116 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:39,116 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 90, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:39,116 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 190 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:39,116 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=701) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:39,116 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:39,116 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:39,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 218
02.12.2021 17:25:39,116 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 90, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:39,116 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=701) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:39,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 212
02.12.2021 17:25:39,129 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:39,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:39,147 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119701ms for 120000ms of delay, sleeping for 309ms
02.12.2021 17:25:39,155 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239887ms for 240000ms of delay, sleeping for 123ms
02.12.2021 17:25:39,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,213 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,214 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:39,215 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:39,215 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:39,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:39,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,229 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:39,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,230 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,267 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,277 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:39,277 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:39,277 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1075) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:39,279 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239944ms for 240000ms of delay, sleeping for 66ms
02.12.2021 17:25:39,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,329 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:39,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:39,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,335 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,348 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239222ms for 240000ms of delay, sleeping for 788ms
02.12.2021 17:25:39,378 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1075): org.apache.kafka.common.requests.HeartbeatResponse@4376c7e9
02.12.2021 17:25:39,378 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:39,430 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:39,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:39,458 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119611ms for 120000ms of delay, sleeping for 399ms
02.12.2021 17:25:39,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:39,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:39,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:39,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:39,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,715 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,730 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,730 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,731 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,772 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:39,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:39,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,837 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,836 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,844 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,865 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119748ms for 120000ms of delay, sleeping for 262ms
02.12.2021 17:25:39,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:39,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:39,938 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59787ms delay out of 60000ms. Remaining 213ms. Executor queue at 0
02.12.2021 17:25:39,939 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59574ms for 60000ms of delay, sleeping for 436ms
02.12.2021 17:25:40,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:40,038 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:40,128 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119045ms for 120000ms of delay, sleeping for 965ms
02.12.2021 17:25:40,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:40,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:40,145 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,145 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 190 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:40,145 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1136) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null}
02.12.2021 17:25:40,155 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239026ms for 240000ms of delay, sleeping for 984ms
02.12.2021 17:25:40,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,216 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,245 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1136): org.apache.kafka.common.requests.HeartbeatResponse@73dc7dc3
02.12.2021 17:25:40,245 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:40,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,275 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 498
02.12.2021 17:25:40,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:40,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:40,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:40,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,344 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:40,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,347 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,377 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59687ms for 60000ms of delay, sleeping for 323ms
02.12.2021 17:25:40,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:40,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:40,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:40,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:40,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:40,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:40,707 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59643ms for 60000ms of delay, sleeping for 367ms
02.12.2021 17:25:40,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,721 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 54
02.12.2021 17:25:40,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,736 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,736 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,736 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,775 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,777 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:40,777 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=690) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null}
02.12.2021 17:25:40,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:40,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 443
02.12.2021 17:25:40,774 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,778 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:40,778 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=690) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null}
02.12.2021 17:25:40,781 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:40,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:40,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,781 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:40,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 392
02.12.2021 17:25:40,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 391
02.12.2021 17:25:40,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,848 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,848 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,852 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,856 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 289
02.12.2021 17:25:40,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:41,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:41,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 188
02.12.2021 17:25:41,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 10 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:41,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:41,083 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142404, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:41,086 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142414, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:41,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:41,095 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:41,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,095 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:41,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:41,095 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59432ms for 60000ms of delay, sleeping for 578ms
02.12.2021 17:25:41,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 19 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 36016ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 20 iterations.
02.12.2021 17:25:41,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 20 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 36016ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:41,107 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:41,107 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:41,107 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:41,108 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 90, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 5])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:41,108 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1137) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:41,114 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016418, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:41,119 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016428, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:41,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 15 ms and fetched 10 records
02.12.2021 17:25:41,122 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:41,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,122 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:41,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 20 iterations.
02.12.2021 17:25:41,123 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119840ms for 120000ms of delay, sleeping for 170ms
02.12.2021 17:25:41,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 71 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 220003ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:41,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 220004ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:41,143 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1386): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', members=[])
02.12.2021 17:25:41,144 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', members=[])
02.12.2021 17:25:41,144 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:41,144 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}
02.12.2021 17:25:41,144 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:41,144 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1387) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null,assignments=[]}
02.12.2021 17:25:41,144 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970318, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:41,146 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970328, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:41,146 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:41,149 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:41,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,149 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:41,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:41,150 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239971ms for 240000ms of delay, sleeping for 39ms
02.12.2021 17:25:41,150 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:41,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:41,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 85
02.12.2021 17:25:41,191 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239976ms for 240000ms of delay, sleeping for 34ms
02.12.2021 17:25:41,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,222 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,226 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239089ms for 240000ms of delay, sleeping for 921ms
02.12.2021 17:25:41,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,237 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 308
02.12.2021 17:25:41,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,238 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:41,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,282 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,294 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119764ms for 120000ms of delay, sleeping for 246ms
02.12.2021 17:25:41,337 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 208
02.12.2021 17:25:41,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:41,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,349 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:41,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,358 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 107
02.12.2021 17:25:41,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:41,499 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=701): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:41,499 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:41,499 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:41,499 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:41,499 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:41,499 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=702) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:41,499 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=701): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:41,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 360
02.12.2021 17:25:41,499 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:41,500 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:41,501 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:41,501 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:41,502 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=702) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,assignments=[]}
02.12.2021 17:25:41,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 348
02.12.2021 17:25:41,531 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:41,531 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:41,531 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=684) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:41,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,533 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=684): org.apache.kafka.common.requests.HeartbeatResponse@405589d3
02.12.2021 17:25:41,533 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:41,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 205
02.12.2021 17:25:41,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 204
02.12.2021 17:25:41,528 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=702): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,534 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,534 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=191, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:41,534 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 191 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:41,534 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:41,534 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,534 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,534 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:41,534 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,534 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from RUNNING to REBALANCING
02.12.2021 17:25:41,535 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:41,528 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=702): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,537 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,538 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=191, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:41,538 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 191 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:41,538 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:41,538 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,538 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,538 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:41,538 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,538 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:41,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 322
02.12.2021 17:25:41,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 316
02.12.2021 17:25:41,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 7
02.12.2021 17:25:41,547 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118489ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:41,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,549 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:41,550 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:41,550 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=741) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:41,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 188
02.12.2021 17:25:41,551 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=741): org.apache.kafka.common.requests.HeartbeatResponse@2fb0b2f3
02.12.2021 17:25:41,551 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:41,551 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:41,551 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:41,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 104
02.12.2021 17:25:41,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 221
02.12.2021 17:25:41,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 212
02.12.2021 17:25:41,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:41,678 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58586ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:41,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,725 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 1
02.12.2021 17:25:41,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,738 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,739 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,739 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,742 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 108
02.12.2021 17:25:41,742 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 117
02.12.2021 17:25:41,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,783 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,797 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=689): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,797 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,797 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=689): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,798 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,798 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}
02.12.2021 17:25:41,798 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=690): org.apache.kafka.common.requests.HeartbeatResponse@59767b4f
02.12.2021 17:25:41,799 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:41,798 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}
02.12.2021 17:25:41,799 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025
02.12.2021 17:25:41,799 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:41,799 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,799 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,799 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=690): org.apache.kafka.common.requests.HeartbeatResponse@27414a59
02.12.2021 17:25:41,800 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:41,801 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,801 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from RUNNING to REBALANCING
02.12.2021 17:25:41,804 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:41,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 485
02.12.2021 17:25:41,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 479
02.12.2021 17:25:41,800 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:41,805 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e
02.12.2021 17:25:41,805 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:41,805 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,805 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,806 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:41,807 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,807 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:41,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 434
02.12.2021 17:25:41,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 423
02.12.2021 17:25:41,838 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:41,842 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:41,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 4
02.12.2021 17:25:41,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 13
02.12.2021 17:25:41,847 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1387): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 7, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,848 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 7, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,848 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}
02.12.2021 17:25:41,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,852 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:41,853 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,854 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,854 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:41,854 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:41,854 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,854 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,854 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:41,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,854 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,855 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:41,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,864 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:41,864 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,865 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,865 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:41,865 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:41,865 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,865 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,865 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,865 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from REBALANCING to RUNNING
02.12.2021 17:25:41,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:41,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,865 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 378
02.12.2021 17:25:41,908 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 323
02.12.2021 17:25:41,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:41,942 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:41,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:41,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:42,009 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 222
02.12.2021 17:25:42,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 276
02.12.2021 17:25:42,042 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:42,042 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:42,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:42,070 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 295
02.12.2021 17:25:42,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 114
02.12.2021 17:25:42,119 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 164
02.12.2021 17:25:42,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:42,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:42,157 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239257ms for 240000ms of delay, sleeping for 753ms
02.12.2021 17:25:42,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 189
02.12.2021 17:25:42,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 167
02.12.2021 17:25:42,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 13
02.12.2021 17:25:42,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 57
02.12.2021 17:25:42,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:42,232 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:42,233 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:42,233 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:42,233 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:42,233 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:42,233 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:42,233 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:42,233 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:42,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:42,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,233 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,239 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,239 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 89
02.12.2021 17:25:42,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:42,284 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:42,284 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from REBALANCING to RUNNING
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,299 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 66
02.12.2021 17:25:42,305 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:42,305 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:42,306 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1076) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:42,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:42,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:42,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:42,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,355 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,369 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:42,406 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1076): org.apache.kafka.common.requests.HeartbeatResponse@35a33548
02.12.2021 17:25:42,406 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:42,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:42,440 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:42,441 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:42,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:42,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:42,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:42,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:42,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:42,541 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:42,547 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119489ms delay out of 120000ms. Remaining 511ms. Executor queue at 0
02.12.2021 17:25:42,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:42,567 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119416ms for 120000ms of delay, sleeping for 594ms
02.12.2021 17:25:42,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:42,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:42,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:42,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:42,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:42,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:42,679 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 190
02.12.2021 17:25:42,679 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59587ms delay out of 60000ms. Remaining 413ms. Executor queue at 1
02.12.2021 17:25:42,684 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59641ms for 60000ms of delay, sleeping for 369ms
02.12.2021 17:25:42,686 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:42,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,735 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,744 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,744 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,744 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,744 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:42,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:42,822 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,825 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,836 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:42,844 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:42,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:42,856 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,856 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,856 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,856 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,856 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,856 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,856 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,856 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,856 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,912 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239775ms for 240000ms of delay, sleeping for 235ms
02.12.2021 17:25:42,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 543 ms and fetched 0 records
02.12.2021 17:25:42,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,912 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,913 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:42,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:42,944 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:42,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:42,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:43,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:43,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:43,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:43,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:43,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:43,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:43,058 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59351ms for 60000ms of delay, sleeping for 659ms
02.12.2021 17:25:43,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:43,128 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:43,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:43,156 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239753ms for 240000ms of delay, sleeping for 257ms
02.12.2021 17:25:43,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:43,154 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:43,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:43,164 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119951ms for 120000ms of delay, sleeping for 59ms
02.12.2021 17:25:43,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:43,227 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119786ms for 120000ms of delay, sleeping for 224ms
02.12.2021 17:25:43,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:43,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,237 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:43,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:43,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,246 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,246 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:43,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,247 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:43,316 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:43,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,325 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 448
02.12.2021 17:25:43,337 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:43,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:43,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:43,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,357 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,414 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,416 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239533ms for 240000ms of delay, sleeping for 477ms
02.12.2021 17:25:43,426 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 348
02.12.2021 17:25:43,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:43,447 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:43,447 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:43,452 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119989ms for 120000ms of delay, sleeping for 21ms
02.12.2021 17:25:43,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:43,475 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119346ms for 120000ms of delay, sleeping for 664ms
02.12.2021 17:25:43,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:43,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 248
02.12.2021 17:25:43,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:43,548 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:43,548 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:43,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:43,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:43,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:43,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 147
02.12.2021 17:25:43,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:43,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:43,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:43,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:43,720 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59668ms for 60000ms of delay, sleeping for 342ms
02.12.2021 17:25:43,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:43,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,740 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 34
02.12.2021 17:25:43,742 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,745 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 30
02.12.2021 17:25:43,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:43,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:43,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:43,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,776 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,775 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:43,776 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,777 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,776 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=691) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null}
02.12.2021 17:25:43,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,803 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,776 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:43,803 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,776 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,803 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=691) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null}
02.12.2021 17:25:43,776 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,803 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 442
02.12.2021 17:25:43,804 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=691): org.apache.kafka.common.requests.HeartbeatResponse@2c803c78
02.12.2021 17:25:43,804 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:43,804 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e
02.12.2021 17:25:43,804 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:43,804 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:43,803 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,804 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 99, -7, 73, -122, 97, 3, 73, 127, -105, 10, 111, -53, -15, -100, 50, -91, 0, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,805 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 23
02.12.2021 17:25:43,805 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=691): org.apache.kafka.common.requests.HeartbeatResponse@47f4f42b
02.12.2021 17:25:43,808 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:43,805 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=692) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:43,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 437
02.12.2021 17:25:43,808 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025
02.12.2021 17:25:43,809 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:43,809 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:43,809 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 99, -7, 73, -122, 97, 3, 73, 127, -105, 10, 111, -53, -15, -100, 50, -91, 0, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,810 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=692) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:43,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 16
02.12.2021 17:25:43,816 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:43,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,850 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,850 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:43,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 515 ms and fetched 0 records
02.12.2021 17:25:43,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,872 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,881 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,903 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:43,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:43,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 222764ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:43,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:43,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 73 iterations.
02.12.2021 17:25:43,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 73 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:43,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 222766ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:43,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:43,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:43,909 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 395
02.12.2021 17:25:43,906 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3
02.12.2021 17:25:43,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 371
02.12.2021 17:25:43,905 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:43,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:43,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,918 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,909 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:43,918 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[redacted.Cloud.Message.Callback.Retry3-7], userDataSize=48)
02.12.2021 17:25:43,918 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:43,918 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:330] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Skip resuming since state is RUNNING
02.12.2021 17:25:43,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,919 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:43,919 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:43,919 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from RUNNING to REBALANCING
02.12.2021 17:25:43,919 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions [redacted.Cloud.Message.Callback.Retry3-7]
02.12.2021 17:25:43,919 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:43,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 238
02.12.2021 17:25:43,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:44,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 266
02.12.2021 17:25:44,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:44,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:44,019 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:44,022 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:44,022 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 125
02.12.2021 17:25:44,083 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:44,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:44,116 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59085ms for 60000ms of delay, sleeping for 925ms
02.12.2021 17:25:44,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 162
02.12.2021 17:25:44,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:44,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 20 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,122 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:44,146 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:44,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:44,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 39049ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 21 iterations.
02.12.2021 17:25:44,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 21 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:44,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 39068ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,146 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 22
02.12.2021 17:25:44,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:44,164 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1137): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', members=[])
02.12.2021 17:25:44,165 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', members=[])
02.12.2021 17:25:44,168 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:44,168 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}
02.12.2021 17:25:44,168 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:44,169 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016428, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:44,169 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016438, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:44,169 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1138) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:44,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 11 ms and fetched 10 records
02.12.2021 17:25:44,171 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:44,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,171 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:44,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 21 iterations.
02.12.2021 17:25:44,173 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119912ms for 120000ms of delay, sleeping for 98ms
02.12.2021 17:25:44,173 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1138): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:44,176 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=191, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}
02.12.2021 17:25:44,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:44,184 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:44,189 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,191 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:44,191 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1388) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null}
02.12.2021 17:25:44,191 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:44,191 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 222
02.12.2021 17:25:44,191 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1388): org.apache.kafka.common.requests.HeartbeatResponse@535be6ec
02.12.2021 17:25:44,191 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:44,193 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:44,194 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3
02.12.2021 17:25:44,194 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:44,198 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:44,199 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 99, -7, 73, -122, 97, 3, 73, 127, -105, 10, 111, -53, -15, -100, 50, -91, 0, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 7])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:44,200 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1389) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:44,202 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:44,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 204
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 51
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:44,214 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:44,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:44,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,247 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:44,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,283 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:44,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 259
02.12.2021 17:25:44,291 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119849ms for 120000ms of delay, sleeping for 161ms
02.12.2021 17:25:44,291 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:44,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 518 ms and fetched 0 records
02.12.2021 17:25:44,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,321 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 210
02.12.2021 17:25:44,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 85
02.12.2021 17:25:44,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,351 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,409 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:44,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:44,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:44,413 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:44,414 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:44,414 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:44,414 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions [redacted.Cloud.Message.Callback.Retry3-7]
02.12.2021 17:25:44,414 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:44,414 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:44,414 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:44,414 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:44,414 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from REBALANCING to RUNNING
02.12.2021 17:25:44,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:44,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,414 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:44,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 73 iterations.
02.12.2021 17:25:44,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 73 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:44,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 223275ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:44,415 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970328, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:44,415 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970338, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:44,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:44,415 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:44,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,415 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:44,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 73 iterations.
02.12.2021 17:25:44,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 159
02.12.2021 17:25:44,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:44,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,417 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,419 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,419 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 80
02.12.2021 17:25:44,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 83
02.12.2021 17:25:44,422 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 109
02.12.2021 17:25:44,437 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239314ms for 240000ms of delay, sleeping for 696ms
02.12.2021 17:25:44,454 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119911ms for 120000ms of delay, sleeping for 99ms
02.12.2021 17:25:44,499 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,499 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,500 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=703) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null}
02.12.2021 17:25:44,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 420
02.12.2021 17:25:44,500 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=703): org.apache.kafka.common.requests.HeartbeatResponse@66f62fb7
02.12.2021 17:25:44,500 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:44,500 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 191 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:44,500 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:44,500 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:44,500 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 91, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,501 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=704) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:44,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 418
02.12.2021 17:25:44,503 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,503 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,503 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=703) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null}
02.12.2021 17:25:44,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 415
02.12.2021 17:25:44,503 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=703): org.apache.kafka.common.requests.HeartbeatResponse@6ef597c9
02.12.2021 17:25:44,503 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:44,504 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 191 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:44,504 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:44,504 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:44,504 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 91, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,504 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=704) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 414
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 32
02.12.2021 17:25:44,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 8
02.12.2021 17:25:44,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,531 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,534 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:44,534 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=685) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:44,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 286
02.12.2021 17:25:44,535 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=685): org.apache.kafka.common.requests.HeartbeatResponse@43866cdd
02.12.2021 17:25:44,536 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:44,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 285
02.12.2021 17:25:44,544 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 277
02.12.2021 17:25:44,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,549 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,553 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:44,555 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119902ms for 120000ms of delay, sleeping for 108ms
02.12.2021 17:25:44,553 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=742) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:44,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 240
02.12.2021 17:25:44,556 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=742): org.apache.kafka.common.requests.HeartbeatResponse@6c0c6a71
02.12.2021 17:25:44,556 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:44,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 234
02.12.2021 17:25:44,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 234
02.12.2021 17:25:44,600 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:44,603 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:44,645 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 177
02.12.2021 17:25:44,662 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 128
02.12.2021 17:25:44,664 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119602ms for 120000ms of delay, sleeping for 408ms
02.12.2021 17:25:44,745 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 76
02.12.2021 17:25:44,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,748 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,748 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,762 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 28
02.12.2021 17:25:44,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,791 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,791 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:44,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,821 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:44,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,852 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,852 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,892 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:44,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 383
02.12.2021 17:25:44,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,942 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,943 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:44,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30438ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:44,992 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:45,041 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 280
02.12.2021 17:25:45,044 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59212ms for 60000ms of delay, sleeping for 798ms
02.12.2021 17:25:45,082 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118132ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:45,093 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:45,135 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239980ms for 240000ms of delay, sleeping for 30ms
02.12.2021 17:25:45,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 179
02.12.2021 17:25:45,167 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239571ms for 240000ms of delay, sleeping for 439ms
02.12.2021 17:25:45,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:45,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 79
02.12.2021 17:25:45,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,249 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,249 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,291 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,323 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,323 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,339 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:45,339 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:45,339 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1077) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:45,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,353 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:45,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:45,439 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1077): org.apache.kafka.common.requests.HeartbeatResponse@7a27fbbc
02.12.2021 17:25:45,439 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:45,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,443 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,444 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:45,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,446 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30942ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,446 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:45,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:45,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:45,607 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239403ms for 240000ms of delay, sleeping for 607ms
02.12.2021 17:25:45,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:45,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:45,728 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:45,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,750 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:45,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,795 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,824 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,824 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,844 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59913ms for 60000ms of delay, sleeping for 97ms
02.12.2021 17:25:45,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,854 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:45,921 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=692): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', members=[])
02.12.2021 17:25:45,921 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', members=[])
02.12.2021 17:25:45,921 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:45,921 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}
02.12.2021 17:25:45,922 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,922 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=693) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 432
02.12.2021 17:25:45,922 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=692): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', members=[])
02.12.2021 17:25:45,922 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', members=[])
02.12.2021 17:25:45,922 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:45,922 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}
02.12.2021 17:25:45,922 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,922 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=693) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 328
02.12.2021 17:25:45,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:45,942 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59938ms for 60000ms of delay, sleeping for 72ms
02.12.2021 17:25:45,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,945 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:45,946 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,951 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31448ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,952 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:46,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 10 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:46,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:46,016 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,016 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:46,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:46,017 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142414, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:46,017 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142424, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:46,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:46,018 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:46,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,018 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:46,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:46,018 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59853ms for 60000ms of delay, sleeping for 157ms
02.12.2021 17:25:46,029 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:46,083 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119133ms delay out of 120000ms. Remaining 867ms. Executor queue at 0
02.12.2021 17:25:46,093 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119001ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:46,097 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:46,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:46,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:46,216 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59972ms for 60000ms of delay, sleeping for 38ms
02.12.2021 17:25:46,216 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239380ms for 240000ms of delay, sleeping for 630ms
02.12.2021 17:25:46,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:46,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,251 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,256 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59973ms for 60000ms of delay, sleeping for 37ms
02.12.2021 17:25:46,295 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59550ms for 60000ms of delay, sleeping for 460ms
02.12.2021 17:25:46,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:46,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,304 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30019ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,304 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:46,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,355 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:46,426 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31949ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:46,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,454 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:46,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:46,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:46,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:46,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:46,728 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:46,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,752 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,752 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,757 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59909ms for 60000ms of delay, sleeping for 101ms
02.12.2021 17:25:46,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:46,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,805 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,805 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30153ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,829 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,853 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239679ms for 240000ms of delay, sleeping for 331ms
02.12.2021 17:25:46,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,857 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,857 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,862 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59850ms for 60000ms of delay, sleeping for 160ms
02.12.2021 17:25:46,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:46,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:46,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:46,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,954 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32450ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:46,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,955 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,005 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:47,023 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59168ms for 60000ms of delay, sleeping for 842ms
02.12.2021 17:25:47,030 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:47,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 21 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 42006ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:47,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 22 iterations.
02.12.2021 17:25:47,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 22 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 42007ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:47,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:47,098 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:47,098 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:47,098 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:47,098 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 91, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 5])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:47,099 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1139) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:47,100 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016438, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:47,100 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016448, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:47,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:47,101 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:47,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,101 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:47,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 22 iterations.
02.12.2021 17:25:47,101 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119956ms for 120000ms of delay, sleeping for 54ms
02.12.2021 17:25:47,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:47,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:47,157 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119035ms for 120000ms of delay, sleeping for 975ms
02.12.2021 17:25:47,184 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:47,186 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239788ms for 240000ms of delay, sleeping for 222ms
02.12.2021 17:25:47,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:47,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:47,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,253 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,253 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,306 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,306 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 243
02.12.2021 17:25:47,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,331 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:47,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,358 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,406 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 143
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 73 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 226270ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 74 iterations.
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 74 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 226270ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1389): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', members=[])
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', members=[])
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:47,409 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:47,410 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970338, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:47,410 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970348, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1390) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null,assignments=[]}
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:47,411 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:47,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,411 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:47,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 74 iterations.
02.12.2021 17:25:47,412 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239476ms for 240000ms of delay, sleeping for 534ms
02.12.2021 17:25:47,433 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:47,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32952ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:47,469 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=693): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,469 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=693): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,469 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,469 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,470 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025', protocol='stream'}
02.12.2021 17:25:47,470 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025
02.12.2021 17:25:47,470 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:47,470 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:47,470 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:47,470 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:47,470 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:47,470 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from RUNNING to REBALANCING
02.12.2021 17:25:47,470 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:47,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 389
02.12.2021 17:25:47,470 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e', protocol='stream'}
02.12.2021 17:25:47,470 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e
02.12.2021 17:25:47,470 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:47,470 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:47,470 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:47,471 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:47,471 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:47,471 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:47,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 284
02.12.2021 17:25:47,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 42
02.12.2021 17:25:47,510 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1390): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 7, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,511 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 7, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,511 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3', protocol='stream'}
02.12.2021 17:25:47,532 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:47,535 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:47,535 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=686) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:47,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:47,535 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=686): org.apache.kafka.common.requests.HeartbeatResponse@1968497c
02.12.2021 17:25:47,535 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:47,542 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:47,543 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 288
02.12.2021 17:25:47,549 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:47,549 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:47,549 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=743) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:47,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,550 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=743): org.apache.kafka.common.requests.HeartbeatResponse@2f7918df
02.12.2021 17:25:47,551 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:47,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 255
02.12.2021 17:25:47,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 254
02.12.2021 17:25:47,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 288
02.12.2021 17:25:47,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 182
02.12.2021 17:25:47,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 185
02.12.2021 17:25:47,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 153
02.12.2021 17:25:47,671 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 187
02.12.2021 17:25:47,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 80
02.12.2021 17:25:47,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 85
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:47,754 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 53
02.12.2021 17:25:47,771 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 87
02.12.2021 17:25:47,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:47,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,808 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:47,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,832 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,832 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:47,855 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:47,871 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58854ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:47,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 517 ms and fetched 0 records
02.12.2021 17:25:47,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:47,875 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:47,875 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:47,875 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:47,876 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:47,876 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:47,876 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:47,876 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:47,876 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:47,876 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from REBALANCING to RUNNING
02.12.2021 17:25:47,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:47,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,877 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,909 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:47,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:47,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,956 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,957 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 33453ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:47,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,958 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:47,958 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239998ms for 240000ms of delay, sleeping for 12ms
02.12.2021 17:25:47,958 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:47,981 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239666ms for 240000ms of delay, sleeping for 344ms
02.12.2021 17:25:48,018 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:48,060 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 194
02.12.2021 17:25:48,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 277
02.12.2021 17:25:48,081 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:48,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:48,137 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119987ms for 120000ms of delay, sleeping for 23ms
02.12.2021 17:25:48,165 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119661ms for 120000ms of delay, sleeping for 349ms
02.12.2021 17:25:48,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 89
02.12.2021 17:25:48,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 166
02.12.2021 17:25:48,182 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:48,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:48,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,255 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:48,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 66
02.12.2021 17:25:48,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:48,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,309 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,309 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,327 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239758ms for 240000ms of delay, sleeping for 252ms
02.12.2021 17:25:48,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,334 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,378 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,379 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:48,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:48,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,379 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:48,380 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1078) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:48,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:48,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:48,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,462 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:48,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,463 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 33959ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:48,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:48,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 276
02.12.2021 17:25:48,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 355
02.12.2021 17:25:48,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:48,480 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1078): org.apache.kafka.common.requests.HeartbeatResponse@615e8719
02.12.2021 17:25:48,480 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:48,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:48,519 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119620ms for 120000ms of delay, sleeping for 390ms
02.12.2021 17:25:48,580 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 175
02.12.2021 17:25:48,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:48,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 253
02.12.2021 17:25:48,585 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239713ms for 240000ms of delay, sleeping for 297ms
02.12.2021 17:25:48,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:48,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 75
02.12.2021 17:25:48,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 152
02.12.2021 17:25:48,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:48,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:48,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,756 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 166
02.12.2021 17:25:48,783 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:48,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 52
02.12.2021 17:25:48,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,810 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,838 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,856 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 66
02.12.2021 17:25:48,871 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59854ms delay out of 60000ms. Remaining 146ms. Executor queue at 0
02.12.2021 17:25:48,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 10 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:48,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,873 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 6 fetched records at offset FetchPosition{offset=1142424, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:48,873 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142430, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:48,873 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:1199] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Added READ_UNCOMMITTED fetch request for partition redacted.Cloud.Message.Callback.Retry1-0 at position FetchPosition{offset=1142430, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)], epoch=absent}} to node kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)
02.12.2021 17:25:48,873 DEBUG [org.apache.kafka.clients.FetchSessionHandler:259] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Built incremental fetch (sessionId=24681818, epoch=336) for node 4. Added (), altered (redacted.Cloud.Message.Callback.Retry1-0), removed () out of (OSS.STAGING.Cloud.Message.Callback.Retry1-0)
02.12.2021 17:25:48,873 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:266] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(redacted.Cloud.Message.Callback.Retry1-0), toForget=(), implied=()) to broker kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)
02.12.2021 17:25:48,873 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending FETCH request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1079) and timeout 30000 to node 4: {replica_id=-1,max_wait_ms=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=24681818,session_epoch=336,topics=[{topic=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition=0,current_leader_epoch=-1,fetch_offset=1142430,log_start_offset=-1,partition_max_bytes=1048576}]}],forgotten_topics_data=[],rack_id=}
02.12.2021 17:25:48,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 6 records
02.12.2021 17:25:48,874 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 6
02.12.2021 17:25:48,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,874 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:48,875 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59988ms for 60000ms of delay, sleeping for 22ms
02.12.2021 17:25:48,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,880 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,880 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 41
02.12.2021 17:25:48,882 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received FETCH response from node 4 for request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1079): org.apache.kafka.common.requests.FetchResponse@14e25d54
02.12.2021 17:25:48,883 DEBUG [org.apache.kafka.clients.FetchSessionHandler:463] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Node 4 sent an incremental fetch response with throttleTimeMs = 0 for session 24681818 with response=(redacted.Cloud.Message.Callback.Retry1-0)
02.12.2021 17:25:48,884 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:315] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Fetch READ_UNCOMMITTED at offset 1142430 for partition redacted.Cloud.Message.Callback.Retry1-0 returned fetch data (error=NONE, highWaterMark=1142577, lastStableOffset = 1142577, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, divergingEpoch =Optional.empty, recordsSizeInBytes=66740)
02.12.2021 17:25:48,887 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239657ms for 240000ms of delay, sleeping for 353ms
02.12.2021 17:25:48,898 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59863ms for 60000ms of delay, sleeping for 147ms
02.12.2021 17:25:48,910 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119993ms for 120000ms of delay, sleeping for 17ms
02.12.2021 17:25:48,911 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:48,922 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,922 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:48,922 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=694) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null}
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 458
02.12.2021 17:25:48,926 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=694): org.apache.kafka.common.requests.HeartbeatResponse@6fb3927b
02.12.2021 17:25:48,926 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:48,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 454
02.12.2021 17:25:48,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 454
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,926 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:48,926 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=694) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null}
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,927 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=694): org.apache.kafka.common.requests.HeartbeatResponse@4535ae04
02.12.2021 17:25:48,927 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:48,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 329
02.12.2021 17:25:48,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 329
02.12.2021 17:25:48,930 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119677ms for 120000ms of delay, sleeping for 333ms
02.12.2021 17:25:48,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:48,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,963 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,964 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,966 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 34462ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:48,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:48,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:49,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 352
02.12.2021 17:25:49,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 229
02.12.2021 17:25:49,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:49,052 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59201ms for 60000ms of delay, sleeping for 809ms
02.12.2021 17:25:49,112 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:49,129 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 252
02.12.2021 17:25:49,129 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 127
02.12.2021 17:25:49,144 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:49,212 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:49,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 24
02.12.2021 17:25:49,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 148
02.12.2021 17:25:49,241 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239089ms for 240000ms of delay, sleeping for 921ms
02.12.2021 17:25:49,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:49,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,256 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,264 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119937ms for 120000ms of delay, sleeping for 73ms
02.12.2021 17:25:49,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,311 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,311 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 48
02.12.2021 17:25:49,338 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119830ms for 120000ms of delay, sleeping for 180ms
02.12.2021 17:25:49,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,339 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:49,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,381 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:49,440 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:49,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:49,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:49,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,466 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,467 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,467 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 34963ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:49,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:49,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,468 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,482 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:49,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:49,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:49,542 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118663ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:49,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:49,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:49,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:49,643 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:49,660 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:49,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:49,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:49,743 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:49,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,758 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,788 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:49,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,812 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,812 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,840 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,844 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 397
02.12.2021 17:25:49,878 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59737ms for 60000ms of delay, sleeping for 273ms
02.12.2021 17:25:49,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:49,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,890 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,890 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,912 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:49,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:49,962 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:49,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,968 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 35465ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:49,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:49,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:49,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,970 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:50,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:50,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:50,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:50,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:50,126 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:50,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:50,162 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59962ms for 60000ms of delay, sleeping for 48ms
02.12.2021 17:25:50,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 81
02.12.2021 17:25:50,179 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239667ms for 240000ms of delay, sleeping for 343ms
02.12.2021 17:25:50,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:50,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 6 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:50,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,219 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1251] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Preparing to read 66740 bytes of data for partition redacted.Cloud.Message.Callback.Retry1-0 with offset FetchPosition{offset=1142430, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)], epoch=absent}}
02.12.2021 17:25:50,219 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1275] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating high watermark for partition redacted.Cloud.Message.Callback.Retry1-0 to 1142577
02.12.2021 17:25:50,219 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1280] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating log start offset for partition redacted.Cloud.Message.Callback.Retry1-0 to 0
02.12.2021 17:25:50,219 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1285] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating last stable offset for partition redacted.Cloud.Message.Callback.Retry1-0 to 1142577
02.12.2021 17:25:50,219 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142430, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:50,219 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142440, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:50,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:50,219 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:50,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,220 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:50,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:50,225 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58182ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:50,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 67
02.12.2021 17:25:50,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:50,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,261 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,284 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=704): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:50,285 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=704): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:50,289 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:50,289 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:50,290 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:50,290 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:50,290 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=705) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,assignments=[]}
02.12.2021 17:25:50,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 180
02.12.2021 17:25:50,285 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:50,291 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:50,291 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:50,291 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:50,291 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=705) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:50,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 178
02.12.2021 17:25:50,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:50,314 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:50,314 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,314 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 234
02.12.2021 17:25:50,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:50,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,347 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 185
02.12.2021 17:25:50,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:50,389 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=705): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,389 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=705): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,389 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,389 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,389 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=192, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:50,389 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=192, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:50,389 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 192 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:50,389 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 192 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:50,389 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:50,390 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:50,390 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:50,390 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:50,390 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:50,390 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:50,390 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:50,390 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:50,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,390 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:50,390 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:50,390 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from RUNNING to REBALANCING
02.12.2021 17:25:50,390 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:50,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 80
02.12.2021 17:25:50,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,390 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,390 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:50,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,391 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 81
02.12.2021 17:25:50,391 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 133
02.12.2021 17:25:50,438 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:50,438 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:50,438 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1391) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null}
02.12.2021 17:25:50,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:50,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:50,471 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Committing all active tasks [] and standby tasks [] since 35967ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:50,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:50,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:50,472 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:50,472 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:50,472 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:50,472 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:50,472 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:50,472 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:50,472 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:50,472 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:50,472 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from REBALANCING to RUNNING
02.12.2021 17:25:50,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:50,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,472 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:50,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 29
02.12.2021 17:25:50,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 74 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,533 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:50,533 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:50,533 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=687) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:50,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 229387ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:50,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,534 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=687): org.apache.kafka.common.requests.HeartbeatResponse@c8c8e42
02.12.2021 17:25:50,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:50,535 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 75 iterations.
02.12.2021 17:25:50,534 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:50,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 313
02.12.2021 17:25:50,542 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 305
02.12.2021 17:25:50,535 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 75 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,538 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1391): org.apache.kafka.common.requests.HeartbeatResponse@32df7116
02.12.2021 17:25:50,544 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119665ms delay out of 120000ms. Remaining 335ms. Executor queue at 0
02.12.2021 17:25:50,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 22 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,544 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:50,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 45454ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:50,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:50,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 23 iterations.
02.12.2021 17:25:50,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 229403ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:50,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:50,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 23 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,549 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:50,550 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:50,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 45457ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:50,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:50,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,553 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1139): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', members=[])
02.12.2021 17:25:50,553 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', members=[])
02.12.2021 17:25:50,553 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:50,553 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}
02.12.2021 17:25:50,550 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=744) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:50,549 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3
02.12.2021 17:25:50,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 261
02.12.2021 17:25:50,553 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:50,554 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016448, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:50,554 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016458, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:50,554 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=744): org.apache.kafka.common.requests.HeartbeatResponse@4fe02837
02.12.2021 17:25:50,554 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:50,554 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:50,554 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[redacted.Cloud.Message.Callback.Retry3-7], userDataSize=48)
02.12.2021 17:25:50,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 261
02.12.2021 17:25:50,554 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1140) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:50,555 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 260
02.12.2021 17:25:50,555 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:50,556 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:330] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Skip resuming since state is RUNNING
02.12.2021 17:25:50,556 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:50,556 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:50,556 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from RUNNING to REBALANCING
02.12.2021 17:25:50,556 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions [redacted.Cloud.Message.Callback.Retry3-7]
02.12.2021 17:25:50,556 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:50,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 5 ms and fetched 10 records
02.12.2021 17:25:50,557 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:50,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,557 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:50,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 23 iterations.
02.12.2021 17:25:50,557 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119430ms for 120000ms of delay, sleeping for 580ms
02.12.2021 17:25:50,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:50,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:50,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:50,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:50,642 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 205
02.12.2021 17:25:50,655 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1140): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 5, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,655 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 5, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,656 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=192, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', protocol='stream'}
02.12.2021 17:25:50,656 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 159
02.12.2021 17:25:50,656 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:50,656 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:50,657 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 393
02.12.2021 17:25:50,662 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:50,672 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:50,673 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:50,700 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 191
02.12.2021 17:25:50,743 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 104
02.12.2021 17:25:50,757 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:50,757 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:50,757 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 292
02.12.2021 17:25:50,757 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 58
02.12.2021 17:25:50,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,762 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,762 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:50,774 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 200
02.12.2021 17:25:50,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 85
02.12.2021 17:25:50,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,816 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,844 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 3
02.12.2021 17:25:50,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,847 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,857 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:50,858 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:50,858 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:50,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:50,874 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:50,874 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:50,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,893 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:50,952 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:50,958 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:50,958 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:50,958 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:50,963 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:50,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,971 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,974 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,974 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,994 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:51,018 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:51,049 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-7 because it is paused
02.12.2021 17:25:51,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:51,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:51,049 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:51,049 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions [redacted.Cloud.Message.Callback.Retry3-7]
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:51,050 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:51,050 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5] State transition from REBALANCING to RUNNING
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 75 iterations.
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 75 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 229911ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Flushing record collector
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Prepared RUNNING task for committing
02.12.2021 17:25:51,050 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry3-7=OffsetAndMetadata{offset=970348, leaderEpoch=null, metadata='AQAAAX1787sw'}} to coordinator kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,050 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1392) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry3,partitions=[{partition_index=7,committed_offset=970348,committed_leader_epoch=-1,committed_metadata=AQAAAX1787sw}]}]}
02.12.2021 17:25:51,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:51,066 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:51,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,071 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received OFFSET_COMMIT response from node 2147483643 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1392): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry3', partitions=[OffsetCommitResponsePartition(partitionIndex=7, errorCode=0)])])
02.12.2021 17:25:51,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,074 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Committed offset 970348 for partition redacted.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:51,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry3-7=970347}
02.12.2021 17:25:51,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:51,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Committed all active tasks [0_7] and standby tasks [] in 0ms
02.12.2021 17:25:51,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,080 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970348, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:51,080 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970358, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:51,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:51,084 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:51,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,084 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 75 iterations.
02.12.2021 17:25:51,093 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239972ms for 240000ms of delay, sleeping for 38ms
02.12.2021 17:25:51,095 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:51,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:51,134 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239926ms for 240000ms of delay, sleeping for 84ms
02.12.2021 17:25:51,140 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119007ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:51,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:51,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:51,174 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:51,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:51,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:51,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:51,220 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239271ms for 240000ms of delay, sleeping for 739ms
02.12.2021 17:25:51,226 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59183ms delay out of 60000ms. Remaining 817ms. Executor queue at 0
02.12.2021 17:25:51,227 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59155ms for 60000ms of delay, sleeping for 855ms
02.12.2021 17:25:51,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:51,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,262 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,262 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:51,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:51,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:51,299 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:51,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,319 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,319 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,348 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:51,375 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:51,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:51,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,394 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:51,407 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,407 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:51,407 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1080) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:51,419 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:51,448 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:51,463 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:51,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,473 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,475 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:51,507 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1080): org.apache.kafka.common.requests.HeartbeatResponse@384723f5
02.12.2021 17:25:51,508 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:51,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:51,548 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:51,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:51,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,575 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:51,621 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:51,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:51,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:51,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:51,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:51,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:51,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:51,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:51,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,762 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,763 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 160
02.12.2021 17:25:51,774 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:51,776 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:51,800 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:51,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,820 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,850 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,851 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,863 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 60
02.12.2021 17:25:51,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:51,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:51,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,894 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 27
02.12.2021 17:25:51,921 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:51,922 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,922 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,922 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=695) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null}
02.12.2021 17:25:51,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 473
02.12.2021 17:25:51,923 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=695): org.apache.kafka.common.requests.HeartbeatResponse@e934370
02.12.2021 17:25:51,923 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:51,923 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,923 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,923 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=695) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null}
02.12.2021 17:25:51,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 472
02.12.2021 17:25:51,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:51,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 471
02.12.2021 17:25:51,924 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=695): org.apache.kafka.common.requests.HeartbeatResponse@1d0569ce
02.12.2021 17:25:51,924 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:51,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 339
02.12.2021 17:25:51,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 339
02.12.2021 17:25:51,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 383
02.12.2021 17:25:51,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,973 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,973 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,980 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,980 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239589ms for 240000ms of delay, sleeping for 421ms
02.12.2021 17:25:52,021 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:52,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 239
02.12.2021 17:25:52,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 370
02.12.2021 17:25:52,070 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 281
02.12.2021 17:25:52,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:52,090 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 391
02.12.2021 17:25:52,092 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59087ms for 60000ms of delay, sleeping for 923ms
02.12.2021 17:25:52,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 138
02.12.2021 17:25:52,122 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:52,126 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 269
02.12.2021 17:25:52,155 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119969ms for 120000ms of delay, sleeping for 41ms
02.12.2021 17:25:52,175 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:52,170 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 181
02.12.2021 17:25:52,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 290
02.12.2021 17:25:52,200 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119568ms for 120000ms of delay, sleeping for 442ms
02.12.2021 17:25:52,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 38
02.12.2021 17:25:52,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:52,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 167
02.12.2021 17:25:52,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,264 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:52,280 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 71
02.12.2021 17:25:52,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 190
02.12.2021 17:25:52,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,321 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 65
02.12.2021 17:25:52,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,351 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:52,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:52,395 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,395 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,395 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,395 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,395 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,395 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,395 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,396 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,415 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239990ms for 240000ms of delay, sleeping for 20ms
02.12.2021 17:25:52,422 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:52,436 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239308ms for 240000ms of delay, sleeping for 702ms
02.12.2021 17:25:52,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:52,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:52,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,474 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:52,481 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,482 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,482 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:52,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:52,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:52,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:52,574 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:52,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:52,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:52,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:52,644 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119509ms for 120000ms of delay, sleeping for 501ms
02.12.2021 17:25:52,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:52,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:52,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:52,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:52,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 190
02.12.2021 17:25:52,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:52,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:52,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,764 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:52,790 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 192
02.12.2021 17:25:52,807 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 89
02.12.2021 17:25:52,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,821 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,855 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,855 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,875 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:52,892 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:52,897 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,899 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:52,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:52,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:52,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,975 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,975 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 316
02.12.2021 17:25:52,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,982 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 308
02.12.2021 17:25:53,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,021 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59127ms for 60000ms of delay, sleeping for 883ms
02.12.2021 17:25:53,023 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:53,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:53,066 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:53,075 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 216
02.12.2021 17:25:53,083 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 207
02.12.2021 17:25:53,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:53,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:53,141 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239964ms for 240000ms of delay, sleeping for 46ms
02.12.2021 17:25:53,152 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119957ms for 120000ms of delay, sleeping for 53ms
02.12.2021 17:25:53,156 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:53,167 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:53,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 114
02.12.2021 17:25:53,185 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 105
02.12.2021 17:25:53,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 75 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 76 iterations.
02.12.2021 17:25:53,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 76 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:53,188 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970358, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:53,188 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970368, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:53,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:53,189 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:53,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,189 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:53,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 76 iterations.
02.12.2021 17:25:53,190 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239971ms for 240000ms of delay, sleeping for 39ms
02.12.2021 17:25:53,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:53,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 23 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 48117ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:53,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:53,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 24 iterations.
02.12.2021 17:25:53,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 24 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 48118ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:53,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:53,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:53,209 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 192 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd
02.12.2021 17:25:53,209 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:53,209 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[redacted.Cloud.Message.Callback.Retry2-5], userDataSize=48)
02.12.2021 17:25:53,209 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:53,209 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:330] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Skip resuming since state is RUNNING
02.12.2021 17:25:53,209 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:53,209 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:53,209 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from RUNNING to REBALANCING
02.12.2021 17:25:53,209 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Pausing partitions [redacted.Cloud.Message.Callback.Retry2-5]
02.12.2021 17:25:53,210 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-5 because it is paused
02.12.2021 17:25:53,210 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 344
02.12.2021 17:25:53,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:53,232 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239367ms for 240000ms of delay, sleeping for 643ms
02.12.2021 17:25:53,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:53,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,265 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 14
02.12.2021 17:25:53,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 5
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,290 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 192 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,290 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=706) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null}
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 192
02.12.2021 17:25:53,291 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=706): org.apache.kafka.common.requests.HeartbeatResponse@47ffddee
02.12.2021 17:25:53,291 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:53,291 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 192 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:53,291 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:53,291 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:53,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,292 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 92, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,292 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=707) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:53,292 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 189
02.12.2021 17:25:53,293 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 192 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,295 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=706) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null}
02.12.2021 17:25:53,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 183
02.12.2021 17:25:53,296 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=706): org.apache.kafka.common.requests.HeartbeatResponse@3d5f76e6
02.12.2021 17:25:53,296 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:53,297 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 192 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:53,297 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:53,297 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:53,299 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 92, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,299 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=707) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:53,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 174
02.12.2021 17:25:53,302 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:53,310 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-5 because it is paused
02.12.2021 17:25:53,310 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-5 because it is paused
02.12.2021 17:25:53,310 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 243
02.12.2021 17:25:53,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:53,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,325 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 224
02.12.2021 17:25:53,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,355 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,355 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 178
02.12.2021 17:25:53,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:53,391 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:53,397 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:53,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,401 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,411 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-5 because it is paused
02.12.2021 17:25:53,411 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-5 because it is paused
02.12.2021 17:25:53,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 142
02.12.2021 17:25:53,426 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 123
02.12.2021 17:25:53,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 77
02.12.2021 17:25:53,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:53,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,476 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,476 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,481 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,481 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:53,481 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1393) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null}
02.12.2021 17:25:53,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,485 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,511 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-5 because it is paused
02.12.2021 17:25:53,512 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-5 because it is paused
02.12.2021 17:25:53,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 42
02.12.2021 17:25:53,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 23
02.12.2021 17:25:53,533 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,533 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:53,533 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=688) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:53,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,533 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=688): org.apache.kafka.common.requests.HeartbeatResponse@607b9511
02.12.2021 17:25:53,534 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:53,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 321
02.12.2021 17:25:53,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 321
02.12.2021 17:25:53,555 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-5 because it is paused
02.12.2021 17:25:53,555 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,555 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 192 and member id staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,555 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1141) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null}
02.12.2021 17:25:53,555 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-5 because it is paused
02.12.2021 17:25:53,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 154
02.12.2021 17:25:53,556 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1141): org.apache.kafka.common.requests.HeartbeatResponse@4f026ffb
02.12.2021 17:25:53,556 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:53,556 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-5 because it is paused
02.12.2021 17:25:53,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,556 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,556 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:53,556 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 192 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd
02.12.2021 17:25:53,556 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=745) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:53,557 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:53,557 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:53,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 269
02.12.2021 17:25:53,557 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 51, -111, -109, 87, -72, -79, 73, -69, -82, -71, -125, -19, -107, -127, -105, 92, 0, 0, 0, 0, 0, 0, 0, 0, 92, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 5])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,557 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=745): org.apache.kafka.common.requests.HeartbeatResponse@65ed2c12
02.12.2021 17:25:53,557 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, correlationId=1142) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer-9e46622f-af12-4e8c-a662-7163ece6e6fd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:53,557 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:53,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 268
02.12.2021 17:25:53,557 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-5 because it is paused
02.12.2021 17:25:53,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 152
02.12.2021 17:25:53,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 268
02.12.2021 17:25:53,566 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:53,582 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1393): org.apache.kafka.common.requests.HeartbeatResponse@417007c5
02.12.2021 17:25:53,582 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:53,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:53,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 221
02.12.2021 17:25:53,656 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:53,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 167
02.12.2021 17:25:53,667 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:53,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-5 because it is paused
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Resuming partitions [redacted.Cloud.Message.Callback.Retry2-5]
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:53,710 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:53,710 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from REBALANCING to RUNNING
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 24 iterations.
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 24 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 48619ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:53,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:53,711 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016458, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:53,711 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016468, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:53,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:53,711 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:53,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,711 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:53,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 24 iterations.
02.12.2021 17:25:53,714 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119593ms for 120000ms of delay, sleeping for 417ms
02.12.2021 17:25:53,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 120
02.12.2021 17:25:53,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 67
02.12.2021 17:25:53,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:53,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,768 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,768 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,805 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:53,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,826 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,835 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 20
02.12.2021 17:25:53,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:53,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,861 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,869 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,880 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239697ms for 240000ms of delay, sleeping for 313ms
02.12.2021 17:25:53,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,904 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,910 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,912 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59168ms for 60000ms of delay, sleeping for 842ms
02.12.2021 17:25:53,928 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:53,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:53,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:53,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,993 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,995 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:54,029 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:54,070 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:54,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 176
02.12.2021 17:25:54,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 285
02.12.2021 17:25:54,129 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:54,154 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119970ms for 120000ms of delay, sleeping for 40ms
02.12.2021 17:25:54,170 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:54,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 76
02.12.2021 17:25:54,202 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239053ms for 240000ms of delay, sleeping for 957ms
02.12.2021 17:25:54,211 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119368ms for 120000ms of delay, sleeping for 642ms
02.12.2021 17:25:54,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 185
02.12.2021 17:25:54,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:54,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,269 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,270 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:54,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:54,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,329 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 79
02.12.2021 17:25:54,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:54,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,371 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:54,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,410 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,410 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:54,414 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,414 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:54,414 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1081) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:54,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:54,472 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:54,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:54,515 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1081): org.apache.kafka.common.requests.HeartbeatResponse@7df8d55a
02.12.2021 17:25:54,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:54,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:54,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 283
02.12.2021 17:25:54,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:54,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:54,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:54,730 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 180
02.12.2021 17:25:54,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 42
02.12.2021 17:25:54,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 141
02.12.2021 17:25:54,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:54,755 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58965ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:54,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:54,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,773 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,774 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,774 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,774 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 149
02.12.2021 17:25:54,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,829 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 80
02.12.2021 17:25:54,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 40
02.12.2021 17:25:54,855 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119706ms for 120000ms of delay, sleeping for 304ms
02.12.2021 17:25:54,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,871 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,872 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,875 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 48
02.12.2021 17:25:54,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,911 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,911 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 11
02.12.2021 17:25:54,923 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,923 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,923 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=696) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null}
02.12.2021 17:25:54,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 488
02.12.2021 17:25:54,923 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=696): org.apache.kafka.common.requests.HeartbeatResponse@64d5edee
02.12.2021 17:25:54,923 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:54,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 488
02.12.2021 17:25:54,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 488
02.12.2021 17:25:54,923 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,924 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,924 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=696) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null}
02.12.2021 17:25:54,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 350
02.12.2021 17:25:54,925 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=696): org.apache.kafka.common.requests.HeartbeatResponse@30bbfbb5
02.12.2021 17:25:54,926 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 348
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 348
02.12.2021 17:25:54,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:54,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:55,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,000 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,000 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 387
02.12.2021 17:25:55,030 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:55,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 246
02.12.2021 17:25:55,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:55,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:55,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 278
02.12.2021 17:25:55,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 140
02.12.2021 17:25:55,161 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239985ms for 240000ms of delay, sleeping for 25ms
02.12.2021 17:25:55,161 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119811ms for 120000ms of delay, sleeping for 199ms
02.12.2021 17:25:55,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:55,189 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239383ms for 240000ms of delay, sleeping for 627ms
02.12.2021 17:25:55,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 40
02.12.2021 17:25:55,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:55,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 177
02.12.2021 17:25:55,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:55,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,332 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 75
02.12.2021 17:25:55,363 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119458ms for 120000ms of delay, sleeping for 552ms
02.12.2021 17:25:55,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,373 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:55,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,412 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:55,476 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:55,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:55,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,501 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,501 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:55,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:55,576 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:55,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:55,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:55,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:55,676 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:55,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:55,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:55,756 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59966ms delay out of 60000ms. Remaining 34ms. Executor queue at 0
02.12.2021 17:25:55,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 10 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:55,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:55,758 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142440, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:55,758 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142450, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:55,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:55,759 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:55,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,759 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:55,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:55,759 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59829ms for 60000ms of delay, sleeping for 181ms
02.12.2021 17:25:55,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 73
02.12.2021 17:25:55,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,777 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:55,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:55,821 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239916ms for 240000ms of delay, sleeping for 94ms
02.12.2021 17:25:55,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:55,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,834 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:55,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,875 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,875 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,879 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:55,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,915 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 76 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 77 iterations.
02.12.2021 17:25:55,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 77 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:55,918 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970368, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:55,918 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970378, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:55,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:55,918 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:55,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,918 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:55,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 77 iterations.
02.12.2021 17:25:55,920 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239816ms for 240000ms of delay, sleeping for 194ms
02.12.2021 17:25:55,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 24 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 50829ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:55,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:55,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 25 iterations.
02.12.2021 17:25:55,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 25 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 50832ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:55,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:55,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:55,925 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016468, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:55,928 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016478, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:55,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:55,928 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:55,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,928 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:55,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 25 iterations.
02.12.2021 17:25:55,929 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119525ms for 120000ms of delay, sleeping for 485ms
02.12.2021 17:25:55,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:55,951 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59287ms for 60000ms of delay, sleeping for 723ms
02.12.2021 17:25:55,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:55,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:56,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,002 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,002 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,003 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,003 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 396
02.12.2021 17:25:56,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 288
02.12.2021 17:25:56,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:56,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:56,115 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239865ms for 240000ms of delay, sleeping for 145ms
02.12.2021 17:25:56,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 295
02.12.2021 17:25:56,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 185
02.12.2021 17:25:56,182 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:56,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:56,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:56,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 85
02.12.2021 17:25:56,262 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239840ms for 240000ms of delay, sleeping for 170ms
02.12.2021 17:25:56,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:56,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,279 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:56,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 81
02.12.2021 17:25:56,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:56,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,341 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,341 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 215
02.12.2021 17:25:56,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,375 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 156
02.12.2021 17:25:56,380 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:56,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:56,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,422 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,422 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,429 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119933ms for 120000ms of delay, sleeping for 77ms
02.12.2021 17:25:56,435 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239302ms for 240000ms of delay, sleeping for 708ms
02.12.2021 17:25:56,442 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 114
02.12.2021 17:25:56,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 56
02.12.2021 17:25:56,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:56,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,506 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,506 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,512 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119720ms for 120000ms of delay, sleeping for 290ms
02.12.2021 17:25:56,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:56,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,534 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:56,534 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:56,534 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=689) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:56,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 343
02.12.2021 17:25:56,535 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=689): org.apache.kafka.common.requests.HeartbeatResponse@106bfd47
02.12.2021 17:25:56,535 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:56,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 342
02.12.2021 17:25:56,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 342
02.12.2021 17:25:56,542 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 14
02.12.2021 17:25:56,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,557 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:56,557 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:56,557 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=746) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:56,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 284
02.12.2021 17:25:56,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 283
02.12.2021 17:25:56,558 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=746): org.apache.kafka.common.requests.HeartbeatResponse@6abd9d3c
02.12.2021 17:25:56,558 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:56,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 283
02.12.2021 17:25:56,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 283
02.12.2021 17:25:56,560 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:56,560 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:56,560 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1394) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null}
02.12.2021 17:25:56,580 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:56,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:56,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 242
02.12.2021 17:25:56,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 183
02.12.2021 17:25:56,661 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1394): org.apache.kafka.common.requests.HeartbeatResponse@61804e74
02.12.2021 17:25:56,661 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:56,677 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59970ms for 60000ms of delay, sleeping for 40ms
02.12.2021 17:25:56,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:56,719 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59988ms for 60000ms of delay, sleeping for 22ms
02.12.2021 17:25:56,723 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:56,736 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 141
02.12.2021 17:25:56,749 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59668ms for 60000ms of delay, sleeping for 342ms
02.12.2021 17:25:56,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:56,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,780 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,780 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,804 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119889ms for 120000ms of delay, sleeping for 121ms
02.12.2021 17:25:56,823 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:56,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 40
02.12.2021 17:25:56,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,842 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,842 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:56,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:56,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,878 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:56,881 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:56,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,924 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,926 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119872ms for 120000ms of delay, sleeping for 138ms
02.12.2021 17:25:56,946 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:56,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:56,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:57,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:57,065 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119208ms for 120000ms of delay, sleeping for 802ms
02.12.2021 17:25:57,080 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:57,081 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:57,099 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58965ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:57,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:57,126 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:57,167 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239981ms for 240000ms of delay, sleeping for 29ms
02.12.2021 17:25:57,180 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:57,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:57,198 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239991ms for 240000ms of delay, sleeping for 19ms
02.12.2021 17:25:57,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 10 records with 77 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:57,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 78 iterations.
02.12.2021 17:25:57,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processed 0 records with 78 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:57,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:57,218 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=970378, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:57,218 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=970388, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-7
02.12.2021 17:25:57,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:57,218 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-7, new queue size is 10
02.12.2021 17:25:57,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,218 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:57,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1] Processing tasks with 78 iterations.
02.12.2021 17:25:57,218 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239902ms for 240000ms of delay, sleeping for 108ms
02.12.2021 17:25:57,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:57,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 171
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:57,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:57,328 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239812ms for 240000ms of delay, sleeping for 198ms
02.12.2021 17:25:57,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,343 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 71
02.12.2021 17:25:57,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,378 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:57,421 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,421 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:57,421 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1082) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer-9ad82c90-bce8-4248-9f91-8e8912bd0845,group_instance_id=null}
02.12.2021 17:25:57,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,426 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,426 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 497
02.12.2021 17:25:57,443 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:57,479 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:57,482 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:57,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,508 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,508 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,521 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, correlationId=1082): org.apache.kafka.common.requests.HeartbeatResponse@688be3b3
02.12.2021 17:25:57,521 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:57,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 394
02.12.2021 17:25:57,536 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239376ms for 240000ms of delay, sleeping for 634ms
02.12.2021 17:25:57,544 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:57,580 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:57,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:57,644 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:57,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 289
02.12.2021 17:25:57,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:57,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:57,781 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 62
02.12.2021 17:25:57,781 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 142
02.12.2021 17:25:57,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:57,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,785 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 138
02.12.2021 17:25:57,788 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:57,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,844 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,845 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,871 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119783ms for 120000ms of delay, sleeping for 227ms
02.12.2021 17:25:57,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 41
02.12.2021 17:25:57,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,883 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,884 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 37
02.12.2021 17:25:57,923 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,924 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:57,924 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=697) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer-6c62d289-f8c1-4884-9912-de494b3ab025,group_instance_id=null}
02.12.2021 17:25:57,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:57,923 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,925 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:57,925 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=697) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer-4dedc8fc-4520-4fe9-bb56-cae5d927896e,group_instance_id=null}
02.12.2021 17:25:57,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:57,925 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, correlationId=697): org.apache.kafka.common.requests.HeartbeatResponse@46008f3
02.12.2021 17:25:57,926 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:57,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,926 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, correlationId=697): org.apache.kafka.common.requests.HeartbeatResponse@1df57226
02.12.2021 17:25:57,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,926 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,926 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:57,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 359
02.12.2021 17:25:57,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:57,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 358
02.12.2021 17:25:57,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:57,945 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:57,985 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:58,009 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,010 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,009 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,015 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,015 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 257
02.12.2021 17:25:58,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:58,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:58,086 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:58,101 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59967ms delay out of 60000ms. Remaining 33ms. Executor queue at 0
02.12.2021 17:25:58,102 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59769ms for 60000ms of delay, sleeping for 241ms
02.12.2021 17:25:58,129 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 156
02.12.2021 17:25:58,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 10 records with 25 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:58,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 53053ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:58,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:58,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 26 iterations.
02.12.2021 17:25:58,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processed 0 records with 26 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:58,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 53054ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:58,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:58,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:58,145 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1016478, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:58,145 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1016488, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-5
02.12.2021 17:25:58,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:58,145 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-5, new queue size is 10
02.12.2021 17:25:58,146 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,140 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 287
02.12.2021 17:25:58,146 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:58,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-1] Processing tasks with 26 iterations.
02.12.2021 17:25:58,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:58,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:58,195 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119135ms for 120000ms of delay, sleeping for 875ms
02.12.2021 17:25:58,194 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239441ms for 240000ms of delay, sleeping for 569ms
02.12.2021 17:25:58,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 56
02.12.2021 17:25:58,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 178
02.12.2021 17:25:58,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 78
02.12.2021 17:25:58,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:58,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:58,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,290 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,344 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59368ms for 60000ms of delay, sleeping for 642ms
02.12.2021 17:25:58,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,346 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 74
02.12.2021 17:25:58,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,384 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,385 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:58,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,428 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,428 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,446 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:58,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:58,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:58,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,511 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,517 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:58,517 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,517 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,517 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,517 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:58,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:58,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:58,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:58,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:58,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:58,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:58,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:58,730 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:58,747 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:58,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,792 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,788 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:58,795 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239962ms for 240000ms of delay, sleeping for 48ms
02.12.2021 17:25:58,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:58,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:58,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,898 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:58,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,900 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 397
02.12.2021 17:25:58,904 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239778ms for 240000ms of delay, sleeping for 232ms
02.12.2021 17:25:58,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 10 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:58,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:58,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processed 0 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:58,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:58,990 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142450, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:58,990 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142460, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-0
02.12.2021 17:25:58,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:58,990 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-0, new queue size is 10
02.12.2021 17:25:58,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,990 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:58,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:58,991 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59974ms for 60000ms of delay, sleeping for 36ms
02.12.2021 17:25:58,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 567 ms and fetched 0 records
02.12.2021 17:25:58,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,999 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 254
02.12.2021 17:25:59,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,046 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,046 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,046 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,046 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,046 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:58,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:59,046 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,043 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59990ms for 60000ms of delay, sleeping for 20ms
02.12.2021 17:25:59,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,067 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,071 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119981ms for 120000ms of delay, sleeping for 29ms
02.12.2021 17:25:59,084 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59014ms for 60000ms of delay, sleeping for 996ms
02.12.2021 17:25:59,102 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119332ms for 120000ms of delay, sleeping for 678ms
02.12.2021 17:25:59,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,143 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 151
02.12.2021 17:25:59,151 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238983ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:59,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 250
02.12.2021 17:25:59,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 252
02.12.2021 17:25:59,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:59,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 141
02.12.2021 17:25:59,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 34
02.12.2021 17:25:59,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 140
02.12.2021 17:25:59,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,294 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,295 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,304 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:59,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 41
02.12.2021 17:25:59,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 39
02.12.2021 17:25:59,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:59,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,400 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,400 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 134
02.12.2021 17:25:59,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,401 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 156
02.12.2021 17:25:59,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:59,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:59,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 34
02.12.2021 17:25:59,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:59,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,501 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 55
02.12.2021 17:25:59,510 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=707): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:59,510 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', members=[])
02.12.2021 17:25:59,510 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:59,510 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=193, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:59,510 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=193, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=193, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:59,510 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=707): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:59,510 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=708) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=193,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:59,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 36
02.12.2021 17:25:59,510 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', members=[])
02.12.2021 17:25:59,511 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:59,511 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=193, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:59,511 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=193, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=193, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:59,511 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=708) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=193,member_id=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101,group_instance_id=null,assignments=[]}
02.12.2021 17:25:59,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 56
02.12.2021 17:25:59,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,536 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:59,536 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:59,537 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=690) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer-4029dd4e-e0d0-474a-aae5-da3c3615de1c,group_instance_id=null}
02.12.2021 17:25:59,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,537 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, correlationId=690): org.apache.kafka.common.requests.HeartbeatResponse@4b93659f
02.12.2021 17:25:59,540 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:59,541 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 360
02.12.2021 17:25:59,542 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, correlationId=708): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,542 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, correlationId=708): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,542 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 358
02.12.2021 17:25:59,543 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,543 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,544 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=193, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101', protocol='stream'}
02.12.2021 17:25:59,544 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=193, memberId='staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd', protocol='stream'}
02.12.2021 17:25:59,545 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 193 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer-02cd3c2a-259c-4bfd-b98c-21f5fdd257cd
02.12.2021 17:25:59,545 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 193 and memberId staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer-0df95d64-47d7-4228-a15d-80e6cc336101
02.12.2021 17:25:59,546 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:59,550 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:59,546 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:59,550 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:59,551 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:59,550 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:59,552 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:59,552 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:59,552 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from RUNNING to REBALANCING
02.12.2021 17:25:59,553 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:59,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 4
02.12.2021 17:25:59,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:59,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:59,557 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:59,557 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:59,557 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:59,552 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:59,567 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:59,567 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:59,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 24
02.12.2021 17:25:59,567 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:59,569 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:59,569 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=747) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer-0ebff838-c61b-4106-999e-d9a217d72400,group_instance_id=null}
02.12.2021 17:25:59,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,557 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:59,570 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:59,570 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:59,570 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:59,570 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:59,569 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 332
02.12.2021 17:25:59,570 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, correlationId=747): org.apache.kafka.common.requests.HeartbeatResponse@de5cf54
02.12.2021 17:25:59,570 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:59,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:59,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,573 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 331
02.12.2021 17:25:59,574 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 327
02.12.2021 17:25:59,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,589 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:59,589 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:59,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Main Consumer poll completed in 538 ms and fetched 0 records
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:59,593 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:59,593 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c] State transition from REBALANCING to RUNNING
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,592 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1395) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer-3b73301e-0e66-41ad-8964-3d4636ce2da3,group_instance_id=null}
02.12.2021 17:25:59,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:59,601 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,644 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 257
02.12.2021 17:25:59,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 224
02.12.2021 17:25:59,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:59,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:59,697 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:59,697 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, correlationId=1395): org.apache.kafka.common.requests.HeartbeatResponse@37767f1b
02.12.2021 17:25:59,698 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:59,702 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:59,744 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 156
02.12.2021 17:25:59,782 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119762ms for 120000ms of delay, sleeping for 248ms
02.12.2021 17:25:59,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:59,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 124
02.12.2021 17:25:59,794 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:59,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,797 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,802 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:59,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 53
02.12.2021 17:25:59,884 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 17
02.12.2021 17:25:59,883 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:59,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:59,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,901 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,903 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:59,902 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:59,902 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-96ce75d1-ce75-4225-8340-5f0e13af7d90-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:59,995 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:59,986 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-33919357-b8b1-49bb-aeb9-83ed9581975c-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 92
02.12.2021 17:25:59,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-63f94986-6103-497f-970a-6fcbf19c32a5-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299